2023-07-12T01:34:11.168 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-12T01:34:11.169 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --name pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334517 -- /home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334517/orig.config.yaml 2023-07-12T01:34:11.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:34:11.310 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334517 branch: wip-pdonnell-testing-20230710.195410 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: pdonnell@redhat.com first_in_suite: false job_id: '7334517' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-pdonnell-testing-20230710.195410 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20230710.195410 sha1: 6a59b159e6baf6cc2ce7ca365bda9e61847ec2a4 owner: scheduled_pdonnell@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 948 sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 sleep_before_teardown: 0 subset: 199/512 suite: fs suite_branch: wip-pdonnell-testing-20230710.195410 suite_path: /home/teuthworker/src/github.com_batrick_ceph_6a59b159e6baf6cc2ce7ca365bda9e61847ec2a4/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 6a59b159e6baf6cc2ce7ca365bda9e61847ec2a4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMFsFBETFo9LxwaHSLA7s0f0yJvx6hAx9p6PYdGihoXire8cxVL1W0K86OWxQ1wNYX/yqli7D8+eosmPSkoPxeU= smithi196.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDavFvVoRdbeo85AWgTErhNPMGwTk+Km2rCzlX/3LAHP1BoVvZX4rIsCzhirmJlYZ7KN4QKCTzFsmaLiqq8vTCuKD63JOGyEOJ3VxraOVDIbhaXktRx1VL7EBXclQCxk86jPpWFqPwRBA+FvG8pWG96x8AqNWr5JEoBZ95IlDkXVfZuuKR9HEqDmkqqxx/8tii9UDNN7D+ZeVWX/9XWPns/PFXGEKGwBTQrIH0mLpDdy7L+/z9tvlBD6S2KzscJW4zl/Qg265OOaIguMX1ieyseiFGzL6HN5qL8w6+BYIL7TcN775gnDWX2PiN7k8v4kFyJ+fUMi+wrJpRO7pQ1lfXbxl/kKbFj8sjgjjvqYoIJOw3lXwGBckxhNSIHkCvLOdGlnYWo9UX9eDPPFKsEjvNwWAFHBePFYJn94st5wODlK+vcZd5wlvISrS6qoxrG6/s3vKk+/iwXlmHgV/wlsnBXJdudMHo6sS5gOsSwTVdqAsfR3FlAOAqlZ23av21vA+k= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b53f236c1077f1d295baafb9e0ca9a4b447019d7 timestamp: 2023-07-12_01:23:58 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-12T01:34:11.311 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_6a59b159e6baf6cc2ce7ca365bda9e61847ec2a4/qa; will attempt to use it 2023-07-12T01:34:11.312 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_6a59b159e6baf6cc2ce7ca365bda9e61847ec2a4/qa/tasks 2023-07-12T01:34:11.312 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-12T01:34:11.314 INFO:teuthology.task.internal:Checking packages... 2023-07-12T01:34:11.344 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2' 2023-07-12T01:34:11.345 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-12T01:34:11.345 INFO:teuthology.packaging:ref: None 2023-07-12T01:34:11.345 INFO:teuthology.packaging:tag: None 2023-07-12T01:34:11.345 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20230710.195410 2023-07-12T01:34:11.346 INFO:teuthology.packaging:sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-12T01:34:11.346 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20230710.195410 2023-07-12T01:34:11.560 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4828.gb5891ed6 2023-07-12T01:34:11.561 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-12T01:34:11.575 INFO:teuthology.task.internal:no buildpackages task found 2023-07-12T01:34:11.575 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-12T01:34:11.587 INFO:teuthology.task.internal:Saving configuration 2023-07-12T01:34:11.603 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-12T01:34:11.613 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T01:34:11.642 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334517', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 01:25:00.797489', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMFsFBETFo9LxwaHSLA7s0f0yJvx6hAx9p6PYdGihoXire8cxVL1W0K86OWxQ1wNYX/yqli7D8+eosmPSkoPxeU='} 2023-07-12T01:34:11.667 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334517', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 01:25:00.796241', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNkx47yaN3eCCFbiNjTDEwzkUDM4dzcatviZlpzRbJf12cX6sUPrxx+Zu6cjTCdU+FqDS6q09i/HAQupiX2bUKM='} 2023-07-12T01:34:11.668 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-12T01:34:11.676 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-12T01:34:11.676 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-12T01:34:11.676 INFO:teuthology.run_tasks:Running task console_log... 2023-07-12T01:34:11.753 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f23fc6fc280>, signals=[15]) 2023-07-12T01:34:11.754 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-12T01:34:11.761 INFO:teuthology.task.internal:Opening connections... 2023-07-12T01:34:11.762 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2023-07-12T01:34:11.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:34:11.832 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2023-07-12T01:34:11.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:34:11.903 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-12T01:34:11.911 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-07-12T01:34:11.935 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-07-12T01:34:11.935 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-07-12T01:34:11.996 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2023-07-12T01:34:11.996 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8" 2023-07-12T01:34:11.997 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2023-07-12T01:34:11.997 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2023-07-12T01:34:11.997 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8" 2023-07-12T01:34:11.997 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-07-12T01:34:11.997 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-12T01:34:11.998 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-07-12T01:34:11.998 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-12T01:34:11.998 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2023-07-12T01:34:11.998 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T01:34:11.998 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T01:34:11.998 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-12T01:34:11.999 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-07-12T01:34:12.023 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2023-07-12T01:34:12.045 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2023-07-12T01:34:12.046 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2023-07-12T01:34:12.106 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2023-07-12T01:34:12.107 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8" 2023-07-12T01:34:12.107 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2023-07-12T01:34:12.107 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2023-07-12T01:34:12.107 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8" 2023-07-12T01:34:12.108 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8" 2023-07-12T01:34:12.108 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-12T01:34:12.108 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2023-07-12T01:34:12.108 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-12T01:34:12.108 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2023-07-12T01:34:12.108 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T01:34:12.108 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T01:34:12.109 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-12T01:34:12.109 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2023-07-12T01:34:12.132 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-12T01:34:12.146 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-12T01:34:12.154 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-12T01:34:12.155 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2023-07-12T01:34:12.158 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2023-07-12T01:34:12.178 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-12T01:34:12.185 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-12T01:34:12.186 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2023-07-12T01:34:12.219 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2023-07-12T01:34:12.252 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-12T01:34:12.320 INFO:teuthology.run_tasks:Running task kernel... 2023-07-12T01:34:12.339 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-07-12T01:34:12.339 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-07-12T01:34:12.340 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-07-12T01:34:12.340 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-12T01:34:12.341 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-12T01:34:12.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T01:34:12.361 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-12T01:34:12.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T01:34:12.364 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-12T01:34:12.581 DEBUG:teuthology.task.kernel:sha1 for client.1 is 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-12T01:34:12.581 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "84139c18d56f518615369e8310ae4ecf07a36dcd"... 2023-07-12T01:34:12.581 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2023-07-12T01:34:12.602 INFO:teuthology.orchestra.run.smithi196.stdout:4.18.0-489.el8.x86_64 2023-07-12T01:34:12.602 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-12T01:34:12.603 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-12T01:34:12.603 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum upgrade -y linux-firmware 2023-07-12T01:34:12.646 DEBUG:teuthology.task.kernel:sha1 for client.0 is 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-12T01:34:12.646 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "84139c18d56f518615369e8310ae4ecf07a36dcd"... 2023-07-12T01:34:12.647 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-07-12T01:34:12.670 INFO:teuthology.orchestra.run.smithi037.stdout:4.18.0-489.el8.x86_64 2023-07-12T01:34:12.670 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-12T01:34:12.670 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-12T01:34:12.671 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum upgrade -y linux-firmware 2023-07-12T01:35:23.122 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 8 - AppStream 463 kB/s | 31 MB 01:07 2023-07-12T01:35:26.437 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 8 - AppStream 441 kB/s | 31 MB 01:11 2023-07-12T01:35:30.771 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 8 - BaseOS 20 MB/s | 41 MB 00:02 2023-07-12T01:35:34.029 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 8 - BaseOS 29 MB/s | 41 MB 00:01 2023-07-12T01:35:37.312 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 8 - Extras 33 kB/s | 18 kB 00:00 2023-07-12T01:35:37.905 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.6 kB 00:00 2023-07-12T01:35:40.698 INFO:teuthology.orchestra.run.smithi196.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-12T01:35:40.837 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 8 - Extras 47 kB/s | 18 kB 00:00 2023-07-12T01:35:41.430 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.6 kB 00:00 2023-07-12T01:35:44.165 INFO:teuthology.orchestra.run.smithi037.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-12T01:35:45.100 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 3.7 MB/s | 16 MB 00:04 2023-07-12T01:35:46.034 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 16 MB 00:01 2023-07-12T01:35:48.814 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 598 kB/s | 24 kB 00:00 2023-07-12T01:35:49.974 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 480 kB/s | 24 kB 00:00 2023-07-12T01:35:52.356 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2023-07-12T01:35:52.357 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2023-07-12T01:35:52.357 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repo Size 2023-07-12T01:35:52.358 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2023-07-12T01:35:52.358 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrading: 2023-07-12T01:35:52.358 INFO:teuthology.orchestra.run.smithi196.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-07-12T01:35:52.358 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T01:35:52.358 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2023-07-12T01:35:52.358 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2023-07-12T01:35:52.358 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrade 1 Package 2023-07-12T01:35:52.358 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T01:35:52.359 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 266 M 2023-07-12T01:35:52.359 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2023-07-12T01:35:53.603 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-12T01:35:53.604 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-12T01:35:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2023-07-12T01:35:53.604 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-12T01:35:53.604 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2023-07-12T01:35:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-07-12T01:35:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T01:35:53.604 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-12T01:35:53.605 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-12T01:35:53.605 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 1 Package 2023-07-12T01:35:53.605 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T01:35:53.605 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 266 M 2023-07-12T01:35:53.606 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-12T01:36:17.581 INFO:teuthology.orchestra.run.smithi037.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 11 MB/s | 266 MB 00:23 2023-07-12T01:36:17.582 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-12T01:36:17.582 INFO:teuthology.orchestra.run.smithi037.stdout:Total 11 MB/s | 266 MB 00:23 2023-07-12T01:36:19.241 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-12T01:36:19.303 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-12T01:36:19.303 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-12T01:36:21.068 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-12T01:36:21.098 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-12T01:36:27.035 INFO:teuthology.orchestra.run.smithi196.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 7.7 MB/s | 266 MB 00:34 2023-07-12T01:36:27.036 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2023-07-12T01:36:27.036 INFO:teuthology.orchestra.run.smithi196.stdout:Total 7.7 MB/s | 266 MB 00:34 2023-07-12T01:36:28.618 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2023-07-12T01:36:28.696 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2023-07-12T01:36:28.696 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2023-07-12T01:36:30.349 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2023-07-12T01:36:30.367 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2023-07-12T01:36:39.868 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-12T01:36:40.249 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-12T01:36:40.487 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-12T01:36:40.738 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-12T01:36:40.739 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-12T01:36:41.493 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-12T01:36:41.493 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T01:36:41.493 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2023-07-12T01:36:41.493 INFO:teuthology.orchestra.run.smithi037.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-07-12T01:36:41.494 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T01:36:41.494 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-12T01:36:41.658 INFO:teuthology.task.kernel:Downloading kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.0... 2023-07-12T01:36:41.658 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-12T01:36:41.807 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ 2023-07-12T01:36:41.808 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_g84139c18d56f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-12T01:36:41.810 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi037.front.sepia.ceph.com to complete... 2023-07-12T01:36:48.028 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2023-07-12T01:36:48.436 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-12T01:36:48.698 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-12T01:36:48.939 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-12T01:36:48.939 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-12T01:36:49.664 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-12T01:36:49.664 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T01:36:49.665 INFO:teuthology.orchestra.run.smithi196.stdout:Upgraded: 2023-07-12T01:36:49.665 INFO:teuthology.orchestra.run.smithi196.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-07-12T01:36:49.665 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T01:36:49.665 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2023-07-12T01:36:49.878 INFO:teuthology.task.kernel:Downloading kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.1... 2023-07-12T01:36:49.878 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-12T01:36:50.095 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ 2023-07-12T01:36:50.096 DEBUG:teuthology.orchestra.run.smithi196:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_g84139c18d56f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-12T01:36:50.098 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi196.front.sepia.ceph.com to complete... 2023-07-12T01:36:55.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12 01:36:55 URL:https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/kernel-6.4.0_g84139c18d56f-1.x86_64.rpm [379858600/379858600] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-12T01:36:55.932 INFO:teuthology.orchestra.run.smithi037.stderr:FINISHED --2023-07-12 01:36:55-- 2023-07-12T01:36:55.932 INFO:teuthology.orchestra.run.smithi037.stderr:Total wall clock time: 14s 2023-07-12T01:36:55.932 INFO:teuthology.orchestra.run.smithi037.stderr:Downloaded: 1 files, 362M in 14s (26.4 MB/s) 2023-07-12T01:36:55.933 INFO:teuthology.task.kernel:Installing kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.0... 2023-07-12T01:36:55.934 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-12T01:36:57.666 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying... ######################################## 2023-07-12T01:36:57.712 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing... ######################################## 2023-07-12T01:36:57.828 INFO:teuthology.orchestra.run.smithi037.stdout:Updating / installing... 2023-07-12T01:37:11.521 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12 01:37:11 URL:https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/kernel-6.4.0_g84139c18d56f-1.x86_64.rpm [379858600/379858600] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-12T01:37:11.521 INFO:teuthology.orchestra.run.smithi196.stderr:FINISHED --2023-07-12 01:37:11-- 2023-07-12T01:37:11.521 INFO:teuthology.orchestra.run.smithi196.stderr:Total wall clock time: 21s 2023-07-12T01:37:11.522 INFO:teuthology.orchestra.run.smithi196.stderr:Downloaded: 1 files, 362M in 21s (17.5 MB/s) 2023-07-12T01:37:11.522 INFO:teuthology.task.kernel:Installing kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.1... 2023-07-12T01:37:11.523 DEBUG:teuthology.orchestra.run.smithi196:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-12T01:37:13.171 INFO:teuthology.orchestra.run.smithi196.stdout:Verifying... ######################################## 2023-07-12T01:37:13.214 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing... ######################################## 2023-07-12T01:37:13.323 INFO:teuthology.orchestra.run.smithi196.stdout:Updating / installing... 2023-07-12T01:37:38.360 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-6.4.0_g84139c18d56f-1 ######################################## 2023-07-12T01:37:51.156 INFO:teuthology.orchestra.run.smithi196.stdout:kernel-6.4.0_g84139c18d56f-1 ######################################## 2023-07-12T01:38:00.327 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-12T01:38:00.328 DEBUG:teuthology.orchestra.run.smithi037:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-12T01:38:00.386 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/System.map-6.4.0-g84139c18d56f 2023-07-12T01:38:00.386 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/config-6.4.0-g84139c18d56f 2023-07-12T01:38:00.386 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-12T01:38:00.386 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f 2023-07-12T01:38:00.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel 2023-07-12T01:38:00.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch 2023-07-12T01:38:00.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86 2023-07-12T01:38:00.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto 2023-07-12T01:38:00.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-12T01:38:00.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-12T01:38:00.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-12T01:38:00.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-12T01:38:00.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-12T01:38:00.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-12T01:38:00.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-12T01:38:00.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-12T01:38:00.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-12T01:38:00.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-12T01:38:00.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-12T01:38:00.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-12T01:38:00.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-12T01:38:00.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-12T01:38:00.391 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-12T01:38:00.391 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel 2023-07-12T01:38:00.391 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu 2023-07-12T01:38:00.392 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce 2023-07-12T01:38:00.392 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-12T01:38:00.392 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm 2023-07-12T01:38:00.392 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-12T01:38:00.393 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-12T01:38:00.393 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm.ko 2023-07-12T01:38:00.393 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto 2023-07-12T01:38:00.394 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ansi_cprng.ko 2023-07-12T01:38:00.394 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/anubis.ko 2023-07-12T01:38:00.394 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/arc4.ko 2023-07-12T01:38:00.394 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx 2023-07-12T01:38:00.395 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_memcpy.ko 2023-07-12T01:38:00.395 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_pq.ko 2023-07-12T01:38:00.395 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-12T01:38:00.396 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_tx.ko 2023-07-12T01:38:00.396 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_xor.ko 2023-07-12T01:38:00.396 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/raid6test.ko 2023-07-12T01:38:00.397 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authenc.ko 2023-07-12T01:38:00.397 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authencesn.ko 2023-07-12T01:38:00.397 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blake2b_generic.ko 2023-07-12T01:38:00.397 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_common.ko 2023-07-12T01:38:00.398 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_generic.ko 2023-07-12T01:38:00.398 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/camellia_generic.ko 2023-07-12T01:38:00.398 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast5_generic.ko 2023-07-12T01:38:00.398 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast6_generic.ko 2023-07-12T01:38:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast_common.ko 2023-07-12T01:38:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ccm.ko 2023-07-12T01:38:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cmac.ko 2023-07-12T01:38:00.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crc32_generic.ko 2023-07-12T01:38:00.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_engine.ko 2023-07-12T01:38:00.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_user.ko 2023-07-12T01:38:00.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cts.ko 2023-07-12T01:38:00.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/des_generic.ko 2023-07-12T01:38:00.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/dh_generic.ko 2023-07-12T01:38:00.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/echainiv.ko 2023-07-12T01:38:00.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/essiv.ko 2023-07-12T01:38:00.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/fcrypt.ko 2023-07-12T01:38:00.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/khazad.ko 2023-07-12T01:38:00.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4.ko 2023-07-12T01:38:00.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4hc.ko 2023-07-12T01:38:00.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/md4.ko 2023-07-12T01:38:00.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/michael_mic.ko 2023-07-12T01:38:00.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcbc.ko 2023-07-12T01:38:00.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcrypt.ko 2023-07-12T01:38:00.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/rmd160.ko 2023-07-12T01:38:00.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/seed.ko 2023-07-12T01:38:00.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/serpent_generic.ko 2023-07-12T01:38:00.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tcrypt.ko 2023-07-12T01:38:00.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tea.ko 2023-07-12T01:38:00.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_common.ko 2023-07-12T01:38:00.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_generic.ko 2023-07-12T01:38:00.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/vmac.ko 2023-07-12T01:38:00.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/wp512.ko 2023-07-12T01:38:00.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xcbc.ko 2023-07-12T01:38:00.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xor.ko 2023-07-12T01:38:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xxhash_generic.ko 2023-07-12T01:38:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers 2023-07-12T01:38:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi 2023-07-12T01:38:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-12T01:38:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_pad.ko 2023-07-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/custom_method.ko 2023-07-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ec_sys.ko 2023-07-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/platform_profile.ko 2023-07-12T01:38:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbs.ko 2023-07-12T01:38:00.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbshc.ko 2023-07-12T01:38:00.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/video.ko 2023-07-12T01:38:00.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata 2023-07-12T01:38:00.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/acard-ahci.ko 2023-07-12T01:38:00.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci_platform.ko 2023-07-12T01:38:00.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ata_generic.ko 2023-07-12T01:38:00.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci_platform.ko 2023-07-12T01:38:00.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_acpi.ko 2023-07-12T01:38:00.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ali.ko 2023-07-12T01:38:00.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_amd.ko 2023-07-12T01:38:00.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_artop.ko 2023-07-12T01:38:00.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atiixp.ko 2023-07-12T01:38:00.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atp867x.ko 2023-07-12T01:38:00.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd640.ko 2023-07-12T01:38:00.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd64x.ko 2023-07-12T01:38:00.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cypress.ko 2023-07-12T01:38:00.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_efar.ko 2023-07-12T01:38:00.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt366.ko 2023-07-12T01:38:00.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt37x.ko 2023-07-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it8213.ko 2023-07-12T01:38:00.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it821x.ko 2023-07-12T01:38:00.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_jmicron.ko 2023-07-12T01:38:00.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_marvell.ko 2023-07-12T01:38:00.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_mpiix.ko 2023-07-12T01:38:00.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_netcell.ko 2023-07-12T01:38:00.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ninja32.ko 2023-07-12T01:38:00.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87410.ko 2023-07-12T01:38:00.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87415.ko 2023-07-12T01:38:00.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_oldpiix.ko 2023-07-12T01:38:00.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_opti.ko 2023-07-12T01:38:00.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_optidma.ko 2023-07-12T01:38:00.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pcmcia.ko 2023-07-12T01:38:00.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-12T01:38:00.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-12T01:38:00.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_piccolo.ko 2023-07-12T01:38:00.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rdc.ko 2023-07-12T01:38:00.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sch.ko 2023-07-12T01:38:00.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_serverworks.ko 2023-07-12T01:38:00.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sil680.ko 2023-07-12T01:38:00.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sis.ko 2023-07-12T01:38:00.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sl82c105.ko 2023-07-12T01:38:00.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_triflex.ko 2023-07-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_via.ko 2023-07-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pdc_adma.ko 2023-07-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_inic162x.ko 2023-07-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_mv.ko 2023-07-12T01:38:00.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_nv.ko 2023-07-12T01:38:00.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_promise.ko 2023-07-12T01:38:00.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_qstor.ko 2023-07-12T01:38:00.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil.ko 2023-07-12T01:38:00.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil24.ko 2023-07-12T01:38:00.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sis.ko 2023-07-12T01:38:00.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_svw.ko 2023-07-12T01:38:00.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sx4.ko 2023-07-12T01:38:00.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_uli.ko 2023-07-12T01:38:00.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_via.ko 2023-07-12T01:38:00.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_vsc.ko 2023-07-12T01:38:00.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay 2023-07-12T01:38:00.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ks0108.ko 2023-07-12T01:38:00.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base 2023-07-12T01:38:00.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap 2023-07-12T01:38:00.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-12T01:38:00.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma 2023-07-12T01:38:00.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/bcma.ko 2023-07-12T01:38:00.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block 2023-07-12T01:38:00.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe 2023-07-12T01:38:00.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/aoe.ko 2023-07-12T01:38:00.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/brd.ko 2023-07-12T01:38:00.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd 2023-07-12T01:38:00.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/drbd.ko 2023-07-12T01:38:00.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/floppy.ko 2023-07-12T01:38:00.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/loop.ko 2023-07-12T01:38:00.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx 2023-07-12T01:38:00.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-12T01:38:00.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/nbd.ko 2023-07-12T01:38:00.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk 2023-07-12T01:38:00.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/null_blk.ko 2023-07-12T01:38:00.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/pktcdvd.ko 2023-07-12T01:38:00.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/rbd.ko 2023-07-12T01:38:00.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/virtio_blk.ko 2023-07-12T01:38:00.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback 2023-07-12T01:38:00.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-12T01:38:00.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkfront.ko 2023-07-12T01:38:00.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram 2023-07-12T01:38:00.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/zram.ko 2023-07-12T01:38:00.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char 2023-07-12T01:38:00.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hangcheck-timer.ko 2023-07-12T01:38:00.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random 2023-07-12T01:38:00.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-12T01:38:00.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-12T01:38:00.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-12T01:38:00.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/via-rng.ko 2023-07-12T01:38:00.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-12T01:38:00.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi 2023-07-12T01:38:00.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-12T01:38:00.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-12T01:38:00.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-12T01:38:00.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-12T01:38:00.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-12T01:38:00.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-12T01:38:00.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/lp.ko 2023-07-12T01:38:00.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave 2023-07-12T01:38:00.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/mwave.ko 2023-07-12T01:38:00.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ppdev.ko 2023-07-12T01:38:00.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tlclk.ko 2023-07-12T01:38:00.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm 2023-07-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm.ko 2023-07-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/uv_mmtimer.ko 2023-07-12T01:38:00.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/virtio_console.ko 2023-07-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq 2023-07-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-12T01:38:00.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-12T01:38:00.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto 2023-07-12T01:38:00.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp 2023-07-12T01:38:00.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-12T01:38:00.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp.ko 2023-07-12T01:38:00.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel 2023-07-12T01:38:00.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat 2023-07-12T01:38:00.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common 2023-07-12T01:38:00.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-12T01:38:00.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-12T01:38:00.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-12T01:38:00.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-aes.ko 2023-07-12T01:38:00.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-sha.ko 2023-07-12T01:38:00.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio 2023-07-12T01:38:00.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-12T01:38:00.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca 2023-07-12T01:38:00.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/dca.ko 2023-07-12T01:38:00.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq 2023-07-12T01:38:00.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-12T01:38:00.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma 2023-07-12T01:38:00.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw 2023-07-12T01:38:00.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-12T01:38:00.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat 2023-07-12T01:38:00.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac 2023-07-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/amd64_edac.ko 2023-07-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/e752x_edac.ko 2023-07-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/edac_mce_amd.ko 2023-07-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3000_edac.ko 2023-07-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3200_edac.ko 2023-07-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5100_edac.ko 2023-07-12T01:38:00.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5400_edac.ko 2023-07-12T01:38:00.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7300_edac.ko 2023-07-12T01:38:00.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7core_edac.ko 2023-07-12T01:38:00.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i82975x_edac.ko 2023-07-12T01:38:00.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ie31200_edac.ko 2023-07-12T01:38:00.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/sb_edac.ko 2023-07-12T01:38:00.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/x38_edac.ko 2023-07-12T01:38:00.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware 2023-07-12T01:38:00.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/edd.ko 2023-07-12T01:38:00.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-12T01:38:00.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio 2023-07-12T01:38:00.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ich.ko 2023-07-12T01:38:00.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-12T01:38:00.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid 2023-07-12T01:38:00.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-appleir.ko 2023-07-12T01:38:00.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-aureal.ko 2023-07-12T01:38:00.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-axff.ko 2023-07-12T01:38:00.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-dr.ko 2023-07-12T01:38:00.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elecom.ko 2023-07-12T01:38:00.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elo.ko 2023-07-12T01:38:00.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-emsff.ko 2023-07-12T01:38:00.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gaff.ko 2023-07-12T01:38:00.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gt683r.ko 2023-07-12T01:38:00.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gyration.ko 2023-07-12T01:38:00.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-12T01:38:00.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-12T01:38:00.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtekff.ko 2023-07-12T01:38:00.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-hyperv.ko 2023-07-12T01:38:00.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-icade.ko 2023-07-12T01:38:00.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-keytouch.ko 2023-07-12T01:38:00.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kye.ko 2023-07-12T01:38:00.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lcpower.ko 2023-07-12T01:38:00.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-led.ko 2023-07-12T01:38:00.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lenovo.ko 2023-07-12T01:38:00.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-12T01:38:00.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-12T01:38:00.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-multitouch.ko 2023-07-12T01:38:00.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ortek.ko 2023-07-12T01:38:00.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-penmount.ko 2023-07-12T01:38:00.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-petalynx.ko 2023-07-12T01:38:00.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-picolcd.ko 2023-07-12T01:38:00.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-pl.ko 2023-07-12T01:38:00.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-plantronics.ko 2023-07-12T01:38:00.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-primax.ko 2023-07-12T01:38:00.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-rmi.ko 2023-07-12T01:38:00.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-12T01:38:00.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-common.ko 2023-07-12T01:38:00.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-12T01:38:00.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-12T01:38:00.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-12T01:38:00.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-12T01:38:00.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-12T01:38:00.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-12T01:38:00.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-12T01:38:00.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-12T01:38:00.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-12T01:38:00.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat.ko 2023-07-12T01:38:00.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-saitek.ko 2023-07-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-samsung.ko 2023-07-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sjoy.ko 2023-07-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sony.ko 2023-07-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-speedlink.ko 2023-07-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-steelseries.ko 2023-07-12T01:38:00.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sunplus.ko 2023-07-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tivo.ko 2023-07-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tmff.ko 2023-07-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-topseed.ko 2023-07-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-twinhan.ko 2023-07-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-uclogic.ko 2023-07-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-waltop.ko 2023-07-12T01:38:00.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-wiimote.ko 2023-07-12T01:38:00.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-xinmo.ko 2023-07-12T01:38:00.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zpff.ko 2023-07-12T01:38:00.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zydacron.ko 2023-07-12T01:38:00.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/uhid.ko 2023-07-12T01:38:00.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/wacom.ko 2023-07-12T01:38:00.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv 2023-07-12T01:38:00.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_balloon.ko 2023-07-12T01:38:00.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_utils.ko 2023-07-12T01:38:00.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_vmbus.ko 2023-07-12T01:38:00.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon 2023-07-12T01:38:00.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru.ko 2023-07-12T01:38:00.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru3.ko 2023-07-12T01:38:00.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-12T01:38:00.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7414.ko 2023-07-12T01:38:00.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7418.ko 2023-07-12T01:38:00.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adc128d818.ko 2023-07-12T01:38:00.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1025.ko 2023-07-12T01:38:00.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1026.ko 2023-07-12T01:38:00.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1029.ko 2023-07-12T01:38:00.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1031.ko 2023-07-12T01:38:00.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm9240.ko 2023-07-12T01:38:00.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ads7828.ko 2023-07-12T01:38:00.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7410.ko 2023-07-12T01:38:00.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7411.ko 2023-07-12T01:38:00.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7462.ko 2023-07-12T01:38:00.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7470.ko 2023-07-12T01:38:00.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7475.ko 2023-07-12T01:38:00.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7x10.ko 2023-07-12T01:38:00.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/amc6821.ko 2023-07-12T01:38:00.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/applesmc.ko 2023-07-12T01:38:00.449 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asb100.ko 2023-07-12T01:38:00.449 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asc7621.ko 2023-07-12T01:38:00.449 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-12T01:38:00.449 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/atxp1.ko 2023-07-12T01:38:00.449 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/coretemp.ko 2023-07-12T01:38:00.449 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-12T01:38:00.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dme1737.ko 2023-07-12T01:38:00.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds1621.ko 2023-07-12T01:38:00.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds620.ko 2023-07-12T01:38:00.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc1403.ko 2023-07-12T01:38:00.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc6w201.ko 2023-07-12T01:38:00.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71805f.ko 2023-07-12T01:38:00.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71882fg.ko 2023-07-12T01:38:00.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f75375s.ko 2023-07-12T01:38:00.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fam15h_power.ko 2023-07-12T01:38:00.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fschmd.ko 2023-07-12T01:38:00.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g760a.ko 2023-07-12T01:38:00.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g762.ko 2023-07-12T01:38:00.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl518sm.ko 2023-07-12T01:38:00.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl520sm.ko 2023-07-12T01:38:00.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-12T01:38:00.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5500_temp.ko 2023-07-12T01:38:00.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5k_amb.ko 2023-07-12T01:38:00.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmaem.ko 2023-07-12T01:38:00.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmpex.ko 2023-07-12T01:38:00.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina209.ko 2023-07-12T01:38:00.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina2xx.ko 2023-07-12T01:38:00.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/it87.ko 2023-07-12T01:38:00.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k10temp.ko 2023-07-12T01:38:00.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k8temp.ko 2023-07-12T01:38:00.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lineage-pem.ko 2023-07-12T01:38:00.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm63.ko 2023-07-12T01:38:00.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm73.ko 2023-07-12T01:38:00.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm75.ko 2023-07-12T01:38:00.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm77.ko 2023-07-12T01:38:00.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm78.ko 2023-07-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm80.ko 2023-07-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm83.ko 2023-07-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm85.ko 2023-07-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm87.ko 2023-07-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm90.ko 2023-07-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm92.ko 2023-07-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm93.ko 2023-07-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95234.ko 2023-07-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95241.ko 2023-07-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95245.ko 2023-07-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc2945.ko 2023-07-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4151.ko 2023-07-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4215.ko 2023-07-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4222.ko 2023-07-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4245.ko 2023-07-12T01:38:00.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4260.ko 2023-07-12T01:38:00.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4261.ko 2023-07-12T01:38:00.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max16065.ko 2023-07-12T01:38:00.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1619.ko 2023-07-12T01:38:00.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1668.ko 2023-07-12T01:38:00.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max197.ko 2023-07-12T01:38:00.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6639.ko 2023-07-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6650.ko 2023-07-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6697.ko 2023-07-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mcp3021.ko 2023-07-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6683.ko 2023-07-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775-core.ko 2023-07-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775.ko 2023-07-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct7802.ko 2023-07-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87360.ko 2023-07-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87427.ko 2023-07-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pcf8591.ko 2023-07-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus 2023-07-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/powr1220.ko 2023-07-12T01:38:00.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5627.ko 2023-07-12T01:38:00.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5636.ko 2023-07-12T01:38:00.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-12T01:38:00.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht15.ko 2023-07-12T01:38:00.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht21.ko 2023-07-12T01:38:00.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/shtc1.ko 2023-07-12T01:38:00.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sis5595.ko 2023-07-12T01:38:00.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47b397.ko 2023-07-12T01:38:00.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m1.ko 2023-07-12T01:38:00.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m192.ko 2023-07-12T01:38:00.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/thmc50.ko 2023-07-12T01:38:00.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp102.ko 2023-07-12T01:38:00.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp103.ko 2023-07-12T01:38:00.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp401.ko 2023-07-12T01:38:00.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp421.ko 2023-07-12T01:38:00.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via-cputemp.ko 2023-07-12T01:38:00.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via686a.ko 2023-07-12T01:38:00.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt1211.ko 2023-07-12T01:38:00.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt8231.ko 2023-07-12T01:38:00.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627ehf.ko 2023-07-12T01:38:00.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627hf.ko 2023-07-12T01:38:00.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83781d.ko 2023-07-12T01:38:00.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83791d.ko 2023-07-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83792d.ko 2023-07-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83793.ko 2023-07-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83795.ko 2023-07-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l785ts.ko 2023-07-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l786ng.ko 2023-07-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c 2023-07-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos 2023-07-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-12T01:38:00.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-12T01:38:00.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses 2023-07-12T01:38:00.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-12T01:38:00.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-12T01:38:00.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-12T01:38:00.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-12T01:38:00.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-12T01:38:00.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-12T01:38:00.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-12T01:38:00.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-12T01:38:00.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-12T01:38:00.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-12T01:38:00.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-12T01:38:00.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-12T01:38:00.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-12T01:38:00.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-12T01:38:00.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-12T01:38:00.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-12T01:38:00.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-12T01:38:00.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-12T01:38:00.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-12T01:38:00.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-12T01:38:00.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-12T01:38:00.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-12T01:38:00.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-12T01:38:00.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-dev.ko 2023-07-12T01:38:00.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-mux.ko 2023-07-12T01:38:00.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-12T01:38:00.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-smbus.ko 2023-07-12T01:38:00.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-stub.ko 2023-07-12T01:38:00.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband 2023-07-12T01:38:00.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core 2023-07-12T01:38:00.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-12T01:38:00.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_core.ko 2023-07-12T01:38:00.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-12T01:38:00.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-12T01:38:00.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw 2023-07-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4 2023-07-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4 2023-07-12T01:38:00.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-12T01:38:00.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5 2023-07-12T01:38:00.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-12T01:38:00.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca 2023-07-12T01:38:00.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-12T01:38:00.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp 2023-07-12T01:38:00.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib 2023-07-12T01:38:00.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-12T01:38:00.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser 2023-07-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert 2023-07-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp 2023-07-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt 2023-07-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-12T01:38:00.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input 2023-07-12T01:38:00.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport 2023-07-12T01:38:00.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-12T01:38:00.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-12T01:38:00.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/gameport.ko 2023-07-12T01:38:00.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/lightning.ko 2023-07-12T01:38:00.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ns558.ko 2023-07-12T01:38:00.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/joydev.ko 2023-07-12T01:38:00.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard 2023-07-12T01:38:00.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-12T01:38:00.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse 2023-07-12T01:38:00.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/appletouch.ko 2023-07-12T01:38:00.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/bcm5974.ko 2023-07-12T01:38:00.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/cyapatp.ko 2023-07-12T01:38:00.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-12T01:38:00.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/sermouse.ko 2023-07-12T01:38:00.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-12T01:38:00.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-12T01:38:00.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-12T01:38:00.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4 2023-07-12T01:38:00.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-12T01:38:00.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio 2023-07-12T01:38:00.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/altera_ps2.ko 2023-07-12T01:38:00.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/arc_ps2.ko 2023-07-12T01:38:00.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-12T01:38:00.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serio_raw.ko 2023-07-12T01:38:00.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/sparse-keymap.ko 2023-07-12T01:38:00.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu 2023-07-12T01:38:00.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd 2023-07-12T01:38:00.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-12T01:38:00.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds 2023-07-12T01:38:00.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-blinkm.ko 2023-07-12T01:38:00.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3530.ko 2023-07-12T01:38:00.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp3944.ko 2023-07-12T01:38:00.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-ss4200.ko 2023-07-12T01:38:00.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger 2023-07-12T01:38:00.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-12T01:38:00.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-12T01:38:00.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-12T01:38:00.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-12T01:38:00.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-12T01:38:00.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-12T01:38:00.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-12T01:38:00.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-12T01:38:00.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md 2023-07-12T01:38:00.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache 2023-07-12T01:38:00.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/bcache.ko 2023-07-12T01:38:00.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bio-prison.ko 2023-07-12T01:38:00.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache-smq.ko 2023-07-12T01:38:00.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache.ko 2023-07-12T01:38:00.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-crypt.ko 2023-07-12T01:38:00.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-delay.ko 2023-07-12T01:38:00.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-flakey.ko 2023-07-12T01:38:00.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log-userspace.ko 2023-07-12T01:38:00.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-multipath.ko 2023-07-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-queue-length.ko 2023-07-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-raid.ko 2023-07-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-round-robin.ko 2023-07-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-service-time.ko 2023-07-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-switch.ko 2023-07-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-thin-pool.ko 2023-07-12T01:38:00.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-verity.ko 2023-07-12T01:38:00.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/faulty.ko 2023-07-12T01:38:00.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/linear.ko 2023-07-12T01:38:00.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/multipath.ko 2023-07-12T01:38:00.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data 2023-07-12T01:38:00.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-12T01:38:00.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid0.ko 2023-07-12T01:38:00.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid1.ko 2023-07-12T01:38:00.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid10.ko 2023-07-12T01:38:00.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid456.ko 2023-07-12T01:38:00.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message 2023-07-12T01:38:00.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion 2023-07-12T01:38:00.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptbase.ko 2023-07-12T01:38:00.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptctl.ko 2023-07-12T01:38:00.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptfc.ko 2023-07-12T01:38:00.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptlan.ko 2023-07-12T01:38:00.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptsas.ko 2023-07-12T01:38:00.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptscsih.ko 2023-07-12T01:38:00.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptspi.ko 2023-07-12T01:38:00.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd 2023-07-12T01:38:00.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_ich.ko 2023-07-12T01:38:00.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_sch.ko 2023-07-12T01:38:00.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mfd-core.ko 2023-07-12T01:38:00.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/sm501.ko 2023-07-12T01:38:00.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/viperboard.ko 2023-07-12T01:38:00.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/vx855.ko 2023-07-12T01:38:00.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wl1273-core.ko 2023-07-12T01:38:00.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc 2023-07-12T01:38:00.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl 2023-07-12T01:38:00.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-12T01:38:00.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds9802als.ko 2023-07-12T01:38:00.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds990x.ko 2023-07-12T01:38:00.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/bh1770glc.ko 2023-07-12T01:38:00.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710 2023-07-12T01:38:00.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/cb710.ko 2023-07-12T01:38:00.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom 2023-07-12T01:38:00.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/at24.ko 2023-07-12T01:38:00.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-12T01:38:00.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-12T01:38:00.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/max6875.ko 2023-07-12T01:38:00.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/enclosure.ko 2023-07-12T01:38:00.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hpilo.ko 2023-07-12T01:38:00.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29003.ko 2023-07-12T01:38:00.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29020.ko 2023-07-12T01:38:00.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d 2023-07-12T01:38:00.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-12T01:38:00.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-12T01:38:00.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei 2023-07-12T01:38:00.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-me.ko 2023-07-12T01:38:00.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-txe.ko 2023-07-12T01:38:00.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei.ko 2023-07-12T01:38:00.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru 2023-07-12T01:38:00.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-12T01:38:00.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp 2023-07-12T01:38:00.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-12T01:38:00.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-12T01:38:00.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-12T01:38:00.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_7xx1.ko 2023-07-12T01:38:00.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_core.ko 2023-07-12T01:38:00.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tsl2550.ko 2023-07-12T01:38:00.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_balloon.ko 2023-07-12T01:38:00.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci 2023-07-12T01:38:00.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net 2023-07-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding 2023-07-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/bonding.ko 2023-07-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa 2023-07-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53 2023-07-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-12T01:38:00.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-12T01:38:00.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx 2023-07-12T01:38:00.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-12T01:38:00.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dummy.ko 2023-07-12T01:38:00.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/eql.ko 2023-07-12T01:38:00.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet 2023-07-12T01:38:00.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com 2023-07-12T01:38:00.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-12T01:38:00.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-12T01:38:00.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-12T01:38:00.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-12T01:38:00.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390 2023-07-12T01:38:00.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-12T01:38:00.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-12T01:38:00.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-12T01:38:00.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-12T01:38:00.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec 2023-07-12T01:38:00.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-12T01:38:00.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere 2023-07-12T01:38:00.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-12T01:38:00.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon 2023-07-12T01:38:00.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-12T01:38:00.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera 2023-07-12T01:38:00.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-12T01:38:00.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd 2023-07-12T01:38:00.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-12T01:38:00.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-12T01:38:00.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-12T01:38:00.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros 2023-07-12T01:38:00.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx 2023-07-12T01:38:00.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-12T01:38:00.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-12T01:38:00.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-12T01:38:00.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-12T01:38:00.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-12T01:38:00.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx 2023-07-12T01:38:00.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-12T01:38:00.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-12T01:38:00.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom 2023-07-12T01:38:00.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet 2023-07-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-12T01:38:00.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-12T01:38:00.495 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade 2023-07-12T01:38:00.495 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna 2023-07-12T01:38:00.495 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-12T01:38:00.495 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio 2023-07-12T01:38:00.495 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-12T01:38:00.495 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-12T01:38:00.495 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-12T01:38:00.495 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-12T01:38:00.496 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-12T01:38:00.496 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-12T01:38:00.496 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-12T01:38:00.496 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-12T01:38:00.496 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-12T01:38:00.496 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-12T01:38:00.496 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco 2023-07-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic 2023-07-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec 2023-07-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip 2023-07-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-12T01:38:00.497 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-12T01:38:00.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-12T01:38:00.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-12T01:38:00.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink 2023-07-12T01:38:00.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-12T01:38:00.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-12T01:38:00.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dnet.ko 2023-07-12T01:38:00.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex 2023-07-12T01:38:00.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet 2023-07-12T01:38:00.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-12T01:38:00.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ethoc.ko 2023-07-12T01:38:00.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fealnx.ko 2023-07-12T01:38:00.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel 2023-07-12T01:38:00.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-12T01:38:00.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000 2023-07-12T01:38:00.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e 2023-07-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k 2023-07-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e 2023-07-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf 2023-07-12T01:38:00.500 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-12T01:38:00.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb 2023-07-12T01:38:00.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-12T01:38:00.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf 2023-07-12T01:38:00.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-12T01:38:00.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-12T01:38:00.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-12T01:38:00.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-12T01:38:00.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-12T01:38:00.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/jme.ko 2023-07-12T01:38:00.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell 2023-07-12T01:38:00.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-12T01:38:00.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-12T01:38:00.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-12T01:38:00.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox 2023-07-12T01:38:00.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-12T01:38:00.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-12T01:38:00.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-12T01:38:00.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-12T01:38:00.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-12T01:38:00.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-12T01:38:00.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel 2023-07-12T01:38:00.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-12T01:38:00.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom 2023-07-12T01:38:00.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-12T01:38:00.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-12T01:38:00.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi 2023-07-12T01:38:00.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-12T01:38:00.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-12T01:38:00.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion 2023-07-12T01:38:00.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-12T01:38:00.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia 2023-07-12T01:38:00.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-12T01:38:00.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines 2023-07-12T01:38:00.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-12T01:38:00.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-12T01:38:00.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic 2023-07-12T01:38:00.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-12T01:38:00.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-12T01:38:00.506 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-12T01:38:00.506 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-12T01:38:00.506 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-12T01:38:00.506 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc 2023-07-12T01:38:00.506 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-12T01:38:00.506 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek 2023-07-12T01:38:00.506 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-12T01:38:00.506 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker 2023-07-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc 2023-07-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan 2023-07-12T01:38:00.507 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis 2023-07-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc 2023-07-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-12T01:38:00.508 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-12T01:38:00.509 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-12T01:38:00.509 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro 2023-07-12T01:38:00.509 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-12T01:38:00.509 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-12T01:38:00.509 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-12T01:38:00.509 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun 2023-07-12T01:38:00.509 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-12T01:38:00.509 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-12T01:38:00.510 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-12T01:38:00.510 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-12T01:38:00.510 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti 2023-07-12T01:38:00.510 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-12T01:38:00.510 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti 2023-07-12T01:38:00.510 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-12T01:38:00.510 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via 2023-07-12T01:38:00.510 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet 2023-07-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom 2023-07-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/geneve.ko 2023-07-12T01:38:00.511 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv 2023-07-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154 2023-07-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ifb.ko 2023-07-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan 2023-07-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvlan.ko 2023-07-12T01:38:00.512 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvtap.ko 2023-07-12T01:38:00.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio 2023-07-12T01:38:00.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio.ko 2023-07-12T01:38:00.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-12T01:38:00.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-12T01:38:00.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mii.ko 2023-07-12T01:38:00.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/net_failover.ko 2023-07-12T01:38:00.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/netconsole.ko 2023-07-12T01:38:00.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/nlmon.ko 2023-07-12T01:38:00.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs 2023-07-12T01:38:00.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-07-12T01:38:00.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-12T01:38:00.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy 2023-07-12T01:38:00.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/amd.ko 2023-07-12T01:38:00.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-12T01:38:00.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-12T01:38:00.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-12T01:38:00.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm87xx.ko 2023-07-12T01:38:00.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/broadcom.ko 2023-07-12T01:38:00.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/cicada.ko 2023-07-12T01:38:00.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/davicom.ko 2023-07-12T01:38:00.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/dp83640.ko 2023-07-12T01:38:00.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/et1011c.ko 2023-07-12T01:38:00.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/icplus.ko 2023-07-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/lxt.ko 2023-07-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/marvell.ko 2023-07-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/micrel.ko 2023-07-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/national.ko 2023-07-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/phylink.ko 2023-07-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/qsemi.ko 2023-07-12T01:38:00.516 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/realtek.ko 2023-07-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/smsc.ko 2023-07-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ste10Xp.ko 2023-07-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/vitesse.ko 2023-07-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp 2023-07-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_async.ko 2023-07-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-12T01:38:00.517 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppoe.ko 2023-07-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppox.ko 2023-07-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pptp.ko 2023-07-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip 2023-07-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slhc.ko 2023-07-12T01:38:00.518 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slip.ko 2023-07-12T01:38:00.519 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sungem_phy.ko 2023-07-12T01:38:00.519 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tap.ko 2023-07-12T01:38:00.519 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team 2023-07-12T01:38:00.519 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team.ko 2023-07-12T01:38:00.519 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-12T01:38:00.519 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-12T01:38:00.519 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-12T01:38:00.519 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_random.ko 2023-07-12T01:38:00.520 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-12T01:38:00.520 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tun.ko 2023-07-12T01:38:00.520 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/veth.ko 2023-07-12T01:38:00.520 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/virtio_net.ko 2023-07-12T01:38:00.520 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3 2023-07-12T01:38:00.520 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-12T01:38:00.520 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan 2023-07-12T01:38:00.520 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/vxlan.ko 2023-07-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback 2023-07-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netfront.ko 2023-07-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb 2023-07-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ntb.ko 2023-07-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme 2023-07-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host 2023-07-12T01:38:00.521 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme-core.ko 2023-07-12T01:38:00.522 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme.ko 2023-07-12T01:38:00.522 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport 2023-07-12T01:38:00.522 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport.ko 2023-07-12T01:38:00.522 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_cs.ko 2023-07-12T01:38:00.522 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_pc.ko 2023-07-12T01:38:00.522 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_serial.ko 2023-07-12T01:38:00.522 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci 2023-07-12T01:38:00.522 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug 2023-07-12T01:38:00.523 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-12T01:38:00.523 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie 2023-07-12T01:38:00.523 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-12T01:38:00.523 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/xen-pcifront.ko 2023-07-12T01:38:00.523 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia 2023-07-12T01:38:00.523 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/i82092.ko 2023-07-12T01:38:00.523 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pd6729.ko 2023-07-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl 2023-07-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel 2023-07-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform 2023-07-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86 2023-07-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-12T01:38:00.524 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acerhdf.ko 2023-07-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-12T01:38:00.525 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-12T01:38:00.526 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-12T01:38:00.526 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/hdaps.ko 2023-07-12T01:38:00.526 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel 2023-07-12T01:38:00.526 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-12T01:38:00.526 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel_ips.ko 2023-07-12T01:38:00.526 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-12T01:38:00.526 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-12T01:38:00.526 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-12T01:38:00.527 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-12T01:38:00.527 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-12T01:38:00.527 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-12T01:38:00.527 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-12T01:38:00.527 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-12T01:38:00.527 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-12T01:38:00.527 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi.ko 2023-07-12T01:38:00.527 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap 2023-07-12T01:38:00.528 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-12T01:38:00.528 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-12T01:38:00.528 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps 2023-07-12T01:38:00.528 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients 2023-07-12T01:38:00.528 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-12T01:38:00.528 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-12T01:38:00.528 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps_parport.ko 2023-07-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/pps_core.ko 2023-07-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp 2023-07-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp.ko 2023-07-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp_kvm.ko 2023-07-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc 2023-07-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-12T01:38:00.529 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-12T01:38:00.530 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-12T01:38:00.531 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-em3027.ko 2023-07-12T01:38:00.531 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-12T01:38:00.531 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-12T01:38:00.531 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-12T01:38:00.531 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-12T01:38:00.531 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-12T01:38:00.531 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-12T01:38:00.531 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max6900.ko 2023-07-12T01:38:00.532 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-12T01:38:00.532 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-12T01:38:00.532 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-12T01:38:00.532 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-12T01:38:00.532 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-12T01:38:00.532 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-12T01:38:00.532 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-12T01:38:00.532 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-x1205.ko 2023-07-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi 2023-07-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-9xxx.ko 2023-07-12T01:38:00.533 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-sas.ko 2023-07-12T01:38:00.534 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-xxxx.ko 2023-07-12T01:38:00.534 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/BusLogic.ko 2023-07-12T01:38:00.534 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/a100u2w.ko 2023-07-12T01:38:00.534 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid 2023-07-12T01:38:00.534 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-12T01:38:00.534 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/advansys.ko 2023-07-12T01:38:00.534 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx 2023-07-12T01:38:00.534 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/am53c974.ko 2023-07-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr 2023-07-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/atp870u.ko 2023-07-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi 2023-07-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-12T01:38:00.535 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa 2023-07-12T01:38:00.536 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/bfa.ko 2023-07-12T01:38:00.536 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc 2023-07-12T01:38:00.536 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-12T01:38:00.536 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i 2023-07-12T01:38:00.536 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-12T01:38:00.536 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ch.ko 2023-07-12T01:38:00.536 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor 2023-07-12T01:38:00.537 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-12T01:38:00.537 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi 2023-07-12T01:38:00.537 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-12T01:38:00.537 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-12T01:38:00.537 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-12T01:38:00.537 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-12T01:38:00.537 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-12T01:38:00.537 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dc395x.ko 2023-07-12T01:38:00.538 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler 2023-07-12T01:38:00.538 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-12T01:38:00.538 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-12T01:38:00.538 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-12T01:38:00.538 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-12T01:38:00.538 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dmx3191d.ko 2023-07-12T01:38:00.538 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r 2023-07-12T01:38:00.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-12T01:38:00.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esp_scsi.ko 2023-07-12T01:38:00.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe 2023-07-12T01:38:00.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-12T01:38:00.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-12T01:38:00.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic 2023-07-12T01:38:00.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/fnic.ko 2023-07-12T01:38:00.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hpsa.ko 2023-07-12T01:38:00.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hptiop.ko 2023-07-12T01:38:00.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hv_storvsc.ko 2023-07-12T01:38:00.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/initio.ko 2023-07-12T01:38:00.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ipr.ko 2023-07-12T01:38:00.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ips.ko 2023-07-12T01:38:00.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci 2023-07-12T01:38:00.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/isci.ko 2023-07-12T01:38:00.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-12T01:38:00.541 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-12T01:38:00.541 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc 2023-07-12T01:38:00.541 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/libfc.ko 2023-07-12T01:38:00.541 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi.ko 2023-07-12T01:38:00.541 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-12T01:38:00.541 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas 2023-07-12T01:38:00.541 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/libsas.ko 2023-07-12T01:38:00.541 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc 2023-07-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid 2023-07-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid.ko 2023-07-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas 2023-07-12T01:38:00.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas 2023-07-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvumi.ko 2023-07-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001 2023-07-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pmcraid.ko 2023-07-12T01:38:00.543 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla1280.ko 2023-07-12T01:38:00.544 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx 2023-07-12T01:38:00.544 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-12T01:38:00.544 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-12T01:38:00.544 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx 2023-07-12T01:38:00.544 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-12T01:38:00.544 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/raid_class.ko 2023-07-12T01:38:00.544 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_debug.ko 2023-07-12T01:38:00.544 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-12T01:38:00.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-12T01:38:00.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-12T01:38:00.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-12T01:38:00.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-12T01:38:00.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ses.ko 2023-07-12T01:38:00.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/st.ko 2023-07-12T01:38:00.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/stex.ko 2023-07-12T01:38:00.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2 2023-07-12T01:38:00.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-12T01:38:00.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/virtio_scsi.ko 2023-07-12T01:38:00.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-12T01:38:00.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/wd719x.ko 2023-07-12T01:38:00.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb 2023-07-12T01:38:00.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ssb.ko 2023-07-12T01:38:00.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target 2023-07-12T01:38:00.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi 2023-07-12T01:38:00.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-12T01:38:00.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback 2023-07-12T01:38:00.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-12T01:38:00.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_file.ko 2023-07-12T01:38:00.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_iblock.ko 2023-07-12T01:38:00.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_mod.ko 2023-07-12T01:38:00.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_pscsi.ko 2023-07-12T01:38:00.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_user.ko 2023-07-12T01:38:00.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc 2023-07-12T01:38:00.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-12T01:38:00.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal 2023-07-12T01:38:00.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel 2023-07-12T01:38:00.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal 2023-07-12T01:38:00.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-12T01:38:00.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-12T01:38:00.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-12T01:38:00.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-12T01:38:00.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-12T01:38:00.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-12T01:38:00.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-12T01:38:00.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-12T01:38:00.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-12T01:38:00.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty 2023-07-12T01:38:00.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless 2023-07-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_gsm.ko 2023-07-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_hdlc.ko 2023-07-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/nozomi.ko 2023-07-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial 2023-07-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250 2023-07-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-12T01:38:00.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/arc_uart.ko 2023-07-12T01:38:00.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm 2023-07-12T01:38:00.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-12T01:38:00.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/synclink_gt.ko 2023-07-12T01:38:00.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs 2023-07-12T01:38:00.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core 2023-07-12T01:38:00.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-12T01:38:00.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host 2023-07-12T01:38:00.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-12T01:38:00.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio 2023-07-12T01:38:00.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio.ko 2023-07-12T01:38:00.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_aec.ko 2023-07-12T01:38:00.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_cif.ko 2023-07-12T01:38:00.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pci_generic.ko 2023-07-12T01:38:00.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_sercos3.ko 2023-07-12T01:38:00.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb 2023-07-12T01:38:00.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class 2023-07-12T01:38:00.554 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-acm.ko 2023-07-12T01:38:00.554 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-12T01:38:00.554 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usblp.ko 2023-07-12T01:38:00.554 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usbtmc.ko 2023-07-12T01:38:00.554 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host 2023-07-12T01:38:00.554 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-12T01:38:00.554 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image 2023-07-12T01:38:00.554 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/mdc800.ko 2023-07-12T01:38:00.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/microtek.ko 2023-07-12T01:38:00.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc 2023-07-12T01:38:00.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/adutux.ko 2023-07-12T01:38:00.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/appledisplay.ko 2023-07-12T01:38:00.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi26.ko 2023-07-12T01:38:00.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi62.ko 2023-07-12T01:38:00.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ezusb.ko 2023-07-12T01:38:00.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/idmouse.ko 2023-07-12T01:38:00.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/iowarrior.ko 2023-07-12T01:38:00.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-12T01:38:00.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ldusb.ko 2023-07-12T01:38:00.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/legousbtower.ko 2023-07-12T01:38:00.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga 2023-07-12T01:38:00.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-12T01:38:00.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-12T01:38:00.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usb3503.ko 2023-07-12T01:38:00.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usblcd.ko 2023-07-12T01:38:00.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-12T01:38:00.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/uss720.ko 2023-07-12T01:38:00.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/yurex.ko 2023-07-12T01:38:00.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy 2023-07-12T01:38:00.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-generic.ko 2023-07-12T01:38:00.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial 2023-07-12T01:38:00.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/aircable.ko 2023-07-12T01:38:00.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ark3116.ko 2023-07-12T01:38:00.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-12T01:38:00.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ch341.ko 2023-07-12T01:38:00.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cp210x.ko 2023-07-12T01:38:00.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cyberjack.ko 2023-07-12T01:38:00.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-12T01:38:00.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-12T01:38:00.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/empeg.ko 2023-07-12T01:38:00.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-12T01:38:00.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-12T01:38:00.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-12T01:38:00.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_ti.ko 2023-07-12T01:38:00.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipaq.ko 2023-07-12T01:38:00.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipw.ko 2023-07-12T01:38:00.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ir-usb.ko 2023-07-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan.ko 2023-07-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mct_u232.ko 2023-07-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7720.ko 2023-07-12T01:38:00.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7840.ko 2023-07-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/navman.ko 2023-07-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/omninet.ko 2023-07-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/opticon.ko 2023-07-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/option.ko 2023-07-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/oti6858.ko 2023-07-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/pl2303.ko 2023-07-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcaux.ko 2023-07-12T01:38:00.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcserial.ko 2023-07-12T01:38:00.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/quatech2.ko 2023-07-12T01:38:00.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/safe_serial.ko 2023-07-12T01:38:00.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/sierra.ko 2023-07-12T01:38:00.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-12T01:38:00.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ssu100.ko 2023-07-12T01:38:00.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/symbolserial.ko 2023-07-12T01:38:00.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-12T01:38:00.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-12T01:38:00.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_debug.ko 2023-07-12T01:38:00.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-12T01:38:00.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/visor.ko 2023-07-12T01:38:00.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/whiteheat.ko 2023-07-12T01:38:00.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-12T01:38:00.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage 2023-07-12T01:38:00.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/uas.ko 2023-07-12T01:38:00.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-12T01:38:00.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-12T01:38:00.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-12T01:38:00.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-12T01:38:00.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-12T01:38:00.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-12T01:38:00.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-12T01:38:00.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-karma.ko 2023-07-12T01:38:00.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-12T01:38:00.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-12T01:38:00.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-12T01:38:00.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-12T01:38:00.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-12T01:38:00.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/usb-storage.ko 2023-07-12T01:38:00.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip 2023-07-12T01:38:00.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-12T01:38:00.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-12T01:38:00.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-12T01:38:00.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio 2023-07-12T01:38:00.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci 2023-07-12T01:38:00.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-12T01:38:00.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-12T01:38:00.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio.ko 2023-07-12T01:38:00.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost 2023-07-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost.ko 2023-07-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_net.ko 2023-07-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_scsi.ko 2023-07-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video 2023-07-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight 2023-07-12T01:38:00.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/apple_bl.ko 2023-07-12T01:38:00.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lcd.ko 2023-07-12T01:38:00.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-12T01:38:00.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio 2023-07-12T01:38:00.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio.ko 2023-07-12T01:38:00.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_balloon.ko 2023-07-12T01:38:00.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_mmio.ko 2023-07-12T01:38:00.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci.ko 2023-07-12T01:38:00.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-12T01:38:00.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-12T01:38:00.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_ring.ko 2023-07-12T01:38:00.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1 2023-07-12T01:38:00.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters 2023-07-12T01:38:00.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2482.ko 2023-07-12T01:38:00.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2490.ko 2023-07-12T01:38:00.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves 2023-07-12T01:38:00.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-12T01:38:00.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-12T01:38:00.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-12T01:38:00.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-12T01:38:00.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-12T01:38:00.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-12T01:38:00.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-12T01:38:00.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-12T01:38:00.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-12T01:38:00.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-12T01:38:00.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-12T01:38:00.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/wire.ko 2023-07-12T01:38:00.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog 2023-07-12T01:38:00.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-12T01:38:00.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-12T01:38:00.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-12T01:38:00.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/hpwdt.ko 2023-07-12T01:38:00.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/i6300esb.ko 2023-07-12T01:38:00.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-12T01:38:00.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-12T01:38:00.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ib700wdt.ko 2023-07-12T01:38:00.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ibmasr.ko 2023-07-12T01:38:00.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-12T01:38:00.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it87_wdt.ko 2023-07-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/machzwd.ko 2023-07-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/nv_tco.ko 2023-07-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-12T01:38:00.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/softdog.ko 2023-07-12T01:38:00.574 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-12T01:38:00.574 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/via_wdt.ko 2023-07-12T01:38:00.574 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-12T01:38:00.574 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-12T01:38:00.574 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-12T01:38:00.574 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wdt_pci.ko 2023-07-12T01:38:00.574 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/xen_wdt.ko 2023-07-12T01:38:00.574 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen 2023-07-12T01:38:00.575 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-12T01:38:00.575 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-evtchn.ko 2023-07-12T01:38:00.575 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntalloc.ko 2023-07-12T01:38:00.575 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntdev.ko 2023-07-12T01:38:00.575 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback 2023-07-12T01:38:00.575 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-12T01:38:00.575 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-privcmd.ko 2023-07-12T01:38:00.575 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs 2023-07-12T01:38:00.576 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-12T01:38:00.576 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs 2023-07-12T01:38:00.576 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p 2023-07-12T01:38:00.576 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/9p.ko 2023-07-12T01:38:00.576 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs 2023-07-12T01:38:00.576 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/affs.ko 2023-07-12T01:38:00.576 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs 2023-07-12T01:38:00.577 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/befs.ko 2023-07-12T01:38:00.577 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/binfmt_misc.ko 2023-07-12T01:38:00.577 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs 2023-07-12T01:38:00.577 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/btrfs.ko 2023-07-12T01:38:00.577 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles 2023-07-12T01:38:00.577 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/cachefiles.ko 2023-07-12T01:38:00.577 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph 2023-07-12T01:38:00.577 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ceph.ko 2023-07-12T01:38:00.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda 2023-07-12T01:38:00.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/coda.ko 2023-07-12T01:38:00.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs 2023-07-12T01:38:00.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/cramfs.ko 2023-07-12T01:38:00.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm 2023-07-12T01:38:00.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/dlm.ko 2023-07-12T01:38:00.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs 2023-07-12T01:38:00.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs 2023-07-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/f2fs.ko 2023-07-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat 2023-07-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/fat.ko 2023-07-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/msdos.ko 2023-07-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/vfat.ko 2023-07-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache 2023-07-12T01:38:00.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/fscache.ko 2023-07-12T01:38:00.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse 2023-07-12T01:38:00.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/cuse.ko 2023-07-12T01:38:00.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/fuse.ko 2023-07-12T01:38:00.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2 2023-07-12T01:38:00.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/gfs2.ko 2023-07-12T01:38:00.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs 2023-07-12T01:38:00.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/hfs.ko 2023-07-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus 2023-07-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/hfsplus.ko 2023-07-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs 2023-07-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/isofs.ko 2023-07-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs 2023-07-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/jfs.ko 2023-07-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd 2023-07-12T01:38:00.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/lockd.ko 2023-07-12T01:38:00.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix 2023-07-12T01:38:00.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/minix.ko 2023-07-12T01:38:00.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs 2023-07-12T01:38:00.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/netfs.ko 2023-07-12T01:38:00.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs 2023-07-12T01:38:00.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout 2023-07-12T01:38:00.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-12T01:38:00.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout 2023-07-12T01:38:00.583 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-12T01:38:00.583 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout 2023-07-12T01:38:00.583 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-12T01:38:00.583 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfs.ko 2023-07-12T01:38:00.583 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv3.ko 2023-07-12T01:38:00.583 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv4.ko 2023-07-12T01:38:00.583 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common 2023-07-12T01:38:00.583 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/grace.ko 2023-07-12T01:38:00.584 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/nfs_acl.ko 2023-07-12T01:38:00.584 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd 2023-07-12T01:38:00.584 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/nfsd.ko 2023-07-12T01:38:00.584 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2 2023-07-12T01:38:00.584 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/nilfs2.ko 2023-07-12T01:38:00.584 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls 2023-07-12T01:38:00.584 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-celtic.ko 2023-07-12T01:38:00.584 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-centeuro.ko 2023-07-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-croatian.ko 2023-07-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-cyrillic.ko 2023-07-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-gaelic.ko 2023-07-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-greek.ko 2023-07-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-iceland.ko 2023-07-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-inuit.ko 2023-07-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-roman.ko 2023-07-12T01:38:00.585 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-romanian.ko 2023-07-12T01:38:00.586 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-turkish.ko 2023-07-12T01:38:00.586 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1250.ko 2023-07-12T01:38:00.586 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1251.ko 2023-07-12T01:38:00.586 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1255.ko 2023-07-12T01:38:00.586 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp737.ko 2023-07-12T01:38:00.586 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp775.ko 2023-07-12T01:38:00.586 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp850.ko 2023-07-12T01:38:00.586 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp852.ko 2023-07-12T01:38:00.587 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp855.ko 2023-07-12T01:38:00.587 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp857.ko 2023-07-12T01:38:00.587 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp860.ko 2023-07-12T01:38:00.587 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp861.ko 2023-07-12T01:38:00.587 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp862.ko 2023-07-12T01:38:00.587 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp863.ko 2023-07-12T01:38:00.587 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp864.ko 2023-07-12T01:38:00.587 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp865.ko 2023-07-12T01:38:00.588 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp866.ko 2023-07-12T01:38:00.588 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp869.ko 2023-07-12T01:38:00.588 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp874.ko 2023-07-12T01:38:00.588 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp932.ko 2023-07-12T01:38:00.588 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp936.ko 2023-07-12T01:38:00.588 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp949.ko 2023-07-12T01:38:00.588 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp950.ko 2023-07-12T01:38:00.588 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_euc-jp.ko 2023-07-12T01:38:00.589 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-1.ko 2023-07-12T01:38:00.589 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-13.ko 2023-07-12T01:38:00.589 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-14.ko 2023-07-12T01:38:00.589 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-15.ko 2023-07-12T01:38:00.589 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-2.ko 2023-07-12T01:38:00.589 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-3.ko 2023-07-12T01:38:00.589 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-4.ko 2023-07-12T01:38:00.589 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-5.ko 2023-07-12T01:38:00.590 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-6.ko 2023-07-12T01:38:00.590 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-7.ko 2023-07-12T01:38:00.590 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-9.ko 2023-07-12T01:38:00.590 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-r.ko 2023-07-12T01:38:00.590 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-ru.ko 2023-07-12T01:38:00.590 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-u.ko 2023-07-12T01:38:00.590 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_utf8.ko 2023-07-12T01:38:00.590 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2 2023-07-12T01:38:00.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster 2023-07-12T01:38:00.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-12T01:38:00.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm 2023-07-12T01:38:00.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-12T01:38:00.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs 2023-07-12T01:38:00.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-12T01:38:00.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2.ko 2023-07-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs 2023-07-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/overlay.ko 2023-07-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore 2023-07-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ramoops.ko 2023-07-12T01:38:00.592 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs 2023-07-12T01:38:00.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/reiserfs.ko 2023-07-12T01:38:00.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs 2023-07-12T01:38:00.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/romfs.ko 2023-07-12T01:38:00.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb 2023-07-12T01:38:00.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client 2023-07-12T01:38:00.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/cifs.ko 2023-07-12T01:38:00.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common 2023-07-12T01:38:00.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_arc4.ko 2023-07-12T01:38:00.594 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_md4.ko 2023-07-12T01:38:00.594 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs 2023-07-12T01:38:00.594 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/squashfs.ko 2023-07-12T01:38:00.594 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv 2023-07-12T01:38:00.594 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/sysv.ko 2023-07-12T01:38:00.594 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf 2023-07-12T01:38:00.594 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/udf.ko 2023-07-12T01:38:00.594 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs 2023-07-12T01:38:00.595 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ufs.ko 2023-07-12T01:38:00.595 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs 2023-07-12T01:38:00.595 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/xfs.ko 2023-07-12T01:38:00.595 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel 2023-07-12T01:38:00.595 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu 2023-07-12T01:38:00.595 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu/rcutorture.ko 2023-07-12T01:38:00.595 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/torture.ko 2023-07-12T01:38:00.595 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace 2023-07-12T01:38:00.596 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-12T01:38:00.596 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib 2023-07-12T01:38:00.596 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/asn1_encoder.ko 2023-07-12T01:38:00.596 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc-itu-t.ko 2023-07-12T01:38:00.596 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc8.ko 2023-07-12T01:38:00.596 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto 2023-07-12T01:38:00.596 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libarc4.ko 2023-07-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libdes.ko 2023-07-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/libcrc32c.ko 2023-07-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lru_cache.ko 2023-07-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4 2023-07-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4_compress.ko 2023-07-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4hc_compress.ko 2023-07-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math 2023-07-12T01:38:00.597 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/cordic.ko 2023-07-12T01:38:00.598 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6 2023-07-12T01:38:00.598 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/raid6_pq.ko 2023-07-12T01:38:00.598 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon 2023-07-12T01:38:00.598 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-12T01:38:00.598 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_bm.ko 2023-07-12T01:38:00.598 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_fsm.ko 2023-07-12T01:38:00.598 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_kmp.ko 2023-07-12T01:38:00.598 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd 2023-07-12T01:38:00.599 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd/zstd_compress.ko 2023-07-12T01:38:00.599 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm 2023-07-12T01:38:00.599 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm/hwpoison-inject.ko 2023-07-12T01:38:00.599 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net 2023-07-12T01:38:00.599 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan 2023-07-12T01:38:00.599 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/6lowpan.ko 2023-07-12T01:38:00.599 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_dest.ko 2023-07-12T01:38:00.599 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_fragment.ko 2023-07-12T01:38:00.600 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_hop.ko 2023-07-12T01:38:00.600 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-12T01:38:00.600 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_mobility.ko 2023-07-12T01:38:00.600 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_routing.ko 2023-07-12T01:38:00.600 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_udp.ko 2023-07-12T01:38:00.600 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802 2023-07-12T01:38:00.600 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/garp.ko 2023-07-12T01:38:00.600 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/mrp.ko 2023-07-12T01:38:00.601 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/p8022.ko 2023-07-12T01:38:00.601 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/psnap.ko 2023-07-12T01:38:00.601 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/stp.ko 2023-07-12T01:38:00.601 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q 2023-07-12T01:38:00.601 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/8021q.ko 2023-07-12T01:38:00.601 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p 2023-07-12T01:38:00.601 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet.ko 2023-07-12T01:38:00.601 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_fd.ko 2023-07-12T01:38:00.602 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_rdma.ko 2023-07-12T01:38:00.602 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_virtio.ko 2023-07-12T01:38:00.602 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv 2023-07-12T01:38:00.602 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/batman-adv.ko 2023-07-12T01:38:00.602 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge 2023-07-12T01:38:00.602 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/br_netfilter.ko 2023-07-12T01:38:00.602 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/bridge.ko 2023-07-12T01:38:00.602 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter 2023-07-12T01:38:00.603 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-12T01:38:00.603 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-12T01:38:00.603 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-12T01:38:00.603 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-12T01:38:00.603 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-12T01:38:00.603 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-12T01:38:00.603 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-12T01:38:00.603 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-12T01:38:00.604 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-12T01:38:00.604 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-12T01:38:00.604 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-12T01:38:00.604 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-12T01:38:00.604 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-12T01:38:00.604 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-12T01:38:00.604 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-12T01:38:00.605 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-12T01:38:00.605 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-12T01:38:00.605 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-12T01:38:00.605 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-12T01:38:00.605 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-12T01:38:00.605 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtables.ko 2023-07-12T01:38:00.605 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-12T01:38:00.605 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-12T01:38:00.606 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-12T01:38:00.606 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph 2023-07-12T01:38:00.606 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/libceph.ko 2023-07-12T01:38:00.606 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core 2023-07-12T01:38:00.606 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/failover.ko 2023-07-12T01:38:00.606 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/pktgen.ko 2023-07-12T01:38:00.606 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp 2023-07-12T01:38:00.606 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp.ko 2023-07-12T01:38:00.607 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_diag.ko 2023-07-12T01:38:00.607 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv4.ko 2023-07-12T01:38:00.607 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv6.ko 2023-07-12T01:38:00.607 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver 2023-07-12T01:38:00.607 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver/dns_resolver.ko 2023-07-12T01:38:00.607 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa 2023-07-12T01:38:00.607 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/dsa_core.ko 2023-07-12T01:38:00.607 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_brcm.ko 2023-07-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_dsa.ko 2023-07-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_none.ko 2023-07-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_trailer.ko 2023-07-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154 2023-07-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan 2023-07-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-12T01:38:00.608 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154.ko 2023-07-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4 2023-07-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ah4.ko 2023-07-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/esp4.ko 2023-07-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/fou.ko 2023-07-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/gre.ko 2023-07-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/inet_diag.ko 2023-07-12T01:38:00.609 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_gre.ko 2023-07-12T01:38:00.610 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_tunnel.ko 2023-07-12T01:38:00.610 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_vti.ko 2023-07-12T01:38:00.610 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipcomp.ko 2023-07-12T01:38:00.610 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipip.ko 2023-07-12T01:38:00.610 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter 2023-07-12T01:38:00.610 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-12T01:38:00.610 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-12T01:38:00.610 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-12T01:38:00.611 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-12T01:38:00.611 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-12T01:38:00.611 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-12T01:38:00.611 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-12T01:38:00.611 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-12T01:38:00.611 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-12T01:38:00.611 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-12T01:38:00.611 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-12T01:38:00.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-12T01:38:00.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-12T01:38:00.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-12T01:38:00.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-12T01:38:00.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-12T01:38:00.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-12T01:38:00.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-12T01:38:00.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-12T01:38:00.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-12T01:38:00.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-12T01:38:00.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_bic.ko 2023-07-12T01:38:00.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_dctcp.ko 2023-07-12T01:38:00.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_diag.ko 2023-07-12T01:38:00.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_highspeed.ko 2023-07-12T01:38:00.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_htcp.ko 2023-07-12T01:38:00.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_hybla.ko 2023-07-12T01:38:00.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_illinois.ko 2023-07-12T01:38:00.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_lp.ko 2023-07-12T01:38:00.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_scalable.ko 2023-07-12T01:38:00.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_vegas.ko 2023-07-12T01:38:00.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_veno.ko 2023-07-12T01:38:00.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_westwood.ko 2023-07-12T01:38:00.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_yeah.ko 2023-07-12T01:38:00.615 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tunnel4.ko 2023-07-12T01:38:00.615 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_diag.ko 2023-07-12T01:38:00.615 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_tunnel.ko 2023-07-12T01:38:00.615 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-12T01:38:00.615 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6 2023-07-12T01:38:00.615 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ah6.ko 2023-07-12T01:38:00.615 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/esp6.ko 2023-07-12T01:38:00.615 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/fou6.ko 2023-07-12T01:38:00.616 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_tunnel.ko 2023-07-12T01:38:00.616 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-12T01:38:00.616 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_vti.ko 2023-07-12T01:38:00.616 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ipcomp6.ko 2023-07-12T01:38:00.616 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter 2023-07-12T01:38:00.616 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-12T01:38:00.616 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-12T01:38:00.616 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-12T01:38:00.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-12T01:38:00.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-12T01:38:00.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-12T01:38:00.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-12T01:38:00.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-12T01:38:00.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-12T01:38:00.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-12T01:38:00.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-12T01:38:00.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-12T01:38:00.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-12T01:38:00.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-12T01:38:00.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-12T01:38:00.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-12T01:38:00.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-12T01:38:00.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-12T01:38:00.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-12T01:38:00.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-12T01:38:00.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-12T01:38:00.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-12T01:38:00.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-12T01:38:00.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-12T01:38:00.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/sit.ko 2023-07-12T01:38:00.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/tunnel6.ko 2023-07-12T01:38:00.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-12T01:38:00.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key 2023-07-12T01:38:00.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key/af_key.ko 2023-07-12T01:38:00.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp 2023-07-12T01:38:00.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_core.ko 2023-07-12T01:38:00.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-12T01:38:00.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_eth.ko 2023-07-12T01:38:00.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip.ko 2023-07-12T01:38:00.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip6.ko 2023-07-12T01:38:00.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_netlink.ko 2023-07-12T01:38:00.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ppp.ko 2023-07-12T01:38:00.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc 2023-07-12T01:38:00.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc.ko 2023-07-12T01:38:00.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154 2023-07-12T01:38:00.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/mac802154.ko 2023-07-12T01:38:00.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls 2023-07-12T01:38:00.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/mpls_gso.ko 2023-07-12T01:38:00.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter 2023-07-12T01:38:00.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset 2023-07-12T01:38:00.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set.ko 2023-07-12T01:38:00.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-12T01:38:00.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-12T01:38:00.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-12T01:38:00.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-12T01:38:00.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-12T01:38:00.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-12T01:38:00.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-12T01:38:00.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-12T01:38:00.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-12T01:38:00.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-12T01:38:00.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-12T01:38:00.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-12T01:38:00.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-12T01:38:00.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-12T01:38:00.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-12T01:38:00.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs 2023-07-12T01:38:00.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-12T01:38:00.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-12T01:38:00.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-12T01:38:00.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-12T01:38:00.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-12T01:38:00.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-12T01:38:00.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-12T01:38:00.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-12T01:38:00.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-12T01:38:00.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-12T01:38:00.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-12T01:38:00.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-12T01:38:00.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-12T01:38:00.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-12T01:38:00.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conncount.ko 2023-07-12T01:38:00.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack.ko 2023-07-12T01:38:00.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-12T01:38:00.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-12T01:38:00.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-12T01:38:00.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-12T01:38:00.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-12T01:38:00.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-12T01:38:00.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-12T01:38:00.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-12T01:38:00.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-12T01:38:00.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-12T01:38:00.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-12T01:38:00.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-12T01:38:00.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-12T01:38:00.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table.ko 2023-07-12T01:38:00.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-12T01:38:00.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_log_syslog.ko 2023-07-12T01:38:00.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat.ko 2023-07-12T01:38:00.628 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-12T01:38:00.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-12T01:38:00.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_irc.ko 2023-07-12T01:38:00.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_sip.ko 2023-07-12T01:38:00.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-12T01:38:00.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-12T01:38:00.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_tables.ko 2023-07-12T01:38:00.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink.ko 2023-07-12T01:38:00.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-12T01:38:00.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_log.ko 2023-07-12T01:38:00.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-12T01:38:00.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-12T01:38:00.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_chain_nat.ko 2023-07-12T01:38:00.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_compat.ko 2023-07-12T01:38:00.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_ct.ko 2023-07-12T01:38:00.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-12T01:38:00.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fib.ko 2023-07-12T01:38:00.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-12T01:38:00.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_hash.ko 2023-07-12T01:38:00.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_limit.ko 2023-07-12T01:38:00.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_log.ko 2023-07-12T01:38:00.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_masq.ko 2023-07-12T01:38:00.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_nat.ko 2023-07-12T01:38:00.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_numgen.ko 2023-07-12T01:38:00.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_queue.ko 2023-07-12T01:38:00.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_quota.ko 2023-07-12T01:38:00.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_redir.ko 2023-07-12T01:38:00.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject.ko 2023-07-12T01:38:00.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject_inet.ko 2023-07-12T01:38:00.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_socket.ko 2023-07-12T01:38:00.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_tunnel.ko 2023-07-12T01:38:00.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_AUDIT.ko 2023-07-12T01:38:00.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-12T01:38:00.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-12T01:38:00.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-12T01:38:00.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CT.ko 2023-07-12T01:38:00.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_DSCP.ko 2023-07-12T01:38:00.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HL.ko 2023-07-12T01:38:00.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HMARK.ko 2023-07-12T01:38:00.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-12T01:38:00.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LED.ko 2023-07-12T01:38:00.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LOG.ko 2023-07-12T01:38:00.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-12T01:38:00.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NETMAP.ko 2023-07-12T01:38:00.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFLOG.ko 2023-07-12T01:38:00.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-12T01:38:00.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_RATEEST.ko 2023-07-12T01:38:00.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_SECMARK.ko 2023-07-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TEE.ko 2023-07-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TPROXY.ko 2023-07-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TRACE.ko 2023-07-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_addrtype.ko 2023-07-12T01:38:00.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_bpf.ko 2023-07-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cgroup.ko 2023-07-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cluster.ko 2023-07-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_comment.ko 2023-07-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connbytes.ko 2023-07-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlabel.ko 2023-07-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlimit.ko 2023-07-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connmark.ko 2023-07-12T01:38:00.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_conntrack.ko 2023-07-12T01:38:00.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cpu.ko 2023-07-12T01:38:00.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dccp.ko 2023-07-12T01:38:00.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_devgroup.ko 2023-07-12T01:38:00.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dscp.ko 2023-07-12T01:38:00.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ecn.ko 2023-07-12T01:38:00.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_esp.ko 2023-07-12T01:38:00.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hashlimit.ko 2023-07-12T01:38:00.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_helper.ko 2023-07-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hl.ko 2023-07-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipcomp.ko 2023-07-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_iprange.ko 2023-07-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipvs.ko 2023-07-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_l2tp.ko 2023-07-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_length.ko 2023-07-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_limit.ko 2023-07-12T01:38:00.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mac.ko 2023-07-12T01:38:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mark.ko 2023-07-12T01:38:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_multiport.ko 2023-07-12T01:38:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nat.ko 2023-07-12T01:38:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nfacct.ko 2023-07-12T01:38:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_osf.ko 2023-07-12T01:38:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_owner.ko 2023-07-12T01:38:00.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_physdev.ko 2023-07-12T01:38:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_pkttype.ko 2023-07-12T01:38:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_policy.ko 2023-07-12T01:38:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_quota.ko 2023-07-12T01:38:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_rateest.ko 2023-07-12T01:38:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_realm.ko 2023-07-12T01:38:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_recent.ko 2023-07-12T01:38:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_sctp.ko 2023-07-12T01:38:00.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_set.ko 2023-07-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_socket.ko 2023-07-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_state.ko 2023-07-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_statistic.ko 2023-07-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_string.ko 2023-07-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpmss.ko 2023-07-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_time.ko 2023-07-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_u32.ko 2023-07-12T01:38:00.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink 2023-07-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/netlink_diag.ko 2023-07-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh 2023-07-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/nsh.ko 2023-07-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch 2023-07-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/openvswitch.ko 2023-07-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-geneve.ko 2023-07-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-gre.ko 2023-07-12T01:38:00.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-vxlan.ko 2023-07-12T01:38:00.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet 2023-07-12T01:38:00.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/af_packet_diag.ko 2023-07-12T01:38:00.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds 2023-07-12T01:38:00.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds.ko 2023-07-12T01:38:00.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_rdma.ko 2023-07-12T01:38:00.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_tcp.ko 2023-07-12T01:38:00.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched 2023-07-12T01:38:00.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_csum.ko 2023-07-12T01:38:00.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_gact.ko 2023-07-12T01:38:00.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_ipt.ko 2023-07-12T01:38:00.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_mirred.ko 2023-07-12T01:38:00.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_nat.ko 2023-07-12T01:38:00.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_pedit.ko 2023-07-12T01:38:00.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_police.ko 2023-07-12T01:38:00.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_simple.ko 2023-07-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_skbedit.ko 2023-07-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_vlan.ko 2023-07-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_basic.ko 2023-07-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_bpf.ko 2023-07-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_flow.ko 2023-07-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_fw.ko 2023-07-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_route.ko 2023-07-12T01:38:00.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_u32.ko 2023-07-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_cmp.ko 2023-07-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_ipset.ko 2023-07-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_meta.ko 2023-07-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_nbyte.ko 2023-07-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_text.ko 2023-07-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_u32.ko 2023-07-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_choke.ko 2023-07-12T01:38:00.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_codel.ko 2023-07-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_drr.ko 2023-07-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq.ko 2023-07-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_gred.ko 2023-07-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hfsc.ko 2023-07-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hhf.ko 2023-07-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_htb.ko 2023-07-12T01:38:00.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_ingress.ko 2023-07-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio.ko 2023-07-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio_lib.ko 2023-07-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_multiq.ko 2023-07-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_netem.ko 2023-07-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_pie.ko 2023-07-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_plug.ko 2023-07-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_prio.ko 2023-07-12T01:38:00.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_qfq.ko 2023-07-12T01:38:00.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_red.ko 2023-07-12T01:38:00.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfb.ko 2023-07-12T01:38:00.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfq.ko 2023-07-12T01:38:00.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_tbf.ko 2023-07-12T01:38:00.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_teql.ko 2023-07-12T01:38:00.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp 2023-07-12T01:38:00.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp.ko 2023-07-12T01:38:00.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp_diag.ko 2023-07-12T01:38:00.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc 2023-07-12T01:38:00.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss 2023-07-12T01:38:00.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-12T01:38:00.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-12T01:38:00.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/sunrpc.ko 2023-07-12T01:38:00.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma 2023-07-12T01:38:00.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-12T01:38:00.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc 2023-07-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/diag.ko 2023-07-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/tipc.ko 2023-07-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix 2023-07-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/unix_diag.ko 2023-07-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock 2023-07-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-12T01:38:00.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock.ko 2023-07-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm 2023-07-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security 2023-07-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys 2023-07-12T01:38:00.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys 2023-07-12T01:38:00.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-12T01:38:00.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys 2023-07-12T01:38:00.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys/trusted.ko 2023-07-12T01:38:00.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt 2023-07-12T01:38:00.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib 2023-07-12T01:38:00.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/irqbypass.ko 2023-07-12T01:38:00.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias 2023-07-12T01:38:00.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias.bin 2023-07-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin 2023-07-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.bin 2023-07-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.modinfo 2023-07-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep 2023-07-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep.bin 2023-07-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.devname 2023-07-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.order 2023-07-12T01:38:00.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.softdep 2023-07-12T01:38:00.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols 2023-07-12T01:38:00.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols.bin 2023-07-12T01:38:00.655 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-g84139c18d56f 2023-07-12T01:38:00.656 DEBUG:teuthology.orchestra.run.smithi037:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-12T01:38:00.685 INFO:teuthology.orchestra.run.smithi037.stdout:postinstall scriptlet (using /bin/sh): 2023-07-12T01:38:00.686 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-g84139c18d56f -a -r /boot/System.map-6.4.0-g84139c18d56f ]; then 2023-07-12T01:38:00.686 INFO:teuthology.orchestra.run.smithi037.stdout:cp /boot/vmlinuz-6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm 2023-07-12T01:38:00.686 INFO:teuthology.orchestra.run.smithi037.stdout:cp /boot/System.map-6.4.0-g84139c18d56f /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-12T01:38:00.686 INFO:teuthology.orchestra.run.smithi037.stdout:rm -f /boot/vmlinuz-6.4.0-g84139c18d56f /boot/System.map-6.4.0-g84139c18d56f 2023-07-12T01:38:00.686 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/installkernel 6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-12T01:38:00.687 INFO:teuthology.orchestra.run.smithi037.stdout:rm -f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-12T01:38:00.687 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2023-07-12T01:38:00.687 INFO:teuthology.orchestra.run.smithi037.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-12T01:38:00.687 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-12T01:38:00.687 INFO:teuthology.orchestra.run.smithi037.stdout:new-kernel-pkg --remove 6.4.0-g84139c18d56f --rminitrd --initrdfile=/boot/initramfs-6.4.0-g84139c18d56f.img 2023-07-12T01:38:00.687 INFO:teuthology.orchestra.run.smithi037.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-12T01:38:00.688 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-install remove 6.4.0-g84139c18d56f 2023-07-12T01:38:00.688 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2023-07-12T01:38:00.688 INFO:teuthology.orchestra.run.smithi037.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-12T01:38:00.688 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-12T01:38:00.688 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/update-bootloader --remove 6.4.0-g84139c18d56f 2023-07-12T01:38:00.688 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2023-07-12T01:38:00.689 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2023-07-12T01:38:00.770 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2023-07-12T01:38:00.770 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2023-07-12T01:38:00.770 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.02 2023-07-12T01:38:00.771 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 129.el8 2023-07-12T01:38:00.771 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2023-07-12T01:38:00.771 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-12T01:38:00.771 INFO:teuthology.orchestra.run.smithi037.stdout:Group : System Environment/Base 2023-07-12T01:38:00.771 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 9265586 2023-07-12T01:38:00.771 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2023-07-12T01:38:00.772 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-12T01:38:00.772 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-12T01:38:00.772 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-12T01:38:00.772 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-12T01:38:00.772 INFO:teuthology.orchestra.run.smithi037.stdout:Relocations : (not relocatable) 2023-07-12T01:38:00.772 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : CentOS BuildSystem 2023-07-12T01:38:00.772 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2023-07-12T01:38:00.773 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-12T01:38:00.773 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2023-07-12T01:38:00.773 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2023-07-12T01:38:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T01:38:00.773 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-12T01:38:00.773 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-12T01:38:00.774 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-12T01:38:00.774 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2023-07-12T01:38:00.774 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T01:38:00.774 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2023-07-12T01:38:00.776 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-12T01:38:00.776 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 6.4.0-g84139c18d56f 2023-07-12T01:38:00.777 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-12T01:38:06.228 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2023-07-12T01:38:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:done 2023-07-12T01:38:08.684 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-07-12T01:38:08.715 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.ayN1LF0cWy 2023-07-12T01:38:08.715 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ayN1LF0cWy 2023-07-12T01:38:08.787 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.ayN1LF0cWy 2023-07-12T01:38:08.937 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.ayN1LF0cWy is 6KB 2023-07-12T01:38:08.959 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.ayN1LF0cWy 2023-07-12T01:38:08.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2023-07-12T01:38:09.051 INFO:teuthology.orchestra.run.smithi037.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-12T01:38:09.051 INFO:teuthology.orchestra.run.smithi037.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-12T01:38:09.051 INFO:teuthology.orchestra.run.smithi037.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-12T01:38:09.051 INFO:teuthology.orchestra.run.smithi037.stdout:a1b29d6c289747bdb22930598d39874a-6.4.0-g84139c18d56f.conf 2023-07-12T01:38:09.052 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.4.0-g84139c18d56f 2023-07-12T01:38:09.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2023-07-12T01:38:14.645 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi196.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-12T01:38:14.646 DEBUG:teuthology.orchestra.run.smithi196:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-12T01:38:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/boot/System.map-6.4.0-g84139c18d56f 2023-07-12T01:38:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/boot/config-6.4.0-g84139c18d56f 2023-07-12T01:38:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-12T01:38:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f 2023-07-12T01:38:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel 2023-07-12T01:38:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch 2023-07-12T01:38:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86 2023-07-12T01:38:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto 2023-07-12T01:38:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-12T01:38:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-12T01:38:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-12T01:38:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-12T01:38:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-12T01:38:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-12T01:38:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-12T01:38:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-12T01:38:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-12T01:38:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-12T01:38:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-12T01:38:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-12T01:38:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-12T01:38:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-12T01:38:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-12T01:38:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-12T01:38:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-12T01:38:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-12T01:38:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-12T01:38:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-12T01:38:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel 2023-07-12T01:38:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu 2023-07-12T01:38:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce 2023-07-12T01:38:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-12T01:38:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm 2023-07-12T01:38:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-12T01:38:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-12T01:38:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm.ko 2023-07-12T01:38:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto 2023-07-12T01:38:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ansi_cprng.ko 2023-07-12T01:38:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/anubis.ko 2023-07-12T01:38:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/arc4.ko 2023-07-12T01:38:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx 2023-07-12T01:38:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_memcpy.ko 2023-07-12T01:38:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_pq.ko 2023-07-12T01:38:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-12T01:38:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_tx.ko 2023-07-12T01:38:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_xor.ko 2023-07-12T01:38:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/raid6test.ko 2023-07-12T01:38:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authenc.ko 2023-07-12T01:38:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authencesn.ko 2023-07-12T01:38:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blake2b_generic.ko 2023-07-12T01:38:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_common.ko 2023-07-12T01:38:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_generic.ko 2023-07-12T01:38:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/camellia_generic.ko 2023-07-12T01:38:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast5_generic.ko 2023-07-12T01:38:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast6_generic.ko 2023-07-12T01:38:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast_common.ko 2023-07-12T01:38:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ccm.ko 2023-07-12T01:38:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cmac.ko 2023-07-12T01:38:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crc32_generic.ko 2023-07-12T01:38:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_engine.ko 2023-07-12T01:38:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_user.ko 2023-07-12T01:38:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cts.ko 2023-07-12T01:38:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/des_generic.ko 2023-07-12T01:38:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/dh_generic.ko 2023-07-12T01:38:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/echainiv.ko 2023-07-12T01:38:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/essiv.ko 2023-07-12T01:38:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/fcrypt.ko 2023-07-12T01:38:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/khazad.ko 2023-07-12T01:38:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4.ko 2023-07-12T01:38:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4hc.ko 2023-07-12T01:38:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/md4.ko 2023-07-12T01:38:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/michael_mic.ko 2023-07-12T01:38:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcbc.ko 2023-07-12T01:38:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcrypt.ko 2023-07-12T01:38:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/rmd160.ko 2023-07-12T01:38:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/seed.ko 2023-07-12T01:38:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/serpent_generic.ko 2023-07-12T01:38:14.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tcrypt.ko 2023-07-12T01:38:14.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tea.ko 2023-07-12T01:38:14.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_common.ko 2023-07-12T01:38:14.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_generic.ko 2023-07-12T01:38:14.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/vmac.ko 2023-07-12T01:38:14.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/wp512.ko 2023-07-12T01:38:14.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xcbc.ko 2023-07-12T01:38:14.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xor.ko 2023-07-12T01:38:14.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xxhash_generic.ko 2023-07-12T01:38:14.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers 2023-07-12T01:38:14.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi 2023-07-12T01:38:14.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-12T01:38:14.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_pad.ko 2023-07-12T01:38:14.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/custom_method.ko 2023-07-12T01:38:14.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ec_sys.ko 2023-07-12T01:38:14.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/platform_profile.ko 2023-07-12T01:38:14.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbs.ko 2023-07-12T01:38:14.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbshc.ko 2023-07-12T01:38:14.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/video.ko 2023-07-12T01:38:14.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata 2023-07-12T01:38:14.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/acard-ahci.ko 2023-07-12T01:38:14.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci_platform.ko 2023-07-12T01:38:14.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ata_generic.ko 2023-07-12T01:38:14.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci_platform.ko 2023-07-12T01:38:14.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_acpi.ko 2023-07-12T01:38:14.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ali.ko 2023-07-12T01:38:14.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_amd.ko 2023-07-12T01:38:14.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_artop.ko 2023-07-12T01:38:14.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atiixp.ko 2023-07-12T01:38:14.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atp867x.ko 2023-07-12T01:38:14.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd640.ko 2023-07-12T01:38:14.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd64x.ko 2023-07-12T01:38:14.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cypress.ko 2023-07-12T01:38:14.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_efar.ko 2023-07-12T01:38:14.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt366.ko 2023-07-12T01:38:14.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt37x.ko 2023-07-12T01:38:14.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-12T01:38:14.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-12T01:38:14.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it8213.ko 2023-07-12T01:38:14.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it821x.ko 2023-07-12T01:38:14.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_jmicron.ko 2023-07-12T01:38:14.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_marvell.ko 2023-07-12T01:38:14.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_mpiix.ko 2023-07-12T01:38:14.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_netcell.ko 2023-07-12T01:38:14.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ninja32.ko 2023-07-12T01:38:14.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87410.ko 2023-07-12T01:38:14.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87415.ko 2023-07-12T01:38:14.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_oldpiix.ko 2023-07-12T01:38:14.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_opti.ko 2023-07-12T01:38:14.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_optidma.ko 2023-07-12T01:38:14.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pcmcia.ko 2023-07-12T01:38:14.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-12T01:38:14.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-12T01:38:14.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_piccolo.ko 2023-07-12T01:38:14.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rdc.ko 2023-07-12T01:38:14.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sch.ko 2023-07-12T01:38:14.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_serverworks.ko 2023-07-12T01:38:14.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sil680.ko 2023-07-12T01:38:14.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sis.ko 2023-07-12T01:38:14.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sl82c105.ko 2023-07-12T01:38:14.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_triflex.ko 2023-07-12T01:38:14.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_via.ko 2023-07-12T01:38:14.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pdc_adma.ko 2023-07-12T01:38:14.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_inic162x.ko 2023-07-12T01:38:14.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_mv.ko 2023-07-12T01:38:14.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_nv.ko 2023-07-12T01:38:14.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_promise.ko 2023-07-12T01:38:14.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_qstor.ko 2023-07-12T01:38:14.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil.ko 2023-07-12T01:38:14.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil24.ko 2023-07-12T01:38:14.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sis.ko 2023-07-12T01:38:14.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_svw.ko 2023-07-12T01:38:14.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sx4.ko 2023-07-12T01:38:14.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_uli.ko 2023-07-12T01:38:14.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_via.ko 2023-07-12T01:38:14.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_vsc.ko 2023-07-12T01:38:14.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay 2023-07-12T01:38:14.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ks0108.ko 2023-07-12T01:38:14.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base 2023-07-12T01:38:14.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap 2023-07-12T01:38:14.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-12T01:38:14.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma 2023-07-12T01:38:14.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/bcma.ko 2023-07-12T01:38:14.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block 2023-07-12T01:38:14.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe 2023-07-12T01:38:14.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/aoe.ko 2023-07-12T01:38:14.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/brd.ko 2023-07-12T01:38:14.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd 2023-07-12T01:38:14.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/drbd.ko 2023-07-12T01:38:14.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/floppy.ko 2023-07-12T01:38:14.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/loop.ko 2023-07-12T01:38:14.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx 2023-07-12T01:38:14.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-12T01:38:14.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/nbd.ko 2023-07-12T01:38:14.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk 2023-07-12T01:38:14.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/null_blk.ko 2023-07-12T01:38:14.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/pktcdvd.ko 2023-07-12T01:38:14.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/rbd.ko 2023-07-12T01:38:14.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/virtio_blk.ko 2023-07-12T01:38:14.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback 2023-07-12T01:38:14.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-12T01:38:14.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkfront.ko 2023-07-12T01:38:14.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram 2023-07-12T01:38:14.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/zram.ko 2023-07-12T01:38:14.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char 2023-07-12T01:38:14.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hangcheck-timer.ko 2023-07-12T01:38:14.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random 2023-07-12T01:38:14.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-12T01:38:14.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-12T01:38:14.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-12T01:38:14.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/via-rng.ko 2023-07-12T01:38:14.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-12T01:38:14.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi 2023-07-12T01:38:14.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-12T01:38:14.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-12T01:38:14.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-12T01:38:14.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-12T01:38:14.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-12T01:38:14.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-12T01:38:14.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/lp.ko 2023-07-12T01:38:14.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave 2023-07-12T01:38:14.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/mwave.ko 2023-07-12T01:38:14.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ppdev.ko 2023-07-12T01:38:14.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tlclk.ko 2023-07-12T01:38:14.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm 2023-07-12T01:38:14.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm.ko 2023-07-12T01:38:14.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-12T01:38:14.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-12T01:38:14.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-12T01:38:14.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-12T01:38:14.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-12T01:38:14.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/uv_mmtimer.ko 2023-07-12T01:38:14.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/virtio_console.ko 2023-07-12T01:38:14.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq 2023-07-12T01:38:14.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-12T01:38:14.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-12T01:38:14.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-12T01:38:14.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-12T01:38:14.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-12T01:38:14.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-12T01:38:14.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto 2023-07-12T01:38:14.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp 2023-07-12T01:38:14.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-12T01:38:14.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp.ko 2023-07-12T01:38:14.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel 2023-07-12T01:38:14.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat 2023-07-12T01:38:14.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common 2023-07-12T01:38:14.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-12T01:38:14.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-12T01:38:14.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-12T01:38:14.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-aes.ko 2023-07-12T01:38:14.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-sha.ko 2023-07-12T01:38:14.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio 2023-07-12T01:38:14.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-12T01:38:14.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca 2023-07-12T01:38:14.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/dca.ko 2023-07-12T01:38:14.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq 2023-07-12T01:38:14.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-12T01:38:14.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma 2023-07-12T01:38:14.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw 2023-07-12T01:38:14.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-12T01:38:14.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat 2023-07-12T01:38:14.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-12T01:38:14.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac 2023-07-12T01:38:14.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/amd64_edac.ko 2023-07-12T01:38:14.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/e752x_edac.ko 2023-07-12T01:38:14.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/edac_mce_amd.ko 2023-07-12T01:38:14.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3000_edac.ko 2023-07-12T01:38:14.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3200_edac.ko 2023-07-12T01:38:14.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5100_edac.ko 2023-07-12T01:38:14.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5400_edac.ko 2023-07-12T01:38:14.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7300_edac.ko 2023-07-12T01:38:14.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7core_edac.ko 2023-07-12T01:38:14.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i82975x_edac.ko 2023-07-12T01:38:14.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ie31200_edac.ko 2023-07-12T01:38:14.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/sb_edac.ko 2023-07-12T01:38:14.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/x38_edac.ko 2023-07-12T01:38:14.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware 2023-07-12T01:38:14.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/edd.ko 2023-07-12T01:38:14.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-12T01:38:14.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio 2023-07-12T01:38:14.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ich.ko 2023-07-12T01:38:14.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-12T01:38:14.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid 2023-07-12T01:38:14.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-appleir.ko 2023-07-12T01:38:14.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-aureal.ko 2023-07-12T01:38:14.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-axff.ko 2023-07-12T01:38:14.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-dr.ko 2023-07-12T01:38:14.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elecom.ko 2023-07-12T01:38:14.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elo.ko 2023-07-12T01:38:14.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-emsff.ko 2023-07-12T01:38:14.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gaff.ko 2023-07-12T01:38:14.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gt683r.ko 2023-07-12T01:38:14.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gyration.ko 2023-07-12T01:38:14.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-12T01:38:14.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-12T01:38:14.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtekff.ko 2023-07-12T01:38:14.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-hyperv.ko 2023-07-12T01:38:14.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-icade.ko 2023-07-12T01:38:14.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-keytouch.ko 2023-07-12T01:38:14.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kye.ko 2023-07-12T01:38:14.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lcpower.ko 2023-07-12T01:38:14.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-led.ko 2023-07-12T01:38:14.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lenovo.ko 2023-07-12T01:38:14.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-12T01:38:14.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-12T01:38:14.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-multitouch.ko 2023-07-12T01:38:14.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ortek.ko 2023-07-12T01:38:14.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-penmount.ko 2023-07-12T01:38:14.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-petalynx.ko 2023-07-12T01:38:14.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-picolcd.ko 2023-07-12T01:38:14.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-pl.ko 2023-07-12T01:38:14.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-plantronics.ko 2023-07-12T01:38:14.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-primax.ko 2023-07-12T01:38:14.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-rmi.ko 2023-07-12T01:38:14.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-12T01:38:14.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-common.ko 2023-07-12T01:38:14.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-12T01:38:14.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-12T01:38:14.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-12T01:38:14.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-12T01:38:14.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-12T01:38:14.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-12T01:38:14.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-12T01:38:14.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-12T01:38:14.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-12T01:38:14.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat.ko 2023-07-12T01:38:14.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-saitek.ko 2023-07-12T01:38:14.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-samsung.ko 2023-07-12T01:38:14.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-12T01:38:14.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sjoy.ko 2023-07-12T01:38:14.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sony.ko 2023-07-12T01:38:14.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-speedlink.ko 2023-07-12T01:38:14.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-steelseries.ko 2023-07-12T01:38:14.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sunplus.ko 2023-07-12T01:38:14.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-12T01:38:14.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tivo.ko 2023-07-12T01:38:14.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tmff.ko 2023-07-12T01:38:14.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-topseed.ko 2023-07-12T01:38:14.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-twinhan.ko 2023-07-12T01:38:14.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-uclogic.ko 2023-07-12T01:38:14.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-waltop.ko 2023-07-12T01:38:14.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-wiimote.ko 2023-07-12T01:38:14.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-xinmo.ko 2023-07-12T01:38:14.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zpff.ko 2023-07-12T01:38:14.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zydacron.ko 2023-07-12T01:38:14.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/uhid.ko 2023-07-12T01:38:14.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/wacom.ko 2023-07-12T01:38:14.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv 2023-07-12T01:38:14.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_balloon.ko 2023-07-12T01:38:14.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_utils.ko 2023-07-12T01:38:14.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_vmbus.ko 2023-07-12T01:38:14.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon 2023-07-12T01:38:14.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru.ko 2023-07-12T01:38:14.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru3.ko 2023-07-12T01:38:14.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-12T01:38:14.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7414.ko 2023-07-12T01:38:14.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7418.ko 2023-07-12T01:38:14.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adc128d818.ko 2023-07-12T01:38:14.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1025.ko 2023-07-12T01:38:14.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1026.ko 2023-07-12T01:38:14.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1029.ko 2023-07-12T01:38:14.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1031.ko 2023-07-12T01:38:14.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm9240.ko 2023-07-12T01:38:14.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ads7828.ko 2023-07-12T01:38:14.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7410.ko 2023-07-12T01:38:14.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7411.ko 2023-07-12T01:38:14.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7462.ko 2023-07-12T01:38:14.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7470.ko 2023-07-12T01:38:14.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7475.ko 2023-07-12T01:38:14.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7x10.ko 2023-07-12T01:38:14.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/amc6821.ko 2023-07-12T01:38:14.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/applesmc.ko 2023-07-12T01:38:14.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asb100.ko 2023-07-12T01:38:14.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asc7621.ko 2023-07-12T01:38:14.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-12T01:38:14.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/atxp1.ko 2023-07-12T01:38:14.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/coretemp.ko 2023-07-12T01:38:14.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-12T01:38:14.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dme1737.ko 2023-07-12T01:38:14.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds1621.ko 2023-07-12T01:38:14.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds620.ko 2023-07-12T01:38:14.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc1403.ko 2023-07-12T01:38:14.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc6w201.ko 2023-07-12T01:38:14.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71805f.ko 2023-07-12T01:38:14.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71882fg.ko 2023-07-12T01:38:14.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f75375s.ko 2023-07-12T01:38:14.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fam15h_power.ko 2023-07-12T01:38:14.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fschmd.ko 2023-07-12T01:38:14.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g760a.ko 2023-07-12T01:38:14.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g762.ko 2023-07-12T01:38:14.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl518sm.ko 2023-07-12T01:38:14.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl520sm.ko 2023-07-12T01:38:14.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-12T01:38:14.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5500_temp.ko 2023-07-12T01:38:14.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5k_amb.ko 2023-07-12T01:38:14.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmaem.ko 2023-07-12T01:38:14.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmpex.ko 2023-07-12T01:38:14.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina209.ko 2023-07-12T01:38:14.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina2xx.ko 2023-07-12T01:38:14.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/it87.ko 2023-07-12T01:38:14.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k10temp.ko 2023-07-12T01:38:14.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k8temp.ko 2023-07-12T01:38:14.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lineage-pem.ko 2023-07-12T01:38:14.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm63.ko 2023-07-12T01:38:14.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm73.ko 2023-07-12T01:38:14.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm75.ko 2023-07-12T01:38:14.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm77.ko 2023-07-12T01:38:14.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm78.ko 2023-07-12T01:38:14.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm80.ko 2023-07-12T01:38:14.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm83.ko 2023-07-12T01:38:14.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm85.ko 2023-07-12T01:38:14.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm87.ko 2023-07-12T01:38:14.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm90.ko 2023-07-12T01:38:14.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm92.ko 2023-07-12T01:38:14.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm93.ko 2023-07-12T01:38:14.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95234.ko 2023-07-12T01:38:14.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95241.ko 2023-07-12T01:38:14.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95245.ko 2023-07-12T01:38:14.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc2945.ko 2023-07-12T01:38:14.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4151.ko 2023-07-12T01:38:14.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4215.ko 2023-07-12T01:38:14.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4222.ko 2023-07-12T01:38:14.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4245.ko 2023-07-12T01:38:14.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4260.ko 2023-07-12T01:38:14.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4261.ko 2023-07-12T01:38:14.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max16065.ko 2023-07-12T01:38:14.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1619.ko 2023-07-12T01:38:14.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1668.ko 2023-07-12T01:38:14.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max197.ko 2023-07-12T01:38:14.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6639.ko 2023-07-12T01:38:14.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6650.ko 2023-07-12T01:38:14.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6697.ko 2023-07-12T01:38:14.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mcp3021.ko 2023-07-12T01:38:14.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6683.ko 2023-07-12T01:38:14.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775-core.ko 2023-07-12T01:38:14.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775.ko 2023-07-12T01:38:14.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct7802.ko 2023-07-12T01:38:14.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87360.ko 2023-07-12T01:38:14.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87427.ko 2023-07-12T01:38:14.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pcf8591.ko 2023-07-12T01:38:14.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus 2023-07-12T01:38:14.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-12T01:38:14.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-12T01:38:14.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-12T01:38:14.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-12T01:38:14.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-12T01:38:14.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-12T01:38:14.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-12T01:38:14.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-12T01:38:14.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-12T01:38:14.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-12T01:38:14.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-12T01:38:14.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-12T01:38:14.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/powr1220.ko 2023-07-12T01:38:14.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5627.ko 2023-07-12T01:38:14.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5636.ko 2023-07-12T01:38:14.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-12T01:38:14.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht15.ko 2023-07-12T01:38:14.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht21.ko 2023-07-12T01:38:14.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/shtc1.ko 2023-07-12T01:38:14.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sis5595.ko 2023-07-12T01:38:14.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47b397.ko 2023-07-12T01:38:14.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m1.ko 2023-07-12T01:38:14.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m192.ko 2023-07-12T01:38:14.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/thmc50.ko 2023-07-12T01:38:14.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp102.ko 2023-07-12T01:38:14.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp103.ko 2023-07-12T01:38:14.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp401.ko 2023-07-12T01:38:14.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp421.ko 2023-07-12T01:38:14.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via-cputemp.ko 2023-07-12T01:38:14.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via686a.ko 2023-07-12T01:38:14.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt1211.ko 2023-07-12T01:38:14.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt8231.ko 2023-07-12T01:38:14.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627ehf.ko 2023-07-12T01:38:14.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627hf.ko 2023-07-12T01:38:14.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83781d.ko 2023-07-12T01:38:14.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83791d.ko 2023-07-12T01:38:14.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83792d.ko 2023-07-12T01:38:14.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83793.ko 2023-07-12T01:38:14.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83795.ko 2023-07-12T01:38:14.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l785ts.ko 2023-07-12T01:38:14.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l786ng.ko 2023-07-12T01:38:14.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c 2023-07-12T01:38:14.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos 2023-07-12T01:38:14.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-12T01:38:14.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-12T01:38:14.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses 2023-07-12T01:38:14.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-12T01:38:14.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-12T01:38:14.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-12T01:38:14.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-12T01:38:14.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-12T01:38:14.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-12T01:38:14.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-12T01:38:14.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-12T01:38:14.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-12T01:38:14.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-12T01:38:14.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-12T01:38:14.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-12T01:38:14.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-12T01:38:14.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-12T01:38:14.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-12T01:38:14.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-12T01:38:14.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-12T01:38:14.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-12T01:38:14.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-12T01:38:14.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-12T01:38:14.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-12T01:38:14.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-12T01:38:14.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-12T01:38:14.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-dev.ko 2023-07-12T01:38:14.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-mux.ko 2023-07-12T01:38:14.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-12T01:38:14.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-smbus.ko 2023-07-12T01:38:14.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-stub.ko 2023-07-12T01:38:14.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband 2023-07-12T01:38:14.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core 2023-07-12T01:38:14.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-12T01:38:14.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_core.ko 2023-07-12T01:38:14.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-12T01:38:14.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-12T01:38:14.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-12T01:38:14.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-12T01:38:14.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-12T01:38:14.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw 2023-07-12T01:38:14.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4 2023-07-12T01:38:14.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-12T01:38:14.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4 2023-07-12T01:38:14.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-12T01:38:14.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5 2023-07-12T01:38:14.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-12T01:38:14.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca 2023-07-12T01:38:14.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-12T01:38:14.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp 2023-07-12T01:38:14.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib 2023-07-12T01:38:14.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-12T01:38:14.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser 2023-07-12T01:38:14.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-12T01:38:14.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert 2023-07-12T01:38:14.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-12T01:38:14.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp 2023-07-12T01:38:14.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-12T01:38:14.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt 2023-07-12T01:38:14.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-12T01:38:14.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input 2023-07-12T01:38:14.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport 2023-07-12T01:38:14.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-12T01:38:14.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-12T01:38:14.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/gameport.ko 2023-07-12T01:38:14.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/lightning.ko 2023-07-12T01:38:14.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ns558.ko 2023-07-12T01:38:14.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/joydev.ko 2023-07-12T01:38:14.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard 2023-07-12T01:38:14.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-12T01:38:14.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse 2023-07-12T01:38:14.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/appletouch.ko 2023-07-12T01:38:14.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/bcm5974.ko 2023-07-12T01:38:14.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/cyapatp.ko 2023-07-12T01:38:14.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-12T01:38:14.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/sermouse.ko 2023-07-12T01:38:14.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-12T01:38:14.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-12T01:38:14.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-12T01:38:14.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4 2023-07-12T01:38:14.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-12T01:38:14.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio 2023-07-12T01:38:14.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/altera_ps2.ko 2023-07-12T01:38:14.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/arc_ps2.ko 2023-07-12T01:38:14.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-12T01:38:14.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serio_raw.ko 2023-07-12T01:38:14.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/sparse-keymap.ko 2023-07-12T01:38:14.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu 2023-07-12T01:38:14.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd 2023-07-12T01:38:14.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-12T01:38:14.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds 2023-07-12T01:38:14.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-blinkm.ko 2023-07-12T01:38:14.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3530.ko 2023-07-12T01:38:14.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp3944.ko 2023-07-12T01:38:14.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-ss4200.ko 2023-07-12T01:38:14.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger 2023-07-12T01:38:14.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-12T01:38:14.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-12T01:38:14.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-12T01:38:14.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-12T01:38:14.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-12T01:38:14.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-12T01:38:14.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-12T01:38:14.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-12T01:38:14.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md 2023-07-12T01:38:14.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache 2023-07-12T01:38:14.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/bcache.ko 2023-07-12T01:38:14.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bio-prison.ko 2023-07-12T01:38:14.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache-smq.ko 2023-07-12T01:38:14.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache.ko 2023-07-12T01:38:14.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-crypt.ko 2023-07-12T01:38:14.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-delay.ko 2023-07-12T01:38:14.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-flakey.ko 2023-07-12T01:38:14.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log-userspace.ko 2023-07-12T01:38:14.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-multipath.ko 2023-07-12T01:38:14.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-queue-length.ko 2023-07-12T01:38:14.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-raid.ko 2023-07-12T01:38:14.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-round-robin.ko 2023-07-12T01:38:14.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-service-time.ko 2023-07-12T01:38:14.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-switch.ko 2023-07-12T01:38:14.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-thin-pool.ko 2023-07-12T01:38:14.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-verity.ko 2023-07-12T01:38:14.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/faulty.ko 2023-07-12T01:38:14.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/linear.ko 2023-07-12T01:38:14.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/multipath.ko 2023-07-12T01:38:14.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data 2023-07-12T01:38:14.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-12T01:38:14.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid0.ko 2023-07-12T01:38:14.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid1.ko 2023-07-12T01:38:14.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid10.ko 2023-07-12T01:38:14.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid456.ko 2023-07-12T01:38:14.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message 2023-07-12T01:38:14.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion 2023-07-12T01:38:14.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptbase.ko 2023-07-12T01:38:14.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptctl.ko 2023-07-12T01:38:14.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptfc.ko 2023-07-12T01:38:14.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptlan.ko 2023-07-12T01:38:14.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptsas.ko 2023-07-12T01:38:14.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptscsih.ko 2023-07-12T01:38:14.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptspi.ko 2023-07-12T01:38:14.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd 2023-07-12T01:38:14.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_ich.ko 2023-07-12T01:38:14.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_sch.ko 2023-07-12T01:38:14.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mfd-core.ko 2023-07-12T01:38:14.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/sm501.ko 2023-07-12T01:38:14.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/viperboard.ko 2023-07-12T01:38:14.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/vx855.ko 2023-07-12T01:38:14.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wl1273-core.ko 2023-07-12T01:38:14.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc 2023-07-12T01:38:14.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl 2023-07-12T01:38:14.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-12T01:38:14.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds9802als.ko 2023-07-12T01:38:14.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds990x.ko 2023-07-12T01:38:14.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/bh1770glc.ko 2023-07-12T01:38:14.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710 2023-07-12T01:38:14.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/cb710.ko 2023-07-12T01:38:14.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom 2023-07-12T01:38:14.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/at24.ko 2023-07-12T01:38:14.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-12T01:38:14.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-12T01:38:14.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/max6875.ko 2023-07-12T01:38:14.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/enclosure.ko 2023-07-12T01:38:14.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hpilo.ko 2023-07-12T01:38:14.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29003.ko 2023-07-12T01:38:14.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29020.ko 2023-07-12T01:38:14.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d 2023-07-12T01:38:14.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-12T01:38:14.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-12T01:38:14.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei 2023-07-12T01:38:14.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-me.ko 2023-07-12T01:38:14.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-txe.ko 2023-07-12T01:38:14.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei.ko 2023-07-12T01:38:14.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru 2023-07-12T01:38:14.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-12T01:38:14.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp 2023-07-12T01:38:14.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-12T01:38:14.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-12T01:38:14.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-12T01:38:14.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_7xx1.ko 2023-07-12T01:38:14.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_core.ko 2023-07-12T01:38:14.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tsl2550.ko 2023-07-12T01:38:14.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_balloon.ko 2023-07-12T01:38:14.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci 2023-07-12T01:38:14.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-12T01:38:14.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net 2023-07-12T01:38:14.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding 2023-07-12T01:38:14.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/bonding.ko 2023-07-12T01:38:14.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa 2023-07-12T01:38:14.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53 2023-07-12T01:38:14.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-12T01:38:14.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-12T01:38:14.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-12T01:38:14.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx 2023-07-12T01:38:14.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-12T01:38:14.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dummy.ko 2023-07-12T01:38:14.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/eql.ko 2023-07-12T01:38:14.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet 2023-07-12T01:38:14.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com 2023-07-12T01:38:14.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-12T01:38:14.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-12T01:38:14.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-12T01:38:14.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-12T01:38:14.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390 2023-07-12T01:38:14.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-12T01:38:14.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-12T01:38:14.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-12T01:38:14.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-12T01:38:14.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec 2023-07-12T01:38:14.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-12T01:38:14.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere 2023-07-12T01:38:14.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-12T01:38:14.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon 2023-07-12T01:38:14.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-12T01:38:14.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera 2023-07-12T01:38:14.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-12T01:38:14.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd 2023-07-12T01:38:14.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-12T01:38:14.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-12T01:38:14.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-12T01:38:14.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros 2023-07-12T01:38:14.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx 2023-07-12T01:38:14.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-12T01:38:14.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-12T01:38:14.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-12T01:38:14.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-12T01:38:14.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-12T01:38:14.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx 2023-07-12T01:38:14.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-12T01:38:14.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-12T01:38:14.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom 2023-07-12T01:38:14.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-12T01:38:14.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-12T01:38:14.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-12T01:38:14.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-12T01:38:14.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-12T01:38:14.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet 2023-07-12T01:38:14.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-12T01:38:14.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-12T01:38:14.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade 2023-07-12T01:38:14.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna 2023-07-12T01:38:14.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-12T01:38:14.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio 2023-07-12T01:38:14.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-12T01:38:14.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-12T01:38:14.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-12T01:38:14.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-12T01:38:14.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-12T01:38:14.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-12T01:38:14.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-12T01:38:14.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-12T01:38:14.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-12T01:38:14.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-12T01:38:14.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco 2023-07-12T01:38:14.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic 2023-07-12T01:38:14.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-12T01:38:14.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec 2023-07-12T01:38:14.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip 2023-07-12T01:38:14.805 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-12T01:38:14.805 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-12T01:38:14.805 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-12T01:38:14.805 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-12T01:38:14.805 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-12T01:38:14.805 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-12T01:38:14.805 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink 2023-07-12T01:38:14.806 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-12T01:38:14.806 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-12T01:38:14.806 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dnet.ko 2023-07-12T01:38:14.806 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex 2023-07-12T01:38:14.807 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet 2023-07-12T01:38:14.807 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-12T01:38:14.807 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ethoc.ko 2023-07-12T01:38:14.807 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fealnx.ko 2023-07-12T01:38:14.807 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel 2023-07-12T01:38:14.807 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-12T01:38:14.807 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000 2023-07-12T01:38:14.808 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-12T01:38:14.808 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e 2023-07-12T01:38:14.808 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-12T01:38:14.808 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k 2023-07-12T01:38:14.808 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-12T01:38:14.808 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e 2023-07-12T01:38:14.808 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-12T01:38:14.809 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf 2023-07-12T01:38:14.809 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-12T01:38:14.809 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb 2023-07-12T01:38:14.809 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-12T01:38:14.809 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf 2023-07-12T01:38:14.809 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-12T01:38:14.809 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-12T01:38:14.809 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-12T01:38:14.810 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-12T01:38:14.810 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-12T01:38:14.810 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/jme.ko 2023-07-12T01:38:14.810 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell 2023-07-12T01:38:14.810 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-12T01:38:14.810 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-12T01:38:14.810 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-12T01:38:14.811 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox 2023-07-12T01:38:14.811 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-12T01:38:14.811 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-12T01:38:14.811 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-12T01:38:14.811 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-12T01:38:14.811 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-12T01:38:14.811 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-12T01:38:14.812 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel 2023-07-12T01:38:14.812 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-12T01:38:14.812 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom 2023-07-12T01:38:14.812 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-12T01:38:14.812 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-12T01:38:14.812 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi 2023-07-12T01:38:14.812 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-12T01:38:14.812 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-12T01:38:14.813 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion 2023-07-12T01:38:14.813 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-12T01:38:14.813 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia 2023-07-12T01:38:14.813 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-12T01:38:14.813 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines 2023-07-12T01:38:14.813 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-12T01:38:14.813 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-12T01:38:14.814 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic 2023-07-12T01:38:14.814 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-12T01:38:14.814 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-12T01:38:14.814 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-12T01:38:14.814 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-12T01:38:14.814 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-12T01:38:14.814 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc 2023-07-12T01:38:14.814 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-12T01:38:14.815 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek 2023-07-12T01:38:14.815 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-12T01:38:14.815 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-12T01:38:14.815 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-12T01:38:14.815 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-12T01:38:14.815 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker 2023-07-12T01:38:14.815 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-12T01:38:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc 2023-07-12T01:38:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-12T01:38:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan 2023-07-12T01:38:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-12T01:38:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis 2023-07-12T01:38:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-12T01:38:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-12T01:38:14.817 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc 2023-07-12T01:38:14.817 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-12T01:38:14.817 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-12T01:38:14.817 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-12T01:38:14.817 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-12T01:38:14.817 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro 2023-07-12T01:38:14.817 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-12T01:38:14.818 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-12T01:38:14.818 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-12T01:38:14.818 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun 2023-07-12T01:38:14.818 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-12T01:38:14.818 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-12T01:38:14.818 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-12T01:38:14.818 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-12T01:38:14.819 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti 2023-07-12T01:38:14.819 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-12T01:38:14.819 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti 2023-07-12T01:38:14.819 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-12T01:38:14.819 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via 2023-07-12T01:38:14.819 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-12T01:38:14.819 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-12T01:38:14.819 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet 2023-07-12T01:38:14.820 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-12T01:38:14.820 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-12T01:38:14.820 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom 2023-07-12T01:38:14.820 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-12T01:38:14.820 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/geneve.ko 2023-07-12T01:38:14.820 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv 2023-07-12T01:38:14.820 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-12T01:38:14.821 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154 2023-07-12T01:38:14.821 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-12T01:38:14.821 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ifb.ko 2023-07-12T01:38:14.821 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan 2023-07-12T01:38:14.821 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-12T01:38:14.821 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvlan.ko 2023-07-12T01:38:14.821 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvtap.ko 2023-07-12T01:38:14.822 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio 2023-07-12T01:38:14.822 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio.ko 2023-07-12T01:38:14.822 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-12T01:38:14.822 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-12T01:38:14.822 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mii.ko 2023-07-12T01:38:14.822 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/net_failover.ko 2023-07-12T01:38:14.822 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/netconsole.ko 2023-07-12T01:38:14.823 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/nlmon.ko 2023-07-12T01:38:14.823 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs 2023-07-12T01:38:14.823 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-07-12T01:38:14.823 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-12T01:38:14.823 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy 2023-07-12T01:38:14.823 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/amd.ko 2023-07-12T01:38:14.823 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-12T01:38:14.824 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-12T01:38:14.824 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-12T01:38:14.824 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm87xx.ko 2023-07-12T01:38:14.824 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/broadcom.ko 2023-07-12T01:38:14.824 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/cicada.ko 2023-07-12T01:38:14.824 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/davicom.ko 2023-07-12T01:38:14.824 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/dp83640.ko 2023-07-12T01:38:14.824 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/et1011c.ko 2023-07-12T01:38:14.825 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/icplus.ko 2023-07-12T01:38:14.825 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/lxt.ko 2023-07-12T01:38:14.825 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/marvell.ko 2023-07-12T01:38:14.825 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/micrel.ko 2023-07-12T01:38:14.825 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/national.ko 2023-07-12T01:38:14.825 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/phylink.ko 2023-07-12T01:38:14.825 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/qsemi.ko 2023-07-12T01:38:14.826 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/realtek.ko 2023-07-12T01:38:14.826 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/smsc.ko 2023-07-12T01:38:14.826 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ste10Xp.ko 2023-07-12T01:38:14.826 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/vitesse.ko 2023-07-12T01:38:14.826 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp 2023-07-12T01:38:14.826 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-12T01:38:14.826 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_async.ko 2023-07-12T01:38:14.826 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-12T01:38:14.827 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-12T01:38:14.827 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-12T01:38:14.827 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-12T01:38:14.827 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppoe.ko 2023-07-12T01:38:14.827 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppox.ko 2023-07-12T01:38:14.827 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pptp.ko 2023-07-12T01:38:14.827 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip 2023-07-12T01:38:14.828 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slhc.ko 2023-07-12T01:38:14.828 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slip.ko 2023-07-12T01:38:14.828 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sungem_phy.ko 2023-07-12T01:38:14.828 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tap.ko 2023-07-12T01:38:14.828 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team 2023-07-12T01:38:14.828 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team.ko 2023-07-12T01:38:14.828 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-12T01:38:14.828 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-12T01:38:14.829 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-12T01:38:14.829 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_random.ko 2023-07-12T01:38:14.829 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-12T01:38:14.829 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tun.ko 2023-07-12T01:38:14.829 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/veth.ko 2023-07-12T01:38:14.829 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/virtio_net.ko 2023-07-12T01:38:14.829 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3 2023-07-12T01:38:14.829 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-12T01:38:14.830 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan 2023-07-12T01:38:14.830 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/vxlan.ko 2023-07-12T01:38:14.830 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback 2023-07-12T01:38:14.830 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-12T01:38:14.830 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netfront.ko 2023-07-12T01:38:14.830 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb 2023-07-12T01:38:14.830 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ntb.ko 2023-07-12T01:38:14.831 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme 2023-07-12T01:38:14.831 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host 2023-07-12T01:38:14.831 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme-core.ko 2023-07-12T01:38:14.831 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme.ko 2023-07-12T01:38:14.831 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport 2023-07-12T01:38:14.831 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport.ko 2023-07-12T01:38:14.831 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_cs.ko 2023-07-12T01:38:14.831 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_pc.ko 2023-07-12T01:38:14.832 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_serial.ko 2023-07-12T01:38:14.832 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci 2023-07-12T01:38:14.832 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug 2023-07-12T01:38:14.832 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-12T01:38:14.832 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie 2023-07-12T01:38:14.832 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-12T01:38:14.832 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/xen-pcifront.ko 2023-07-12T01:38:14.833 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia 2023-07-12T01:38:14.833 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/i82092.ko 2023-07-12T01:38:14.833 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pd6729.ko 2023-07-12T01:38:14.833 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-12T01:38:14.833 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl 2023-07-12T01:38:14.833 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel 2023-07-12T01:38:14.833 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-12T01:38:14.834 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform 2023-07-12T01:38:14.834 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86 2023-07-12T01:38:14.834 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-12T01:38:14.834 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acerhdf.ko 2023-07-12T01:38:14.834 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-12T01:38:14.834 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-12T01:38:14.834 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-12T01:38:14.834 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-12T01:38:14.835 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-12T01:38:14.835 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-12T01:38:14.835 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-12T01:38:14.835 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-12T01:38:14.835 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-12T01:38:14.835 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/hdaps.ko 2023-07-12T01:38:14.835 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel 2023-07-12T01:38:14.835 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-12T01:38:14.836 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel_ips.ko 2023-07-12T01:38:14.836 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-12T01:38:14.836 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-12T01:38:14.836 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-12T01:38:14.836 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-12T01:38:14.836 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-12T01:38:14.836 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-12T01:38:14.837 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-12T01:38:14.837 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-12T01:38:14.837 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-12T01:38:14.837 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi.ko 2023-07-12T01:38:14.837 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap 2023-07-12T01:38:14.837 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-12T01:38:14.837 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-12T01:38:14.838 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps 2023-07-12T01:38:14.838 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients 2023-07-12T01:38:14.838 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-12T01:38:14.838 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-12T01:38:14.838 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps_parport.ko 2023-07-12T01:38:14.838 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/pps_core.ko 2023-07-12T01:38:14.838 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp 2023-07-12T01:38:14.839 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp.ko 2023-07-12T01:38:14.839 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp_kvm.ko 2023-07-12T01:38:14.839 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc 2023-07-12T01:38:14.839 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-12T01:38:14.839 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-12T01:38:14.839 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-12T01:38:14.839 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-12T01:38:14.839 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-12T01:38:14.840 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-12T01:38:14.840 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-12T01:38:14.840 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-12T01:38:14.840 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-12T01:38:14.840 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-12T01:38:14.840 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-12T01:38:14.840 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-em3027.ko 2023-07-12T01:38:14.841 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-12T01:38:14.841 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-12T01:38:14.841 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-12T01:38:14.841 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-12T01:38:14.841 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-12T01:38:14.841 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-12T01:38:14.841 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max6900.ko 2023-07-12T01:38:14.842 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-12T01:38:14.842 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-12T01:38:14.842 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-12T01:38:14.842 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-12T01:38:14.842 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-12T01:38:14.842 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-12T01:38:14.842 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-12T01:38:14.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-12T01:38:14.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-12T01:38:14.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-12T01:38:14.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-12T01:38:14.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-12T01:38:14.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-x1205.ko 2023-07-12T01:38:14.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi 2023-07-12T01:38:14.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-9xxx.ko 2023-07-12T01:38:14.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-sas.ko 2023-07-12T01:38:14.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-xxxx.ko 2023-07-12T01:38:14.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/BusLogic.ko 2023-07-12T01:38:14.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/a100u2w.ko 2023-07-12T01:38:14.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid 2023-07-12T01:38:14.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-12T01:38:14.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/advansys.ko 2023-07-12T01:38:14.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx 2023-07-12T01:38:14.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-12T01:38:14.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-12T01:38:14.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/am53c974.ko 2023-07-12T01:38:14.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr 2023-07-12T01:38:14.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-12T01:38:14.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/atp870u.ko 2023-07-12T01:38:14.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi 2023-07-12T01:38:14.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-12T01:38:14.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa 2023-07-12T01:38:14.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/bfa.ko 2023-07-12T01:38:14.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc 2023-07-12T01:38:14.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-12T01:38:14.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i 2023-07-12T01:38:14.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-12T01:38:14.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ch.ko 2023-07-12T01:38:14.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor 2023-07-12T01:38:14.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-12T01:38:14.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi 2023-07-12T01:38:14.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-12T01:38:14.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-12T01:38:14.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-12T01:38:14.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-12T01:38:14.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-12T01:38:14.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dc395x.ko 2023-07-12T01:38:14.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler 2023-07-12T01:38:14.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-12T01:38:14.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-12T01:38:14.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-12T01:38:14.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-12T01:38:14.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dmx3191d.ko 2023-07-12T01:38:14.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r 2023-07-12T01:38:14.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-12T01:38:14.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esp_scsi.ko 2023-07-12T01:38:14.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe 2023-07-12T01:38:14.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-12T01:38:14.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-12T01:38:14.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic 2023-07-12T01:38:14.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/fnic.ko 2023-07-12T01:38:14.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hpsa.ko 2023-07-12T01:38:14.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hptiop.ko 2023-07-12T01:38:14.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hv_storvsc.ko 2023-07-12T01:38:14.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/initio.ko 2023-07-12T01:38:14.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ipr.ko 2023-07-12T01:38:14.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ips.ko 2023-07-12T01:38:14.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci 2023-07-12T01:38:14.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/isci.ko 2023-07-12T01:38:14.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-12T01:38:14.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-12T01:38:14.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc 2023-07-12T01:38:14.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/libfc.ko 2023-07-12T01:38:14.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi.ko 2023-07-12T01:38:14.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-12T01:38:14.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas 2023-07-12T01:38:14.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/libsas.ko 2023-07-12T01:38:14.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc 2023-07-12T01:38:14.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-12T01:38:14.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid 2023-07-12T01:38:14.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid.ko 2023-07-12T01:38:14.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-12T01:38:14.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-12T01:38:14.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-12T01:38:14.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas 2023-07-12T01:38:14.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-12T01:38:14.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas 2023-07-12T01:38:14.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-12T01:38:14.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvumi.ko 2023-07-12T01:38:14.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001 2023-07-12T01:38:14.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-12T01:38:14.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pmcraid.ko 2023-07-12T01:38:14.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla1280.ko 2023-07-12T01:38:14.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx 2023-07-12T01:38:14.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-12T01:38:14.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-12T01:38:14.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx 2023-07-12T01:38:14.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-12T01:38:14.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/raid_class.ko 2023-07-12T01:38:14.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_debug.ko 2023-07-12T01:38:14.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-12T01:38:14.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-12T01:38:14.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-12T01:38:14.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-12T01:38:14.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-12T01:38:14.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ses.ko 2023-07-12T01:38:14.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/st.ko 2023-07-12T01:38:14.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/stex.ko 2023-07-12T01:38:14.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2 2023-07-12T01:38:14.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-12T01:38:14.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/virtio_scsi.ko 2023-07-12T01:38:14.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-12T01:38:14.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/wd719x.ko 2023-07-12T01:38:14.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb 2023-07-12T01:38:14.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ssb.ko 2023-07-12T01:38:14.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target 2023-07-12T01:38:14.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi 2023-07-12T01:38:14.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-12T01:38:14.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback 2023-07-12T01:38:14.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-12T01:38:14.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_file.ko 2023-07-12T01:38:14.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_iblock.ko 2023-07-12T01:38:14.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_mod.ko 2023-07-12T01:38:14.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_pscsi.ko 2023-07-12T01:38:14.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_user.ko 2023-07-12T01:38:14.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc 2023-07-12T01:38:14.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-12T01:38:14.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal 2023-07-12T01:38:14.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel 2023-07-12T01:38:14.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal 2023-07-12T01:38:14.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-12T01:38:14.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-12T01:38:14.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-12T01:38:14.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-12T01:38:14.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-12T01:38:14.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-12T01:38:14.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-12T01:38:14.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-12T01:38:14.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-12T01:38:14.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-12T01:38:14.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-12T01:38:14.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-12T01:38:14.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-12T01:38:14.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-12T01:38:14.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-12T01:38:14.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty 2023-07-12T01:38:14.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless 2023-07-12T01:38:14.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-12T01:38:14.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_gsm.ko 2023-07-12T01:38:14.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_hdlc.ko 2023-07-12T01:38:14.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/nozomi.ko 2023-07-12T01:38:14.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial 2023-07-12T01:38:14.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250 2023-07-12T01:38:14.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-12T01:38:14.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/arc_uart.ko 2023-07-12T01:38:14.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm 2023-07-12T01:38:14.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-12T01:38:14.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/synclink_gt.ko 2023-07-12T01:38:14.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs 2023-07-12T01:38:14.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core 2023-07-12T01:38:14.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-12T01:38:14.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host 2023-07-12T01:38:14.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-12T01:38:14.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio 2023-07-12T01:38:14.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio.ko 2023-07-12T01:38:14.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_aec.ko 2023-07-12T01:38:14.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_cif.ko 2023-07-12T01:38:14.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pci_generic.ko 2023-07-12T01:38:14.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_sercos3.ko 2023-07-12T01:38:14.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb 2023-07-12T01:38:14.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class 2023-07-12T01:38:14.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-acm.ko 2023-07-12T01:38:14.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-12T01:38:14.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usblp.ko 2023-07-12T01:38:14.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usbtmc.ko 2023-07-12T01:38:14.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host 2023-07-12T01:38:14.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-12T01:38:14.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image 2023-07-12T01:38:14.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/mdc800.ko 2023-07-12T01:38:14.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/microtek.ko 2023-07-12T01:38:14.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc 2023-07-12T01:38:14.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/adutux.ko 2023-07-12T01:38:14.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/appledisplay.ko 2023-07-12T01:38:14.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi26.ko 2023-07-12T01:38:14.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi62.ko 2023-07-12T01:38:14.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ezusb.ko 2023-07-12T01:38:14.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/idmouse.ko 2023-07-12T01:38:14.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/iowarrior.ko 2023-07-12T01:38:14.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-12T01:38:14.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ldusb.ko 2023-07-12T01:38:14.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/legousbtower.ko 2023-07-12T01:38:14.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga 2023-07-12T01:38:14.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-12T01:38:14.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-12T01:38:14.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usb3503.ko 2023-07-12T01:38:14.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usblcd.ko 2023-07-12T01:38:14.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-12T01:38:14.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/uss720.ko 2023-07-12T01:38:14.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/yurex.ko 2023-07-12T01:38:14.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy 2023-07-12T01:38:14.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-generic.ko 2023-07-12T01:38:14.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial 2023-07-12T01:38:14.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/aircable.ko 2023-07-12T01:38:14.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ark3116.ko 2023-07-12T01:38:14.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-12T01:38:14.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ch341.ko 2023-07-12T01:38:14.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cp210x.ko 2023-07-12T01:38:14.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cyberjack.ko 2023-07-12T01:38:14.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-12T01:38:14.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-12T01:38:14.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/empeg.ko 2023-07-12T01:38:14.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-12T01:38:14.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-12T01:38:14.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-12T01:38:14.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_ti.ko 2023-07-12T01:38:14.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipaq.ko 2023-07-12T01:38:14.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipw.ko 2023-07-12T01:38:14.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ir-usb.ko 2023-07-12T01:38:14.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-12T01:38:14.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan.ko 2023-07-12T01:38:14.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-12T01:38:14.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-12T01:38:14.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-12T01:38:14.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mct_u232.ko 2023-07-12T01:38:14.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7720.ko 2023-07-12T01:38:14.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7840.ko 2023-07-12T01:38:14.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/navman.ko 2023-07-12T01:38:14.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/omninet.ko 2023-07-12T01:38:14.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/opticon.ko 2023-07-12T01:38:14.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/option.ko 2023-07-12T01:38:14.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/oti6858.ko 2023-07-12T01:38:14.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/pl2303.ko 2023-07-12T01:38:14.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcaux.ko 2023-07-12T01:38:14.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcserial.ko 2023-07-12T01:38:14.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/quatech2.ko 2023-07-12T01:38:14.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/safe_serial.ko 2023-07-12T01:38:14.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/sierra.ko 2023-07-12T01:38:14.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-12T01:38:14.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ssu100.ko 2023-07-12T01:38:14.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/symbolserial.ko 2023-07-12T01:38:14.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-12T01:38:14.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-12T01:38:14.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_debug.ko 2023-07-12T01:38:14.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-12T01:38:14.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/visor.ko 2023-07-12T01:38:14.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/whiteheat.ko 2023-07-12T01:38:14.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-12T01:38:14.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage 2023-07-12T01:38:14.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/uas.ko 2023-07-12T01:38:14.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-12T01:38:14.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-12T01:38:14.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-12T01:38:14.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-12T01:38:14.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-12T01:38:14.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-12T01:38:14.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-12T01:38:14.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-karma.ko 2023-07-12T01:38:14.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-12T01:38:14.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-12T01:38:14.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-12T01:38:14.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-12T01:38:14.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-12T01:38:14.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/usb-storage.ko 2023-07-12T01:38:14.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip 2023-07-12T01:38:14.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-12T01:38:14.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-12T01:38:14.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-12T01:38:14.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio 2023-07-12T01:38:14.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci 2023-07-12T01:38:14.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-12T01:38:14.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-12T01:38:14.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio.ko 2023-07-12T01:38:14.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-12T01:38:14.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost 2023-07-12T01:38:14.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost.ko 2023-07-12T01:38:14.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-12T01:38:14.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_net.ko 2023-07-12T01:38:14.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_scsi.ko 2023-07-12T01:38:14.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video 2023-07-12T01:38:14.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight 2023-07-12T01:38:14.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/apple_bl.ko 2023-07-12T01:38:14.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lcd.ko 2023-07-12T01:38:14.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-12T01:38:14.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio 2023-07-12T01:38:14.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio.ko 2023-07-12T01:38:14.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_balloon.ko 2023-07-12T01:38:14.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_mmio.ko 2023-07-12T01:38:14.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci.ko 2023-07-12T01:38:14.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-12T01:38:14.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-12T01:38:14.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_ring.ko 2023-07-12T01:38:14.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1 2023-07-12T01:38:14.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters 2023-07-12T01:38:14.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2482.ko 2023-07-12T01:38:14.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2490.ko 2023-07-12T01:38:14.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves 2023-07-12T01:38:14.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-12T01:38:14.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-12T01:38:14.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-12T01:38:14.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-12T01:38:14.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-12T01:38:14.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-12T01:38:14.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-12T01:38:14.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-12T01:38:14.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-12T01:38:14.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-12T01:38:14.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-12T01:38:14.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/wire.ko 2023-07-12T01:38:14.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog 2023-07-12T01:38:14.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-12T01:38:14.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-12T01:38:14.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-12T01:38:14.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/hpwdt.ko 2023-07-12T01:38:14.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/i6300esb.ko 2023-07-12T01:38:14.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-12T01:38:14.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-12T01:38:14.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ib700wdt.ko 2023-07-12T01:38:14.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ibmasr.ko 2023-07-12T01:38:14.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-12T01:38:14.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-12T01:38:14.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it87_wdt.ko 2023-07-12T01:38:14.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/machzwd.ko 2023-07-12T01:38:14.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/nv_tco.ko 2023-07-12T01:38:14.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-12T01:38:14.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-12T01:38:14.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-12T01:38:14.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-12T01:38:14.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/softdog.ko 2023-07-12T01:38:14.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-12T01:38:14.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/via_wdt.ko 2023-07-12T01:38:14.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-12T01:38:14.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-12T01:38:14.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-12T01:38:14.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wdt_pci.ko 2023-07-12T01:38:14.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/xen_wdt.ko 2023-07-12T01:38:14.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen 2023-07-12T01:38:14.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-12T01:38:14.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-evtchn.ko 2023-07-12T01:38:14.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntalloc.ko 2023-07-12T01:38:14.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntdev.ko 2023-07-12T01:38:14.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback 2023-07-12T01:38:14.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-12T01:38:14.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-privcmd.ko 2023-07-12T01:38:14.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs 2023-07-12T01:38:14.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-12T01:38:14.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs 2023-07-12T01:38:14.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p 2023-07-12T01:38:14.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/9p.ko 2023-07-12T01:38:14.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs 2023-07-12T01:38:14.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/affs.ko 2023-07-12T01:38:14.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs 2023-07-12T01:38:14.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/befs.ko 2023-07-12T01:38:14.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/binfmt_misc.ko 2023-07-12T01:38:14.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs 2023-07-12T01:38:14.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/btrfs.ko 2023-07-12T01:38:14.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles 2023-07-12T01:38:14.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/cachefiles.ko 2023-07-12T01:38:14.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph 2023-07-12T01:38:14.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ceph.ko 2023-07-12T01:38:14.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda 2023-07-12T01:38:14.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/coda.ko 2023-07-12T01:38:14.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs 2023-07-12T01:38:14.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/cramfs.ko 2023-07-12T01:38:14.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm 2023-07-12T01:38:14.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/dlm.ko 2023-07-12T01:38:14.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs 2023-07-12T01:38:14.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-12T01:38:14.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs 2023-07-12T01:38:14.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/f2fs.ko 2023-07-12T01:38:14.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat 2023-07-12T01:38:14.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/fat.ko 2023-07-12T01:38:14.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/msdos.ko 2023-07-12T01:38:14.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/vfat.ko 2023-07-12T01:38:14.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache 2023-07-12T01:38:14.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/fscache.ko 2023-07-12T01:38:14.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse 2023-07-12T01:38:14.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/cuse.ko 2023-07-12T01:38:14.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/fuse.ko 2023-07-12T01:38:14.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2 2023-07-12T01:38:14.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/gfs2.ko 2023-07-12T01:38:14.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs 2023-07-12T01:38:14.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/hfs.ko 2023-07-12T01:38:14.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus 2023-07-12T01:38:14.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/hfsplus.ko 2023-07-12T01:38:14.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs 2023-07-12T01:38:14.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/isofs.ko 2023-07-12T01:38:14.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs 2023-07-12T01:38:14.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/jfs.ko 2023-07-12T01:38:14.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd 2023-07-12T01:38:14.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/lockd.ko 2023-07-12T01:38:14.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix 2023-07-12T01:38:14.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/minix.ko 2023-07-12T01:38:14.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs 2023-07-12T01:38:14.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/netfs.ko 2023-07-12T01:38:14.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs 2023-07-12T01:38:14.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout 2023-07-12T01:38:14.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-12T01:38:14.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout 2023-07-12T01:38:14.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-12T01:38:14.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout 2023-07-12T01:38:14.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-12T01:38:14.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfs.ko 2023-07-12T01:38:14.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv3.ko 2023-07-12T01:38:14.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv4.ko 2023-07-12T01:38:14.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common 2023-07-12T01:38:14.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/grace.ko 2023-07-12T01:38:14.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/nfs_acl.ko 2023-07-12T01:38:14.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd 2023-07-12T01:38:14.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/nfsd.ko 2023-07-12T01:38:14.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2 2023-07-12T01:38:14.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/nilfs2.ko 2023-07-12T01:38:14.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls 2023-07-12T01:38:14.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-celtic.ko 2023-07-12T01:38:14.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-centeuro.ko 2023-07-12T01:38:14.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-croatian.ko 2023-07-12T01:38:14.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-cyrillic.ko 2023-07-12T01:38:14.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-gaelic.ko 2023-07-12T01:38:14.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-greek.ko 2023-07-12T01:38:14.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-iceland.ko 2023-07-12T01:38:14.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-inuit.ko 2023-07-12T01:38:14.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-roman.ko 2023-07-12T01:38:14.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-romanian.ko 2023-07-12T01:38:14.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-turkish.ko 2023-07-12T01:38:14.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1250.ko 2023-07-12T01:38:14.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1251.ko 2023-07-12T01:38:14.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1255.ko 2023-07-12T01:38:14.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp737.ko 2023-07-12T01:38:14.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp775.ko 2023-07-12T01:38:14.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp850.ko 2023-07-12T01:38:14.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp852.ko 2023-07-12T01:38:14.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp855.ko 2023-07-12T01:38:14.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp857.ko 2023-07-12T01:38:14.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp860.ko 2023-07-12T01:38:14.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp861.ko 2023-07-12T01:38:14.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp862.ko 2023-07-12T01:38:14.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp863.ko 2023-07-12T01:38:14.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp864.ko 2023-07-12T01:38:14.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp865.ko 2023-07-12T01:38:14.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp866.ko 2023-07-12T01:38:14.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp869.ko 2023-07-12T01:38:14.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp874.ko 2023-07-12T01:38:14.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp932.ko 2023-07-12T01:38:14.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp936.ko 2023-07-12T01:38:14.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp949.ko 2023-07-12T01:38:14.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp950.ko 2023-07-12T01:38:14.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_euc-jp.ko 2023-07-12T01:38:14.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-1.ko 2023-07-12T01:38:14.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-13.ko 2023-07-12T01:38:14.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-14.ko 2023-07-12T01:38:14.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-15.ko 2023-07-12T01:38:14.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-2.ko 2023-07-12T01:38:14.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-3.ko 2023-07-12T01:38:14.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-4.ko 2023-07-12T01:38:14.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-5.ko 2023-07-12T01:38:14.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-6.ko 2023-07-12T01:38:14.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-7.ko 2023-07-12T01:38:14.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-9.ko 2023-07-12T01:38:14.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-r.ko 2023-07-12T01:38:14.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-ru.ko 2023-07-12T01:38:14.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-u.ko 2023-07-12T01:38:14.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_utf8.ko 2023-07-12T01:38:14.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2 2023-07-12T01:38:14.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster 2023-07-12T01:38:14.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-12T01:38:14.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm 2023-07-12T01:38:14.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-12T01:38:14.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs 2023-07-12T01:38:14.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-12T01:38:14.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2.ko 2023-07-12T01:38:14.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-12T01:38:14.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-12T01:38:14.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-12T01:38:14.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs 2023-07-12T01:38:14.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/overlay.ko 2023-07-12T01:38:14.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore 2023-07-12T01:38:14.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ramoops.ko 2023-07-12T01:38:14.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs 2023-07-12T01:38:14.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/reiserfs.ko 2023-07-12T01:38:14.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs 2023-07-12T01:38:14.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/romfs.ko 2023-07-12T01:38:14.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb 2023-07-12T01:38:14.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client 2023-07-12T01:38:14.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/cifs.ko 2023-07-12T01:38:14.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common 2023-07-12T01:38:14.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_arc4.ko 2023-07-12T01:38:14.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_md4.ko 2023-07-12T01:38:14.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs 2023-07-12T01:38:14.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/squashfs.ko 2023-07-12T01:38:14.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv 2023-07-12T01:38:14.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/sysv.ko 2023-07-12T01:38:14.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf 2023-07-12T01:38:14.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/udf.ko 2023-07-12T01:38:14.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs 2023-07-12T01:38:14.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ufs.ko 2023-07-12T01:38:14.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs 2023-07-12T01:38:14.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/xfs.ko 2023-07-12T01:38:14.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel 2023-07-12T01:38:14.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu 2023-07-12T01:38:14.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu/rcutorture.ko 2023-07-12T01:38:14.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/torture.ko 2023-07-12T01:38:14.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace 2023-07-12T01:38:14.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-12T01:38:14.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib 2023-07-12T01:38:14.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/asn1_encoder.ko 2023-07-12T01:38:14.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc-itu-t.ko 2023-07-12T01:38:14.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc8.ko 2023-07-12T01:38:14.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto 2023-07-12T01:38:14.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libarc4.ko 2023-07-12T01:38:14.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libdes.ko 2023-07-12T01:38:14.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/libcrc32c.ko 2023-07-12T01:38:14.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lru_cache.ko 2023-07-12T01:38:14.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4 2023-07-12T01:38:14.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4_compress.ko 2023-07-12T01:38:14.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4hc_compress.ko 2023-07-12T01:38:14.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math 2023-07-12T01:38:14.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/cordic.ko 2023-07-12T01:38:14.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6 2023-07-12T01:38:14.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/raid6_pq.ko 2023-07-12T01:38:14.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon 2023-07-12T01:38:14.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-12T01:38:14.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_bm.ko 2023-07-12T01:38:14.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_fsm.ko 2023-07-12T01:38:14.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_kmp.ko 2023-07-12T01:38:14.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd 2023-07-12T01:38:14.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd/zstd_compress.ko 2023-07-12T01:38:14.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm 2023-07-12T01:38:14.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm/hwpoison-inject.ko 2023-07-12T01:38:14.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net 2023-07-12T01:38:14.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan 2023-07-12T01:38:14.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/6lowpan.ko 2023-07-12T01:38:14.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_dest.ko 2023-07-12T01:38:14.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_fragment.ko 2023-07-12T01:38:14.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_hop.ko 2023-07-12T01:38:14.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-12T01:38:14.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_mobility.ko 2023-07-12T01:38:14.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_routing.ko 2023-07-12T01:38:14.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_udp.ko 2023-07-12T01:38:14.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802 2023-07-12T01:38:14.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/garp.ko 2023-07-12T01:38:14.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/mrp.ko 2023-07-12T01:38:14.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/p8022.ko 2023-07-12T01:38:14.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/psnap.ko 2023-07-12T01:38:14.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/stp.ko 2023-07-12T01:38:14.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q 2023-07-12T01:38:14.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/8021q.ko 2023-07-12T01:38:14.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p 2023-07-12T01:38:14.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet.ko 2023-07-12T01:38:14.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_fd.ko 2023-07-12T01:38:14.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_rdma.ko 2023-07-12T01:38:14.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_virtio.ko 2023-07-12T01:38:14.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv 2023-07-12T01:38:14.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/batman-adv.ko 2023-07-12T01:38:14.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge 2023-07-12T01:38:14.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/br_netfilter.ko 2023-07-12T01:38:14.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/bridge.ko 2023-07-12T01:38:14.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter 2023-07-12T01:38:14.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-12T01:38:14.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-12T01:38:14.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-12T01:38:14.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-12T01:38:14.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-12T01:38:14.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-12T01:38:14.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-12T01:38:14.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-12T01:38:14.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-12T01:38:14.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-12T01:38:14.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-12T01:38:14.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-12T01:38:14.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-12T01:38:14.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-12T01:38:14.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-12T01:38:14.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-12T01:38:14.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-12T01:38:14.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-12T01:38:14.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-12T01:38:14.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-12T01:38:14.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtables.ko 2023-07-12T01:38:14.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-12T01:38:14.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-12T01:38:14.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-12T01:38:14.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph 2023-07-12T01:38:14.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/libceph.ko 2023-07-12T01:38:14.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core 2023-07-12T01:38:14.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/failover.ko 2023-07-12T01:38:14.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/pktgen.ko 2023-07-12T01:38:14.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp 2023-07-12T01:38:14.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp.ko 2023-07-12T01:38:14.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_diag.ko 2023-07-12T01:38:14.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv4.ko 2023-07-12T01:38:14.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv6.ko 2023-07-12T01:38:14.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver 2023-07-12T01:38:14.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver/dns_resolver.ko 2023-07-12T01:38:14.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa 2023-07-12T01:38:14.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/dsa_core.ko 2023-07-12T01:38:14.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_brcm.ko 2023-07-12T01:38:14.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_dsa.ko 2023-07-12T01:38:14.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_none.ko 2023-07-12T01:38:14.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_trailer.ko 2023-07-12T01:38:14.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154 2023-07-12T01:38:14.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan 2023-07-12T01:38:14.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-12T01:38:14.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154.ko 2023-07-12T01:38:14.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-12T01:38:14.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4 2023-07-12T01:38:14.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ah4.ko 2023-07-12T01:38:14.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/esp4.ko 2023-07-12T01:38:14.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/fou.ko 2023-07-12T01:38:14.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/gre.ko 2023-07-12T01:38:14.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/inet_diag.ko 2023-07-12T01:38:14.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_gre.ko 2023-07-12T01:38:14.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_tunnel.ko 2023-07-12T01:38:14.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_vti.ko 2023-07-12T01:38:14.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipcomp.ko 2023-07-12T01:38:14.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipip.ko 2023-07-12T01:38:14.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter 2023-07-12T01:38:14.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-12T01:38:14.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-12T01:38:14.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-12T01:38:14.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-12T01:38:14.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-12T01:38:14.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-12T01:38:14.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-12T01:38:14.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-12T01:38:14.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-12T01:38:14.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-12T01:38:14.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-12T01:38:14.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-12T01:38:14.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-12T01:38:14.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-12T01:38:14.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-12T01:38:14.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-12T01:38:14.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-12T01:38:14.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-12T01:38:14.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-12T01:38:14.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-12T01:38:14.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-12T01:38:14.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_bic.ko 2023-07-12T01:38:14.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_dctcp.ko 2023-07-12T01:38:14.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_diag.ko 2023-07-12T01:38:14.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_highspeed.ko 2023-07-12T01:38:14.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_htcp.ko 2023-07-12T01:38:14.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_hybla.ko 2023-07-12T01:38:14.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_illinois.ko 2023-07-12T01:38:14.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_lp.ko 2023-07-12T01:38:14.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_scalable.ko 2023-07-12T01:38:14.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_vegas.ko 2023-07-12T01:38:14.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_veno.ko 2023-07-12T01:38:14.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_westwood.ko 2023-07-12T01:38:14.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_yeah.ko 2023-07-12T01:38:14.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tunnel4.ko 2023-07-12T01:38:14.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_diag.ko 2023-07-12T01:38:14.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_tunnel.ko 2023-07-12T01:38:14.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-12T01:38:14.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6 2023-07-12T01:38:14.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ah6.ko 2023-07-12T01:38:14.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/esp6.ko 2023-07-12T01:38:14.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/fou6.ko 2023-07-12T01:38:14.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_tunnel.ko 2023-07-12T01:38:14.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-12T01:38:14.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_vti.ko 2023-07-12T01:38:14.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ipcomp6.ko 2023-07-12T01:38:14.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter 2023-07-12T01:38:14.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-12T01:38:14.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-12T01:38:14.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-12T01:38:14.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-12T01:38:14.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-12T01:38:14.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-12T01:38:14.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-12T01:38:14.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-12T01:38:14.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-12T01:38:14.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-12T01:38:14.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-12T01:38:14.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-12T01:38:14.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-12T01:38:14.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-12T01:38:14.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-12T01:38:14.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-12T01:38:14.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-12T01:38:14.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-12T01:38:14.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-12T01:38:14.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-12T01:38:14.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-12T01:38:14.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-12T01:38:14.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-12T01:38:14.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-12T01:38:14.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/sit.ko 2023-07-12T01:38:14.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/tunnel6.ko 2023-07-12T01:38:14.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-12T01:38:14.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key 2023-07-12T01:38:14.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key/af_key.ko 2023-07-12T01:38:14.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp 2023-07-12T01:38:14.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_core.ko 2023-07-12T01:38:14.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-12T01:38:14.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_eth.ko 2023-07-12T01:38:14.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip.ko 2023-07-12T01:38:14.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip6.ko 2023-07-12T01:38:14.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_netlink.ko 2023-07-12T01:38:14.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ppp.ko 2023-07-12T01:38:14.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc 2023-07-12T01:38:14.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc.ko 2023-07-12T01:38:14.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154 2023-07-12T01:38:14.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/mac802154.ko 2023-07-12T01:38:14.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls 2023-07-12T01:38:14.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/mpls_gso.ko 2023-07-12T01:38:14.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter 2023-07-12T01:38:14.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset 2023-07-12T01:38:14.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set.ko 2023-07-12T01:38:14.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-12T01:38:14.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-12T01:38:14.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-12T01:38:14.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-12T01:38:14.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-12T01:38:14.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-12T01:38:14.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-12T01:38:14.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-12T01:38:14.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-12T01:38:14.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-12T01:38:14.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-12T01:38:14.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-12T01:38:14.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-12T01:38:14.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-12T01:38:14.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-12T01:38:14.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs 2023-07-12T01:38:14.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-12T01:38:14.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-12T01:38:14.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-12T01:38:14.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-12T01:38:14.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-12T01:38:14.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-12T01:38:14.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-12T01:38:14.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-12T01:38:14.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-12T01:38:14.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-12T01:38:14.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-12T01:38:14.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-12T01:38:14.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-12T01:38:14.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-12T01:38:14.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conncount.ko 2023-07-12T01:38:14.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack.ko 2023-07-12T01:38:14.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-12T01:38:14.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-12T01:38:14.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-12T01:38:14.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-12T01:38:14.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-12T01:38:14.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-12T01:38:14.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-12T01:38:14.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-12T01:38:14.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-12T01:38:14.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-12T01:38:14.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-12T01:38:14.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-12T01:38:14.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-12T01:38:14.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table.ko 2023-07-12T01:38:14.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-12T01:38:14.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_log_syslog.ko 2023-07-12T01:38:14.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat.ko 2023-07-12T01:38:14.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-12T01:38:14.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-12T01:38:14.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_irc.ko 2023-07-12T01:38:14.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_sip.ko 2023-07-12T01:38:14.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-12T01:38:14.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-12T01:38:14.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_tables.ko 2023-07-12T01:38:14.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink.ko 2023-07-12T01:38:14.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-12T01:38:14.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_log.ko 2023-07-12T01:38:14.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-12T01:38:14.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-12T01:38:14.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_chain_nat.ko 2023-07-12T01:38:14.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_compat.ko 2023-07-12T01:38:14.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_ct.ko 2023-07-12T01:38:14.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-12T01:38:14.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fib.ko 2023-07-12T01:38:14.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-12T01:38:14.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_hash.ko 2023-07-12T01:38:14.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_limit.ko 2023-07-12T01:38:14.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_log.ko 2023-07-12T01:38:14.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_masq.ko 2023-07-12T01:38:14.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_nat.ko 2023-07-12T01:38:14.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_numgen.ko 2023-07-12T01:38:14.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_queue.ko 2023-07-12T01:38:14.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_quota.ko 2023-07-12T01:38:14.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_redir.ko 2023-07-12T01:38:14.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject.ko 2023-07-12T01:38:14.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject_inet.ko 2023-07-12T01:38:14.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_socket.ko 2023-07-12T01:38:14.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_tunnel.ko 2023-07-12T01:38:14.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_AUDIT.ko 2023-07-12T01:38:14.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-12T01:38:14.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-12T01:38:14.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-12T01:38:14.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CT.ko 2023-07-12T01:38:14.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_DSCP.ko 2023-07-12T01:38:14.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HL.ko 2023-07-12T01:38:14.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HMARK.ko 2023-07-12T01:38:14.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-12T01:38:14.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LED.ko 2023-07-12T01:38:14.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LOG.ko 2023-07-12T01:38:14.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-12T01:38:14.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NETMAP.ko 2023-07-12T01:38:14.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFLOG.ko 2023-07-12T01:38:14.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-12T01:38:14.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_RATEEST.ko 2023-07-12T01:38:14.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-12T01:38:14.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_SECMARK.ko 2023-07-12T01:38:14.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-12T01:38:14.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-12T01:38:14.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TEE.ko 2023-07-12T01:38:14.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TPROXY.ko 2023-07-12T01:38:14.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TRACE.ko 2023-07-12T01:38:14.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_addrtype.ko 2023-07-12T01:38:14.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_bpf.ko 2023-07-12T01:38:14.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cgroup.ko 2023-07-12T01:38:14.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cluster.ko 2023-07-12T01:38:14.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_comment.ko 2023-07-12T01:38:14.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connbytes.ko 2023-07-12T01:38:14.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlabel.ko 2023-07-12T01:38:14.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlimit.ko 2023-07-12T01:38:14.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connmark.ko 2023-07-12T01:38:14.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_conntrack.ko 2023-07-12T01:38:14.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cpu.ko 2023-07-12T01:38:14.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dccp.ko 2023-07-12T01:38:14.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_devgroup.ko 2023-07-12T01:38:14.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dscp.ko 2023-07-12T01:38:14.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ecn.ko 2023-07-12T01:38:14.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_esp.ko 2023-07-12T01:38:14.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hashlimit.ko 2023-07-12T01:38:14.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_helper.ko 2023-07-12T01:38:14.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hl.ko 2023-07-12T01:38:14.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipcomp.ko 2023-07-12T01:38:14.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_iprange.ko 2023-07-12T01:38:14.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipvs.ko 2023-07-12T01:38:14.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_l2tp.ko 2023-07-12T01:38:14.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_length.ko 2023-07-12T01:38:14.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_limit.ko 2023-07-12T01:38:14.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mac.ko 2023-07-12T01:38:14.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mark.ko 2023-07-12T01:38:14.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_multiport.ko 2023-07-12T01:38:14.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nat.ko 2023-07-12T01:38:14.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nfacct.ko 2023-07-12T01:38:14.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_osf.ko 2023-07-12T01:38:14.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_owner.ko 2023-07-12T01:38:14.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_physdev.ko 2023-07-12T01:38:14.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_pkttype.ko 2023-07-12T01:38:14.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_policy.ko 2023-07-12T01:38:14.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_quota.ko 2023-07-12T01:38:14.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_rateest.ko 2023-07-12T01:38:14.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_realm.ko 2023-07-12T01:38:14.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_recent.ko 2023-07-12T01:38:14.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_sctp.ko 2023-07-12T01:38:14.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_set.ko 2023-07-12T01:38:14.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_socket.ko 2023-07-12T01:38:14.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_state.ko 2023-07-12T01:38:14.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_statistic.ko 2023-07-12T01:38:14.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_string.ko 2023-07-12T01:38:14.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpmss.ko 2023-07-12T01:38:14.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_time.ko 2023-07-12T01:38:14.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_u32.ko 2023-07-12T01:38:14.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink 2023-07-12T01:38:14.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/netlink_diag.ko 2023-07-12T01:38:14.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh 2023-07-12T01:38:14.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/nsh.ko 2023-07-12T01:38:14.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch 2023-07-12T01:38:14.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/openvswitch.ko 2023-07-12T01:38:14.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-geneve.ko 2023-07-12T01:38:14.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-gre.ko 2023-07-12T01:38:14.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-vxlan.ko 2023-07-12T01:38:14.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet 2023-07-12T01:38:14.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/af_packet_diag.ko 2023-07-12T01:38:14.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds 2023-07-12T01:38:14.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds.ko 2023-07-12T01:38:14.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_rdma.ko 2023-07-12T01:38:14.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_tcp.ko 2023-07-12T01:38:14.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched 2023-07-12T01:38:14.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_csum.ko 2023-07-12T01:38:14.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_gact.ko 2023-07-12T01:38:14.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_ipt.ko 2023-07-12T01:38:14.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_mirred.ko 2023-07-12T01:38:14.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_nat.ko 2023-07-12T01:38:14.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_pedit.ko 2023-07-12T01:38:14.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_police.ko 2023-07-12T01:38:14.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_simple.ko 2023-07-12T01:38:14.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_skbedit.ko 2023-07-12T01:38:14.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_vlan.ko 2023-07-12T01:38:14.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_basic.ko 2023-07-12T01:38:14.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_bpf.ko 2023-07-12T01:38:14.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_flow.ko 2023-07-12T01:38:14.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_fw.ko 2023-07-12T01:38:14.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_route.ko 2023-07-12T01:38:14.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_u32.ko 2023-07-12T01:38:14.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_cmp.ko 2023-07-12T01:38:14.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_ipset.ko 2023-07-12T01:38:14.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_meta.ko 2023-07-12T01:38:14.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_nbyte.ko 2023-07-12T01:38:14.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_text.ko 2023-07-12T01:38:14.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_u32.ko 2023-07-12T01:38:14.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_choke.ko 2023-07-12T01:38:14.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_codel.ko 2023-07-12T01:38:14.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_drr.ko 2023-07-12T01:38:14.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq.ko 2023-07-12T01:38:14.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_gred.ko 2023-07-12T01:38:14.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hfsc.ko 2023-07-12T01:38:14.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hhf.ko 2023-07-12T01:38:14.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_htb.ko 2023-07-12T01:38:14.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_ingress.ko 2023-07-12T01:38:14.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio.ko 2023-07-12T01:38:14.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio_lib.ko 2023-07-12T01:38:14.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_multiq.ko 2023-07-12T01:38:14.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_netem.ko 2023-07-12T01:38:14.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_pie.ko 2023-07-12T01:38:14.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_plug.ko 2023-07-12T01:38:14.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_prio.ko 2023-07-12T01:38:14.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_qfq.ko 2023-07-12T01:38:14.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_red.ko 2023-07-12T01:38:14.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfb.ko 2023-07-12T01:38:14.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfq.ko 2023-07-12T01:38:14.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_tbf.ko 2023-07-12T01:38:14.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_teql.ko 2023-07-12T01:38:14.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp 2023-07-12T01:38:14.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp.ko 2023-07-12T01:38:14.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp_diag.ko 2023-07-12T01:38:14.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc 2023-07-12T01:38:14.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss 2023-07-12T01:38:14.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-12T01:38:14.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-12T01:38:14.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/sunrpc.ko 2023-07-12T01:38:14.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma 2023-07-12T01:38:14.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-12T01:38:14.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc 2023-07-12T01:38:14.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/diag.ko 2023-07-12T01:38:14.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/tipc.ko 2023-07-12T01:38:14.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix 2023-07-12T01:38:14.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/unix_diag.ko 2023-07-12T01:38:14.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock 2023-07-12T01:38:14.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-12T01:38:14.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-12T01:38:14.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock.ko 2023-07-12T01:38:14.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-12T01:38:14.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-12T01:38:14.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm 2023-07-12T01:38:14.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-12T01:38:14.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security 2023-07-12T01:38:14.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys 2023-07-12T01:38:14.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys 2023-07-12T01:38:14.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-12T01:38:14.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys 2023-07-12T01:38:14.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys/trusted.ko 2023-07-12T01:38:14.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt 2023-07-12T01:38:14.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib 2023-07-12T01:38:14.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/irqbypass.ko 2023-07-12T01:38:14.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias 2023-07-12T01:38:14.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias.bin 2023-07-12T01:38:14.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin 2023-07-12T01:38:14.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.bin 2023-07-12T01:38:14.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.modinfo 2023-07-12T01:38:14.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep 2023-07-12T01:38:14.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep.bin 2023-07-12T01:38:14.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.devname 2023-07-12T01:38:14.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.order 2023-07-12T01:38:14.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.softdep 2023-07-12T01:38:14.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols 2023-07-12T01:38:14.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols.bin 2023-07-12T01:38:14.975 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-g84139c18d56f 2023-07-12T01:38:14.975 DEBUG:teuthology.orchestra.run.smithi196:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-12T01:38:15.004 INFO:teuthology.orchestra.run.smithi196.stdout:postinstall scriptlet (using /bin/sh): 2023-07-12T01:38:15.004 INFO:teuthology.orchestra.run.smithi196.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-g84139c18d56f -a -r /boot/System.map-6.4.0-g84139c18d56f ]; then 2023-07-12T01:38:15.004 INFO:teuthology.orchestra.run.smithi196.stdout:cp /boot/vmlinuz-6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm 2023-07-12T01:38:15.005 INFO:teuthology.orchestra.run.smithi196.stdout:cp /boot/System.map-6.4.0-g84139c18d56f /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-12T01:38:15.005 INFO:teuthology.orchestra.run.smithi196.stdout:rm -f /boot/vmlinuz-6.4.0-g84139c18d56f /boot/System.map-6.4.0-g84139c18d56f 2023-07-12T01:38:15.005 INFO:teuthology.orchestra.run.smithi196.stdout:/sbin/installkernel 6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-12T01:38:15.005 INFO:teuthology.orchestra.run.smithi196.stdout:rm -f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-12T01:38:15.005 INFO:teuthology.orchestra.run.smithi196.stdout:fi 2023-07-12T01:38:15.005 INFO:teuthology.orchestra.run.smithi196.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-12T01:38:15.005 INFO:teuthology.orchestra.run.smithi196.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-12T01:38:15.006 INFO:teuthology.orchestra.run.smithi196.stdout:new-kernel-pkg --remove 6.4.0-g84139c18d56f --rminitrd --initrdfile=/boot/initramfs-6.4.0-g84139c18d56f.img 2023-07-12T01:38:15.006 INFO:teuthology.orchestra.run.smithi196.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-12T01:38:15.006 INFO:teuthology.orchestra.run.smithi196.stdout:kernel-install remove 6.4.0-g84139c18d56f 2023-07-12T01:38:15.006 INFO:teuthology.orchestra.run.smithi196.stdout:fi 2023-07-12T01:38:15.006 INFO:teuthology.orchestra.run.smithi196.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-12T01:38:15.006 INFO:teuthology.orchestra.run.smithi196.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-12T01:38:15.006 INFO:teuthology.orchestra.run.smithi196.stdout:/sbin/update-bootloader --remove 6.4.0-g84139c18d56f 2023-07-12T01:38:15.007 INFO:teuthology.orchestra.run.smithi196.stdout:fi 2023-07-12T01:38:15.007 DEBUG:teuthology.orchestra.run.smithi196:> sudo rpm -qi grub2-tools 2023-07-12T01:38:15.086 INFO:teuthology.orchestra.run.smithi196.stdout:Name : grub2-tools 2023-07-12T01:38:15.087 INFO:teuthology.orchestra.run.smithi196.stdout:Epoch : 1 2023-07-12T01:38:15.087 INFO:teuthology.orchestra.run.smithi196.stdout:Version : 2.02 2023-07-12T01:38:15.087 INFO:teuthology.orchestra.run.smithi196.stdout:Release : 129.el8 2023-07-12T01:38:15.087 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: x86_64 2023-07-12T01:38:15.087 INFO:teuthology.orchestra.run.smithi196.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-12T01:38:15.088 INFO:teuthology.orchestra.run.smithi196.stdout:Group : System Environment/Base 2023-07-12T01:38:15.088 INFO:teuthology.orchestra.run.smithi196.stdout:Size : 9265586 2023-07-12T01:38:15.088 INFO:teuthology.orchestra.run.smithi196.stdout:License : GPLv3+ 2023-07-12T01:38:15.088 INFO:teuthology.orchestra.run.smithi196.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-12T01:38:15.088 INFO:teuthology.orchestra.run.smithi196.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-12T01:38:15.088 INFO:teuthology.orchestra.run.smithi196.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-12T01:38:15.088 INFO:teuthology.orchestra.run.smithi196.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-12T01:38:15.089 INFO:teuthology.orchestra.run.smithi196.stdout:Relocations : (not relocatable) 2023-07-12T01:38:15.089 INFO:teuthology.orchestra.run.smithi196.stdout:Packager : CentOS BuildSystem 2023-07-12T01:38:15.089 INFO:teuthology.orchestra.run.smithi196.stdout:Vendor : CentOS 2023-07-12T01:38:15.089 INFO:teuthology.orchestra.run.smithi196.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-12T01:38:15.089 INFO:teuthology.orchestra.run.smithi196.stdout:Summary : Support tools for GRUB. 2023-07-12T01:38:15.089 INFO:teuthology.orchestra.run.smithi196.stdout:Description : 2023-07-12T01:38:15.089 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T01:38:15.089 INFO:teuthology.orchestra.run.smithi196.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-12T01:38:15.090 INFO:teuthology.orchestra.run.smithi196.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-12T01:38:15.090 INFO:teuthology.orchestra.run.smithi196.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-12T01:38:15.090 INFO:teuthology.orchestra.run.smithi196.stdout:hardware devices. 2023-07-12T01:38:15.090 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T01:38:15.091 INFO:teuthology.orchestra.run.smithi196.stdout:This subpackage provides tools for support of all platforms. 2023-07-12T01:38:15.092 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-12T01:38:15.093 INFO:teuthology.task.kernel:Updating grub on smithi196 to boot 6.4.0-g84139c18d56f 2023-07-12T01:38:15.093 DEBUG:teuthology.orchestra.run.smithi196:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-12T01:38:19.357 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2023-07-12T01:38:21.494 INFO:teuthology.orchestra.run.smithi196.stderr:done 2023-07-12T01:38:21.496 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2023-07-12T01:38:21.527 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.EqcpHBBHOQ 2023-07-12T01:38:21.528 DEBUG:teuthology.orchestra.run.smithi196:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.EqcpHBBHOQ 2023-07-12T01:38:21.602 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.EqcpHBBHOQ 2023-07-12T01:38:21.754 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.EqcpHBBHOQ is 6KB 2023-07-12T01:38:21.775 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.EqcpHBBHOQ 2023-07-12T01:38:21.793 DEBUG:teuthology.orchestra.run.smithi196:> sudo /bin/ls /boot/loader/entries || true 2023-07-12T01:38:21.858 INFO:teuthology.orchestra.run.smithi196.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-12T01:38:21.859 INFO:teuthology.orchestra.run.smithi196.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-12T01:38:21.859 INFO:teuthology.orchestra.run.smithi196.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-12T01:38:21.859 INFO:teuthology.orchestra.run.smithi196.stdout:a1b29d6c289747bdb22930598d39874a-6.4.0-g84139c18d56f.conf 2023-07-12T01:38:21.860 DEBUG:teuthology.orchestra.run.smithi196:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.4.0-g84139c18d56f 2023-07-12T01:38:22.041 DEBUG:teuthology.orchestra.run.smithi196:> sudo shutdown -r now 2023-07-12T01:38:39.208 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-07-12T01:38:39.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-12T01:38:39.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:38:52.056 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-07-12T01:38:52.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-07-12T01:38:52.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:38:57.780 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-07-12T01:39:06.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-12T01:39:06.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:39:10.580 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-07-12T01:39:19.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-07-12T01:39:19.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:39:22.642 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-07-12T01:39:25.172 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-07-12T01:39:34.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-07-12T01:39:34.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:39:37.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-12T01:39:37.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:39:40.427 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-07-12T01:39:40.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-12T01:39:40.911 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.4.0-g84139c18d56f"... 2023-07-12T01:39:40.911 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-07-12T01:39:40.966 INFO:teuthology.orchestra.run.smithi037.stdout:6.4.0-g84139c18d56f 2023-07-12T01:39:40.967 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-g84139c18d56f vs 6.4.0-g84139c18d56f 2023-07-12T01:39:40.967 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-12T01:39:40.967 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-12T01:39:41.969 DEBUG:teuthology.parallel:result is None 2023-07-12T01:40:06.427 DEBUG:teuthology.orchestra.run.smithi196:> true 2023-07-12T01:40:06.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-07-12T01:40:06.842 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.4.0-g84139c18d56f"... 2023-07-12T01:40:06.842 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2023-07-12T01:40:06.887 INFO:teuthology.orchestra.run.smithi196.stdout:6.4.0-g84139c18d56f 2023-07-12T01:40:06.887 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-g84139c18d56f vs 6.4.0-g84139c18d56f 2023-07-12T01:40:06.887 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-12T01:40:06.887 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-12T01:40:07.889 DEBUG:teuthology.parallel:result is None 2023-07-12T01:40:07.890 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-12T01:40:07.898 INFO:teuthology.task.internal:Creating test directory... 2023-07-12T01:40:07.898 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-12T01:40:07.904 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-12T01:40:07.955 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-12T01:40:07.968 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-12T01:40:07.976 INFO:teuthology.task.internal:Creating archive directory... 2023-07-12T01:40:07.977 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-12T01:40:07.981 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-12T01:40:08.174 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-12T01:40:08.183 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-12T01:40:08.184 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-12T01:40:08.189 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-12T01:40:08.326 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-12T01:40:08.333 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-12T01:40:08.358 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-12T01:40:08.368 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-12T01:40:08.371 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-12T01:40:08.381 INFO:teuthology.task.internal:Configuring sudo... 2023-07-12T01:40:08.382 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-12T01:40:08.386 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-12T01:40:08.456 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-12T01:40:08.466 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-12T01:40:08.467 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-12T01:40:08.472 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-12T01:40:08.516 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-12T01:40:08.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-12T01:40:08.710 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-12T01:40:08.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-12T01:40:08.859 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T01:40:08.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-12T01:40:08.930 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-12T01:40:09.010 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-12T01:40:09.079 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-12T01:40:09.154 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-12T01:40:09.223 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T01:40:09.223 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-12T01:40:09.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2023-07-12T01:40:09.302 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2023-07-12T01:40:09.414 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-12T01:40:09.460 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-12T01:40:09.887 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-12T01:40:09.895 INFO:teuthology.task.internal:Starting timer... 2023-07-12T01:40:09.896 INFO:teuthology.run_tasks:Running task pcp... 2023-07-12T01:40:09.906 INFO:teuthology.run_tasks:Running task selinux... 2023-07-12T01:40:09.918 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-12T01:40:09.918 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2023-07-12T01:40:10.065 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2023-07-12T01:40:10.070 DEBUG:teuthology.orchestra.run.smithi196:> sudo service auditd rotate 2023-07-12T01:40:10.222 INFO:teuthology.orchestra.run.smithi196.stdout:Rotating logs: 2023-07-12T01:40:10.226 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-12T01:40:10.226 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2023-07-12T01:40:10.294 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2023-07-12T01:40:10.295 DEBUG:teuthology.orchestra.run.smithi196:> /usr/sbin/getenforce 2023-07-12T01:40:10.348 INFO:teuthology.orchestra.run.smithi196.stdout:Permissive 2023-07-12T01:40:10.349 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi196.front.sepia.ceph.com': 'permissive'} 2023-07-12T01:40:10.349 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-12T01:40:10.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T01:40:10.419 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-12T01:40:10.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T01:40:10.489 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-12T01:40:10.489 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2023-07-12T01:40:10.558 DEBUG:teuthology.orchestra.run.smithi196:> sudo /usr/sbin/setenforce permissive 2023-07-12T01:40:10.626 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-12T01:40:10.639 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-07-12T01:40:10.640 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-12T01:40:10.669 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-12T01:40:10.671 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-12T01:53:11.099 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi196.front.sepia.ceph.com')] 2023-07-12T01:53:11.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-12T01:53:11.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:53:11.184 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-07-12T01:53:11.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-12T01:53:11.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-07-12T01:53:11.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:53:11.376 DEBUG:teuthology.orchestra.run.smithi196:> true 2023-07-12T01:53:11.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-07-12T01:53:11.489 INFO:teuthology.run_tasks:Running task clock... 2023-07-12T01:53:11.499 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-12T01:53:11.500 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-12T01:53:11.500 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-12T01:53:11.504 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-12T01:53:11.505 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-12T01:53:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-12T01:53:11.578 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-12T01:53:11.610 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-12T01:53:11.610 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-12T01:53:11.701 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: ntpd: command not found 2023-07-12T01:53:11.704 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2023-07-12T01:53:11.730 INFO:teuthology.orchestra.run.smithi196.stdout:506 Cannot talk to daemon 2023-07-12T01:53:11.732 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2023-07-12T01:53:11.761 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-12T01:53:11.765 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-12T01:53:11.793 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-12T01:53:11.798 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-12T01:53:11.883 INFO:teuthology.orchestra.run.smithi196.stderr:bash: ntpq: command not found 2023-07-12T01:53:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:bash: ntpq: command not found 2023-07-12T01:53:11.890 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-12T01:53:11.890 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2023-07-12T01:53:11.891 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:53:11.891 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:53:11.891 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:53:11.891 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:53:11.892 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-12T01:53:11.892 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-07-12T01:53:11.892 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:53:11.892 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:53:11.892 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:53:11.892 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:53:11.893 INFO:teuthology.run_tasks:Running task install... 2023-07-12T01:53:11.903 DEBUG:teuthology.task.install:project ceph 2023-07-12T01:53:11.903 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}} 2023-07-12T01:53:11.904 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'} 2023-07-12T01:53:11.904 INFO:teuthology.task.install:Using flavor: default 2023-07-12T01:53:11.910 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-12T01:53:11.910 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-12T01:53:11.910 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2', 'tag': None, 'wait_for_package': False} 2023-07-12T01:53:11.911 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-12T01:53:11.913 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2', 'tag': None, 'wait_for_package': False} 2023-07-12T01:53:11.914 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-12T01:53:12.061 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/ 2023-07-12T01:53:12.061 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4828.gb5891ed6 2023-07-12T01:53:12.373 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-12T01:53:12.373 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T01:53:12.374 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-12T01:53:12.445 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-12T01:53:12.445 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-12T01:53:12.556 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-12T01:53:12.558 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/ 2023-07-12T01:53:12.558 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4828.gb5891ed6 2023-07-12T01:53:12.655 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-12T01:53:12.724 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2023-07-12T01:53:12.727 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2023-07-12T01:53:12.836 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-12T01:53:12.836 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T01:53:12.836 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-12T01:53:12.910 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-12T01:53:12.911 DEBUG:teuthology.orchestra.run.smithi196:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-12T01:53:13.022 DEBUG:teuthology.orchestra.run.smithi196:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-12T01:53:13.095 INFO:teuthology.orchestra.run.smithi037.stdout:73 files removed 2023-07-12T01:53:13.115 DEBUG:teuthology.orchestra.run.smithi196:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-12T01:53:13.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-12T01:53:13.182 INFO:teuthology.orchestra.run.smithi196.stdout:check_obsoletes = 1 2023-07-12T01:53:13.185 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum clean all 2023-07-12T01:53:13.531 INFO:teuthology.orchestra.run.smithi196.stdout:73 files removed 2023-07-12T01:53:13.565 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-12T01:53:14.209 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 160 kB/s | 81 kB 00:00 2023-07-12T01:53:14.577 INFO:teuthology.orchestra.run.smithi196.stdout:ceph packages for x86_64 171 kB/s | 81 kB 00:00 2023-07-12T01:53:14.776 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 18 kB/s | 9.4 kB 00:00 2023-07-12T01:53:15.219 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 3.6 kB/s | 1.5 kB 00:00 2023-07-12T01:53:15.261 INFO:teuthology.orchestra.run.smithi196.stdout:ceph noarch packages 15 kB/s | 9.4 kB 00:00 2023-07-12T01:53:15.695 INFO:teuthology.orchestra.run.smithi196.stdout:ceph source packages 3.7 kB/s | 1.5 kB 00:00 2023-07-12T01:54:47.074 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 8 - AppStream 344 kB/s | 31 MB 01:31 2023-07-12T01:54:54.998 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 41 MB 00:01 2023-07-12T01:54:55.035 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 8 - AppStream 315 kB/s | 31 MB 01:39 2023-07-12T01:55:02.022 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 8 - Extras 23 kB/s | 18 kB 00:00 2023-07-12T01:55:02.698 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.6 kB 00:00 2023-07-12T01:55:05.875 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 8 - PowerTools 2.1 MB/s | 6.3 MB 00:03 2023-07-12T01:55:09.126 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 8 - BaseOS 5.3 MB/s | 41 MB 00:07 2023-07-12T01:55:09.701 INFO:teuthology.orchestra.run.smithi196.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-07-12T01:55:15.511 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 2.8 MB/s | 16 MB 00:05 2023-07-12T01:55:16.401 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 8 - Extras 26 kB/s | 18 kB 00:00 2023-07-12T01:55:17.010 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.6 kB 00:00 2023-07-12T01:55:18.530 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 8 - PowerTools 4.6 MB/s | 6.3 MB 00:01 2023-07-12T01:55:20.116 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 110 kB/s | 24 kB 00:00 2023-07-12T01:55:22.296 INFO:teuthology.orchestra.run.smithi037.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2023-07-12T01:55:24.127 INFO:teuthology.orchestra.run.smithi196.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-12T01:55:24.127 INFO:teuthology.orchestra.run.smithi196.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-12T01:55:24.140 INFO:teuthology.orchestra.run.smithi196.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-12T01:55:24.141 INFO:teuthology.orchestra.run.smithi196.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-12T01:55:24.141 INFO:teuthology.orchestra.run.smithi196.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-12T01:55:24.143 INFO:teuthology.orchestra.run.smithi196.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-12T01:55:24.144 INFO:teuthology.orchestra.run.smithi196.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-12T01:55:24.146 INFO:teuthology.orchestra.run.smithi196.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-12T01:55:24.148 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-12T01:55:24.149 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-12T01:55:24.339 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2023-07-12T01:55:24.353 INFO:teuthology.orchestra.run.smithi196.stdout:==================================================================================================== 2023-07-12T01:55:24.353 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2023-07-12T01:55:24.353 INFO:teuthology.orchestra.run.smithi196.stdout:==================================================================================================== 2023-07-12T01:55:24.353 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2023-07-12T01:55:24.353 INFO:teuthology.orchestra.run.smithi196.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-12T01:55:24.354 INFO:teuthology.orchestra.run.smithi196.stdout: ceph x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.4 k 2023-07-12T01:55:24.354 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 5.4 M 2023-07-12T01:55:24.354 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 848 k 2023-07-12T01:55:24.354 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 165 k 2023-07-12T01:55:24.354 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 1.5 M 2023-07-12T01:55:24.354 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 129 k 2023-07-12T01:55:24.354 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 1.7 M 2023-07-12T01:55:24.354 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 7.4 M 2023-07-12T01:55:24.355 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 47 k 2023-07-12T01:55:24.355 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 13 M 2023-07-12T01:55:24.355 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 48 M 2023-07-12T01:55:24.355 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 258 k 2023-07-12T01:55:24.355 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 164 k 2023-07-12T01:55:24.355 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 258 k 2023-07-12T01:55:24.355 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-top noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 18 k 2023-07-12T01:55:24.356 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-12T01:55:24.356 INFO:teuthology.orchestra.run.smithi196.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-12T01:55:24.356 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-12T01:55:24.356 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 31 k 2023-07-12T01:55:24.356 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 771 k 2023-07-12T01:55:24.356 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 139 k 2023-07-12T01:55:24.356 INFO:teuthology.orchestra.run.smithi196.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-12T01:55:24.356 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-12T01:55:24.357 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-12T01:55:24.357 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-12T01:55:24.357 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-12T01:55:24.357 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-12T01:55:24.357 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 197 k 2023-07-12T01:55:24.357 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 371 k 2023-07-12T01:55:24.357 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 364 k 2023-07-12T01:55:24.358 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 107 k 2023-07-12T01:55:24.358 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 94 k 2023-07-12T01:55:24.358 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.4 M 2023-07-12T01:55:24.358 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 180 k 2023-07-12T01:55:24.358 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-12T01:55:24.358 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrading: 2023-07-12T01:55:24.358 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-12T01:55:24.358 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-12T01:55:24.359 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-12T01:55:24.359 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-12T01:55:24.359 INFO:teuthology.orchestra.run.smithi196.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-12T01:55:24.359 INFO:teuthology.orchestra.run.smithi196.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-12T01:55:24.359 INFO:teuthology.orchestra.run.smithi196.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-12T01:55:24.359 INFO:teuthology.orchestra.run.smithi196.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-12T01:55:24.359 INFO:teuthology.orchestra.run.smithi196.stdout: librados2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.7 M 2023-07-12T01:55:24.359 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.6 M 2023-07-12T01:55:24.360 INFO:teuthology.orchestra.run.smithi196.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-12T01:55:24.360 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-12T01:55:24.360 INFO:teuthology.orchestra.run.smithi196.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-12T01:55:24.360 INFO:teuthology.orchestra.run.smithi196.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-12T01:55:24.360 INFO:teuthology.orchestra.run.smithi196.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-12T01:55:24.360 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-12T01:55:24.360 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2023-07-12T01:55:24.361 INFO:teuthology.orchestra.run.smithi196.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-12T01:55:24.361 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 22 M 2023-07-12T01:55:24.361 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 23 k 2023-07-12T01:55:24.361 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 2.3 M 2023-07-12T01:55:24.361 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 240 k 2023-07-12T01:55:24.361 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 4.6 M 2023-07-12T01:55:24.361 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 18 M 2023-07-12T01:55:24.361 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 15 k 2023-07-12T01:55:24.362 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 24 k 2023-07-12T01:55:24.362 INFO:teuthology.orchestra.run.smithi196.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-12T01:55:24.362 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-12T01:55:24.362 INFO:teuthology.orchestra.run.smithi196.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-12T01:55:24.362 INFO:teuthology.orchestra.run.smithi196.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-12T01:55:24.362 INFO:teuthology.orchestra.run.smithi196.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-12T01:55:24.362 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 137 k 2023-07-12T01:55:24.362 INFO:teuthology.orchestra.run.smithi196.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-12T01:55:24.363 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-12T01:55:24.363 INFO:teuthology.orchestra.run.smithi196.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-12T01:55:24.363 INFO:teuthology.orchestra.run.smithi196.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-12T01:55:24.363 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-12T01:55:24.363 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-12T01:55:24.363 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 473 k 2023-07-12T01:55:24.363 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-12T01:55:24.364 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.7 M 2023-07-12T01:55:24.364 INFO:teuthology.orchestra.run.smithi196.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-12T01:55:24.364 INFO:teuthology.orchestra.run.smithi196.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-12T01:55:24.364 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-12T01:55:24.364 INFO:teuthology.orchestra.run.smithi196.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-12T01:55:24.364 INFO:teuthology.orchestra.run.smithi196.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-12T01:55:24.364 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-12T01:55:24.364 INFO:teuthology.orchestra.run.smithi196.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-12T01:55:24.365 INFO:teuthology.orchestra.run.smithi196.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-12T01:55:24.365 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-12T01:55:24.365 INFO:teuthology.orchestra.run.smithi196.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-12T01:55:24.365 INFO:teuthology.orchestra.run.smithi196.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-12T01:55:24.365 INFO:teuthology.orchestra.run.smithi196.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-12T01:55:24.365 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-12T01:55:24.365 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-12T01:55:24.365 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-12T01:55:24.366 INFO:teuthology.orchestra.run.smithi196.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-12T01:55:24.366 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-12T01:55:24.366 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 45 k 2023-07-12T01:55:24.366 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 122 k 2023-07-12T01:55:24.366 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-12T01:55:24.366 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-12T01:55:24.366 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-12T01:55:24.366 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-12T01:55:24.367 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-12T01:55:24.367 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-12T01:55:24.367 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-12T01:55:24.367 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-12T01:55:24.367 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-12T01:55:24.367 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-12T01:55:24.367 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-12T01:55:24.368 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-12T01:55:24.368 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-12T01:55:24.368 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-12T01:55:24.368 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-12T01:55:24.368 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-12T01:55:24.368 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-12T01:55:24.368 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-12T01:55:24.368 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-12T01:55:24.369 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-12T01:55:24.369 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-12T01:55:24.369 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-12T01:55:24.369 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-12T01:55:24.369 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-12T01:55:24.369 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-12T01:55:24.369 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-12T01:55:24.369 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-12T01:55:24.370 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-12T01:55:24.370 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-12T01:55:24.370 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-12T01:55:24.370 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-12T01:55:24.370 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-12T01:55:24.370 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-12T01:55:24.370 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-12T01:55:24.370 INFO:teuthology.orchestra.run.smithi196.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-12T01:55:24.371 INFO:teuthology.orchestra.run.smithi196.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-12T01:55:24.371 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-12T01:55:24.371 INFO:teuthology.orchestra.run.smithi196.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-12T01:55:24.371 INFO:teuthology.orchestra.run.smithi196.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-12T01:55:24.371 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-12T01:55:24.371 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-12T01:55:24.371 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-12T01:55:24.372 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-12T01:55:24.372 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-12T01:55:24.372 INFO:teuthology.orchestra.run.smithi196.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-12T01:55:24.372 INFO:teuthology.orchestra.run.smithi196.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-12T01:55:24.372 INFO:teuthology.orchestra.run.smithi196.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-12T01:55:24.372 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-12T01:55:24.372 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-12T01:55:24.372 INFO:teuthology.orchestra.run.smithi196.stdout:Enabling module streams: 2023-07-12T01:55:24.373 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql 10 2023-07-12T01:55:24.373 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T01:55:24.373 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2023-07-12T01:55:24.373 INFO:teuthology.orchestra.run.smithi196.stdout:==================================================================================================== 2023-07-12T01:55:24.373 INFO:teuthology.orchestra.run.smithi196.stdout:Install 128 Packages 2023-07-12T01:55:24.373 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrade 16 Packages 2023-07-12T01:55:24.373 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T01:55:24.374 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 212 M 2023-07-12T01:55:24.374 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2023-07-12T01:55:25.459 INFO:teuthology.orchestra.run.smithi196.stdout:(1/144): ceph-18.0.0-4828.gb5891ed6.el8.x86_64. 17 kB/s | 6.4 kB 00:00 2023-07-12T01:55:25.976 INFO:teuthology.orchestra.run.smithi196.stdout:(2/144): ceph-fuse-18.0.0-4828.gb5891ed6.el8.x8 1.6 MB/s | 848 kB 00:00 2023-07-12T01:55:26.085 INFO:teuthology.orchestra.run.smithi196.stdout:(3/144): ceph-base-18.0.0-4828.gb5891ed6.el8.x8 5.3 MB/s | 5.4 MB 00:01 2023-07-12T01:55:26.110 INFO:teuthology.orchestra.run.smithi196.stdout:(4/144): ceph-immutable-object-cache-18.0.0-482 1.2 MB/s | 165 kB 00:00 2023-07-12T01:55:26.335 INFO:teuthology.orchestra.run.smithi196.stdout:(5/144): ceph-mds-18.0.0-4828.gb5891ed6.el8.x86 9.1 MB/s | 2.3 MB 00:00 2023-07-12T01:55:26.652 INFO:teuthology.orchestra.run.smithi196.stdout:(6/144): ceph-mgr-18.0.0-4828.gb5891ed6.el8.x86 2.9 MB/s | 1.5 MB 00:00 2023-07-12T01:55:26.666 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 3.7 MB/s | 16 MB 00:04 2023-07-12T01:55:26.794 INFO:teuthology.orchestra.run.smithi196.stdout:(7/144): ceph-mon-18.0.0-4828.gb5891ed6.el8.x86 10 MB/s | 4.6 MB 00:00 2023-07-12T01:55:27.286 INFO:teuthology.orchestra.run.smithi196.stdout:(8/144): ceph-common-18.0.0-4828.gb5891ed6.el8. 10 MB/s | 22 MB 00:02 2023-07-12T01:55:27.353 INFO:teuthology.orchestra.run.smithi196.stdout:(9/144): ceph-selinux-18.0.0-4828.gb5891ed6.el8 368 kB/s | 24 kB 00:00 2023-07-12T01:55:28.137 INFO:teuthology.orchestra.run.smithi196.stdout:(10/144): ceph-radosgw-18.0.0-4828.gb5891ed6.el 10 MB/s | 13 MB 00:01 2023-07-12T01:55:28.229 INFO:teuthology.orchestra.run.smithi196.stdout:(11/144): cephfs-mirror-18.0.0-4828.gb5891ed6.e 2.8 MB/s | 258 kB 00:00 2023-07-12T01:55:28.329 INFO:teuthology.orchestra.run.smithi196.stdout:(12/144): libcephfs-devel-18.0.0-4828.gb5891ed6 311 kB/s | 31 kB 00:00 2023-07-12T01:55:28.870 INFO:teuthology.orchestra.run.smithi196.stdout:(13/144): libcephfs2-18.0.0-4828.gb5891ed6.el8. 1.4 MB/s | 771 kB 00:00 2023-07-12T01:55:29.071 INFO:teuthology.orchestra.run.smithi196.stdout:(14/144): ceph-osd-18.0.0-4828.gb5891ed6.el8.x8 7.3 MB/s | 18 MB 00:02 2023-07-12T01:55:29.088 INFO:teuthology.orchestra.run.smithi196.stdout:(15/144): libcephsqlite-18.0.0-4828.gb5891ed6.e 634 kB/s | 137 kB 00:00 2023-07-12T01:55:29.129 INFO:teuthology.orchestra.run.smithi196.stdout:(16/144): librados-devel-18.0.0-4828.gb5891ed6. 2.3 MB/s | 139 kB 00:00 2023-07-12T01:55:29.155 INFO:teuthology.orchestra.run.smithi196.stdout:(17/144): libradosstriper1-18.0.0-4828.gb5891ed 6.9 MB/s | 473 kB 00:00 2023-07-12T01:55:29.230 INFO:teuthology.orchestra.run.smithi196.stdout:(18/144): python3-ceph-argparse-18.0.0-4828.gb5 596 kB/s | 45 kB 00:00 2023-07-12T01:55:29.306 INFO:teuthology.orchestra.run.smithi196.stdout:(19/144): python3-ceph-common-18.0.0-4828.gb589 1.6 MB/s | 122 kB 00:00 2023-07-12T01:55:29.389 INFO:teuthology.orchestra.run.smithi196.stdout:(20/144): python3-cephfs-18.0.0-4828.gb5891ed6. 2.3 MB/s | 197 kB 00:00 2023-07-12T01:55:29.489 INFO:teuthology.orchestra.run.smithi196.stdout:(21/144): python3-rados-18.0.0-4828.gb5891ed6.e 3.6 MB/s | 371 kB 00:00 2023-07-12T01:55:29.590 INFO:teuthology.orchestra.run.smithi196.stdout:(22/144): python3-rbd-18.0.0-4828.gb5891ed6.el8 3.6 MB/s | 364 kB 00:00 2023-07-12T01:55:29.673 INFO:teuthology.orchestra.run.smithi196.stdout:(23/144): python3-rgw-18.0.0-4828.gb5891ed6.el8 1.3 MB/s | 107 kB 00:00 2023-07-12T01:55:29.757 INFO:teuthology.orchestra.run.smithi196.stdout:(24/144): rbd-fuse-18.0.0-4828.gb5891ed6.el8.x8 1.1 MB/s | 94 kB 00:00 2023-07-12T01:55:29.849 INFO:teuthology.orchestra.run.smithi196.stdout:(25/144): librgw2-18.0.0-4828.gb5891ed6.el8.x86 9.4 MB/s | 6.7 MB 00:00 2023-07-12T01:55:29.941 INFO:teuthology.orchestra.run.smithi196.stdout:(26/144): rbd-nbd-18.0.0-4828.gb5891ed6.el8.x86 1.9 MB/s | 180 kB 00:00 2023-07-12T01:55:30.025 INFO:teuthology.orchestra.run.smithi196.stdout:(27/144): ceph-grafana-dashboards-18.0.0-4828.g 278 kB/s | 23 kB 00:00 2023-07-12T01:55:30.117 INFO:teuthology.orchestra.run.smithi196.stdout:(28/144): ceph-mgr-cephadm-18.0.0-4828.gb5891ed 1.4 MB/s | 129 kB 00:00 2023-07-12T01:55:30.192 INFO:teuthology.orchestra.run.smithi196.stdout:(29/144): rbd-mirror-18.0.0-4828.gb5891ed6.el8. 7.9 MB/s | 3.4 MB 00:00 2023-07-12T01:55:30.376 INFO:teuthology.orchestra.run.smithi196.stdout:(30/144): ceph-mgr-dashboard-18.0.0-4828.gb5891 6.6 MB/s | 1.7 MB 00:00 2023-07-12T01:55:30.492 INFO:teuthology.orchestra.run.smithi196.stdout:(31/144): ceph-mgr-modules-core-18.0.0-4828.gb5 2.0 MB/s | 240 kB 00:00 2023-07-12T01:55:30.576 INFO:teuthology.orchestra.run.smithi196.stdout:(32/144): ceph-mgr-rook-18.0.0-4828.gb5891ed6.e 566 kB/s | 47 kB 00:00 2023-07-12T01:55:31.185 INFO:teuthology.orchestra.run.smithi196.stdout:(33/144): ceph-test-18.0.0-4828.gb5891ed6.el8.x 12 MB/s | 48 MB 00:03 2023-07-12T01:55:31.211 INFO:teuthology.orchestra.run.smithi196.stdout:(34/144): ceph-prometheus-alerts-18.0.0-4828.gb 23 kB/s | 15 kB 00:00 2023-07-12T01:55:31.278 INFO:teuthology.orchestra.run.smithi196.stdout:(35/144): cephadm-18.0.0-4828.gb5891ed6.el8.noa 2.4 MB/s | 164 kB 00:00 2023-07-12T01:55:31.303 INFO:teuthology.orchestra.run.smithi196.stdout:(36/144): ceph-volume-18.0.0-4828.gb5891ed6.el8 2.2 MB/s | 258 kB 00:00 2023-07-12T01:55:31.304 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 376 kB/s | 24 kB 00:00 2023-07-12T01:55:31.395 INFO:teuthology.orchestra.run.smithi196.stdout:(37/144): ceph-mgr-diskprediction-local-18.0.0- 6.2 MB/s | 7.4 MB 00:01 2023-07-12T01:55:31.412 INFO:teuthology.orchestra.run.smithi196.stdout:(38/144): cephfs-top-18.0.0-4828.gb5891ed6.el8. 134 kB/s | 18 kB 00:00 2023-07-12T01:55:35.563 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-12T01:55:35.564 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-12T01:55:35.577 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-12T01:55:35.577 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-12T01:55:35.578 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-12T01:55:35.579 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-12T01:55:35.580 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-12T01:55:35.582 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-12T01:55:35.585 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-12T01:55:35.586 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-12T01:55:35.788 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-12T01:55:35.803 INFO:teuthology.orchestra.run.smithi037.stdout:==================================================================================================== 2023-07-12T01:55:35.803 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-07-12T01:55:35.803 INFO:teuthology.orchestra.run.smithi037.stdout:==================================================================================================== 2023-07-12T01:55:35.803 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-12T01:55:35.803 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-12T01:55:35.804 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.4 k 2023-07-12T01:55:35.804 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 5.4 M 2023-07-12T01:55:35.804 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 848 k 2023-07-12T01:55:35.804 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 165 k 2023-07-12T01:55:35.804 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 1.5 M 2023-07-12T01:55:35.804 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 129 k 2023-07-12T01:55:35.804 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 1.7 M 2023-07-12T01:55:35.805 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 7.4 M 2023-07-12T01:55:35.805 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 47 k 2023-07-12T01:55:35.805 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 13 M 2023-07-12T01:55:35.805 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 48 M 2023-07-12T01:55:35.805 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 258 k 2023-07-12T01:55:35.805 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 164 k 2023-07-12T01:55:35.805 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 258 k 2023-07-12T01:55:35.805 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 18 k 2023-07-12T01:55:35.806 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-12T01:55:35.806 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-12T01:55:35.806 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-12T01:55:35.806 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 31 k 2023-07-12T01:55:35.806 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 771 k 2023-07-12T01:55:35.806 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 139 k 2023-07-12T01:55:35.806 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-12T01:55:35.807 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-12T01:55:35.807 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-12T01:55:35.807 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-12T01:55:35.807 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-12T01:55:35.807 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-12T01:55:35.807 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 197 k 2023-07-12T01:55:35.807 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 371 k 2023-07-12T01:55:35.807 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 364 k 2023-07-12T01:55:35.808 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 107 k 2023-07-12T01:55:35.808 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 94 k 2023-07-12T01:55:35.808 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.4 M 2023-07-12T01:55:35.808 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 180 k 2023-07-12T01:55:35.808 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-12T01:55:35.808 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2023-07-12T01:55:35.808 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-12T01:55:35.809 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-12T01:55:35.809 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-12T01:55:35.809 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-12T01:55:35.809 INFO:teuthology.orchestra.run.smithi037.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-12T01:55:35.809 INFO:teuthology.orchestra.run.smithi037.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-12T01:55:35.809 INFO:teuthology.orchestra.run.smithi037.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-12T01:55:35.809 INFO:teuthology.orchestra.run.smithi037.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-12T01:55:35.809 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.7 M 2023-07-12T01:55:35.810 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.6 M 2023-07-12T01:55:35.810 INFO:teuthology.orchestra.run.smithi037.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-12T01:55:35.810 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-12T01:55:35.810 INFO:teuthology.orchestra.run.smithi037.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-12T01:55:35.810 INFO:teuthology.orchestra.run.smithi037.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-12T01:55:35.810 INFO:teuthology.orchestra.run.smithi037.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-12T01:55:35.810 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-12T01:55:35.810 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-07-12T01:55:35.811 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-12T01:55:35.811 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 22 M 2023-07-12T01:55:35.811 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 23 k 2023-07-12T01:55:35.811 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 2.3 M 2023-07-12T01:55:35.811 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 240 k 2023-07-12T01:55:35.811 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 4.6 M 2023-07-12T01:55:35.811 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 18 M 2023-07-12T01:55:35.811 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 15 k 2023-07-12T01:55:35.812 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 24 k 2023-07-12T01:55:35.812 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-12T01:55:35.812 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-12T01:55:35.812 INFO:teuthology.orchestra.run.smithi037.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-12T01:55:35.812 INFO:teuthology.orchestra.run.smithi037.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-12T01:55:35.812 INFO:teuthology.orchestra.run.smithi037.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-12T01:55:35.812 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 137 k 2023-07-12T01:55:35.812 INFO:teuthology.orchestra.run.smithi037.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-12T01:55:35.813 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-12T01:55:35.813 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-12T01:55:35.813 INFO:teuthology.orchestra.run.smithi037.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-12T01:55:35.813 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-12T01:55:35.813 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-12T01:55:35.813 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 473 k 2023-07-12T01:55:35.813 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-12T01:55:35.813 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.7 M 2023-07-12T01:55:35.814 INFO:teuthology.orchestra.run.smithi037.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-12T01:55:35.814 INFO:teuthology.orchestra.run.smithi037.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-12T01:55:35.814 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-12T01:55:35.814 INFO:teuthology.orchestra.run.smithi037.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-12T01:55:35.814 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-12T01:55:35.814 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-12T01:55:35.814 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-12T01:55:35.815 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-12T01:55:35.815 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-12T01:55:35.815 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-12T01:55:35.815 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-12T01:55:35.815 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-12T01:55:35.815 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-12T01:55:35.815 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-12T01:55:35.816 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-12T01:55:35.816 INFO:teuthology.orchestra.run.smithi037.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-12T01:55:35.816 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-12T01:55:35.816 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 45 k 2023-07-12T01:55:35.816 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 122 k 2023-07-12T01:55:35.816 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-12T01:55:35.816 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-12T01:55:35.817 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-12T01:55:35.817 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-12T01:55:35.817 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-12T01:55:35.817 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-12T01:55:35.817 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-12T01:55:35.817 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-12T01:55:35.817 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-12T01:55:35.817 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-12T01:55:35.818 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-12T01:55:35.818 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-12T01:55:35.818 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-12T01:55:35.818 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-12T01:55:35.818 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-12T01:55:35.818 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-12T01:55:35.818 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-12T01:55:35.818 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-12T01:55:35.819 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-12T01:55:35.819 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-12T01:55:35.819 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-12T01:55:35.819 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-12T01:55:35.819 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-12T01:55:35.819 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-12T01:55:35.819 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-12T01:55:35.819 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-12T01:55:35.820 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-12T01:55:35.820 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-12T01:55:35.820 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-12T01:55:35.820 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-12T01:55:35.820 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-12T01:55:35.820 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-12T01:55:35.820 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-12T01:55:35.821 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-12T01:55:35.821 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-12T01:55:35.821 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-12T01:55:35.821 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-12T01:55:35.821 INFO:teuthology.orchestra.run.smithi037.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-12T01:55:35.821 INFO:teuthology.orchestra.run.smithi037.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-12T01:55:35.821 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-12T01:55:35.822 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-12T01:55:35.822 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-12T01:55:35.822 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-12T01:55:35.822 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-12T01:55:35.822 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-12T01:55:35.822 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-12T01:55:35.822 INFO:teuthology.orchestra.run.smithi037.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-12T01:55:35.822 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-12T01:55:35.823 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-12T01:55:35.823 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling module streams: 2023-07-12T01:55:35.823 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql 10 2023-07-12T01:55:35.823 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T01:55:35.823 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-12T01:55:35.823 INFO:teuthology.orchestra.run.smithi037.stdout:==================================================================================================== 2023-07-12T01:55:35.823 INFO:teuthology.orchestra.run.smithi037.stdout:Install 128 Packages 2023-07-12T01:55:35.823 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 16 Packages 2023-07-12T01:55:35.824 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T01:55:35.824 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 212 M 2023-07-12T01:55:35.824 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-12T01:55:36.631 INFO:teuthology.orchestra.run.smithi037.stdout:(1/144): ceph-18.0.0-4828.gb5891ed6.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2023-07-12T01:55:36.794 INFO:teuthology.orchestra.run.smithi196.stdout:(39/144): flex-2.6.1-9.el8.x86_64.rpm 59 kB/s | 320 kB 00:05 2023-07-12T01:55:36.986 INFO:teuthology.orchestra.run.smithi196.stdout:(40/144): bison-3.0.4-10.el8.x86_64.rpm 123 kB/s | 688 kB 00:05 2023-07-12T01:55:37.406 INFO:teuthology.orchestra.run.smithi037.stdout:(2/144): ceph-fuse-18.0.0-4828.gb5891ed6.el8.x8 1.1 MB/s | 848 kB 00:00 2023-07-12T01:55:37.498 INFO:teuthology.orchestra.run.smithi037.stdout:(3/144): ceph-immutable-object-cache-18.0.0-482 1.8 MB/s | 165 kB 00:00 2023-07-12T01:55:37.612 INFO:teuthology.orchestra.run.smithi196.stdout:(41/144): automake-1.16.1-7.el8.noarch.rpm 113 kB/s | 713 kB 00:06 2023-07-12T01:55:38.345 INFO:teuthology.orchestra.run.smithi196.stdout:(42/144): libpq-13.5-1.el8.x86_64.rpm 145 kB/s | 198 kB 00:01 2023-07-12T01:55:38.757 INFO:teuthology.orchestra.run.smithi037.stdout:(4/144): ceph-mds-18.0.0-4828.gb5891ed6.el8.x86 1.8 MB/s | 2.3 MB 00:01 2023-07-12T01:55:39.170 INFO:teuthology.orchestra.run.smithi196.stdout:(43/144): jq-1.6-7.el8.x86_64.rpm 85 kB/s | 202 kB 00:02 2023-07-12T01:55:39.423 INFO:teuthology.orchestra.run.smithi037.stdout:(5/144): ceph-mgr-18.0.0-4828.gb5891ed6.el8.x86 2.3 MB/s | 1.5 MB 00:00 2023-07-12T01:55:39.762 INFO:teuthology.orchestra.run.smithi196.stdout:(44/144): librdkafka-0.11.4-3.el8.x86_64.rpm 165 kB/s | 354 kB 00:02 2023-07-12T01:55:40.765 INFO:teuthology.orchestra.run.smithi037.stdout:(6/144): ceph-mon-18.0.0-4828.gb5891ed6.el8.x86 3.4 MB/s | 4.6 MB 00:01 2023-07-12T01:55:41.329 INFO:teuthology.orchestra.run.smithi196.stdout:(45/144): libtool-2.4.6-25.el8.x86_64.rpm 238 kB/s | 709 kB 00:02 2023-07-12T01:55:41.829 INFO:teuthology.orchestra.run.smithi196.stdout:(46/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 98 kB/s | 259 kB 00:02 2023-07-12T01:55:41.882 INFO:teuthology.orchestra.run.smithi037.stdout:(7/144): ceph-base-18.0.0-4828.gb5891ed6.el8.x8 987 kB/s | 5.4 MB 00:05 2023-07-12T01:55:43.266 INFO:teuthology.orchestra.run.smithi037.stdout:(8/144): ceph-osd-18.0.0-4828.gb5891ed6.el8.x86 7.1 MB/s | 18 MB 00:02 2023-07-12T01:55:43.316 INFO:teuthology.orchestra.run.smithi037.stdout:(9/144): ceph-selinux-18.0.0-4828.gb5891ed6.el8 492 kB/s | 24 kB 00:00 2023-07-12T01:55:44.337 INFO:teuthology.orchestra.run.smithi196.stdout:(47/144): oniguruma-6.8.2-2.el8.x86_64.rpm 41 kB/s | 187 kB 00:04 2023-07-12T01:55:45.482 INFO:teuthology.orchestra.run.smithi037.stdout:(10/144): ceph-common-18.0.0-4828.gb5891ed6.el8 2.4 MB/s | 22 MB 00:09 2023-07-12T01:55:45.582 INFO:teuthology.orchestra.run.smithi037.stdout:(11/144): cephfs-mirror-18.0.0-4828.gb5891ed6.e 2.5 MB/s | 258 kB 00:00 2023-07-12T01:55:45.641 INFO:teuthology.orchestra.run.smithi037.stdout:(12/144): libcephfs-devel-18.0.0-4828.gb5891ed6 534 kB/s | 31 kB 00:00 2023-07-12T01:55:45.850 INFO:teuthology.orchestra.run.smithi037.stdout:(13/144): libcephfs2-18.0.0-4828.gb5891ed6.el8. 3.6 MB/s | 771 kB 00:00 2023-07-12T01:55:45.917 INFO:teuthology.orchestra.run.smithi037.stdout:(14/144): libcephsqlite-18.0.0-4828.gb5891ed6.e 2.0 MB/s | 137 kB 00:00 2023-07-12T01:55:45.984 INFO:teuthology.orchestra.run.smithi037.stdout:(15/144): librados-devel-18.0.0-4828.gb5891ed6. 2.0 MB/s | 139 kB 00:00 2023-07-12T01:55:46.126 INFO:teuthology.orchestra.run.smithi037.stdout:(16/144): libradosstriper1-18.0.0-4828.gb5891ed 3.3 MB/s | 473 kB 00:00 2023-07-12T01:55:46.409 INFO:teuthology.orchestra.run.smithi037.stdout:(17/144): ceph-radosgw-18.0.0-4828.gb5891ed6.el 3.0 MB/s | 13 MB 00:04 2023-07-12T01:55:46.476 INFO:teuthology.orchestra.run.smithi037.stdout:(18/144): python3-ceph-argparse-18.0.0-4828.gb5 676 kB/s | 45 kB 00:00 2023-07-12T01:55:46.543 INFO:teuthology.orchestra.run.smithi037.stdout:(19/144): python3-ceph-common-18.0.0-4828.gb589 1.8 MB/s | 122 kB 00:00 2023-07-12T01:55:46.652 INFO:teuthology.orchestra.run.smithi037.stdout:(20/144): python3-cephfs-18.0.0-4828.gb5891ed6. 1.8 MB/s | 197 kB 00:00 2023-07-12T01:55:46.810 INFO:teuthology.orchestra.run.smithi037.stdout:(21/144): python3-rados-18.0.0-4828.gb5891ed6.e 2.3 MB/s | 371 kB 00:00 2023-07-12T01:55:46.961 INFO:teuthology.orchestra.run.smithi037.stdout:(22/144): python3-rbd-18.0.0-4828.gb5891ed6.el8 2.4 MB/s | 364 kB 00:00 2023-07-12T01:55:47.019 INFO:teuthology.orchestra.run.smithi037.stdout:(23/144): python3-rgw-18.0.0-4828.gb5891ed6.el8 1.8 MB/s | 107 kB 00:00 2023-07-12T01:55:47.086 INFO:teuthology.orchestra.run.smithi037.stdout:(24/144): rbd-fuse-18.0.0-4828.gb5891ed6.el8.x8 1.4 MB/s | 94 kB 00:00 2023-07-12T01:55:47.945 INFO:teuthology.orchestra.run.smithi037.stdout:(25/144): ceph-test-18.0.0-4828.gb5891ed6.el8.x 10 MB/s | 48 MB 00:04 2023-07-12T01:55:48.045 INFO:teuthology.orchestra.run.smithi037.stdout:(26/144): librgw2-18.0.0-4828.gb5891ed6.el8.x86 3.5 MB/s | 6.7 MB 00:01 2023-07-12T01:55:48.071 INFO:teuthology.orchestra.run.smithi037.stdout:(27/144): rbd-nbd-18.0.0-4828.gb5891ed6.el8.x86 1.4 MB/s | 180 kB 00:00 2023-07-12T01:55:48.104 INFO:teuthology.orchestra.run.smithi037.stdout:(28/144): ceph-grafana-dashboards-18.0.0-4828.g 395 kB/s | 23 kB 00:00 2023-07-12T01:55:48.129 INFO:teuthology.orchestra.run.smithi037.stdout:(29/144): ceph-mgr-cephadm-18.0.0-4828.gb5891ed 2.2 MB/s | 129 kB 00:00 2023-07-12T01:55:48.188 INFO:teuthology.orchestra.run.smithi037.stdout:(30/144): rbd-mirror-18.0.0-4828.gb5891ed6.el8. 3.1 MB/s | 3.4 MB 00:01 2023-07-12T01:55:48.313 INFO:teuthology.orchestra.run.smithi037.stdout:(31/144): ceph-mgr-modules-core-18.0.0-4828.gb5 1.9 MB/s | 240 kB 00:00 2023-07-12T01:55:48.397 INFO:teuthology.orchestra.run.smithi037.stdout:(32/144): ceph-mgr-rook-18.0.0-4828.gb5891ed6.e 570 kB/s | 47 kB 00:00 2023-07-12T01:55:48.464 INFO:teuthology.orchestra.run.smithi037.stdout:(33/144): ceph-prometheus-alerts-18.0.0-4828.gb 219 kB/s | 15 kB 00:00 2023-07-12T01:55:48.564 INFO:teuthology.orchestra.run.smithi037.stdout:(34/144): ceph-volume-18.0.0-4828.gb5891ed6.el8 2.5 MB/s | 258 kB 00:00 2023-07-12T01:55:48.606 INFO:teuthology.orchestra.run.smithi037.stdout:(35/144): ceph-mgr-dashboard-18.0.0-4828.gb5891 3.4 MB/s | 1.7 MB 00:00 2023-07-12T01:55:48.632 INFO:teuthology.orchestra.run.smithi037.stdout:(36/144): cephadm-18.0.0-4828.gb5891ed6.el8.noa 2.4 MB/s | 164 kB 00:00 2023-07-12T01:55:48.657 INFO:teuthology.orchestra.run.smithi037.stdout:(37/144): cephfs-top-18.0.0-4828.gb5891ed6.el8. 358 kB/s | 18 kB 00:00 2023-07-12T01:55:48.816 INFO:teuthology.orchestra.run.smithi037.stdout:(38/144): ceph-mgr-diskprediction-local-18.0.0- 11 MB/s | 7.4 MB 00:00 2023-07-12T01:55:50.262 INFO:teuthology.orchestra.run.smithi196.stdout:(48/144): postgresql-10.23-1.module_el8+300+2c5 270 kB/s | 1.6 MB 00:05 2023-07-12T01:55:51.707 INFO:teuthology.orchestra.run.smithi037.stdout:(39/144): flex-2.6.1-9.el8.x86_64.rpm 111 kB/s | 320 kB 00:02 2023-07-12T01:55:53.049 INFO:teuthology.orchestra.run.smithi037.stdout:(40/144): jq-1.6-7.el8.x86_64.rpm 151 kB/s | 202 kB 00:01 2023-07-12T01:55:53.945 INFO:teuthology.orchestra.run.smithi196.stdout:(49/144): postgresql-contrib-10.23-1.module_el8 245 kB/s | 903 kB 00:03 2023-07-12T01:55:54.874 INFO:teuthology.orchestra.run.smithi037.stdout:(41/144): libpq-13.5-1.el8.x86_64.rpm 108 kB/s | 198 kB 00:01 2023-07-12T01:55:55.158 INFO:teuthology.orchestra.run.smithi037.stdout:(42/144): bison-3.0.4-10.el8.x86_64.rpm 106 kB/s | 688 kB 00:06 2023-07-12T01:55:56.266 INFO:teuthology.orchestra.run.smithi037.stdout:(43/144): librdkafka-0.11.4-3.el8.x86_64.rpm 254 kB/s | 354 kB 00:01 2023-07-12T01:55:58.216 INFO:teuthology.orchestra.run.smithi037.stdout:(44/144): libtool-2.4.6-25.el8.x86_64.rpm 232 kB/s | 709 kB 00:03 2023-07-12T01:55:58.700 INFO:teuthology.orchestra.run.smithi037.stdout:(45/144): automake-1.16.1-7.el8.noarch.rpm 71 kB/s | 713 kB 00:10 2023-07-12T01:55:59.886 INFO:teuthology.orchestra.run.smithi196.stdout:(50/144): openblas-0.3.15-4.el8.x86_64.rpm 261 kB/s | 4.7 MB 00:18 2023-07-12T01:56:01.091 INFO:teuthology.orchestra.run.smithi037.stdout:(46/144): oniguruma-6.8.2-2.el8.x86_64.rpm 65 kB/s | 187 kB 00:02 2023-07-12T01:56:10.476 INFO:teuthology.orchestra.run.smithi196.stdout:(51/144): openblas-threads-0.3.15-4.el8.x86_64. 174 kB/s | 4.9 MB 00:28 2023-07-12T01:56:12.759 INFO:teuthology.orchestra.run.smithi196.stdout:(52/144): python3-jinja2-2.10.1-3.el8.noarch.rp 236 kB/s | 538 kB 00:02 2023-07-12T01:56:12.943 INFO:teuthology.orchestra.run.smithi196.stdout:(53/144): python3-jsonpatch-1.21-2.el8.noarch.r 145 kB/s | 27 kB 00:00 2023-07-12T01:56:13.060 INFO:teuthology.orchestra.run.smithi196.stdout:(54/144): postgresql-server-10.23-1.module_el8+ 274 kB/s | 5.1 MB 00:19 2023-07-12T01:56:13.361 INFO:teuthology.orchestra.run.smithi196.stdout:(55/144): python3-jsonpointer-1.10-11.el8.noarc 48 kB/s | 20 kB 00:00 2023-07-12T01:56:13.861 INFO:teuthology.orchestra.run.smithi196.stdout:(56/144): python3-markupsafe-0.23-19.el8.x86_64 78 kB/s | 39 kB 00:00 2023-07-12T01:56:21.548 INFO:teuthology.orchestra.run.smithi037.stdout:(47/144): openblas-threads-0.3.15-4.el8.x86_64. 243 kB/s | 4.9 MB 00:20 2023-07-12T01:56:22.465 INFO:teuthology.orchestra.run.smithi037.stdout:(48/144): openblas-0.3.15-4.el8.x86_64.rpm 204 kB/s | 4.7 MB 00:23 2023-07-12T01:56:25.832 INFO:teuthology.orchestra.run.smithi037.stdout:(49/144): postgresql-contrib-10.23-1.module_el8 268 kB/s | 903 kB 00:03 2023-07-12T01:56:26.376 INFO:teuthology.orchestra.run.smithi196.stdout:(57/144): python3-babel-2.5.1-7.el8.noarch.rpm 185 kB/s | 4.8 MB 00:26 2023-07-12T01:56:27.175 INFO:teuthology.orchestra.run.smithi196.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 282 kB/s | 225 kB 00:00 2023-07-12T01:56:27.393 INFO:teuthology.orchestra.run.smithi196.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 203 kB/s | 44 kB 00:00 2023-07-12T01:56:28.351 INFO:teuthology.orchestra.run.smithi196.stdout:(60/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 108 kB/s | 103 kB 00:00 2023-07-12T01:56:28.685 INFO:teuthology.orchestra.run.smithi196.stdout:(61/144): python3-numpy-1.14.3-10.el8.x86_64.rp 258 kB/s | 3.7 MB 00:14 2023-07-12T01:56:28.835 INFO:teuthology.orchestra.run.smithi196.stdout:(62/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 261 kB/s | 126 kB 00:00 2023-07-12T01:56:29.110 INFO:teuthology.orchestra.run.smithi196.stdout:(63/144): python3-pyasn1-modules-0.3.7-6.el8.no 259 kB/s | 110 kB 00:00 2023-07-12T01:56:29.635 INFO:teuthology.orchestra.run.smithi196.stdout:(64/144): python3-pytz-2017.2-9.el8.noarch.rpm 68 kB/s | 54 kB 00:00 2023-07-12T01:56:31.460 INFO:teuthology.orchestra.run.smithi196.stdout:(65/144): python3-werkzeug-0.12.2-4.el8.noarch. 251 kB/s | 457 kB 00:01 2023-07-12T01:56:34.144 INFO:teuthology.orchestra.run.smithi196.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 120 kB/s | 323 kB 00:02 2023-07-12T01:56:34.444 INFO:teuthology.orchestra.run.smithi196.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 213 kB/s | 64 kB 00:00 2023-07-12T01:56:35.019 INFO:teuthology.orchestra.run.smithi196.stdout:(68/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 123 kB/s | 71 kB 00:00 2023-07-12T01:56:35.244 INFO:teuthology.orchestra.run.smithi196.stdout:(69/144): elfutils-libelf-devel-0.189-2.el8.x86 274 kB/s | 61 kB 00:00 2023-07-12T01:56:35.344 INFO:teuthology.orchestra.run.smithi196.stdout:(70/144): fuse-2.9.7-17.el8.x86_64.rpm 832 kB/s | 83 kB 00:00 2023-07-12T01:56:35.403 INFO:teuthology.orchestra.run.smithi196.stdout:(71/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 826 kB/s | 48 kB 00:00 2023-07-12T01:56:35.586 INFO:teuthology.orchestra.run.smithi196.stdout:(72/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 3.0 MB/s | 561 kB 00:00 2023-07-12T01:56:35.645 INFO:teuthology.orchestra.run.smithi196.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 321 kB/s | 19 kB 00:00 2023-07-12T01:56:35.712 INFO:teuthology.orchestra.run.smithi196.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 581 kB/s | 39 kB 00:00 2023-07-12T01:56:35.854 INFO:teuthology.orchestra.run.smithi196.stdout:(75/144): libgfortran-8.5.0-20.el8.x86_64.rpm 4.4 MB/s | 645 kB 00:00 2023-07-12T01:56:35.921 INFO:teuthology.orchestra.run.smithi196.stdout:(76/144): libquadmath-8.5.0-20.el8.x86_64.rpm 2.5 MB/s | 172 kB 00:00 2023-07-12T01:56:36.005 INFO:teuthology.orchestra.run.smithi196.stdout:(77/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 565 kB/s | 47 kB 00:00 2023-07-12T01:56:36.080 INFO:teuthology.orchestra.run.smithi196.stdout:(78/144): libselinux-devel-2.9-8.el8.x86_64.rpm 2.6 MB/s | 200 kB 00:00 2023-07-12T01:56:36.147 INFO:teuthology.orchestra.run.smithi196.stdout:(79/144): libsepol-devel-2.9-3.el8.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2023-07-12T01:56:36.206 INFO:teuthology.orchestra.run.smithi196.stdout:(80/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.7 MB/s | 99 kB 00:00 2023-07-12T01:56:36.281 INFO:teuthology.orchestra.run.smithi196.stdout:(81/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 241 kB/s | 18 kB 00:00 2023-07-12T01:56:36.348 INFO:teuthology.orchestra.run.smithi196.stdout:(82/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 674 kB/s | 44 kB 00:00 2023-07-12T01:56:36.873 INFO:teuthology.orchestra.run.smithi196.stdout:(83/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 6.1 MB/s | 3.2 MB 00:00 2023-07-12T01:56:36.990 INFO:teuthology.orchestra.run.smithi196.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 5.1 MB/s | 605 kB 00:00 2023-07-12T01:56:37.057 INFO:teuthology.orchestra.run.smithi196.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.4 MB/s | 229 kB 00:00 2023-07-12T01:56:37.132 INFO:teuthology.orchestra.run.smithi196.stdout:(86/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2023-07-12T01:56:37.199 INFO:teuthology.orchestra.run.smithi196.stdout:(87/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 3.6 MB/s | 249 kB 00:00 2023-07-12T01:56:37.316 INFO:teuthology.orchestra.run.smithi196.stdout:(88/144): python3-cryptography-3.2.1-6.el8.x86_ 5.4 MB/s | 641 kB 00:00 2023-07-12T01:56:37.383 INFO:teuthology.orchestra.run.smithi196.stdout:(89/144): python3-jwt-1.6.1-2.el8.noarch.rpm 650 kB/s | 43 kB 00:00 2023-07-12T01:56:37.450 INFO:teuthology.orchestra.run.smithi196.stdout:(90/144): python3-oauthlib-2.1.0-1.el8.noarch.r 2.3 MB/s | 155 kB 00:00 2023-07-12T01:56:37.517 INFO:teuthology.orchestra.run.smithi196.stdout:(91/144): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2023-07-12T01:56:37.556 INFO:teuthology.orchestra.run.smithi037.stdout:(50/144): postgresql-10.23-1.module_el8+300+2c5 100 kB/s | 1.6 MB 00:16 2023-07-12T01:56:37.575 INFO:teuthology.orchestra.run.smithi196.stdout:(92/144): python3-requests-oauthlib-1.0.0-1.el8 733 kB/s | 43 kB 00:00 2023-07-12T01:56:37.642 INFO:teuthology.orchestra.run.smithi196.stdout:(93/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.1 MB/s | 74 kB 00:00 2023-07-12T01:56:37.701 INFO:teuthology.orchestra.run.smithi196.stdout:(94/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 996 kB/s | 58 kB 00:00 2023-07-12T01:56:47.455 INFO:teuthology.orchestra.run.smithi037.stdout:(51/144): postgresql-server-10.23-1.module_el8+ 242 kB/s | 5.1 MB 00:21 2023-07-12T01:56:49.180 INFO:teuthology.orchestra.run.smithi037.stdout:(52/144): python3-jinja2-2.10.1-3.el8.noarch.rp 312 kB/s | 538 kB 00:01 2023-07-12T01:56:49.330 INFO:teuthology.orchestra.run.smithi037.stdout:(53/144): python3-jsonpatch-1.21-2.el8.noarch.r 177 kB/s | 27 kB 00:00 2023-07-12T01:56:49.764 INFO:teuthology.orchestra.run.smithi037.stdout:(54/144): python3-jsonpointer-1.10-11.el8.noarc 46 kB/s | 20 kB 00:00 2023-07-12T01:56:50.339 INFO:teuthology.orchestra.run.smithi037.stdout:(55/144): python3-mako-1.0.6-14.el8.noarch.rpm 273 kB/s | 157 kB 00:00 2023-07-12T01:56:50.773 INFO:teuthology.orchestra.run.smithi037.stdout:(56/144): python3-markupsafe-0.23-19.el8.x86_64 89 kB/s | 39 kB 00:00 2023-07-12T01:56:58.064 INFO:teuthology.orchestra.run.smithi037.stdout:(57/144): python3-babel-2.5.1-7.el8.noarch.rpm 239 kB/s | 4.8 MB 00:20 2023-07-12T01:56:58.814 INFO:teuthology.orchestra.run.smithi037.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 301 kB/s | 225 kB 00:00 2023-07-12T01:56:59.281 INFO:teuthology.orchestra.run.smithi037.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 94 kB/s | 44 kB 00:00 2023-07-12T01:56:59.681 INFO:teuthology.orchestra.run.smithi037.stdout:(60/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 259 kB/s | 103 kB 00:00 2023-07-12T01:57:04.139 INFO:teuthology.orchestra.run.smithi037.stdout:(61/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 28 kB/s | 126 kB 00:04 2023-07-12T01:57:04.673 INFO:teuthology.orchestra.run.smithi037.stdout:(62/144): python3-numpy-1.14.3-10.el8.x86_64.rp 275 kB/s | 3.7 MB 00:13 2023-07-12T01:57:04.815 INFO:teuthology.orchestra.run.smithi037.stdout:(63/144): python3-pyasn1-modules-0.3.7-6.el8.no 163 kB/s | 110 kB 00:00 2023-07-12T01:57:05.465 INFO:teuthology.orchestra.run.smithi037.stdout:(64/144): python3-pytz-2017.2-9.el8.noarch.rpm 68 kB/s | 54 kB 00:00 2023-07-12T01:57:07.607 INFO:teuthology.orchestra.run.smithi037.stdout:(65/144): python3-werkzeug-0.12.2-4.el8.noarch. 214 kB/s | 457 kB 00:02 2023-07-12T01:57:08.723 INFO:teuthology.orchestra.run.smithi037.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 289 kB/s | 323 kB 00:01 2023-07-12T01:57:09.990 INFO:teuthology.orchestra.run.smithi037.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 50 kB/s | 64 kB 00:01 2023-07-12T01:57:10.315 INFO:teuthology.orchestra.run.smithi037.stdout:(68/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 217 kB/s | 71 kB 00:00 2023-07-12T01:57:10.549 INFO:teuthology.orchestra.run.smithi037.stdout:(69/144): elfutils-libelf-devel-0.189-2.el8.x86 264 kB/s | 61 kB 00:00 2023-07-12T01:57:10.649 INFO:teuthology.orchestra.run.smithi037.stdout:(70/144): fuse-2.9.7-17.el8.x86_64.rpm 831 kB/s | 83 kB 00:00 2023-07-12T01:57:10.700 INFO:teuthology.orchestra.run.smithi037.stdout:(71/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 967 kB/s | 48 kB 00:00 2023-07-12T01:57:10.916 INFO:teuthology.orchestra.run.smithi037.stdout:(72/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 2.5 MB/s | 561 kB 00:00 2023-07-12T01:57:10.983 INFO:teuthology.orchestra.run.smithi037.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 280 kB/s | 19 kB 00:00 2023-07-12T01:57:11.042 INFO:teuthology.orchestra.run.smithi037.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 668 kB/s | 39 kB 00:00 2023-07-12T01:57:11.292 INFO:teuthology.orchestra.run.smithi037.stdout:(75/144): libgfortran-8.5.0-20.el8.x86_64.rpm 2.5 MB/s | 645 kB 00:00 2023-07-12T01:57:11.392 INFO:teuthology.orchestra.run.smithi037.stdout:(76/144): libquadmath-8.5.0-20.el8.x86_64.rpm 1.7 MB/s | 172 kB 00:00 2023-07-12T01:57:11.451 INFO:teuthology.orchestra.run.smithi037.stdout:(77/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 805 kB/s | 47 kB 00:00 2023-07-12T01:57:11.560 INFO:teuthology.orchestra.run.smithi037.stdout:(78/144): libselinux-devel-2.9-8.el8.x86_64.rpm 1.8 MB/s | 200 kB 00:00 2023-07-12T01:57:11.619 INFO:teuthology.orchestra.run.smithi037.stdout:(79/144): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-07-12T01:57:11.677 INFO:teuthology.orchestra.run.smithi037.stdout:(80/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.7 MB/s | 99 kB 00:00 2023-07-12T01:57:11.736 INFO:teuthology.orchestra.run.smithi037.stdout:(81/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 309 kB/s | 18 kB 00:00 2023-07-12T01:57:11.803 INFO:teuthology.orchestra.run.smithi037.stdout:(82/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 659 kB/s | 44 kB 00:00 2023-07-12T01:57:12.611 INFO:teuthology.orchestra.run.smithi037.stdout:(83/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 3.9 MB/s | 3.2 MB 00:00 2023-07-12T01:57:12.803 INFO:teuthology.orchestra.run.smithi037.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 3.1 MB/s | 605 kB 00:00 2023-07-12T01:57:12.920 INFO:teuthology.orchestra.run.smithi037.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2023-07-12T01:57:13.029 INFO:teuthology.orchestra.run.smithi037.stdout:(86/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-07-12T01:57:13.146 INFO:teuthology.orchestra.run.smithi037.stdout:(87/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.1 MB/s | 249 kB 00:00 2023-07-12T01:57:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:(88/144): python3-cryptography-3.2.1-6.el8.x86_ 3.3 MB/s | 641 kB 00:00 2023-07-12T01:57:13.404 INFO:teuthology.orchestra.run.smithi037.stdout:(89/144): python3-jwt-1.6.1-2.el8.noarch.rpm 642 kB/s | 43 kB 00:00 2023-07-12T01:57:13.472 INFO:teuthology.orchestra.run.smithi037.stdout:(90/144): python3-oauthlib-2.1.0-1.el8.noarch.r 2.3 MB/s | 155 kB 00:00 2023-07-12T01:57:13.530 INFO:teuthology.orchestra.run.smithi037.stdout:(91/144): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-07-12T01:57:13.589 INFO:teuthology.orchestra.run.smithi037.stdout:(92/144): python3-requests-oauthlib-1.0.0-1.el8 733 kB/s | 43 kB 00:00 2023-07-12T01:57:13.639 INFO:teuthology.orchestra.run.smithi037.stdout:(93/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.5 MB/s | 74 kB 00:00 2023-07-12T01:57:13.698 INFO:teuthology.orchestra.run.smithi037.stdout:(94/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 994 kB/s | 58 kB 00:00 2023-07-12T01:57:14.173 INFO:teuthology.orchestra.run.smithi037.stdout:(95/144): gperftools-libs-2.7-9.el8.x86_64.rpm 645 kB/s | 306 kB 00:00 2023-07-12T01:57:14.273 INFO:teuthology.orchestra.run.smithi037.stdout:(96/144): liboath-2.6.2-3.el8.x86_64.rpm 588 kB/s | 59 kB 00:00 2023-07-12T01:57:14.373 INFO:teuthology.orchestra.run.smithi037.stdout:(97/144): libunwind-1.3.1-3.el8.x86_64.rpm 752 kB/s | 75 kB 00:00 2023-07-12T01:57:14.549 INFO:teuthology.orchestra.run.smithi037.stdout:(98/144): python3-asyncssh-2.7.0-2.el8.noarch.r 2.7 MB/s | 476 kB 00:00 2023-07-12T01:57:14.657 INFO:teuthology.orchestra.run.smithi037.stdout:(99/144): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 403 kB/s | 44 kB 00:00 2023-07-12T01:57:14.766 INFO:teuthology.orchestra.run.smithi037.stdout:(100/144): python3-beautifulsoup4-4.6.3-2.el8.1 1.7 MB/s | 185 kB 00:00 2023-07-12T01:57:14.866 INFO:teuthology.orchestra.run.smithi037.stdout:(101/144): python3-cachetools-3.1.1-4.el8.noarc 331 kB/s | 33 kB 00:00 2023-07-12T01:57:14.958 INFO:teuthology.orchestra.run.smithi037.stdout:(102/144): python3-certifi-2018.10.15-7.el8.noa 178 kB/s | 16 kB 00:00 2023-07-12T01:57:15.059 INFO:teuthology.orchestra.run.smithi037.stdout:(103/144): python3-cheroot-8.5.2-1.el8.noarch.r 1.7 MB/s | 173 kB 00:00 2023-07-12T01:57:15.159 INFO:teuthology.orchestra.run.smithi037.stdout:(104/144): python3-cherrypy-18.4.0-1.el8.noarch 3.8 MB/s | 384 kB 00:00 2023-07-12T01:57:15.259 INFO:teuthology.orchestra.run.smithi037.stdout:(105/144): python3-google-auth-1.1.1-10.el8.noa 814 kB/s | 81 kB 00:00 2023-07-12T01:57:15.351 INFO:teuthology.orchestra.run.smithi037.stdout:(106/144): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-07-12T01:57:15.460 INFO:teuthology.orchestra.run.smithi037.stdout:(107/144): python3-jaraco-functools-2.0-4.el8.n 162 kB/s | 18 kB 00:00 2023-07-12T01:57:15.644 INFO:teuthology.orchestra.run.smithi037.stdout:(108/144): python3-kubernetes-11.0.0-6.el8.noar 6.4 MB/s | 1.2 MB 00:00 2023-07-12T01:57:15.735 INFO:teuthology.orchestra.run.smithi037.stdout:(109/144): python3-logutils-0.3.5-11.el8.noarch 533 kB/s | 49 kB 00:00 2023-07-12T01:57:15.836 INFO:teuthology.orchestra.run.smithi037.stdout:(110/144): python3-more-itertools-7.2.0-3.el8.n 588 kB/s | 59 kB 00:00 2023-07-12T01:57:15.928 INFO:teuthology.orchestra.run.smithi037.stdout:(111/144): python3-natsort-7.1.1-2.el8.noarch.r 658 kB/s | 60 kB 00:00 2023-07-12T01:57:16.053 INFO:teuthology.orchestra.run.smithi037.stdout:(112/144): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-07-12T01:57:16.153 INFO:teuthology.orchestra.run.smithi037.stdout:(113/144): python3-portend-2.6-1.el8.noarch.rpm 156 kB/s | 16 kB 00:00 2023-07-12T01:57:16.254 INFO:teuthology.orchestra.run.smithi037.stdout:(114/144): python3-repoze-lru-0.7-6.el8.noarch. 337 kB/s | 34 kB 00:00 2023-07-12T01:57:16.362 INFO:teuthology.orchestra.run.smithi037.stdout:(115/144): python3-routes-2.4.1-12.el8.noarch.r 1.8 MB/s | 196 kB 00:00 2023-07-12T01:57:16.471 INFO:teuthology.orchestra.run.smithi037.stdout:(116/144): python3-rsa-4.8-1.el8.noarch.rpm 567 kB/s | 61 kB 00:00 2023-07-12T01:57:16.618 INFO:teuthology.orchestra.run.smithi037.stdout:(117/144): python3-simplegeneric-0.8.1-17.el8.n 128 kB/s | 19 kB 00:00 2023-07-12T01:57:16.730 INFO:teuthology.orchestra.run.smithi037.stdout:(118/144): python3-singledispatch-3.4.0.3-18.el 214 kB/s | 24 kB 00:00 2023-07-12T01:57:16.838 INFO:teuthology.orchestra.run.smithi037.stdout:(119/144): python3-tempora-1.14.1-5.el8.noarch. 270 kB/s | 29 kB 00:00 2023-07-12T01:57:16.964 INFO:teuthology.orchestra.run.smithi037.stdout:(120/144): python3-trustme-0.6.0-4.el8.noarch.r 220 kB/s | 27 kB 00:00 2023-07-12T01:57:17.080 INFO:teuthology.orchestra.run.smithi037.stdout:(121/144): python3-waitress-1.4.3-1.el8.noarch. 2.1 MB/s | 255 kB 00:00 2023-07-12T01:57:17.198 INFO:teuthology.orchestra.run.smithi037.stdout:(122/144): python3-webob-1.8.5-1.el8.1.noarch.r 2.1 MB/s | 251 kB 00:00 2023-07-12T01:57:17.323 INFO:teuthology.orchestra.run.smithi037.stdout:(123/144): python3-websocket-client-0.56.0-5.el 491 kB/s | 61 kB 00:00 2023-07-12T01:57:17.440 INFO:teuthology.orchestra.run.smithi037.stdout:(124/144): python3-webtest-2.0.33-1.el8.noarch. 732 kB/s | 85 kB 00:00 2023-07-12T01:57:17.557 INFO:teuthology.orchestra.run.smithi037.stdout:(125/144): python3-zc-lockfile-2.0-2.el8.noarch 197 kB/s | 23 kB 00:00 2023-07-12T01:57:17.879 INFO:teuthology.orchestra.run.smithi196.stdout:(95/144): python3-mako-1.0.6-14.el8.noarch.rpm 2.4 kB/s | 157 kB 01:04 2023-07-12T01:57:18.174 INFO:teuthology.orchestra.run.smithi037.stdout:(126/144): thrift-0.13.0-2.el8.x86_64.rpm 2.8 MB/s | 1.7 MB 00:00 2023-07-12T01:57:18.566 INFO:teuthology.orchestra.run.smithi037.stdout:(127/144): librados2-18.0.0-4828.gb5891ed6.el8. 9.4 MB/s | 3.7 MB 00:00 2023-07-12T01:57:18.757 INFO:teuthology.orchestra.run.smithi037.stdout:(128/144): librbd1-18.0.0-4828.gb5891ed6.el8.x8 19 MB/s | 3.6 MB 00:00 2023-07-12T01:57:19.541 INFO:teuthology.orchestra.run.smithi037.stdout:(129/144): NetworkManager-initscripts-updown-1. 183 kB/s | 143 kB 00:00 2023-07-12T01:57:19.616 INFO:teuthology.orchestra.run.smithi037.stdout:(130/144): elfutils-debuginfod-client-0.189-2.e 1.0 MB/s | 76 kB 00:00 2023-07-12T01:57:19.800 INFO:teuthology.orchestra.run.smithi037.stdout:(131/144): elfutils-libelf-0.189-2.el8.x86_64.r 1.2 MB/s | 232 kB 00:00 2023-07-12T01:57:20.108 INFO:teuthology.orchestra.run.smithi037.stdout:(132/144): elfutils-libs-0.189-2.el8.x86_64.rpm 982 kB/s | 302 kB 00:00 2023-07-12T01:57:20.725 INFO:teuthology.orchestra.run.smithi037.stdout:(133/144): iproute-6.2.0-2.el8.x86_64.rpm 1.4 MB/s | 880 kB 00:00 2023-07-12T01:57:20.795 INFO:teuthology.orchestra.run.smithi196.stdout:(96/144): python3-scipy-1.0.0-21.module_el8.5.0 271 kB/s | 14 MB 00:51 2023-07-12T01:57:20.984 INFO:teuthology.orchestra.run.smithi037.stdout:(134/144): libblkid-2.32.1-42.el8.x86_64.rpm 853 kB/s | 220 kB 00:00 2023-07-12T01:57:21.126 INFO:teuthology.orchestra.run.smithi037.stdout:(135/144): libfdisk-2.32.1-42.el8.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2023-07-12T01:57:21.326 INFO:teuthology.orchestra.run.smithi037.stdout:(136/144): libmount-2.32.1-42.el8.x86_64.rpm 1.2 MB/s | 236 kB 00:00 2023-07-12T01:57:21.468 INFO:teuthology.orchestra.run.smithi037.stdout:(137/144): libsmartcols-2.32.1-42.el8.x86_64.rp 1.2 MB/s | 179 kB 00:00 2023-07-12T01:57:21.552 INFO:teuthology.orchestra.run.smithi037.stdout:(138/144): libuuid-2.32.1-42.el8.x86_64.rpm 1.2 MB/s | 98 kB 00:00 2023-07-12T01:57:22.577 INFO:teuthology.orchestra.run.smithi037.stdout:(139/144): util-linux-2.32.1-42.el8.x86_64.rpm 2.5 MB/s | 2.6 MB 00:01 2023-07-12T01:57:22.652 INFO:teuthology.orchestra.run.smithi037.stdout:(140/144): util-linux-user-2.32.1-42.el8.x86_64 1.3 MB/s | 102 kB 00:00 2023-07-12T01:57:22.794 INFO:teuthology.orchestra.run.smithi037.stdout:(141/144): xfsdump-3.1.8-6.el8.x86_64.rpm 2.3 MB/s | 334 kB 00:00 2023-07-12T01:57:23.069 INFO:teuthology.orchestra.run.smithi037.stdout:(142/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 3.9 MB/s | 1.1 MB 00:00 2023-07-12T01:57:47.484 INFO:teuthology.orchestra.run.smithi037.stdout:(143/144): python3-scipy-1.0.0-21.module_el8.5. 328 kB/s | 14 MB 00:42 2023-07-12T01:58:07.000 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] lttng-ust-2.8.1-11.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mnvoip.mm.fcix.net/centos/8-stream/AppStream/x86_64/os/Packages/lttng-ust-2.8.1-11.el8.x86_64.rpm [Failed to connect to mnvoip.mm.fcix.net port 80: Connection timed out] 2023-07-12T01:58:07.232 INFO:teuthology.orchestra.run.smithi037.stdout:(144/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.0 kB/s | 259 kB 02:10 2023-07-12T01:58:07.234 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-12T01:58:07.234 INFO:teuthology.orchestra.run.smithi037.stdout:Total 1.4 MB/s | 212 MB 02:31 2023-07-12T01:58:09.098 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-12T01:58:09.538 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-12T01:58:09.538 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-12T01:58:11.104 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-12T01:58:11.108 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-12T01:58:16.497 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-12T01:58:16.731 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-12T01:58:16.885 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-12T01:58:17.030 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-12T01:58:17.137 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-12T01:58:17.288 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-12T01:58:17.381 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-12T01:58:17.566 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-12T01:58:17.793 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-12T01:58:18.005 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-12T01:58:18.180 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-12T01:58:18.650 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-12T01:58:18.846 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-12T01:58:19.321 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-12T01:58:19.513 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-12T01:58:19.661 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-12T01:58:19.962 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-12T01:58:20.087 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-12T01:58:20.291 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-12T01:58:20.429 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-12T01:58:20.664 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-12T01:58:20.854 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-12T01:58:20.947 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-12T01:58:21.149 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-12T01:58:21.348 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-12T01:58:21.826 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-12T01:58:22.043 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-12T01:58:22.196 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-12T01:58:22.329 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-12T01:58:22.471 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-12T01:58:22.619 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-12T01:58:22.968 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-12T01:58:23.133 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-12T01:58:23.246 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-12T01:58:23.408 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-12T01:58:23.554 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-12T01:58:24.267 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-12T01:58:24.454 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-12T01:58:25.181 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-12T01:58:25.337 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-12T01:58:26.199 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-12T01:58:26.544 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-12T01:58:26.739 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-12T01:58:26.886 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-12T01:58:27.076 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-12T01:58:27.319 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 30/160 2023-07-12T01:58:27.459 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 31/160 2023-07-12T01:58:27.701 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 32/160 2023-07-12T01:58:28.845 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-12T01:58:29.178 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-12T01:58:29.493 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-12T01:58:29.703 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-12T01:58:31.906 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-12T01:58:32.193 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-12T01:58:32.388 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-12T01:58:32.585 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-12T01:58:32.778 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 40/160 2023-07-12T01:58:32.966 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 41/160 2023-07-12T01:58:33.137 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-12T01:58:33.326 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-12T01:58:33.536 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-12T01:58:33.658 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-12T01:58:33.836 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-12T01:58:33.926 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-12T01:58:34.075 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-12T01:58:34.269 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-12T01:58:34.893 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-12T01:58:35.145 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-12T01:58:35.174 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-12T01:58:35.378 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-12T01:58:35.674 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-12T01:58:35.898 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-12T01:58:36.049 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-12T01:58:36.199 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-12T01:58:36.386 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-12T01:58:36.579 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-12T01:58:36.793 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-12T01:58:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-12T01:58:37.135 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-12T01:58:37.303 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-12T01:58:37.485 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-12T01:58:37.664 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-12T01:58:37.825 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-12T01:58:38.369 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-12T01:58:38.639 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-12T01:58:38.847 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-12T01:58:39.184 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-12T01:58:39.438 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-12T01:58:39.642 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-12T01:58:40.528 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-12T01:58:40.743 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-12T01:58:40.836 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-12T01:58:41.031 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 71/160 2023-07-12T01:58:41.285 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-12T01:58:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-12T01:58:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-12T01:58:42.118 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-12T01:58:42.378 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-12T01:58:42.588 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-12T01:58:43.948 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-12T01:58:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-12T01:58:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-12T01:58:44.758 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-12T01:58:45.076 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-12T01:58:45.346 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-12T01:58:45.591 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-12T01:58:45.800 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-12T01:58:46.168 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-12T01:58:46.391 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-12T01:58:46.562 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-12T01:58:46.747 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-12T01:58:47.110 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-12T01:58:47.348 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-12T01:58:47.501 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-12T01:58:47.698 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-12T01:58:47.896 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-12T01:58:48.089 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-12T01:58:48.378 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-12T01:58:48.542 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-12T01:58:48.674 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-12T01:58:48.837 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-12T01:58:48.976 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-12T01:58:49.056 INFO:teuthology.orchestra.run.smithi196.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-12T01:58:49.262 INFO:teuthology.orchestra.run.smithi196.stdout:(97/144): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 kB/s | 306 kB 02:11 2023-07-12T01:58:52.046 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-12T01:58:52.284 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-12T01:58:52.999 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-12T01:58:53.644 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-12T01:58:53.855 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-12T01:58:54.058 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-12T01:59:15.311 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-12T01:59:15.311 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2023-07-12T01:59:15.311 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2023-07-12T01:59:15.311 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /dev 2023-07-12T01:59:15.312 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /run 2023-07-12T01:59:15.312 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2023-07-12T01:59:15.312 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2023-07-12T01:59:15.312 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2023-07-12T01:59:15.312 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2023-07-12T01:59:15.312 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /dev 2023-07-12T01:59:15.312 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T01:59:15.739 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-12T01:59:17.575 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-12T01:59:17.815 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-12T01:59:18.097 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-12T01:59:18.256 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-12T01:59:18.815 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-12T01:59:19.014 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-12T01:59:19.065 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-12T01:59:19.273 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-12T01:59:19.479 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-12T01:59:19.639 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-12T01:59:19.726 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-12T01:59:20.058 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-12T01:59:20.406 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-12T01:59:21.038 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-12T01:59:21.209 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-12T01:59:21.347 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 113/160 2023-07-12T01:59:21.546 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 114/160 2023-07-12T01:59:21.771 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-12T01:59:22.043 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-12T01:59:22.272 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-12T01:59:23.462 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-12T01:59:23.655 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-12T01:59:23.788 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-12T01:59:24.223 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 118/160 2023-07-12T01:59:24.448 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-12T01:59:24.515 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-12T01:59:24.696 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-12T01:59:24.724 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-12T01:59:24.907 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 121/160 2023-07-12T01:59:25.071 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-12T01:59:30.359 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-12T01:59:30.493 INFO:teuthology.orchestra.run.smithi196.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-12T01:59:30.494 INFO:teuthology.orchestra.run.smithi196.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-12T01:59:30.664 INFO:teuthology.orchestra.run.smithi196.stdout:(98/144): liboath-2.6.2-3.el8.x86_64.rpm 453 B/s | 59 kB 02:12 2023-07-12T01:59:30.689 INFO:teuthology.orchestra.run.smithi196.stdout:(99/144): libunwind-1.3.1-3.el8.x86_64.rpm 591 B/s | 75 kB 02:09 2023-07-12T01:59:30.706 INFO:teuthology.orchestra.run.smithi196.stdout:(100/144): python3-bcrypt-3.1.6-2.el8.1.x86_64. 1.0 MB/s | 44 kB 00:00 2023-07-12T01:59:30.739 INFO:teuthology.orchestra.run.smithi196.stdout:(101/144): python3-cachetools-3.1.1-4.el8.noarc 991 kB/s | 33 kB 00:00 2023-07-12T01:59:30.765 INFO:teuthology.orchestra.run.smithi196.stdout:(102/144): python3-beautifulsoup4-4.6.3-2.el8.1 2.4 MB/s | 185 kB 00:00 2023-07-12T01:59:30.790 INFO:teuthology.orchestra.run.smithi196.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 323 kB/s | 16 kB 00:00 2023-07-12T01:59:30.816 INFO:teuthology.orchestra.run.smithi196.stdout:(104/144): python3-cheroot-8.5.2-1.el8.noarch.r 3.4 MB/s | 173 kB 00:00 2023-07-12T01:59:30.858 INFO:teuthology.orchestra.run.smithi196.stdout:(105/144): python3-google-auth-1.1.1-10.el8.noa 1.9 MB/s | 81 kB 00:00 2023-07-12T01:59:30.891 INFO:teuthology.orchestra.run.smithi196.stdout:(106/144): python3-cherrypy-18.4.0-1.el8.noarch 3.7 MB/s | 384 kB 00:00 2023-07-12T01:59:30.916 INFO:teuthology.orchestra.run.smithi196.stdout:(107/144): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2023-07-12T01:59:30.941 INFO:teuthology.orchestra.run.smithi196.stdout:(108/144): python3-jaraco-functools-2.0-4.el8.n 352 kB/s | 18 kB 00:00 2023-07-12T01:59:30.983 INFO:teuthology.orchestra.run.smithi196.stdout:(109/144): python3-logutils-0.3.5-11.el8.noarch 1.1 MB/s | 49 kB 00:00 2023-07-12T01:59:31.017 INFO:teuthology.orchestra.run.smithi196.stdout:(110/144): python3-kubernetes-11.0.0-6.el8.noar 12 MB/s | 1.2 MB 00:00 2023-07-12T01:59:31.042 INFO:teuthology.orchestra.run.smithi196.stdout:(111/144): python3-more-itertools-7.2.0-3.el8.n 1.0 MB/s | 59 kB 00:00 2023-07-12T01:59:31.068 INFO:teuthology.orchestra.run.smithi196.stdout:(112/144): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2023-07-12T01:59:31.093 INFO:teuthology.orchestra.run.smithi196.stdout:(113/144): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-07-12T01:59:31.118 INFO:teuthology.orchestra.run.smithi196.stdout:(114/144): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2023-07-12T01:59:31.144 INFO:teuthology.orchestra.run.smithi196.stdout:(115/144): python3-repoze-lru-0.7-6.el8.noarch. 672 kB/s | 34 kB 00:00 2023-07-12T01:59:31.169 INFO:teuthology.orchestra.run.smithi196.stdout:(116/144): python3-routes-2.4.1-12.el8.noarch.r 3.8 MB/s | 196 kB 00:00 2023-07-12T01:59:31.194 INFO:teuthology.orchestra.run.smithi196.stdout:(117/144): python3-rsa-4.8-1.el8.noarch.rpm 1.2 MB/s | 61 kB 00:00 2023-07-12T01:59:31.219 INFO:teuthology.orchestra.run.smithi196.stdout:(118/144): python3-simplegeneric-0.8.1-17.el8.n 375 kB/s | 19 kB 00:00 2023-07-12T01:59:31.245 INFO:teuthology.orchestra.run.smithi196.stdout:(119/144): python3-singledispatch-3.4.0.3-18.el 477 kB/s | 24 kB 00:00 2023-07-12T01:59:31.270 INFO:teuthology.orchestra.run.smithi196.stdout:(120/144): python3-tempora-1.14.1-5.el8.noarch. 584 kB/s | 29 kB 00:00 2023-07-12T01:59:31.295 INFO:teuthology.orchestra.run.smithi196.stdout:(121/144): python3-trustme-0.6.0-4.el8.noarch.r 552 kB/s | 27 kB 00:00 2023-07-12T01:59:31.320 INFO:teuthology.orchestra.run.smithi196.stdout:(122/144): python3-waitress-1.4.3-1.el8.noarch. 5.0 MB/s | 255 kB 00:00 2023-07-12T01:59:31.346 INFO:teuthology.orchestra.run.smithi196.stdout:(123/144): python3-webob-1.8.5-1.el8.1.noarch.r 4.9 MB/s | 251 kB 00:00 2023-07-12T01:59:31.371 INFO:teuthology.orchestra.run.smithi196.stdout:(124/144): python3-websocket-client-0.56.0-5.el 1.2 MB/s | 61 kB 00:00 2023-07-12T01:59:31.404 INFO:teuthology.orchestra.run.smithi196.stdout:(125/144): python3-webtest-2.0.33-1.el8.noarch. 1.4 MB/s | 85 kB 00:00 2023-07-12T01:59:31.455 INFO:teuthology.orchestra.run.smithi196.stdout:(126/144): python3-zc-lockfile-2.0-2.el8.noarch 275 kB/s | 23 kB 00:00 2023-07-12T01:59:31.530 INFO:teuthology.orchestra.run.smithi196.stdout:(127/144): thrift-0.13.0-2.el8.x86_64.rpm 14 MB/s | 1.7 MB 00:00 2023-07-12T01:59:31.881 INFO:teuthology.orchestra.run.smithi196.stdout:(128/144): librados2-18.0.0-4828.gb5891ed6.el8. 8.6 MB/s | 3.7 MB 00:00 2023-07-12T01:59:31.977 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 123/160 2023-07-12T01:59:32.188 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-12T01:59:32.251 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-12T01:59:32.272 INFO:teuthology.orchestra.run.smithi196.stdout:(129/144): NetworkManager-initscripts-updown-1. 366 kB/s | 143 kB 00:00 2023-07-12T01:59:32.381 INFO:teuthology.orchestra.run.smithi196.stdout:(130/144): elfutils-debuginfod-client-0.189-2.e 702 kB/s | 76 kB 00:00 2023-07-12T01:59:32.404 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-12T01:59:32.440 INFO:teuthology.orchestra.run.smithi196.stdout:(131/144): librbd1-18.0.0-4828.gb5891ed6.el8.x8 3.9 MB/s | 3.6 MB 00:00 2023-07-12T01:59:32.476 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-12T01:59:32.624 INFO:teuthology.orchestra.run.smithi196.stdout:(132/144): elfutils-libelf-0.189-2.el8.x86_64.r 957 kB/s | 232 kB 00:00 2023-07-12T01:59:32.671 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-12T01:59:32.791 INFO:teuthology.orchestra.run.smithi196.stdout:(133/144): elfutils-libs-0.189-2.el8.x86_64.rpm 865 kB/s | 302 kB 00:00 2023-07-12T01:59:32.916 INFO:teuthology.orchestra.run.smithi196.stdout:(134/144): libblkid-2.32.1-42.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-07-12T01:59:33.032 INFO:teuthology.orchestra.run.smithi196.stdout:(135/144): libfdisk-2.32.1-42.el8.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2023-07-12T01:59:33.102 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-12T01:59:33.141 INFO:teuthology.orchestra.run.smithi196.stdout:(136/144): libmount-2.32.1-42.el8.x86_64.rpm 2.1 MB/s | 236 kB 00:00 2023-07-12T01:59:33.217 INFO:teuthology.orchestra.run.smithi196.stdout:(137/144): libsmartcols-2.32.1-42.el8.x86_64.rp 2.3 MB/s | 179 kB 00:00 2023-07-12T01:59:33.258 INFO:teuthology.orchestra.run.smithi196.stdout:(138/144): iproute-6.2.0-2.el8.x86_64.rpm 1.4 MB/s | 880 kB 00:00 2023-07-12T01:59:33.283 INFO:teuthology.orchestra.run.smithi196.stdout:(139/144): libuuid-2.32.1-42.el8.x86_64.rpm 1.4 MB/s | 98 kB 00:00 2023-07-12T01:59:33.312 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-12T01:59:33.359 INFO:teuthology.orchestra.run.smithi196.stdout:(140/144): util-linux-user-2.32.1-42.el8.x86_64 1.3 MB/s | 102 kB 00:00 2023-07-12T01:59:33.509 INFO:teuthology.orchestra.run.smithi196.stdout:(141/144): xfsdump-3.1.8-6.el8.x86_64.rpm 2.2 MB/s | 334 kB 00:00 2023-07-12T01:59:33.620 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-12T01:59:33.876 INFO:teuthology.orchestra.run.smithi196.stdout:(142/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 3.0 MB/s | 1.1 MB 00:00 2023-07-12T01:59:33.912 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-12T01:59:34.618 INFO:teuthology.orchestra.run.smithi196.stdout:(143/144): util-linux-2.32.1-42.el8.x86_64.rpm 1.9 MB/s | 2.6 MB 00:01 2023-07-12T01:59:35.171 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-12T01:59:35.451 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-12T01:59:35.677 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-12T01:59:35.868 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-12T01:59:36.034 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-12T01:59:36.229 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 134/160 2023-07-12T01:59:37.439 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-12T01:59:37.679 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-12T01:59:37.765 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-12T01:59:37.950 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-12T01:59:38.188 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 137/160 2023-07-12T01:59:38.388 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 138/160 2023-07-12T01:59:38.754 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 139/160 2023-07-12T01:59:39.022 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-12T01:59:39.169 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-12T01:59:39.196 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-12T01:59:39.396 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-12T01:59:39.661 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-12T01:59:39.779 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-12T01:59:40.019 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-12T01:59:40.046 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-12T01:59:40.213 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-12T01:59:40.398 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-12T01:59:40.549 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-12T01:59:40.549 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-12T01:59:40.824 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-12T01:59:40.824 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-12T01:59:41.055 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-12T01:59:41.071 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-12T01:59:41.184 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-12T01:59:41.185 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-12T01:59:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-12T01:59:41.596 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-12T01:59:41.782 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-12T01:59:41.996 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-12T01:59:41.996 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-12T01:59:42.197 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-12T01:59:42.198 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-12T01:59:42.406 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-12T01:59:42.406 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-12T01:59:42.622 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-12T01:59:42.623 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-12T01:59:42.839 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-12T01:59:42.839 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-12T01:59:43.039 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-12T01:59:43.204 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-12T01:59:43.419 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-12T01:59:43.419 INFO:teuthology.orchestra.run.smithi037.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-12T01:59:43.420 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T01:59:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 1/160 2023-07-12T01:59:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2/160 2023-07-12T01:59:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 3/160 2023-07-12T01:59:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 4/160 2023-07-12T01:59:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 5/160 2023-07-12T01:59:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 6/160 2023-07-12T01:59:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 7/160 2023-07-12T01:59:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-12T01:59:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-12T01:59:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-12T01:59:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-12T01:59:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 12/160 2023-07-12T01:59:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 13/160 2023-07-12T01:59:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 14/160 2023-07-12T01:59:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 15/160 2023-07-12T01:59:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 16/160 2023-07-12T01:59:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 17/160 2023-07-12T01:59:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 18/160 2023-07-12T01:59:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 19/160 2023-07-12T01:59:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 20/160 2023-07-12T01:59:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 21/160 2023-07-12T01:59:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 22/160 2023-07-12T01:59:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 23/160 2023-07-12T01:59:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 24/160 2023-07-12T01:59:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 25/160 2023-07-12T01:59:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 26/160 2023-07-12T01:59:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 27/160 2023-07-12T01:59:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 28/160 2023-07-12T01:59:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 29/160 2023-07-12T01:59:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 30/160 2023-07-12T01:59:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 31/160 2023-07-12T01:59:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 32/160 2023-07-12T01:59:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 33/160 2023-07-12T01:59:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 34/160 2023-07-12T01:59:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 35/160 2023-07-12T01:59:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 36/160 2023-07-12T01:59:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 37/160 2023-07-12T01:59:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 38/160 2023-07-12T01:59:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-12T01:59:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-12T01:59:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-12T01:59:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-12T01:59:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-12T01:59:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-12T01:59:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-12T01:59:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-12T01:59:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-12T01:59:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-12T01:59:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-12T01:59:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-12T01:59:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-12T01:59:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-12T01:59:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-12T01:59:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-12T01:59:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-12T01:59:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-12T01:59:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-12T01:59:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-12T01:59:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-12T01:59:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-12T01:59:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-12T01:59:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-12T01:59:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-12T01:59:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-12T01:59:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-12T01:59:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-12T01:59:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-12T01:59:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-12T01:59:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-12T01:59:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-12T01:59:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-12T01:59:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-12T01:59:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-12T01:59:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-12T01:59:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-12T01:59:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-12T01:59:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-12T01:59:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-12T01:59:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-12T01:59:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-12T01:59:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-12T01:59:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-12T01:59:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-12T01:59:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-12T01:59:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-12T01:59:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-12T01:59:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-12T01:59:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-12T01:59:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-12T01:59:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-12T01:59:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-12T01:59:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-12T01:59:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-12T01:59:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-12T01:59:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-12T01:59:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-12T01:59:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-12T01:59:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-12T01:59:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-12T01:59:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-12T01:59:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-12T01:59:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-12T01:59:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-12T01:59:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-12T01:59:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-12T01:59:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-12T01:59:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-12T01:59:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-12T01:59:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-12T01:59:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-12T01:59:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-12T01:59:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-12T01:59:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-12T01:59:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-12T01:59:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-12T01:59:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-12T01:59:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-12T01:59:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-12T01:59:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-12T01:59:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-12T01:59:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-12T01:59:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-12T01:59:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-12T01:59:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-12T01:59:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-12T01:59:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-12T01:59:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-12T01:59:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-12T01:59:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-12T01:59:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-12T01:59:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 131/160 2023-07-12T01:59:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-12T01:59:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-12T01:59:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-12T01:59:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-12T01:59:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-12T01:59:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-12T01:59:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-12T01:59:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-12T01:59:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-12T01:59:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-12T01:59:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-12T01:59:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-12T01:59:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-12T01:59:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-12T01:59:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-12T01:59:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-12T01:59:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-12T01:59:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-12T01:59:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-12T01:59:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-12T01:59:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-12T01:59:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-12T01:59:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-12T01:59:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-12T01:59:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-12T01:59:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-12T01:59:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-12T01:59:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-12T01:59:46.280 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-12T01:59:46.281 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T01:59:46.281 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2023-07-12T01:59:46.281 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-12T01:59:46.281 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-12T01:59:46.281 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-12T01:59:46.281 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-12T01:59:46.282 INFO:teuthology.orchestra.run.smithi037.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-12T01:59:46.282 INFO:teuthology.orchestra.run.smithi037.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-12T01:59:46.282 INFO:teuthology.orchestra.run.smithi037.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-12T01:59:46.282 INFO:teuthology.orchestra.run.smithi037.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-12T01:59:46.282 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.282 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.282 INFO:teuthology.orchestra.run.smithi037.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-12T01:59:46.282 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-12T01:59:46.283 INFO:teuthology.orchestra.run.smithi037.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-12T01:59:46.283 INFO:teuthology.orchestra.run.smithi037.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-12T01:59:46.283 INFO:teuthology.orchestra.run.smithi037.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-12T01:59:46.283 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-12T01:59:46.283 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-12T01:59:46.283 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.1-7.el8.noarch 2023-07-12T01:59:46.283 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.0.4-10.el8.x86_64 2023-07-12T01:59:46.284 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.284 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.284 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.284 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.284 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:46.284 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.284 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.284 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.285 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:46.285 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:46.285 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:46.285 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:46.285 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:46.285 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.285 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.285 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:46.286 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.286 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.286 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.286 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:46.286 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:46.286 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.286 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:46.286 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-12T01:59:46.287 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.1-9.el8.x86_64 2023-07-12T01:59:46.287 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-12T01:59:46.287 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-12T01:59:46.287 INFO:teuthology.orchestra.run.smithi037.stdout: jq-1.6-7.el8.x86_64 2023-07-12T01:59:46.287 INFO:teuthology.orchestra.run.smithi037.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-12T01:59:46.287 INFO:teuthology.orchestra.run.smithi037.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-12T01:59:46.287 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-12T01:59:46.288 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.288 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.288 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.288 INFO:teuthology.orchestra.run.smithi037.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-12T01:59:46.288 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-12T01:59:46.288 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-12T01:59:46.288 INFO:teuthology.orchestra.run.smithi037.stdout: libpq-13.5-1.el8.x86_64 2023-07-12T01:59:46.288 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-12T01:59:46.289 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-12T01:59:46.289 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.289 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.289 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-12T01:59:46.289 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.289 INFO:teuthology.orchestra.run.smithi037.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-12T01:59:46.289 INFO:teuthology.orchestra.run.smithi037.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-12T01:59:46.289 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-12T01:59:46.290 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-12T01:59:46.290 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-12T01:59:46.290 INFO:teuthology.orchestra.run.smithi037.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-12T01:59:46.290 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-12T01:59:46.290 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-12T01:59:46.290 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-12T01:59:46.290 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-12T01:59:46.291 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-12T01:59:46.291 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-12T01:59:46.291 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-12T01:59:46.291 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-12T01:59:46.291 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-12T01:59:46.291 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-12T01:59:46.291 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-12T01:59:46.291 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-12T01:59:46.292 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-12T01:59:46.292 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-12T01:59:46.292 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-12T01:59:46.292 INFO:teuthology.orchestra.run.smithi037.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-12T01:59:46.292 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-12T01:59:46.292 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.292 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.292 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.293 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-12T01:59:46.293 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-12T01:59:46.293 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-12T01:59:46.293 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-12T01:59:46.293 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-12T01:59:46.293 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-12T01:59:46.293 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-12T01:59:46.293 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-12T01:59:46.294 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-12T01:59:46.294 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-12T01:59:46.294 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-12T01:59:46.294 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-12T01:59:46.294 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-12T01:59:46.294 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-12T01:59:46.294 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-12T01:59:46.295 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-12T01:59:46.295 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-12T01:59:46.295 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-12T01:59:46.295 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-12T01:59:46.295 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-12T01:59:46.295 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-12T01:59:46.295 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-12T01:59:46.295 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-2.6-1.el8.noarch 2023-07-12T01:59:46.296 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-12T01:59:46.296 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-12T01:59:46.296 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-12T01:59:46.296 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-12T01:59:46.296 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-12T01:59:46.296 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-12T01:59:46.296 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.296 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.297 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-12T01:59:46.297 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-12T01:59:46.297 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.297 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-12T01:59:46.297 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-12T01:59:46.297 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-12T01:59:46.297 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-12T01:59:46.297 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-12T01:59:46.298 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-12T01:59:46.298 INFO:teuthology.orchestra.run.smithi037.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-12T01:59:46.298 INFO:teuthology.orchestra.run.smithi037.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-12T01:59:46.298 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-12T01:59:46.298 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-12T01:59:46.298 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-12T01:59:46.298 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-12T01:59:46.298 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-12T01:59:46.299 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.299 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.299 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:46.299 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-12T01:59:46.299 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-12T01:59:46.299 INFO:teuthology.orchestra.run.smithi037.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-12T01:59:46.299 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-12T01:59:46.299 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-12T01:59:46.300 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-12T01:59:46.300 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T01:59:46.300 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-12T01:59:46.580 DEBUG:teuthology.parallel:result is None 2023-07-12T02:01:00.177 INFO:teuthology.orchestra.run.smithi196.stdout:[MIRROR] python3-asyncssh-2.7.0-2.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-asyncssh-2.7.0-2.el8.noarch.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-12T02:01:00.336 INFO:teuthology.orchestra.run.smithi196.stdout:(144/144): python3-asyncssh-2.7.0-2.el8.noarch. 3.6 kB/s | 476 kB 02:11 2023-07-12T02:01:00.337 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2023-07-12T02:01:00.338 INFO:teuthology.orchestra.run.smithi196.stdout:Total 646 kB/s | 212 MB 05:35 2023-07-12T02:01:02.148 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2023-07-12T02:01:02.558 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2023-07-12T02:01:02.558 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2023-07-12T02:01:04.137 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2023-07-12T02:01:04.140 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2023-07-12T02:01:09.408 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2023-07-12T02:01:09.628 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-12T02:01:09.803 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-12T02:01:09.931 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-12T02:01:10.028 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-12T02:01:10.173 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-12T02:01:10.244 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-12T02:01:10.419 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-12T02:01:10.595 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-12T02:01:10.783 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-12T02:01:10.948 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-12T02:01:11.408 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-12T02:01:11.564 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-12T02:01:12.008 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-12T02:01:12.181 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-12T02:01:12.328 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-12T02:01:12.497 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-12T02:01:12.615 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-12T02:01:12.799 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-12T02:01:12.931 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-12T02:01:13.156 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-12T02:01:13.339 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-12T02:01:13.434 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-12T02:01:13.638 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-12T02:01:13.832 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-12T02:01:14.275 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-12T02:01:14.461 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-12T02:01:14.614 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-12T02:01:14.740 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-12T02:01:14.888 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-12T02:01:15.037 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-12T02:01:15.244 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-12T02:01:15.404 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-12T02:01:15.530 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-12T02:01:15.691 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-12T02:01:15.838 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-12T02:01:16.514 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-12T02:01:16.680 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-12T02:01:17.359 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-12T02:01:17.538 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-12T02:01:18.353 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-12T02:01:18.714 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-12T02:01:18.905 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-12T02:01:19.079 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-12T02:01:19.291 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-12T02:01:19.504 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 30/160 2023-07-12T02:01:19.656 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 31/160 2023-07-12T02:01:19.954 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 32/160 2023-07-12T02:01:21.029 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-12T02:01:21.392 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-12T02:01:21.689 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-12T02:01:21.887 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-12T02:01:23.948 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-12T02:01:24.258 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-12T02:01:24.462 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-12T02:01:24.683 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-12T02:01:24.888 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 40/160 2023-07-12T02:01:25.074 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 41/160 2023-07-12T02:01:25.251 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-12T02:01:25.433 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-12T02:01:25.628 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-12T02:01:25.721 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-12T02:01:25.895 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-12T02:01:25.989 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-12T02:01:26.150 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-12T02:01:26.328 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-12T02:01:26.921 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-12T02:01:27.179 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-12T02:01:27.207 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-12T02:01:27.411 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-12T02:01:27.737 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-12T02:01:27.953 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-12T02:01:28.108 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-12T02:01:28.257 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-12T02:01:28.468 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-12T02:01:28.678 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-12T02:01:28.892 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-12T02:01:29.073 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-12T02:01:29.227 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-12T02:01:29.402 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-12T02:01:29.602 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-12T02:01:29.772 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-12T02:01:29.941 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-12T02:01:30.173 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-12T02:01:30.410 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-12T02:01:30.611 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-12T02:01:30.958 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-12T02:01:31.455 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-12T02:01:31.684 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-12T02:01:32.499 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-12T02:01:32.693 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-12T02:01:32.775 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-12T02:01:32.988 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 71/160 2023-07-12T02:01:33.245 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-12T02:01:33.648 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-12T02:01:33.934 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-12T02:01:34.116 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-12T02:01:34.372 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-12T02:01:34.578 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-12T02:01:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-12T02:01:36.244 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-12T02:01:36.445 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-12T02:01:36.712 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-12T02:01:37.008 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-12T02:01:37.267 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-12T02:01:37.498 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-12T02:01:37.697 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-12T02:01:38.058 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-12T02:01:38.274 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-12T02:01:38.404 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-12T02:01:38.580 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-12T02:01:38.935 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-12T02:01:39.148 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-12T02:01:39.316 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-12T02:01:39.509 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-12T02:01:39.712 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-12T02:01:39.929 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-12T02:01:40.103 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-12T02:01:40.276 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-12T02:01:40.401 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-12T02:01:40.593 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-12T02:01:40.759 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-12T02:01:43.654 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-12T02:01:43.884 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-12T02:01:44.554 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-12T02:01:44.865 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-12T02:01:45.070 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-12T02:01:45.283 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-12T02:02:05.948 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-12T02:02:05.948 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /sys 2023-07-12T02:02:05.948 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /proc 2023-07-12T02:02:05.948 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /dev 2023-07-12T02:02:05.949 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /run 2023-07-12T02:02:05.949 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /mnt 2023-07-12T02:02:05.949 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /var/tmp 2023-07-12T02:02:05.949 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /home 2023-07-12T02:02:05.949 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /tmp 2023-07-12T02:02:05.949 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /dev 2023-07-12T02:02:05.949 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:06.360 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-12T02:02:08.076 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-12T02:02:08.294 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-12T02:02:08.561 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-12T02:02:08.762 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-12T02:02:09.286 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-12T02:02:09.462 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-12T02:02:09.510 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-12T02:02:09.704 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-12T02:02:09.920 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-12T02:02:10.062 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-12T02:02:10.154 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-12T02:02:10.464 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-12T02:02:10.720 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-12T02:02:11.305 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-12T02:02:11.455 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-12T02:02:11.611 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 113/160 2023-07-12T02:02:11.807 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 114/160 2023-07-12T02:02:12.011 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-12T02:02:12.266 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-12T02:02:12.468 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-12T02:02:13.569 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-12T02:02:13.761 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-12T02:02:13.888 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-12T02:02:14.274 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 118/160 2023-07-12T02:02:14.468 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-12T02:02:14.532 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-12T02:02:14.694 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-12T02:02:14.720 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-12T02:02:14.933 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 121/160 2023-07-12T02:02:15.102 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-12T02:02:20.063 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-12T02:02:21.590 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 123/160 2023-07-12T02:02:21.875 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-12T02:02:21.936 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-12T02:02:22.085 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-12T02:02:22.154 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-12T02:02:22.335 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-12T02:02:22.742 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-12T02:02:22.951 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-12T02:02:23.230 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-12T02:02:23.563 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-12T02:02:24.715 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-12T02:02:25.031 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-12T02:02:25.216 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-12T02:02:25.406 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-12T02:02:25.572 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-12T02:02:25.777 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 134/160 2023-07-12T02:02:26.979 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-12T02:02:27.234 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-12T02:02:27.316 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-12T02:02:27.547 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-12T02:02:27.809 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 137/160 2023-07-12T02:02:28.043 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 138/160 2023-07-12T02:02:28.412 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 139/160 2023-07-12T02:02:28.686 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-12T02:02:28.833 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-12T02:02:28.865 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-12T02:02:29.070 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-12T02:02:29.299 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-12T02:02:29.412 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-12T02:02:29.642 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-12T02:02:29.667 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-12T02:02:29.835 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-12T02:02:30.008 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-12T02:02:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-12T02:02:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-12T02:02:30.446 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-12T02:02:30.446 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-12T02:02:30.686 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-12T02:02:30.701 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-12T02:02:30.822 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-12T02:02:30.822 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-12T02:02:31.091 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-12T02:02:31.260 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-12T02:02:31.460 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-12T02:02:31.677 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-12T02:02:31.677 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-12T02:02:31.886 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-12T02:02:31.886 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-12T02:02:32.094 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-12T02:02:32.095 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-12T02:02:32.294 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-12T02:02:32.294 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-12T02:02:32.494 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-12T02:02:32.495 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-12T02:02:32.670 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-12T02:02:32.834 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-12T02:02:33.039 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-12T02:02:33.040 INFO:teuthology.orchestra.run.smithi196.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-12T02:02:33.040 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:33.761 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 1/160 2023-07-12T02:02:33.761 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2/160 2023-07-12T02:02:33.762 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 3/160 2023-07-12T02:02:33.762 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 4/160 2023-07-12T02:02:33.762 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 5/160 2023-07-12T02:02:33.762 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 6/160 2023-07-12T02:02:33.762 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 7/160 2023-07-12T02:02:33.762 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-12T02:02:33.762 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-12T02:02:33.763 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-12T02:02:33.763 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-12T02:02:33.763 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 12/160 2023-07-12T02:02:33.763 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 13/160 2023-07-12T02:02:33.763 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 14/160 2023-07-12T02:02:33.763 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 15/160 2023-07-12T02:02:33.763 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 16/160 2023-07-12T02:02:33.763 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 17/160 2023-07-12T02:02:33.764 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 18/160 2023-07-12T02:02:33.764 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 19/160 2023-07-12T02:02:33.764 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 20/160 2023-07-12T02:02:33.764 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 21/160 2023-07-12T02:02:33.764 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 22/160 2023-07-12T02:02:33.764 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 23/160 2023-07-12T02:02:33.764 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 24/160 2023-07-12T02:02:33.765 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 25/160 2023-07-12T02:02:33.765 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 26/160 2023-07-12T02:02:33.765 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 27/160 2023-07-12T02:02:33.773 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 28/160 2023-07-12T02:02:33.773 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 29/160 2023-07-12T02:02:33.773 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 30/160 2023-07-12T02:02:33.773 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 31/160 2023-07-12T02:02:33.774 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 32/160 2023-07-12T02:02:33.774 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 33/160 2023-07-12T02:02:33.774 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 34/160 2023-07-12T02:02:33.774 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 35/160 2023-07-12T02:02:33.774 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 36/160 2023-07-12T02:02:33.774 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 37/160 2023-07-12T02:02:33.774 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 38/160 2023-07-12T02:02:33.775 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-12T02:02:33.775 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-12T02:02:33.775 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-12T02:02:33.775 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-12T02:02:33.775 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-12T02:02:33.775 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-12T02:02:33.775 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-12T02:02:33.775 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-12T02:02:33.776 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-12T02:02:33.776 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-12T02:02:33.776 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-12T02:02:33.776 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-12T02:02:33.776 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-12T02:02:33.776 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-12T02:02:33.776 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-12T02:02:33.777 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-12T02:02:33.777 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-12T02:02:33.777 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-12T02:02:33.777 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-12T02:02:33.777 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-12T02:02:33.777 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-12T02:02:33.777 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-12T02:02:33.777 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-12T02:02:33.778 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-12T02:02:33.778 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-12T02:02:33.778 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-12T02:02:33.778 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-12T02:02:33.778 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-12T02:02:33.778 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-12T02:02:33.778 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-12T02:02:33.778 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-12T02:02:33.779 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-12T02:02:33.779 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-12T02:02:33.779 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-12T02:02:33.779 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-12T02:02:33.779 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-12T02:02:33.779 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-12T02:02:33.779 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-12T02:02:33.780 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-12T02:02:33.780 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-12T02:02:33.780 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-12T02:02:33.780 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-12T02:02:33.780 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-12T02:02:33.780 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-12T02:02:33.780 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-12T02:02:33.780 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-12T02:02:33.781 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-12T02:02:33.781 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-12T02:02:33.781 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-12T02:02:33.781 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-12T02:02:33.781 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-12T02:02:33.781 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-12T02:02:33.781 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-12T02:02:33.781 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-12T02:02:33.782 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-12T02:02:33.782 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-12T02:02:33.782 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-12T02:02:33.782 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-12T02:02:33.782 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-12T02:02:33.782 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-12T02:02:33.782 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-12T02:02:33.782 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-12T02:02:33.783 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-12T02:02:33.783 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-12T02:02:33.783 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-12T02:02:33.783 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-12T02:02:33.783 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-12T02:02:33.783 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-12T02:02:33.783 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-12T02:02:33.783 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-12T02:02:33.784 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-12T02:02:33.784 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-12T02:02:33.784 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-12T02:02:33.784 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-12T02:02:33.784 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-12T02:02:33.784 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-12T02:02:33.784 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-12T02:02:33.785 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-12T02:02:33.785 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-12T02:02:33.785 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-12T02:02:33.785 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-12T02:02:33.785 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-12T02:02:33.785 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-12T02:02:33.785 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-12T02:02:33.785 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-12T02:02:33.786 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-12T02:02:33.786 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-12T02:02:33.786 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-12T02:02:33.786 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-12T02:02:33.786 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-12T02:02:33.786 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-12T02:02:33.786 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-12T02:02:33.786 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 131/160 2023-07-12T02:02:33.787 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-12T02:02:33.787 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-12T02:02:33.787 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-12T02:02:33.787 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-12T02:02:33.787 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-12T02:02:33.787 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-12T02:02:33.787 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-12T02:02:33.787 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-12T02:02:33.788 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-12T02:02:33.788 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-12T02:02:33.788 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-12T02:02:33.788 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-12T02:02:33.788 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-12T02:02:33.788 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-12T02:02:33.788 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-12T02:02:33.788 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-12T02:02:33.789 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-12T02:02:33.789 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-12T02:02:33.789 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-12T02:02:33.789 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-12T02:02:33.789 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-12T02:02:33.789 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-12T02:02:33.789 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-12T02:02:33.789 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-12T02:02:33.790 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-12T02:02:33.790 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-12T02:02:33.790 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-12T02:02:33.790 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-12T02:02:35.868 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-12T02:02:35.868 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:35.869 INFO:teuthology.orchestra.run.smithi196.stdout:Upgraded: 2023-07-12T02:02:35.869 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-12T02:02:35.869 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-12T02:02:35.869 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-12T02:02:35.869 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-12T02:02:35.869 INFO:teuthology.orchestra.run.smithi196.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-12T02:02:35.869 INFO:teuthology.orchestra.run.smithi196.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-12T02:02:35.870 INFO:teuthology.orchestra.run.smithi196.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-12T02:02:35.870 INFO:teuthology.orchestra.run.smithi196.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-12T02:02:35.870 INFO:teuthology.orchestra.run.smithi196.stdout: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.870 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.870 INFO:teuthology.orchestra.run.smithi196.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-12T02:02:35.870 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-12T02:02:35.870 INFO:teuthology.orchestra.run.smithi196.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-12T02:02:35.871 INFO:teuthology.orchestra.run.smithi196.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-12T02:02:35.871 INFO:teuthology.orchestra.run.smithi196.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-12T02:02:35.871 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-12T02:02:35.871 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2023-07-12T02:02:35.871 INFO:teuthology.orchestra.run.smithi196.stdout: automake-1.16.1-7.el8.noarch 2023-07-12T02:02:35.871 INFO:teuthology.orchestra.run.smithi196.stdout: bison-3.0.4-10.el8.x86_64 2023-07-12T02:02:35.871 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:02:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:02:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:02:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:02:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:02:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:02:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:02:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:02:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:02:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:02:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-12T02:02:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: flex-2.6.1-9.el8.x86_64 2023-07-12T02:02:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-12T02:02:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-12T02:02:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: jq-1.6-7.el8.x86_64 2023-07-12T02:02:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-12T02:02:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-12T02:02:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-12T02:02:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-12T02:02:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-12T02:02:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-12T02:02:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: libpq-13.5-1.el8.x86_64 2023-07-12T02:02:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-12T02:02:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-12T02:02:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-12T02:02:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-12T02:02:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-12T02:02:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-12T02:02:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-12T02:02:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-12T02:02:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-12T02:02:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-12T02:02:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-12T02:02:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-12T02:02:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-12T02:02:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-12T02:02:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-12T02:02:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-12T02:02:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-12T02:02:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-12T02:02:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-12T02:02:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-12T02:02:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-12T02:02:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-12T02:02:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-12T02:02:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-12T02:02:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-12T02:02:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-12T02:02:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-12T02:02:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-12T02:02:35.882 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-12T02:02:35.882 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-12T02:02:35.882 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-12T02:02:35.882 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-12T02:02:35.882 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-12T02:02:35.882 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-12T02:02:35.882 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-12T02:02:35.883 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-12T02:02:35.883 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-12T02:02:35.883 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-12T02:02:35.883 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-12T02:02:35.883 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-12T02:02:35.883 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-12T02:02:35.883 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-12T02:02:35.884 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-12T02:02:35.884 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-12T02:02:35.884 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-12T02:02:35.884 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-12T02:02:35.884 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-12T02:02:35.884 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-12T02:02:35.884 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend-2.6-1.el8.noarch 2023-07-12T02:02:35.885 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-12T02:02:35.885 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-12T02:02:35.885 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-12T02:02:35.885 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-12T02:02:35.885 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-12T02:02:35.885 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-12T02:02:35.885 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.885 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.886 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-12T02:02:35.886 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-12T02:02:35.886 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.886 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-12T02:02:35.886 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-12T02:02:35.886 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-12T02:02:35.886 INFO:teuthology.orchestra.run.smithi196.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-12T02:02:35.887 INFO:teuthology.orchestra.run.smithi196.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-12T02:02:35.887 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-12T02:02:35.887 INFO:teuthology.orchestra.run.smithi196.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-12T02:02:35.887 INFO:teuthology.orchestra.run.smithi196.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-12T02:02:35.887 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-12T02:02:35.887 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-12T02:02:35.887 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-12T02:02:35.888 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-12T02:02:35.888 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-12T02:02:35.888 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.888 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.888 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:02:35.888 INFO:teuthology.orchestra.run.smithi196.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-12T02:02:35.888 INFO:teuthology.orchestra.run.smithi196.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-12T02:02:35.889 INFO:teuthology.orchestra.run.smithi196.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-12T02:02:35.889 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-12T02:02:35.889 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-12T02:02:35.889 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-12T02:02:35.889 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:35.890 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2023-07-12T02:02:36.209 DEBUG:teuthology.parallel:result is None 2023-07-12T02:02:36.210 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-12T02:02:36.481 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-12T02:02:36.542 INFO:teuthology.orchestra.run.smithi037.stdout:18.0.0-4828.gb5891ed6.el8 2023-07-12T02:02:36.543 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4828.gb5891ed6.el8 2023-07-12T02:02:36.544 INFO:teuthology.task.install:The correct ceph version 18.0.0-4828.gb5891ed6 is installed. 2023-07-12T02:02:36.544 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-12T02:02:36.776 DEBUG:teuthology.orchestra.run.smithi196:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-12T02:02:36.831 INFO:teuthology.orchestra.run.smithi196.stdout:18.0.0-4828.gb5891ed6.el8 2023-07-12T02:02:36.831 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4828.gb5891ed6.el8 2023-07-12T02:02:36.831 INFO:teuthology.task.install:The correct ceph version 18.0.0-4828.gb5891ed6 is installed. 2023-07-12T02:02:36.832 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-12T02:02:36.832 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:02:36.832 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-12T02:02:36.913 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:02:36.913 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-12T02:02:36.986 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-12T02:02:36.986 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:02:36.987 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2023-07-12T02:02:37.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-12T02:02:37.167 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:02:37.167 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2023-07-12T02:02:37.238 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-12T02:02:37.348 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-12T02:02:37.348 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:02:37.348 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-12T02:02:37.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-12T02:02:37.524 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:02:37.524 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-12T02:02:37.595 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-12T02:02:37.705 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-12T02:02:37.705 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:02:37.706 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2023-07-12T02:02:37.774 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-12T02:02:37.882 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:02:37.882 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2023-07-12T02:02:37.952 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-12T02:02:38.062 INFO:teuthology.run_tasks:Running task ceph... 2023-07-12T02:02:38.129 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-12T02:02:38.130 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2023-07-12T02:02:38.134 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /var/log/ceph 2023-07-12T02:02:38.202 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-12T02:02:38.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-12T02:02:38.207 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-12T02:02:38.277 INFO:tasks.ceph:Creating extra log directories... 2023-07-12T02:02:38.277 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-12T02:02:38.281 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-12T02:02:38.359 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-12T02:02:38.359 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-12T02:02:38.359 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-12T02:02:38.360 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:02:38.360 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-12T02:02:38.404 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-12T02:02:38.621 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-12T02:02:38.690 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:02:38.690 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-12T02:02:38.735 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-12T02:02:38.937 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-12T02:02:39.015 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-12T02:02:39.015 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-12T02:02:39.015 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334517', 'branch': 'wip-pdonnell-testing-20230710.195410', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7334517', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20230710.195410'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20230710.195410', 'sha1': '6a59b159e6baf6cc2ce7ca365bda9e61847ec2a4'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 948, 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2', 'sleep_before_teardown': 0, 'subset': '199/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20230710.195410', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_6a59b159e6baf6cc2ce7ca365bda9e61847ec2a4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '6a59b159e6baf6cc2ce7ca365bda9e61847ec2a4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMFsFBETFo9LxwaHSLA7s0f0yJvx6hAx9p6PYdGihoXire8cxVL1W0K86OWxQ1wNYX/yqli7D8+eosmPSkoPxeU=', 'smithi196.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDavFvVoRdbeo85AWgTErhNPMGwTk+Km2rCzlX/3LAHP1BoVvZX4rIsCzhirmJlYZ7KN4QKCTzFsmaLiqq8vTCuKD63JOGyEOJ3VxraOVDIbhaXktRx1VL7EBXclQCxk86jPpWFqPwRBA+FvG8pWG96x8AqNWr5JEoBZ95IlDkXVfZuuKR9HEqDmkqqxx/8tii9UDNN7D+ZeVWX/9XWPns/PFXGEKGwBTQrIH0mLpDdy7L+/z9tvlBD6S2KzscJW4zl/Qg265OOaIguMX1ieyseiFGzL6HN5qL8w6+BYIL7TcN775gnDWX2PiN7k8v4kFyJ+fUMi+wrJpRO7pQ1lfXbxl/kKbFj8sjgjjvqYoIJOw3lXwGBckxhNSIHkCvLOdGlnYWo9UX9eDPPFKsEjvNwWAFHBePFYJn94st5wODlK+vcZd5wlvISrS6qoxrG6/s3vKk+/iwXlmHgV/wlsnBXJdudMHo6sS5gOsSwTVdqAsfR3FlAOAqlZ23av21vA+k='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b53f236c1077f1d295baafb9e0ca9a4b447019d7', 'timestamp': '2023-07-12_01:23:58', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-12T02:02:39.016 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-12T02:02:39.021 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-12T02:02:39.069 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2023-07-12T02:02:39.106 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/run/ceph 2023-07-12T02:02:39.176 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:02:39.177 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2023-07-12T02:02:39.221 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-12T02:02:39.221 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2023-07-12T02:02:39.306 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-12T02:02:39.306 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-12T02:02:39.306 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-07-12T02:02:39.306 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-12T02:02:39.307 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-07-12T02:02:39.307 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-07-12 01:59:43.636098152 +0000 2023-07-12T02:02:39.307 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-07-12 01:49:45.627325383 +0000 2023-07-12T02:02:39.307 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-07-12 01:49:45.627325383 +0000 2023-07-12T02:02:39.307 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-07-12 01:49:45.600325731 +0000 2023-07-12T02:02:39.307 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-12T02:02:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-07-12T02:02:39.413 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-07-12T02:02:39.413 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000461226 s, 1.1 MB/s 2023-07-12T02:02:39.415 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-12T02:02:39.462 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2023-07-12T02:02:39.507 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-12T02:02:39.507 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-12T02:02:39.508 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-07-12T02:02:39.508 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-12T02:02:39.508 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-07-12T02:02:39.508 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-07-12 01:59:43.636098152 +0000 2023-07-12T02:02:39.508 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-07-12 01:49:46.461314646 +0000 2023-07-12T02:02:39.508 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-07-12 01:49:46.461314646 +0000 2023-07-12T02:02:39.508 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-07-12 01:49:46.436314968 +0000 2023-07-12T02:02:39.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-12T02:02:39.613 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-07-12T02:02:39.613 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-07-12T02:02:39.613 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000283634 s, 1.8 MB/s 2023-07-12T02:02:39.615 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-12T02:02:39.662 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2023-07-12T02:02:39.707 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-12T02:02:39.707 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-12T02:02:39.707 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-07-12T02:02:39.707 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-12T02:02:39.707 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-07-12T02:02:39.707 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-07-12 01:59:43.636098152 +0000 2023-07-12T02:02:39.707 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-07-12 01:49:47.292303948 +0000 2023-07-12T02:02:39.708 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-07-12 01:49:47.292303948 +0000 2023-07-12T02:02:39.708 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-07-12 01:49:47.269304244 +0000 2023-07-12T02:02:39.708 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-12T02:02:39.813 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-07-12T02:02:39.813 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-07-12T02:02:39.813 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000279104 s, 1.8 MB/s 2023-07-12T02:02:39.815 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-12T02:02:39.862 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2023-07-12T02:02:39.907 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-12T02:02:39.907 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-12T02:02:39.907 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-07-12T02:02:39.907 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-12T02:02:39.907 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-07-12T02:02:39.907 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-07-12 01:59:43.636098152 +0000 2023-07-12T02:02:39.907 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-07-12 01:49:48.140293031 +0000 2023-07-12T02:02:39.908 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-07-12 01:49:48.140293031 +0000 2023-07-12T02:02:39.908 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-07-12 01:49:48.114293366 +0000 2023-07-12T02:02:39.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-12T02:02:40.014 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-07-12T02:02:40.014 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-07-12T02:02:40.014 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000308674 s, 1.7 MB/s 2023-07-12T02:02:40.016 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-12T02:02:40.063 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-12T02:02:40.063 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:02:40.063 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2023-07-12T02:02:40.254 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-12T02:02:40.254 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 2023-07-12T02:02:40.341 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-12T02:02:40.341 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-12T02:02:40.341 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 447 Links: 1 2023-07-12T02:02:40.342 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-12T02:02:40.342 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2023-07-12T02:02:40.342 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2023-07-12 02:02:33.258563517 +0000 2023-07-12T02:02:40.342 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2023-07-12 01:51:41.059655952 +0000 2023-07-12T02:02:40.342 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2023-07-12 01:51:41.059655952 +0000 2023-07-12T02:02:40.342 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2023-07-12 01:51:41.032656525 +0000 2023-07-12T02:02:40.343 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-12T02:02:40.447 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2023-07-12T02:02:40.447 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2023-07-12T02:02:40.447 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000319454 s, 1.6 MB/s 2023-07-12T02:02:40.449 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-12T02:02:40.499 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 2023-07-12T02:02:40.544 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-12T02:02:40.544 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-12T02:02:40.545 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 453 Links: 1 2023-07-12T02:02:40.545 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-12T02:02:40.545 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2023-07-12T02:02:40.545 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2023-07-12 02:02:33.258563517 +0000 2023-07-12T02:02:40.545 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2023-07-12 01:51:41.879638556 +0000 2023-07-12T02:02:40.545 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2023-07-12 01:51:41.879638556 +0000 2023-07-12T02:02:40.545 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2023-07-12 01:51:41.854639086 +0000 2023-07-12T02:02:40.546 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-12T02:02:40.649 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2023-07-12T02:02:40.649 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2023-07-12T02:02:40.649 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000288657 s, 1.8 MB/s 2023-07-12T02:02:40.651 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-12T02:02:40.699 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 2023-07-12T02:02:40.745 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-12T02:02:40.746 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-12T02:02:40.746 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 459 Links: 1 2023-07-12T02:02:40.746 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-12T02:02:40.746 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2023-07-12T02:02:40.746 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2023-07-12 02:02:33.258563517 +0000 2023-07-12T02:02:40.746 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2023-07-12 01:51:42.700621138 +0000 2023-07-12T02:02:40.746 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2023-07-12 01:51:42.700621138 +0000 2023-07-12T02:02:40.747 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2023-07-12 01:51:42.677621626 +0000 2023-07-12T02:02:40.747 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-12T02:02:40.813 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2023-07-12T02:02:40.813 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2023-07-12T02:02:40.813 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000270982 s, 1.9 MB/s 2023-07-12T02:02:40.815 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-12T02:02:40.862 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 2023-07-12T02:02:40.908 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-12T02:02:40.909 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-12T02:02:40.909 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 465 Links: 1 2023-07-12T02:02:40.909 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-12T02:02:40.909 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2023-07-12T02:02:40.909 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2023-07-12 02:02:33.258563517 +0000 2023-07-12T02:02:40.909 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2023-07-12 01:51:43.534603445 +0000 2023-07-12T02:02:40.910 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2023-07-12 01:51:43.534603445 +0000 2023-07-12T02:02:40.910 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2023-07-12 01:51:43.506604039 +0000 2023-07-12T02:02:40.910 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-12T02:02:40.976 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2023-07-12T02:02:40.976 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2023-07-12T02:02:40.976 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000285134 s, 1.8 MB/s 2023-07-12T02:02:40.979 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-12T02:02:41.029 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-12T02:02:41.029 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-12T02:02:41.030 INFO:tasks.ceph:Generating config... 2023-07-12T02:02:41.031 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-12T02:02:41.031 INFO:tasks.ceph:[client] debug client = 20 2023-07-12T02:02:41.031 INFO:tasks.ceph:[client] debug ms = 1 2023-07-12T02:02:41.032 INFO:tasks.ceph:[client] pid file = 2023-07-12T02:02:41.032 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-12T02:02:41.032 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-12T02:02:41.032 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-12T02:02:41.032 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-12T02:02:41.033 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-12T02:02:41.033 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-12T02:02:41.033 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-12T02:02:41.033 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-12T02:02:41.033 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-12T02:02:41.034 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-12T02:02:41.034 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-12T02:02:41.034 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-12T02:02:41.034 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-12T02:02:41.034 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-12T02:02:41.035 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-12T02:02:41.035 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-12T02:02:41.035 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-12T02:02:41.035 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-12T02:02:41.035 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-12T02:02:41.035 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-12T02:02:41.036 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-12T02:02:41.036 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-07-12T02:02:41.036 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-07-12T02:02:41.036 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-12T02:02:41.036 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-12T02:02:41.037 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-07-12T02:02:41.037 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-12T02:02:41.037 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-12T02:02:41.037 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-12T02:02:41.037 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-12T02:02:41.038 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-12T02:02:41.038 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-12T02:02:41.038 INFO:tasks.ceph:Setting up mon.a... 2023-07-12T02:02:41.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-12T02:02:41.155 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2023-07-12T02:02:41.161 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-12T02:02:41.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-12T02:02:41.331 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37'), ('mon.b', '172.21.15.196'), ('mon.c', '[v2:172.21.15.196:3301,v1:172.21.15.196:6790]')] 2023-07-12T02:02:41.332 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-12T02:02:41.333 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:02:41.333 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-12T02:02:41.378 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --add b 172.21.15.196 --addv c '[v2:172.21.15.196:3301,v1:172.21.15.196:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:02:41.507 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:02:41.507 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid e0d485b9-796c-494c-84d4-d32d9c18c85f 2023-07-12T02:02:41.507 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = pacific 2023-07-12T02:02:41.507 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2023-07-12T02:02:41.508 INFO:teuthology.orchestra.run.smithi037.stdout:fsid e0d485b9-796c-494c-84d4-d32d9c18c85f 2023-07-12T02:02:41.508 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2023-07-12T02:02:41.504969+0000 2023-07-12T02:02:41.508 INFO:teuthology.orchestra.run.smithi037.stdout:created 2023-07-12T02:02:41.504969+0000 2023-07-12T02:02:41.508 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 16 (pacific) 2023-07-12T02:02:41.508 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2023-07-12T02:02:41.508 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2023-07-12T02:02:41.508 INFO:teuthology.orchestra.run.smithi037.stdout:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2023-07-12T02:02:41.509 INFO:teuthology.orchestra.run.smithi037.stdout:2: [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] mon.c 2023-07-12T02:02:41.509 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-12T02:02:41.510 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-12T02:02:41.554 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e0d485b9-796c-494c-84d4-d32d9c18c85f... 2023-07-12T02:02:41.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-12T02:02:41.598 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-12T02:02:41.711 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-07-12T02:02:41.711 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-07-12T02:02:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-12T02:02:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-07-12T02:02:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-07-12T02:02:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-07-12T02:02:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-07-12T02:02:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-07-12T02:02:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-07-12T02:02:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-07-12T02:02:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-12T02:02:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-07-12T02:02:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-07-12T02:02:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-12T02:02:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-07-12T02:02:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-07-12T02:02:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-07-12T02:02:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-07-12T02:02:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-07-12T02:02:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-07-12T02:02:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-07-12T02:02:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-07-12T02:02:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-12T02:02:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-12T02:02:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-07-12T02:02:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-12T02:02:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-07-12T02:02:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-07-12T02:02:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-07-12T02:02:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-07-12T02:02:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-07-12T02:02:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]" 2023-07-12T02:02:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on skipped message = False 2023-07-12T02:02:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = e0d485b9-796c-494c-84d4-d32d9c18c85f 2023-07-12T02:02:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.717 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-07-12T02:02:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-07-12T02:02:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-07-12T02:02:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-07-12T02:02:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-07-12T02:02:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-07-12T02:02:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-07-12T02:02:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-07-12T02:02:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-07-12T02:02:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-07-12T02:02:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-07-12T02:02:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-07-12T02:02:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-07-12T02:02:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-07-12T02:02:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-07-12T02:02:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-07-12T02:02:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-07-12T02:02:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-07-12T02:02:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-07-12T02:02:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-07-12T02:02:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-07-12T02:02:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 20 2023-07-12T02:02:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 20 2023-07-12T02:02:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-12T02:02:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-07-12T02:02:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 10 2023-07-12T02:02:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-07-12T02:02:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-07-12T02:02:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-07-12T02:02:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-07-12T02:02:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-07-12T02:02:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-07-12T02:02:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.723 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-07-12T02:02:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-12T02:02:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-07-12T02:02:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-07-12T02:02:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-07-12T02:02:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-07-12T02:02:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-07-12T02:02:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-07-12T02:02:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.724 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-07-12T02:02:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-12T02:02:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-07-12T02:02:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-07-12T02:02:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-07-12T02:02:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-07-12T02:02:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-07-12T02:02:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-07-12T02:02:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-07-12T02:02:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-07-12T02:02:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-07-12T02:02:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-12T02:02:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-07-12T02:02:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-07-12T02:02:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-07-12T02:02:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-12T02:02:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-12T02:02:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-07-12T02:02:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-07-12T02:02:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-07-12T02:02:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2023-07-12T02:02:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:02:41.727 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-07-12T02:02:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-07-12T02:02:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2023-07-12T02:02:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-07-12T02:02:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-12T02:02:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-12T02:02:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2023-07-12T02:02:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-07-12T02:02:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-12T02:02:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2023-07-12T02:02:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-07-12T02:02:41.729 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-07-12T02:02:41.729 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-07-12T02:02:41.729 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2023-07-12T02:02:41.729 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2023-07-12T02:02:41.729 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-07-12T02:02:41.729 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-07-12T02:02:41.729 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-07-12T02:02:41.729 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-07-12T02:02:41.730 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2023-07-12T02:02:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2023-07-12T02:02:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds balancer = 20 2023-07-12T02:02:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-12T02:02:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2023-07-12T02:02:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2023-07-12T02:02:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2023-07-12T02:02:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2023-07-12T02:02:41.731 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-07-12T02:02:41.731 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-07-12T02:02:41.731 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-07-12T02:02:41.731 INFO:teuthology.orchestra.run.smithi196.stdout:[global] 2023-07-12T02:02:41.731 INFO:teuthology.orchestra.run.smithi196.stdout: chdir = "" 2023-07-12T02:02:41.732 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-12T02:02:41.732 INFO:teuthology.orchestra.run.smithi196.stdout: auth supported = cephx 2023-07-12T02:02:41.732 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.732 INFO:teuthology.orchestra.run.smithi196.stdout: filestore xattr use omap = true 2023-07-12T02:02:41.732 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.732 INFO:teuthology.orchestra.run.smithi196.stdout: mon clock drift allowed = 1.000 2023-07-12T02:02:41.732 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.732 INFO:teuthology.orchestra.run.smithi196.stdout: osd crush chooseleaf type = 0 2023-07-12T02:02:41.733 INFO:teuthology.orchestra.run.smithi196.stdout: auth debug = true 2023-07-12T02:02:41.733 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.733 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on old message = true 2023-07-12T02:02:41.733 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on bug = true 2023-07-12T02:02:41.733 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.733 INFO:teuthology.orchestra.run.smithi196.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-12T02:02:41.733 INFO:teuthology.orchestra.run.smithi196.stdout: mon pg warn max object skew = 0 2023-07-12T02:02:41.733 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.734 INFO:teuthology.orchestra.run.smithi196.stdout: # disable pg_autoscaler by default for new pools 2023-07-12T02:02:41.734 INFO:teuthology.orchestra.run.smithi196.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-12T02:02:41.734 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.734 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default size = 2 2023-07-12T02:02:41.734 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.734 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow primary affinity = true 2023-07-12T02:02:41.734 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow pg remap = true 2023-07-12T02:02:41.734 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on legacy crush tunables = false 2023-07-12T02:02:41.735 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on crush straw calc version zero = false 2023-07-12T02:02:41.735 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on no sortbitwise = false 2023-07-12T02:02:41.735 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on osd down out interval zero = false 2023-07-12T02:02:41.735 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on too few osds = false 2023-07-12T02:02:41.735 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-12T02:02:41.735 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-12T02:02:41.735 INFO:teuthology.orchestra.run.smithi196.stdout: mon_allow_pool_size_one = true 2023-07-12T02:02:41.735 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.736 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-12T02:02:41.736 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.736 INFO:teuthology.orchestra.run.smithi196.stdout: osd default data pool replay window = 5 2023-07-12T02:02:41.736 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.736 INFO:teuthology.orchestra.run.smithi196.stdout: mon allow pool delete = true 2023-07-12T02:02:41.736 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.736 INFO:teuthology.orchestra.run.smithi196.stdout: mon cluster log file level = debug 2023-07-12T02:02:41.737 INFO:teuthology.orchestra.run.smithi196.stdout: debug asserts on shutdown = true 2023-07-12T02:02:41.737 INFO:teuthology.orchestra.run.smithi196.stdout: mon health detail to clog = false 2023-07-12T02:02:41.737 INFO:teuthology.orchestra.run.smithi196.stdout: mon host = "172.21.15.37,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]" 2023-07-12T02:02:41.737 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on skipped message = False 2023-07-12T02:02:41.737 INFO:teuthology.orchestra.run.smithi196.stdout: fsid = e0d485b9-796c-494c-84d4-d32d9c18c85f 2023-07-12T02:02:41.737 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.737 INFO:teuthology.orchestra.run.smithi196.stdout:[osd] 2023-07-12T02:02:41.737 INFO:teuthology.orchestra.run.smithi196.stdout: osd journal size = 100 2023-07-12T02:02:41.738 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.738 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub load threshold = 5.0 2023-07-12T02:02:41.738 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub max interval = 600 2023-07-12T02:02:41.738 INFO:teuthology.orchestra.run.smithi196.stdout: osd mclock profile = high_recovery_ops 2023-07-12T02:02:41.738 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.738 INFO:teuthology.orchestra.run.smithi196.stdout: osd recover clone overlap = true 2023-07-12T02:02:41.738 INFO:teuthology.orchestra.run.smithi196.stdout: osd recovery max chunk = 1048576 2023-07-12T02:02:41.738 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.739 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug shutdown = true 2023-07-12T02:02:41.739 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug op order = true 2023-07-12T02:02:41.739 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify stray on activate = true 2023-07-12T02:02:41.739 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.739 INFO:teuthology.orchestra.run.smithi196.stdout: osd open classes on start = true 2023-07-12T02:02:41.739 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug pg log writeout = true 2023-07-12T02:02:41.739 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.739 INFO:teuthology.orchestra.run.smithi196.stdout: osd deep scrub update digest min age = 30 2023-07-12T02:02:41.740 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.740 INFO:teuthology.orchestra.run.smithi196.stdout: osd map max advance = 10 2023-07-12T02:02:41.740 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.740 INFO:teuthology.orchestra.run.smithi196.stdout: journal zero on create = true 2023-07-12T02:02:41.740 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.740 INFO:teuthology.orchestra.run.smithi196.stdout: filestore ondisk finisher threads = 3 2023-07-12T02:02:41.740 INFO:teuthology.orchestra.run.smithi196.stdout: filestore apply finisher threads = 3 2023-07-12T02:02:41.740 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.741 INFO:teuthology.orchestra.run.smithi196.stdout: bdev debug aio = true 2023-07-12T02:02:41.741 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug misdirected ops = true 2023-07-12T02:02:41.741 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore block size = 96636764160 2023-07-12T02:02:41.741 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore fsck on mount = True 2023-07-12T02:02:41.741 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluefs = 20 2023-07-12T02:02:41.741 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluestore = 20 2023-07-12T02:02:41.741 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2023-07-12T02:02:41.741 INFO:teuthology.orchestra.run.smithi196.stdout: debug osd = 20 2023-07-12T02:02:41.742 INFO:teuthology.orchestra.run.smithi196.stdout: debug rocksdb = 10 2023-07-12T02:02:41.742 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd backfillfull_ratio = 0.85 2023-07-12T02:02:41.742 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd full ratio = 0.9 2023-07-12T02:02:41.742 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd nearfull ratio = 0.8 2023-07-12T02:02:41.742 INFO:teuthology.orchestra.run.smithi196.stdout: osd failsafe full ratio = 0.95 2023-07-12T02:02:41.742 INFO:teuthology.orchestra.run.smithi196.stdout: osd objectstore = bluestore 2023-07-12T02:02:41.742 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2023-07-12T02:02:41.742 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.743 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr] 2023-07-12T02:02:41.743 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2023-07-12T02:02:41.743 INFO:teuthology.orchestra.run.smithi196.stdout: debug mgr = 20 2023-07-12T02:02:41.743 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2023-07-12T02:02:41.743 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2023-07-12T02:02:41.743 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2023-07-12T02:02:41.743 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2023-07-12T02:02:41.743 INFO:teuthology.orchestra.run.smithi196.stdout: mgr/telemetry/nag = false 2023-07-12T02:02:41.744 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.744 INFO:teuthology.orchestra.run.smithi196.stdout:[mon] 2023-07-12T02:02:41.744 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2023-07-12T02:02:41.744 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2023-07-12T02:02:41.744 INFO:teuthology.orchestra.run.smithi196.stdout: debug paxos = 20 2023-07-12T02:02:41.744 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2023-07-12T02:02:41.744 INFO:teuthology.orchestra.run.smithi196.stdout: mon data avail warn = 5 2023-07-12T02:02:41.744 INFO:teuthology.orchestra.run.smithi196.stdout: mon mgr mkfs grace = 240 2023-07-12T02:02:41.745 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2023-07-12T02:02:41.745 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd reporter subtree level = osd 2023-07-12T02:02:41.745 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd prime pg temp = true 2023-07-12T02:02:41.745 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2023-07-12T02:02:41.745 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.745 INFO:teuthology.orchestra.run.smithi196.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-12T02:02:41.745 INFO:teuthology.orchestra.run.smithi196.stdout: auth mon ticket ttl = 660 # 11m 2023-07-12T02:02:41.745 INFO:teuthology.orchestra.run.smithi196.stdout: auth service ticket ttl = 240 # 4m 2023-07-12T02:02:41.746 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.746 INFO:teuthology.orchestra.run.smithi196.stdout: # don't complain about insecure global_id in the test suite 2023-07-12T02:02:41.746 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-12T02:02:41.746 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-12T02:02:41.746 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.746 INFO:teuthology.orchestra.run.smithi196.stdout: # 1m isn't quite enough 2023-07-12T02:02:41.746 INFO:teuthology.orchestra.run.smithi196.stdout: mon_down_mkfs_grace = 2m 2023-07-12T02:02:41.746 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.747 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_filestore_osds = false 2023-07-12T02:02:41.747 INFO:teuthology.orchestra.run.smithi196.stdout: mon op complaint time = 120 2023-07-12T02:02:41.747 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-07-12T02:02:41.747 INFO:teuthology.orchestra.run.smithi196.stdout:[client] 2023-07-12T02:02:41.747 INFO:teuthology.orchestra.run.smithi196.stdout: rgw cache enabled = true 2023-07-12T02:02:41.747 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable ops log = true 2023-07-12T02:02:41.747 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable usage log = true 2023-07-12T02:02:41.747 INFO:teuthology.orchestra.run.smithi196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-12T02:02:41.748 INFO:teuthology.orchestra.run.smithi196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-12T02:02:41.748 INFO:teuthology.orchestra.run.smithi196.stdout: client mount timeout = 600 2023-07-12T02:02:41.748 INFO:teuthology.orchestra.run.smithi196.stdout: debug client = 20 2023-07-12T02:02:41.748 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2023-07-12T02:02:41.748 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = "" 2023-07-12T02:02:41.748 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2023-07-12T02:02:41.748 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2023-07-12T02:02:41.748 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.a] 2023-07-12T02:02:41.749 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.b] 2023-07-12T02:02:41.749 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.c] 2023-07-12T02:02:41.749 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2023-07-12T02:02:41.749 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2023-07-12T02:02:41.749 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2023-07-12T02:02:41.749 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.d] 2023-07-12T02:02:41.749 INFO:teuthology.orchestra.run.smithi196.stdout:[mds] 2023-07-12T02:02:41.749 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds = 20 2023-07-12T02:02:41.750 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds balancer = 20 2023-07-12T02:02:41.750 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2023-07-12T02:02:41.750 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug frag = True 2023-07-12T02:02:41.750 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug scatterstat = True 2023-07-12T02:02:41.750 INFO:teuthology.orchestra.run.smithi196.stdout: mds op complaint time = 180 2023-07-12T02:02:41.750 INFO:teuthology.orchestra.run.smithi196.stdout: mds verify scatter = True 2023-07-12T02:02:41.750 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2023-07-12T02:02:41.750 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2023-07-12T02:02:41.751 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2023-07-12T02:02:41.752 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-12T02:02:41.752 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-12T02:02:41.865 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-12T02:02:41.865 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:02:41.865 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-12T02:02:41.909 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:02:41.910 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-12T02:02:41.993 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2023-07-12T02:02:41.994 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:02:41.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-12T02:02:41.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-12T02:02:42.127 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:02:42.127 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:02:42.211 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi196.front.sepia.ceph.com 2023-07-12T02:02:42.212 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:02:42.212 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-12T02:02:42.212 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-12T02:02:42.308 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:02:42.309 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:02:42.395 INFO:tasks.ceph:Setting up mon nodes... 2023-07-12T02:02:42.396 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-12T02:02:42.396 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-12T02:02:42.519 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-12T02:02:42.524 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-12T02:02:42.676 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-12T02:02:42.683 INFO:tasks.ceph:Setting up mds nodes... 2023-07-12T02:02:42.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-12T02:02:42.807 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-12T02:02:42.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-12T02:02:42.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-12T02:02:43.003 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-12T02:02:43.008 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-12T02:02:43.077 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-12T02:02:43.207 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-12T02:02:43.213 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-12T02:02:43.284 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-12T02:02:43.409 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-12T02:02:43.415 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-12T02:02:43.486 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-12T02:02:43.486 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-12T02:02:43.587 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-12T02:02:43.617 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-12T02:02:43.714 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-12T02:02:43.745 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-12T02:02:43.840 INFO:teuthology.orchestra.run.smithi196.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-12T02:02:43.870 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-12T02:02:43.964 INFO:teuthology.orchestra.run.smithi196.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-12T02:02:43.994 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-12T02:02:43.995 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-12T02:02:43.995 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-12T02:02:44.065 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-12T02:02:44.066 INFO:tasks.ceph:role: osd.0 2023-07-12T02:02:44.066 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-12T02:02:44.066 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-12T02:02:44.142 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-12T02:02:44.142 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-12T02:02:44.142 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-12T02:02:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-12T02:02:44.143 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-12T02:02:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-07-12T02:02:44.143 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-12T02:02:44.143 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-12T02:02:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-12T02:02:44.143 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-12T02:02:44.584 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-07-12T02:02:44.589 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-07-12T02:02:44.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-12T02:02:44.765 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-12T02:02:44.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-12T02:02:44.912 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-12T02:02:44.913 INFO:tasks.ceph:role: osd.1 2023-07-12T02:02:44.913 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-12T02:02:44.913 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-12T02:02:44.989 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-12T02:02:44.989 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-12T02:02:44.989 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-12T02:02:44.989 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-12T02:02:44.990 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-12T02:02:44.990 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-07-12T02:02:44.990 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-12T02:02:44.990 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-12T02:02:44.990 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-12T02:02:44.990 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-12T02:02:45.406 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-07-12T02:02:45.409 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-07-12T02:02:45.409 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-12T02:02:45.547 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-12T02:02:45.623 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-12T02:02:45.692 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-12T02:02:45.692 INFO:tasks.ceph:role: osd.2 2023-07-12T02:02:45.692 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-12T02:02:45.693 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-12T02:02:45.769 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-12T02:02:45.769 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-12T02:02:45.769 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-12T02:02:45.769 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-12T02:02:45.770 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-12T02:02:45.770 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-07-12T02:02:45.770 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-12T02:02:45.770 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-12T02:02:45.770 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-12T02:02:45.770 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-12T02:02:46.224 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-07-12T02:02:46.228 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-07-12T02:02:46.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-12T02:02:46.437 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-12T02:02:46.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-12T02:02:46.585 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-12T02:02:46.585 INFO:tasks.ceph:role: osd.3 2023-07-12T02:02:46.585 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-12T02:02:46.586 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-12T02:02:46.661 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-12T02:02:46.662 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-12T02:02:46.662 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-12T02:02:46.662 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-12T02:02:46.662 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-12T02:02:46.662 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-07-12T02:02:46.662 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-12T02:02:46.662 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-12T02:02:46.663 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-12T02:02:46.663 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-12T02:02:47.096 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-07-12T02:02:47.101 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-07-12T02:02:47.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-12T02:02:47.216 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-12T02:02:47.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:02:47.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:47.406+0000 7f372cc81640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-12T02:02:47.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:47.407+0000 7f372cc81640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:47.407+0000 7f372cc81640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:47.407+0000 7f372cc81640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:47.407+0000 7f372cc81640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-12T02:02:47.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:47.409+0000 7f372cc81640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-12T02:02:50.298 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-12T02:02:50.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:02:50.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:50.474+0000 7efe0ac05640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-12T02:02:50.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:50.474+0000 7efe0ac05640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-12T02:02:50.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:50.474+0000 7efe0ac05640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-12T02:02:50.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:50.474+0000 7efe0ac05640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-12T02:02:50.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:50.474+0000 7efe0ac05640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-12T02:02:50.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:50.476+0000 7efe0ac05640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-12T02:02:53.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-12T02:02:53.422 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:02:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:53.525+0000 7f5ceea6d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-12T02:02:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:53.525+0000 7f5ceea6d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-12T02:02:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:53.526+0000 7f5ceea6d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-12T02:02:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:53.526+0000 7f5ceea6d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-12T02:02:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:53.526+0000 7f5ceea6d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-12T02:02:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:53.527+0000 7f5ceea6d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-12T02:02:56.408 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-12T02:02:56.481 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:02:56.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:56.586+0000 7f57f13ed640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-12T02:02:56.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:56.586+0000 7f57f13ed640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-12T02:02:56.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:56.586+0000 7f57f13ed640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-12T02:02:56.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:56.586+0000 7f57f13ed640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-12T02:02:56.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:56.586+0000 7f57f13ed640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-12T02:02:56.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:02:56.588+0000 7f57f13ed640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-12T02:02:59.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-12T02:02:59.555 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-12T02:02:59.630 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-12T02:02:59.630 INFO:tasks.ceph:role: osd.4 2023-07-12T02:02:59.630 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com 2023-07-12T02:02:59.631 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-12T02:02:59.708 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-12T02:02:59.708 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-12T02:02:59.709 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-12T02:02:59.709 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-12T02:02:59.709 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-12T02:02:59.709 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2023-07-12T02:02:59.709 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-12T02:02:59.709 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-12T02:02:59.709 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-12T02:02:59.710 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-12T02:03:00.159 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2023-07-12T02:03:00.163 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2023-07-12T02:03:00.164 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-12T02:03:00.362 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-12T02:03:00.439 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-12T02:03:00.507 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-12T02:03:00.507 INFO:tasks.ceph:role: osd.5 2023-07-12T02:03:00.508 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com 2023-07-12T02:03:00.508 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-12T02:03:00.582 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-12T02:03:00.583 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-12T02:03:00.583 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-12T02:03:00.583 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-12T02:03:00.583 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-12T02:03:00.583 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2023-07-12T02:03:00.583 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-12T02:03:00.584 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-12T02:03:00.584 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-12T02:03:00.584 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-12T02:03:00.989 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2023-07-12T02:03:00.993 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2023-07-12T02:03:00.993 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-12T02:03:01.121 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-12T02:03:01.198 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-12T02:03:01.266 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-12T02:03:01.266 INFO:tasks.ceph:role: osd.6 2023-07-12T02:03:01.267 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com 2023-07-12T02:03:01.267 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-12T02:03:01.342 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-12T02:03:01.342 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-12T02:03:01.342 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-12T02:03:01.342 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-12T02:03:01.343 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-12T02:03:01.343 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2023-07-12T02:03:01.343 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-12T02:03:01.343 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-12T02:03:01.343 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-12T02:03:01.343 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-12T02:03:01.785 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2023-07-12T02:03:01.788 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2023-07-12T02:03:01.789 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-12T02:03:01.978 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-12T02:03:02.052 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-12T02:03:02.120 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-12T02:03:02.121 INFO:tasks.ceph:role: osd.7 2023-07-12T02:03:02.121 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com 2023-07-12T02:03:02.121 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-12T02:03:02.196 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-12T02:03:02.197 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-12T02:03:02.197 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-12T02:03:02.197 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-12T02:03:02.197 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-12T02:03:02.197 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2023-07-12T02:03:02.197 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-12T02:03:02.197 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-12T02:03:02.198 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-12T02:03:02.198 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-12T02:03:02.635 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2023-07-12T02:03:02.639 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2023-07-12T02:03:02.639 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-12T02:03:02.772 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-12T02:03:02.845 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:03:02.973 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:02.970+0000 7fe634c20640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-12T02:03:02.974 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:02.970+0000 7fe634c20640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-12T02:03:02.974 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:02.970+0000 7fe634c20640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-12T02:03:02.974 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:02.970+0000 7fe634c20640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-12T02:03:02.975 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:02.970+0000 7fe634c20640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-12T02:03:02.976 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:02.972+0000 7fe634c20640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-12T02:03:05.862 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-12T02:03:05.935 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:03:06.040 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:06.036+0000 7f0a3c4a8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-12T02:03:06.041 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:06.037+0000 7f0a3c4a8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-12T02:03:06.041 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:06.037+0000 7f0a3c4a8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-12T02:03:06.041 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:06.037+0000 7f0a3c4a8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-12T02:03:06.041 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:06.037+0000 7f0a3c4a8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-12T02:03:06.042 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:06.038+0000 7f0a3c4a8640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-12T02:03:08.922 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-12T02:03:08.993 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:03:09.018 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:03:09.022 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:03:09.101 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:09.097+0000 7feeb01ff640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-12T02:03:09.101 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:09.097+0000 7feeb01ff640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-12T02:03:09.102 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:09.097+0000 7feeb01ff640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-12T02:03:09.102 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:09.097+0000 7feeb01ff640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-12T02:03:09.102 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:09.097+0000 7feeb01ff640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-12T02:03:09.103 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:09.099+0000 7feeb01ff640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-12T02:03:11.980 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-12T02:03:12.051 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:03:12.154 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:12.150+0000 7fde85769640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-12T02:03:12.155 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:12.151+0000 7fde85769640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-12T02:03:12.155 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:12.151+0000 7fde85769640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-12T02:03:12.155 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:12.151+0000 7fde85769640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-12T02:03:12.155 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:12.151+0000 7fde85769640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-12T02:03:12.156 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:12.153+0000 7fde85769640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-12T02:03:15.032 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-12T02:03:15.105 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-12T02:03:15.105 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:03:15.106 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-12T02:03:15.181 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:03:15.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-12T02:03:15.253 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:03:15.253 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-12T02:03:15.362 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:03:15.362 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-12T02:03:15.470 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:03:15.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-12T02:03:15.578 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:03:15.579 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-12T02:03:15.686 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:03:15.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-12T02:03:15.794 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:03:15.795 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-12T02:03:15.869 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:03:15.869 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-12T02:03:15.939 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:03:15.939 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-12T02:03:16.047 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:03:16.048 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-12T02:03:16.154 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:03:16.155 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-12T02:03:16.261 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:03:16.261 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-12T02:03:16.369 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:03:16.369 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-12T02:03:16.477 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:03:16.477 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-12T02:03:16.526 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:03:16.526 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-12T02:03:16.573 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:03:16.573 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-12T02:03:16.617 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:03:16.617 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-12T02:03:16.700 INFO:tasks.ceph:Adding keys to all mons... 2023-07-12T02:03:16.701 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-12T02:03:16.705 DEBUG:teuthology.orchestra.run.smithi196:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-12T02:03:16.768 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.y] 2023-07-12T02:03:16.769 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDCCa5kFTjNHhAAZ80nufKhsfvlLW/0r8yXbg== 2023-07-12T02:03:16.769 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-07-12T02:03:16.769 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDCCa5kmzT6LxAAW0qkUzF6YI4EagSSaez+gQ== 2023-07-12T02:03:16.769 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-07-12T02:03:16.769 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDDCa5kn2kXABAAAnbLv1fuIMRmEBkg+pU8vQ== 2023-07-12T02:03:16.769 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2023-07-12T02:03:16.770 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDHCa5ku+BQGBAAonxOANdZCZshPwxzllTRVA== 2023-07-12T02:03:16.770 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2023-07-12T02:03:16.770 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDKCa5kDfhYHBAAfNKAb5TBMEd34E8nyy0tbQ== 2023-07-12T02:03:16.770 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2023-07-12T02:03:16.770 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDNCa5kyXpiHxAA8Pl/jbeUv23j3+Zej0EAyA== 2023-07-12T02:03:16.770 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2023-07-12T02:03:16.770 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDQCa5kd6YBIxAA32OIB3eq2oELuR5YVwOoww== 2023-07-12T02:03:16.771 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2023-07-12T02:03:16.771 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDCCa5kEQMtKBAABU2eONDRjE/1tUOyJTDCfw== 2023-07-12T02:03:16.771 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-07-12T02:03:16.771 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDDCa5k/vw7DBAAPp0phNSm5ZFCEj6sYUcjsg== 2023-07-12T02:03:16.771 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-07-12T02:03:16.771 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDDCa5k4ApMGBAAsQx7ltqZefMR3buK6/9iTQ== 2023-07-12T02:03:16.771 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.4] 2023-07-12T02:03:16.772 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDWCa5k0j3qORAA2AmosMC6V0SF0zFBPXnwsA== 2023-07-12T02:03:16.772 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.5] 2023-07-12T02:03:16.772 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaCa5kIAtJAhAAR/AlDdZhFXIJPLHVvQ71NA== 2023-07-12T02:03:16.772 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.6] 2023-07-12T02:03:16.772 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDdCa5kfS3nBRAA419im9djzLhwZy4VVsiq2Q== 2023-07-12T02:03:16.772 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.7] 2023-07-12T02:03:16.772 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDgCa5kNfoWCRAAMjXouPb1lGaTHLFcb4iAPg== 2023-07-12T02:03:16.773 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-12T02:03:16.773 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDDCa5kRgbdIhAAz7y/7oTRqD+BzAGhG1mhjg== 2023-07-12T02:03:16.773 INFO:teuthology.orchestra.run.smithi037.stdout:[client.2] 2023-07-12T02:03:16.773 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDDCa5kxPp6KhAA0VRGDq8kCvSgiaMkDO/Cpw== 2023-07-12T02:03:16.773 INFO:teuthology.orchestra.run.smithi037.stdout:[client.1] 2023-07-12T02:03:16.773 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDDCa5ksuf4MRAAXxrPxvbo/NPmReHt90AVpg== 2023-07-12T02:03:16.773 INFO:teuthology.orchestra.run.smithi037.stdout:[client.3] 2023-07-12T02:03:16.773 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDDCa5ktwhhORAA7/eBsiiiQXaTfDYM8SYV3g== 2023-07-12T02:03:16.805 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.y] 2023-07-12T02:03:16.805 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDCCa5kFTjNHhAAZ80nufKhsfvlLW/0r8yXbg== 2023-07-12T02:03:16.805 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2023-07-12T02:03:16.805 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDCCa5kmzT6LxAAW0qkUzF6YI4EagSSaez+gQ== 2023-07-12T02:03:16.805 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2023-07-12T02:03:16.805 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDDCa5kn2kXABAAAnbLv1fuIMRmEBkg+pU8vQ== 2023-07-12T02:03:16.806 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.0] 2023-07-12T02:03:16.806 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDHCa5ku+BQGBAAonxOANdZCZshPwxzllTRVA== 2023-07-12T02:03:16.806 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.1] 2023-07-12T02:03:16.806 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDKCa5kDfhYHBAAfNKAb5TBMEd34E8nyy0tbQ== 2023-07-12T02:03:16.806 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.2] 2023-07-12T02:03:16.806 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDNCa5kyXpiHxAA8Pl/jbeUv23j3+Zej0EAyA== 2023-07-12T02:03:16.806 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.3] 2023-07-12T02:03:16.807 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDQCa5kd6YBIxAA32OIB3eq2oELuR5YVwOoww== 2023-07-12T02:03:16.807 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.x] 2023-07-12T02:03:16.807 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDCCa5kEQMtKBAABU2eONDRjE/1tUOyJTDCfw== 2023-07-12T02:03:16.807 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2023-07-12T02:03:16.807 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDDCa5k/vw7DBAAPp0phNSm5ZFCEj6sYUcjsg== 2023-07-12T02:03:16.807 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.d] 2023-07-12T02:03:16.807 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDDCa5k4ApMGBAAsQx7ltqZefMR3buK6/9iTQ== 2023-07-12T02:03:16.808 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.4] 2023-07-12T02:03:16.808 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDWCa5k0j3qORAA2AmosMC6V0SF0zFBPXnwsA== 2023-07-12T02:03:16.808 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.5] 2023-07-12T02:03:16.808 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDaCa5kIAtJAhAAR/AlDdZhFXIJPLHVvQ71NA== 2023-07-12T02:03:16.808 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.6] 2023-07-12T02:03:16.808 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDdCa5kfS3nBRAA419im9djzLhwZy4VVsiq2Q== 2023-07-12T02:03:16.808 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.7] 2023-07-12T02:03:16.809 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDgCa5kNfoWCRAAMjXouPb1lGaTHLFcb4iAPg== 2023-07-12T02:03:16.809 INFO:teuthology.orchestra.run.smithi196.stdout:[client.0] 2023-07-12T02:03:16.809 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDDCa5kRgbdIhAAz7y/7oTRqD+BzAGhG1mhjg== 2023-07-12T02:03:16.809 INFO:teuthology.orchestra.run.smithi196.stdout:[client.2] 2023-07-12T02:03:16.809 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDDCa5kxPp6KhAA0VRGDq8kCvSgiaMkDO/Cpw== 2023-07-12T02:03:16.809 INFO:teuthology.orchestra.run.smithi196.stdout:[client.1] 2023-07-12T02:03:16.809 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDDCa5ksuf4MRAAXxrPxvbo/NPmReHt90AVpg== 2023-07-12T02:03:16.810 INFO:teuthology.orchestra.run.smithi196.stdout:[client.3] 2023-07-12T02:03:16.810 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDDCa5ktwhhORAA7/eBsiiiQXaTfDYM8SYV3g== 2023-07-12T02:03:16.810 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-12T02:03:16.818 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-12T02:03:16.957 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-12T02:03:16.962 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-12T02:03:17.072 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-12T02:03:17.077 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-12T02:03:17.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:03:17.190 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:03:17.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:03:17.301 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:03:17.407 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:03:17.411 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:03:17.518 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:03:17.523 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:03:17.629 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-12T02:03:17.633 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-12T02:03:17.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-12T02:03:17.743 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-12T02:03:17.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-12T02:03:17.856 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-12T02:03:17.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:03:17.971 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:03:18.078 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:03:18.082 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:03:18.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:03:18.193 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:03:18.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:03:18.303 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:03:18.411 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-12T02:03:18.415 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-12T02:03:18.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-12T02:03:18.530 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-12T02:03:18.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-12T02:03:18.646 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-12T02:03:18.757 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-12T02:03:18.761 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-12T02:03:18.871 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-12T02:03:18.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-12T02:03:18.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-12T02:03:19.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-12T02:03:19.134 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-12T02:03:19.203 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-12T02:03:19.327 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-12T02:03:19.395 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-12T02:03:19.462 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-12T02:03:19.582 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-12T02:03:19.649 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:03:19.654 DEBUG:teuthology.orchestra.run.smithi196:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:03:19.698 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-12T02:03:19.698 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-12T02:03:19.699 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-12T02:03:19.703 INFO:tasks.ceph.mon.a:Started 2023-07-12T02:03:19.703 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-12T02:03:19.703 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-12T02:03:19.742 INFO:tasks.ceph.mon.b:Started 2023-07-12T02:03:19.742 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-12T02:03:19.742 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-12T02:03:19.746 INFO:tasks.ceph.mon.c:Started 2023-07-12T02:03:19.746 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-12T02:03:19.747 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-12T02:03:19.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-12T02:03:19.751 INFO:tasks.ceph.mgr.y:Started 2023-07-12T02:03:19.752 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-12T02:03:19.752 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-12T02:03:19.757 INFO:tasks.ceph.mgr.x:Started 2023-07-12T02:03:19.757 INFO:tasks.ceph:Setting crush tunables to default 2023-07-12T02:03:19.757 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2023-07-12T02:03:19.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.953+0000 7faf781ff700 1 Processor -- start 2023-07-12T02:03:19.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.954+0000 7faf781ff700 1 -- start start 2023-07-12T02:03:19.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.955+0000 7faf781ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 0x7faf700cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.955+0000 7faf781ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf700d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.955+0000 7faf781ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf70160a00 con 0x7faf700d25c0 2023-07-12T02:03:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.955+0000 7faf781ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf70160ce0 con 0x7faf700b4d20 2023-07-12T02:03:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.955+0000 7faf781ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf700cd280 con 0x7faf700b8260 2023-07-12T02:03:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.955+0000 7faf7679c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf700d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:19.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.955+0000 7faf7679c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf700d0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35362/0 (socket says 172.21.15.37:35362) 2023-07-12T02:03:19.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.955+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 learned_addr learned my addr 172.21.15.37:0/1666514107 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:19.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.955+0000 7faf7579a700 1 --1- 172.21.15.37:0/1666514107 >> v1:172.21.15.37:6789/0 conn(0x7faf700d25c0 0x7faf700b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51656/0 (socket says 172.21.15.37:51656) 2023-07-12T02:03:19.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.956+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 0x7faf700cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:19.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.956+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf700d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-12T02:03:19.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.956+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf700d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:19.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.956+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf700d0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:19.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.956+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf700d0a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-12T02:03:19.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.956+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 msgr2=0x7faf700cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-12T02:03:19.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.956+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 msgr2=0x7faf700cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:19.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.956+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 0x7faf700cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:19.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:19.956+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 0x7faf700cede0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-12T02:03:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.157+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf700d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.157+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf700d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-12T02:03:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.157+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf700d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.157+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf700d0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.157+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf700d0a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-12T02:03:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.157+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 0x7faf700cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.157+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 msgr2=0x7faf700cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-12T02:03:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.157+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 msgr2=0x7faf700cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.157+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 0x7faf700cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.157+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 0x7faf700cede0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-12T02:03:20.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.558+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf700d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:20.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.558+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf700d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-12T02:03:20.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.558+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf700d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:20.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.558+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf700d0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:20.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.558+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf700d0a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-12T02:03:20.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.558+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 0x7faf700cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:20.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.558+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 msgr2=0x7faf700cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-12T02:03:20.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.558+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 msgr2=0x7faf700cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:20.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.558+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 0x7faf700cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:20.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:20.558+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 0x7faf700cede0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-12T02:03:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:21.359+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf700d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:21.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:21.359+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf700d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-12T02:03:21.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:21.359+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf700d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:21.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:21.359+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf700d0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:21.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:21.360+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf700d0a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-12T02:03:21.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:21.360+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 0x7faf700cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:21.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:21.360+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 msgr2=0x7faf700cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-12T02:03:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:21.360+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 msgr2=0x7faf700cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:21.360+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 0x7faf700cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:21.360+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 0x7faf700cede0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-12T02:03:22.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:22.956+0000 7faf677fe700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 msgr2=0x7faf700cede0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:03:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:22.956+0000 7faf677fe700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf700b8260 0x7faf700cede0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:22.956+0000 7faf677fe700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf700d0a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:03:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:22.956+0000 7faf677fe700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf700d0a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:22.956+0000 7faf677fe700 1 -- 172.21.15.37:0/1666514107 >> v1:172.21.15.37:6789/0 conn(0x7faf700d25c0 legacy=0x7faf700b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:22.956+0000 7faf677fe700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 0x7faf54005be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:22.956+0000 7faf677fe700 1 -- 172.21.15.37:0/1666514107 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf700cd560 con 0x7faf54006210 2023-07-12T02:03:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:22.956+0000 7faf677fe700 1 -- 172.21.15.37:0/1666514107 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf70160ce0 con 0x7faf54003770 2023-07-12T02:03:22.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:22.956+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 0x7faf54005be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:22.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:22.956+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 msgr2=0x7faf54005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-12T02:03:22.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:22.956+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 msgr2=0x7faf54005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:22.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:22.956+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 0x7faf54005be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:22.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:22.956+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 0x7faf54005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-12T02:03:23.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:23.157+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 0x7faf54005be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:23.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:23.157+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 msgr2=0x7faf54005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-12T02:03:23.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:23.157+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 msgr2=0x7faf54005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:23.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:23.157+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 0x7faf54005be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:23.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:23.157+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 0x7faf54005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-12T02:03:23.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:23.558+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 0x7faf54005be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:23.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:23.558+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 msgr2=0x7faf54005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-12T02:03:23.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:23.558+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 msgr2=0x7faf54005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:23.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:23.558+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 0x7faf54005be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:23.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:23.558+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 0x7faf54005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-12T02:03:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:24.360+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 0x7faf54005be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:24.360+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 msgr2=0x7faf54005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-12T02:03:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:24.360+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 msgr2=0x7faf54005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:24.360+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 0x7faf54005be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:24.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:24.360+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 0x7faf54005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-12T02:03:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.956+0000 7faf677fe700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 msgr2=0x7faf54005be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:03:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.956+0000 7faf677fe700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003770 0x7faf54005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.956+0000 7faf677fe700 1 -- 172.21.15.37:0/1666514107 >> v1:172.21.15.196:6789/0 conn(0x7faf54006210 legacy=0x7faf540086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.956+0000 7faf677fe700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf5400a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.956+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 reap_dead start 2023-07-12T02:03:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf677fe700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 0x7faf5400a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf677fe700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 0x7faf540086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf677fe700 1 -- 172.21.15.37:0/1666514107 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf70160ce0 con 0x7faf700b4d20 2023-07-12T02:03:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf677fe700 1 -- 172.21.15.37:0/1666514107 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf700cd280 con 0x7faf54003b90 2023-07-12T02:03:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf677fe700 1 -- 172.21.15.37:0/1666514107 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf54008ea0 con 0x7faf5400aab0 2023-07-12T02:03:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf5400a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf5400a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-12T02:03:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf5400a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf5400a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf5400a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-12T02:03:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf7579a700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 0x7faf5400a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 0x7faf540086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf7579a700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 msgr2=0x7faf5400a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-12T02:03:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf7579a700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 msgr2=0x7faf5400a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 msgr2=0x7faf540086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-12T02:03:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf7579a700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 0x7faf5400a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 msgr2=0x7faf540086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 0x7faf540086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf7579a700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 0x7faf5400a570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-12T02:03:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:25.957+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 0x7faf540086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-12T02:03:26.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.158+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf5400a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:26.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.158+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf5400a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-12T02:03:26.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.158+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf5400a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:26.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.158+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf5400a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:26.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.158+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf5400a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-12T02:03:26.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.158+0000 7faf7579a700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 0x7faf5400a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:26.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.158+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 0x7faf540086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:26.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.158+0000 7faf7579a700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 msgr2=0x7faf5400a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-12T02:03:26.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.158+0000 7faf7579a700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 msgr2=0x7faf5400a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:26.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.158+0000 7faf7579a700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 0x7faf5400a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:26.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.158+0000 7faf7579a700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 0x7faf5400a570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-12T02:03:26.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.158+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 msgr2=0x7faf540086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-12T02:03:26.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.158+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 msgr2=0x7faf540086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:26.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.158+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 0x7faf540086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:26.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.160+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 0x7faf540086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-12T02:03:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.559+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf5400a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.559+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf5400a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-12T02:03:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.559+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf5400a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.559+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf5400a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.559+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf5400a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-12T02:03:26.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.561+0000 7faf7579a700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 0x7faf5400a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:26.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.561+0000 7faf7579a700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 msgr2=0x7faf5400a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-12T02:03:26.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.561+0000 7faf7579a700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 msgr2=0x7faf5400a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:26.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.561+0000 7faf7579a700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 0x7faf5400a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:26.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.561+0000 7faf7579a700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 0x7faf5400a570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-12T02:03:26.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.562+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 0x7faf540086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:26.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.562+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 msgr2=0x7faf540086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-12T02:03:26.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.562+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 msgr2=0x7faf540086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:26.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.562+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 0x7faf540086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:26.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:26.562+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 0x7faf540086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-12T02:03:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:27.361+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf5400a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:27.361+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf5400a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-12T02:03:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:27.361+0000 7faf75f9b700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf5400a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:27.361+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf5400a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:27.361+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf5400a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-12T02:03:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:27.362+0000 7faf7579a700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 0x7faf5400a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:27.362+0000 7faf7579a700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 msgr2=0x7faf5400a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-12T02:03:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:27.362+0000 7faf7579a700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 msgr2=0x7faf5400a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:27.362+0000 7faf7579a700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 0x7faf5400a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:27.363+0000 7faf7579a700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 0x7faf5400a570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-12T02:03:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:27.363+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 0x7faf540086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:27.363+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 msgr2=0x7faf540086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-12T02:03:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:27.363+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 msgr2=0x7faf540086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:03:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:27.363+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 0x7faf540086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:03:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:27.363+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 0x7faf540086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-12T02:03:28.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:28.957+0000 7faf677fe700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 msgr2=0x7faf540086a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:03:28.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:28.957+0000 7faf677fe700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5400aab0 0x7faf540086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:28.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:28.957+0000 7faf677fe700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 msgr2=0x7faf5400a570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:03:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:28.957+0000 7faf677fe700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.196:3300/0 conn(0x7faf54003b90 0x7faf5400a570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:28.957+0000 7faf677fe700 1 -- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 msgr2=0x7faf5400a030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:03:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:28.957+0000 7faf677fe700 1 --2- 172.21.15.37:0/1666514107 >> v2:172.21.15.37:3300/0 conn(0x7faf700b4d20 0x7faf5400a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:28.957+0000 7faf677fe700 1 -- 172.21.15.37:0/1666514107 --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5400af90 con 0x7faf540102b0 2023-07-12T02:03:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:28.957+0000 7faf677fe700 1 -- 172.21.15.37:0/1666514107 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf54014ed0 con 0x7faf540091e0 2023-07-12T02:03:30.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.108+0000 7faf74f99700 1 -- 172.21.15.37:0/1666514107 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279720149 0 0) 0x7faf5400af90 con 0x7faf540102b0 2023-07-12T02:03:30.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.108+0000 7faf74f99700 1 -- 172.21.15.37:0/1666514107 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf5c0035b0 con 0x7faf540102b0 2023-07-12T02:03:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.109+0000 7faf74f99700 1 -- 172.21.15.37:0/1666514107 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1594832993 0 0) 0x7faf5c0035b0 con 0x7faf540102b0 2023-07-12T02:03:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.109+0000 7faf74f99700 1 -- 172.21.15.37:0/1666514107 >> v1:172.21.15.196:6789/0 conn(0x7faf540091e0 legacy=0x7faf54009600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.109+0000 7faf74f99700 1 -- 172.21.15.37:0/1666514107 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf540160b0 con 0x7faf540102b0 2023-07-12T02:03:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.109+0000 7faf74f99700 1 -- 172.21.15.37:0/1666514107 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7faf60007e90 con 0x7faf540102b0 2023-07-12T02:03:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.109+0000 7faf74f99700 1 -- 172.21.15.37:0/1666514107 >> v1:172.21.15.37:6789/0 conn(0x7faf540102b0 legacy=0x7faf54012690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.109+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 reap_dead start 2023-07-12T02:03:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.109+0000 7faf74f99700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5c003aa0 0x7faf5c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.109+0000 7faf74f99700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf5c004850 0x7faf5c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.109+0000 7faf74f99700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf5c009a00 0x7faf5c00bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.109+0000 7faf74f99700 1 -- 172.21.15.37:0/1666514107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c00c370 con 0x7faf5c009a00 2023-07-12T02:03:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.109+0000 7faf74f99700 1 -- 172.21.15.37:0/1666514107 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c00c4e0 con 0x7faf5c004850 2023-07-12T02:03:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.109+0000 7faf74f99700 1 -- 172.21.15.37:0/1666514107 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c00c6a0 con 0x7faf5c003aa0 2023-07-12T02:03:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.110+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5c003aa0 0x7faf5c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.110+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf5c009a00 0x7faf5c00bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.110+0000 7faf7579a700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf5c004850 0x7faf5c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.110+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5c003aa0 msgr2=0x7faf5c003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.110+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5c003aa0 0x7faf5c003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.110+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf5c004850 msgr2=0x7faf5c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.110+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf5c004850 0x7faf5c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:30.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.110+0000 7faf7679c700 1 -- 172.21.15.37:0/1666514107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c0035b0 con 0x7faf5c009a00 2023-07-12T02:03:30.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.110+0000 7faf75f9b700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5c003aa0 0x7faf5c003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:03:30.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.111+0000 7faf7679c700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf5c009a00 0x7faf5c00bde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faf7006ce70 tx=0x7faf5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a79e3d106d02a39 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:30.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.111+0000 7faf74f99700 1 -- 172.21.15.37:0/1666514107 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6801b790 con 0x7faf5c009a00 2023-07-12T02:03:30.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.111+0000 7faf74f99700 1 -- 172.21.15.37:0/1666514107 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6800f040 con 0x7faf5c009a00 2023-07-12T02:03:30.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.111+0000 7faf74f99700 1 -- 172.21.15.37:0/1666514107 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6801bb10 con 0x7faf5c009a00 2023-07-12T02:03:30.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.112+0000 7faf781ff700 1 -- 172.21.15.37:0/1666514107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf5c009a00 msgr2=0x7faf5c00bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:30.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.112+0000 7faf781ff700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf5c009a00 0x7faf5c00bde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faf7006ce70 tx=0x7faf5c005880 comp rx=0 tx=0).stop 2023-07-12T02:03:30.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.112+0000 7faf781ff700 1 -- 172.21.15.37:0/1666514107 shutdown_connections 2023-07-12T02:03:30.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.112+0000 7faf781ff700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf5c009a00 0x7faf5c00bde0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:30.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.112+0000 7faf781ff700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf5c004850 0x7faf5c004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:30.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.112+0000 7faf781ff700 1 --2- 172.21.15.37:0/1666514107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5c003aa0 0x7faf5c003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:30.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.112+0000 7faf781ff700 1 -- 172.21.15.37:0/1666514107 >> 172.21.15.37:0/1666514107 conn(0x7faf700722b0 msgr2=0x7faf700cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:30.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.113+0000 7faf781ff700 1 -- 172.21.15.37:0/1666514107 shutdown_connections 2023-07-12T02:03:30.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.113+0000 7faf781ff700 1 -- 172.21.15.37:0/1666514107 wait complete. 2023-07-12T02:03:30.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.115+0000 7faf781ff700 1 Processor -- start 2023-07-12T02:03:30.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.116+0000 7faf781ff700 1 -- start start 2023-07-12T02:03:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.117+0000 7faf781ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf5c004850 0x7faf70153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.117+0000 7faf781ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5c009a00 0x7faf700cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:30.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.117+0000 7faf781ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700cc1b0 0x7faf700c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:30.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.117+0000 7faf781ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf700cc630 con 0x7faf700cc1b0 2023-07-12T02:03:30.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.117+0000 7faf781ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf700c9810 con 0x7faf5c004850 2023-07-12T02:03:30.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.117+0000 7faf781ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf700c8c90 con 0x7faf5c009a00 2023-07-12T02:03:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.117+0000 7faf75f9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf5c004850 0x7faf70153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.117+0000 7faf7679c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700cc1b0 0x7faf700c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.117+0000 7faf75f9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf5c004850 0x7faf70153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:53016/0 (socket says 172.21.15.37:53016) 2023-07-12T02:03:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.117+0000 7faf75f9b700 1 -- 172.21.15.37:0/3928313907 learned_addr learned my addr 172.21.15.37:0/3928313907 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.117+0000 7faf7579a700 1 --2- 172.21.15.37:0/3928313907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5c009a00 0x7faf700cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.118+0000 7faf75f9b700 1 -- 172.21.15.37:0/3928313907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5c009a00 msgr2=0x7faf700cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.118+0000 7faf75f9b700 1 --2- 172.21.15.37:0/3928313907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5c009a00 0x7faf700cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.118+0000 7faf75f9b700 1 -- 172.21.15.37:0/3928313907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700cc1b0 msgr2=0x7faf700c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.118+0000 7faf75f9b700 1 --2- 172.21.15.37:0/3928313907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700cc1b0 0x7faf700c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.118+0000 7faf75f9b700 1 -- 172.21.15.37:0/3928313907 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf700c8f70 con 0x7faf5c004850 2023-07-12T02:03:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.118+0000 7faf7579a700 1 --2- 172.21.15.37:0/3928313907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5c009a00 0x7faf700cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:03:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.118+0000 7faf7679c700 1 --2- 172.21.15.37:0/3928313907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700cc1b0 0x7faf700c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:03:30.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.118+0000 7faf75f9b700 1 --2- 172.21.15.37:0/3928313907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf5c004850 0x7faf70153fd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faf6c018a70 tx=0x7faf6c018d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:30.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.123+0000 7faf667fc700 1 -- 172.21.15.37:0/3928313907 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c018ea0 con 0x7faf5c004850 2023-07-12T02:03:30.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.123+0000 7faf667fc700 1 -- 172.21.15.37:0/3928313907 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c01e040 con 0x7faf5c004850 2023-07-12T02:03:30.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.123+0000 7faf667fc700 1 -- 172.21.15.37:0/3928313907 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c025460 con 0x7faf5c004850 2023-07-12T02:03:30.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.123+0000 7faf781ff700 1 -- 172.21.15.37:0/3928313907 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf700c9250 con 0x7faf5c004850 2023-07-12T02:03:30.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.123+0000 7faf781ff700 1 -- 172.21.15.37:0/3928313907 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf70154510 con 0x7faf5c004850 2023-07-12T02:03:30.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.123+0000 7faf667fc700 1 -- 172.21.15.37:0/3928313907 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faf6c0258c0 con 0x7faf5c004850 2023-07-12T02:03:30.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.124+0000 7faf781ff700 1 -- 172.21.15.37:0/3928313907 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7004ea60 con 0x7faf5c004850 2023-07-12T02:03:30.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.128+0000 7faf667fc700 1 -- 172.21.15.37:0/3928313907 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7faf6c005d60 con 0x7faf5c004850 2023-07-12T02:03:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.133+0000 7faf667fc700 1 -- 172.21.15.37:0/3928313907 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7faf6c025df0 con 0x7faf5c004850 2023-07-12T02:03:30.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.216+0000 7faf781ff700 1 -- 172.21.15.37:0/3928313907 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7faf700b1810 con 0x7faf5c004850 2023-07-12T02:03:30.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.221+0000 7faf667fc700 1 -- 172.21.15.37:0/3928313907 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7faf6c02e400 con 0x7faf5c004850 2023-07-12T02:03:30.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.222+0000 7faf781ff700 1 -- 172.21.15.37:0/3928313907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf5c004850 msgr2=0x7faf70153fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:30.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.222+0000 7faf781ff700 1 --2- 172.21.15.37:0/3928313907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf5c004850 0x7faf70153fd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faf6c018a70 tx=0x7faf6c018d80 comp rx=0 tx=0).stop 2023-07-12T02:03:30.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.222+0000 7faf781ff700 1 -- 172.21.15.37:0/3928313907 shutdown_connections 2023-07-12T02:03:30.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.222+0000 7faf781ff700 1 --2- 172.21.15.37:0/3928313907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700cc1b0 0x7faf700c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:30.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.222+0000 7faf781ff700 1 --2- 172.21.15.37:0/3928313907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf5c004850 0x7faf70153fd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:30.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.222+0000 7faf781ff700 1 --2- 172.21.15.37:0/3928313907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf5c009a00 0x7faf700cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:30.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.222+0000 7faf781ff700 1 -- 172.21.15.37:0/3928313907 >> 172.21.15.37:0/3928313907 conn(0x7faf5c003aa0 msgr2=0x7faf7015fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:30.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.222+0000 7faf781ff700 1 -- 172.21.15.37:0/3928313907 shutdown_connections 2023-07-12T02:03:30.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:30.222+0000 7faf781ff700 1 -- 172.21.15.37:0/3928313907 wait complete. 2023-07-12T02:03:30.227 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2023-07-12T02:03:30.243 INFO:tasks.ceph:check_enable_crimson: False 2023-07-12T02:03:30.244 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-12T02:03:30.244 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:03:30.244 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-12T02:03:30.284 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:30.281+0000 7f09a6e47200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-12T02:03:30.295 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:30.292+0000 7fa8cbdaa200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-12T02:03:30.314 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:03:30.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-12T02:03:30.423 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:03:30.423 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-12T02:03:30.485 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:30.482+0000 7f09a6e47200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-12T02:03:30.532 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:30.529+0000 7fa8cbdaa200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-12T02:03:30.549 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:03:30.550 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-12T02:03:30.619 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:03:30.619 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-12T02:03:30.686 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:03:30.687 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-12T02:03:30.795 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:03:30.795 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-12T02:03:30.903 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:03:30.904 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-12T02:03:30.912 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:30.909+0000 7f09a6e47200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-12T02:03:30.973 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:30.970+0000 7fa8cbdaa200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-12T02:03:30.980 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 0c40269f-4c97-4c5a-940e-b2df90bf0d06 0 2023-07-12T02:03:31.211 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.208+0000 7f57789ff700 1 Processor -- start 2023-07-12T02:03:31.211 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.208+0000 7f57789ff700 1 -- start start 2023-07-12T02:03:31.212 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.209+0000 7f57789ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57740b8260 0x7f57740cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:31.212 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.209+0000 7f57789ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f57740b4d20 0x7f57740d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:31.213 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.210+0000 7f57789ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5774160a00 con 0x7f57740d25c0 2023-07-12T02:03:31.213 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.210+0000 7f57789ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5774160ce0 con 0x7f57740b4d20 2023-07-12T02:03:31.213 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.210+0000 7f57789ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57740cd280 con 0x7f57740b8260 2023-07-12T02:03:31.214 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.210+0000 7f577259c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57740b8260 0x7f57740cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:31.214 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.210+0000 7f5772d9d700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f57740b4d20 0x7f57740d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:31.214 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.210+0000 7f5772d9d700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f57740b4d20 0x7f57740d0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:59054/0 (socket says 172.21.15.196:59054) 2023-07-12T02:03:31.215 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.210+0000 7f5772d9d700 1 -- 172.21.15.196:0/3926630856 learned_addr learned my addr 172.21.15.196:0/3926630856 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-07-12T02:03:31.215 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.210+0000 7f5772d9d700 1 -- 172.21.15.196:0/3926630856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57740b8260 msgr2=0x7f57740cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:31.215 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.210+0000 7f5772d9d700 1 --2- 172.21.15.196:0/3926630856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57740b8260 0x7f57740cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.215 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.210+0000 7f5772d9d700 1 -- 172.21.15.196:0/3926630856 >> v1:172.21.15.37:6789/0 conn(0x7f57740d25c0 legacy=0x7f57740b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:31.215 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.210+0000 7f5772d9d700 1 -- 172.21.15.196:0/3926630856 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57740cd560 con 0x7f57740b4d20 2023-07-12T02:03:31.215 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.210+0000 7f577159a700 1 -- 172.21.15.196:0/3926630856 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594943694 0 0) 0x7f5774160a00 con 0x7f57740d25c0 2023-07-12T02:03:31.215 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.210+0000 7f577259c700 1 --2- 172.21.15.196:0/3926630856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57740b8260 0x7f57740cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:03:31.216 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.211+0000 7f5772d9d700 1 --2- 172.21.15.196:0/3926630856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57740b4d20 0x7f57740d0a00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f576c009e50 tx=0x7f576c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56a3d0be5f2d3209 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:31.216 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.211+0000 7f577159a700 1 -- 172.21.15.196:0/3926630856 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c00e070 con 0x7f57740b4d20 2023-07-12T02:03:31.216 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.211+0000 7f577159a700 1 -- 172.21.15.196:0/3926630856 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c00b910 con 0x7f57740b4d20 2023-07-12T02:03:31.216 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.211+0000 7f577159a700 1 -- 172.21.15.196:0/3926630856 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c00bcc0 con 0x7f57740b4d20 2023-07-12T02:03:31.216 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.211+0000 7f57789ff700 1 -- 172.21.15.196:0/3926630856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57740b4d20 msgr2=0x7f57740d0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:31.216 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.211+0000 7f57789ff700 1 --2- 172.21.15.196:0/3926630856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57740b4d20 0x7f57740d0a00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f576c009e50 tx=0x7f576c00b330 comp rx=0 tx=0).stop 2023-07-12T02:03:31.217 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.212+0000 7f57789ff700 1 -- 172.21.15.196:0/3926630856 shutdown_connections 2023-07-12T02:03:31.217 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.212+0000 7f57789ff700 1 --2- 172.21.15.196:0/3926630856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57740b4d20 0x7f57740d0a00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.217 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.212+0000 7f57789ff700 1 --2- 172.21.15.196:0/3926630856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57740b8260 0x7f57740cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.217 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.212+0000 7f57789ff700 1 -- 172.21.15.196:0/3926630856 >> 172.21.15.196:0/3926630856 conn(0x7f57740722b0 msgr2=0x7f57740cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:31.218 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.212+0000 7f57789ff700 1 -- 172.21.15.196:0/3926630856 shutdown_connections 2023-07-12T02:03:31.218 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.212+0000 7f57789ff700 1 -- 172.21.15.196:0/3926630856 wait complete. 2023-07-12T02:03:31.218 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.214+0000 7f57789ff700 1 Processor -- start 2023-07-12T02:03:31.218 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.214+0000 7f57789ff700 1 -- start start 2023-07-12T02:03:31.219 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f57789ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57740b8260 0x7f57740cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:31.219 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f57789ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57740d25c0 0x7f57740c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:31.219 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f57789ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f577415ba40 0x7f577415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:31.219 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f57789ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57740c8bc0 con 0x7f57740d25c0 2023-07-12T02:03:31.219 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f57789ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57740c7f40 con 0x7f57740b8260 2023-07-12T02:03:31.220 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f57789ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57740c8220 con 0x7f577415ba40 2023-07-12T02:03:31.220 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f577259c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57740b8260 0x7f57740cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:31.220 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f577259c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57740b8260 0x7f57740cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:59064/0 (socket says 172.21.15.196:59064) 2023-07-12T02:03:31.220 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f577259c700 1 -- 172.21.15.196:0/3912764937 learned_addr learned my addr 172.21.15.196:0/3912764937 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-07-12T02:03:31.220 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f5771d9b700 1 --2- 172.21.15.196:0/3912764937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57740d25c0 0x7f57740c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:31.220 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f5772d9d700 1 --2- 172.21.15.196:0/3912764937 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f577415ba40 0x7f577415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:31.221 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f577259c700 1 -- 172.21.15.196:0/3912764937 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f577415ba40 msgr2=0x7f577415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:31.222 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f577259c700 1 --2- 172.21.15.196:0/3912764937 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f577415ba40 0x7f577415bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.222 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f577259c700 1 -- 172.21.15.196:0/3912764937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57740d25c0 msgr2=0x7f57740c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:31.222 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f577259c700 1 --2- 172.21.15.196:0/3912764937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57740d25c0 0x7f57740c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.222 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f577259c700 1 -- 172.21.15.196:0/3912764937 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57640094a0 con 0x7f57740b8260 2023-07-12T02:03:31.222 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f5771d9b700 1 --2- 172.21.15.196:0/3912764937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57740d25c0 0x7f57740c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:03:31.222 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.216+0000 7f5772d9d700 1 --2- 172.21.15.196:0/3912764937 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f577415ba40 0x7f577415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:03:31.222 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.217+0000 7f577259c700 1 --2- 172.21.15.196:0/3912764937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57740b8260 0x7f57740cc6e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f576400ebe0 tx=0x7f576400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:31.223 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.217+0000 7f5762ffd700 1 -- 172.21.15.196:0/3912764937 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576400c850 con 0x7f57740b8260 2023-07-12T02:03:31.223 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.217+0000 7f5762ffd700 1 -- 172.21.15.196:0/3912764937 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576400c9b0 con 0x7f57740b8260 2023-07-12T02:03:31.223 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.217+0000 7f57789ff700 1 -- 172.21.15.196:0/3912764937 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576c009b30 con 0x7f57740b8260 2023-07-12T02:03:31.223 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.217+0000 7f5762ffd700 1 -- 172.21.15.196:0/3912764937 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576400cd40 con 0x7f57740b8260 2023-07-12T02:03:31.223 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.217+0000 7f57789ff700 1 -- 172.21.15.196:0/3912764937 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57740c87e0 con 0x7f57740b8260 2023-07-12T02:03:31.223 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.217+0000 7f5762ffd700 1 -- 172.21.15.196:0/3912764937 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5764005d20 con 0x7f57740b8260 2023-07-12T02:03:31.223 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.217+0000 7f5762ffd700 1 -- 172.21.15.196:0/3912764937 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f57640137b0 con 0x7f57740b8260 2023-07-12T02:03:31.223 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.218+0000 7f57789ff700 1 -- 172.21.15.196:0/3912764937 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577404ea60 con 0x7f57740b8260 2023-07-12T02:03:31.224 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.221+0000 7f5762ffd700 1 -- 172.21.15.196:0/3912764937 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f5764021060 con 0x7f57740b8260 2023-07-12T02:03:31.310 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.308+0000 7f57789ff700 1 -- 172.21.15.196:0/3912764937 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0c40269f-4c97-4c5a-940e-b2df90bf0d06", "id": 0} v 0) v1 -- 0x7f57740cfed0 con 0x7f57740b8260 2023-07-12T02:03:31.318 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.315+0000 7f5762ffd700 1 -- 172.21.15.196:0/3912764937 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0c40269f-4c97-4c5a-940e-b2df90bf0d06", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5764029020 con 0x7f57740b8260 2023-07-12T02:03:31.318 INFO:teuthology.orchestra.run.smithi196.stdout:0 2023-07-12T02:03:31.320 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.317+0000 7f57789ff700 1 -- 172.21.15.196:0/3912764937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57740b8260 msgr2=0x7f57740cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:31.320 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.317+0000 7f57789ff700 1 --2- 172.21.15.196:0/3912764937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57740b8260 0x7f57740cc6e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f576400ebe0 tx=0x7f576400eef0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.320 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.317+0000 7f57789ff700 1 -- 172.21.15.196:0/3912764937 shutdown_connections 2023-07-12T02:03:31.320 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.317+0000 7f57789ff700 1 --2- 172.21.15.196:0/3912764937 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f577415ba40 0x7f577415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.320 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.317+0000 7f57789ff700 1 --2- 172.21.15.196:0/3912764937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57740b8260 0x7f57740cc6e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.321 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.317+0000 7f57789ff700 1 --2- 172.21.15.196:0/3912764937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57740d25c0 0x7f57740c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.321 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.317+0000 7f57789ff700 1 -- 172.21.15.196:0/3912764937 >> 172.21.15.196:0/3912764937 conn(0x7f57740b4d20 msgr2=0x7f57740b77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:31.321 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.317+0000 7f57789ff700 1 -- 172.21.15.196:0/3912764937 shutdown_connections 2023-07-12T02:03:31.321 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.317+0000 7f57789ff700 1 -- 172.21.15.196:0/3912764937 wait complete. 2023-07-12T02:03:31.336 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new acf2cbe4-9e0f-40ac-80e4-3d8832972dc1 1 2023-07-12T02:03:31.526 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.523+0000 7f0828fff700 1 Processor -- start 2023-07-12T02:03:31.526 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.523+0000 7f0828fff700 1 -- start start 2023-07-12T02:03:31.527 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.524+0000 7f0828fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f08240d25c0 0x7f08240cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:31.528 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.524+0000 7f0828fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0824160a00 con 0x7f08240b4d20 2023-07-12T02:03:31.528 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.524+0000 7f0828fff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0824160ce0 con 0x7f08240b8260 2023-07-12T02:03:31.528 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.524+0000 7f0828fff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08240cd280 con 0x7f08240d25c0 2023-07-12T02:03:31.528 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.525+0000 7f082259c700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f08240b8260 0x7f08240b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:48844/0 (socket says 172.21.15.196:48844) 2023-07-12T02:03:31.528 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.525+0000 7f082259c700 1 -- 172.21.15.196:0/3678646362 learned_addr learned my addr 172.21.15.196:0/3678646362 (peer_addr_for_me v1:172.21.15.196:0/0) 2023-07-12T02:03:31.528 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.525+0000 7f0822d9d700 1 --2- 172.21.15.196:0/3678646362 >> v2:172.21.15.196:3300/0 conn(0x7f08240d25c0 0x7f08240cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:31.530 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.525+0000 7f082159a700 1 -- 172.21.15.196:0/3678646362 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550955581 0 0) 0x7f0824160ce0 con 0x7f08240b8260 2023-07-12T02:03:31.530 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.525+0000 7f082159a700 1 -- 172.21.15.196:0/3678646362 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f080c0035b0 con 0x7f08240b8260 2023-07-12T02:03:31.530 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.525+0000 7f082159a700 1 -- 172.21.15.196:0/3678646362 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180969071 0 0) 0x7f0824160a00 con 0x7f08240b4d20 2023-07-12T02:03:31.530 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.525+0000 7f082159a700 1 -- 172.21.15.196:0/3678646362 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0824160ce0 con 0x7f08240b4d20 2023-07-12T02:03:31.530 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.525+0000 7f0822d9d700 1 -- 172.21.15.196:0/3678646362 >> v1:172.21.15.196:6789/0 conn(0x7f08240b8260 legacy=0x7f08240b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:31.530 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.525+0000 7f0822d9d700 1 -- 172.21.15.196:0/3678646362 >> v1:172.21.15.37:6789/0 conn(0x7f08240b4d20 legacy=0x7f08240d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:31.531 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.525+0000 7f0822d9d700 1 -- 172.21.15.196:0/3678646362 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08240cd560 con 0x7f08240d25c0 2023-07-12T02:03:31.531 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.525+0000 7f0822d9d700 1 --2- 172.21.15.196:0/3678646362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08240d25c0 0x7f08240cede0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f081c009d90 tx=0x7f081c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d9976bdb62103f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:31.531 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.526+0000 7f082159a700 1 -- 172.21.15.196:0/3678646362 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c00e070 con 0x7f08240d25c0 2023-07-12T02:03:31.531 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.526+0000 7f082159a700 1 -- 172.21.15.196:0/3678646362 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c00bb20 con 0x7f08240d25c0 2023-07-12T02:03:31.531 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.526+0000 7f082159a700 1 -- 172.21.15.196:0/3678646362 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c012430 con 0x7f08240d25c0 2023-07-12T02:03:31.531 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.526+0000 7f0828fff700 1 -- 172.21.15.196:0/3678646362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08240d25c0 msgr2=0x7f08240cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:31.531 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.526+0000 7f0828fff700 1 --2- 172.21.15.196:0/3678646362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08240d25c0 0x7f08240cede0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f081c009d90 tx=0x7f081c00b330 comp rx=0 tx=0).stop 2023-07-12T02:03:31.531 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.526+0000 7f0828fff700 1 -- 172.21.15.196:0/3678646362 shutdown_connections 2023-07-12T02:03:31.532 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.526+0000 7f0828fff700 1 --2- 172.21.15.196:0/3678646362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08240d25c0 0x7f08240cede0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.532 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.526+0000 7f0828fff700 1 -- 172.21.15.196:0/3678646362 >> 172.21.15.196:0/3678646362 conn(0x7f08240722b0 msgr2=0x7f08240cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:31.532 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.526+0000 7f0828fff700 1 -- 172.21.15.196:0/3678646362 shutdown_connections 2023-07-12T02:03:31.532 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.526+0000 7f0828fff700 1 -- 172.21.15.196:0/3678646362 wait complete. 2023-07-12T02:03:31.532 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.529+0000 7f0828fff700 1 Processor -- start 2023-07-12T02:03:31.533 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.529+0000 7f0828fff700 1 -- start start 2023-07-12T02:03:31.533 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.530+0000 7f0828fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08240b8260 0x7f0824149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:31.534 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.530+0000 7f0828fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08240d25c0 0x7f08241e7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:31.534 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.530+0000 7f0828fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08241e7f50 0x7f08240c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:31.534 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.530+0000 7f0828fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0824149540 con 0x7f08240b8260 2023-07-12T02:03:31.534 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.530+0000 7f0828fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08241e6970 con 0x7f08240d25c0 2023-07-12T02:03:31.534 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.530+0000 7f0828fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08241e6c50 con 0x7f08241e7f50 2023-07-12T02:03:31.534 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.530+0000 7f0822d9d700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08241e7f50 0x7f08240c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:31.534 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.530+0000 7f0821d9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08240d25c0 0x7f08241e7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:31.535 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.531+0000 7f0822d9d700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08241e7f50 0x7f08240c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:52950/0 (socket says 172.21.15.196:52950) 2023-07-12T02:03:31.535 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.531+0000 7f0822d9d700 1 -- 172.21.15.196:0/1800937754 learned_addr learned my addr 172.21.15.196:0/1800937754 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-07-12T02:03:31.535 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.531+0000 7f082259c700 1 --2- 172.21.15.196:0/1800937754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08240b8260 0x7f0824149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:31.536 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.531+0000 7f0822d9d700 1 -- 172.21.15.196:0/1800937754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08240d25c0 msgr2=0x7f08241e7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:31.536 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.531+0000 7f0822d9d700 1 --2- 172.21.15.196:0/1800937754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08240d25c0 0x7f08241e7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.536 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.531+0000 7f0822d9d700 1 -- 172.21.15.196:0/1800937754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08240b8260 msgr2=0x7f0824149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:31.536 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.531+0000 7f0822d9d700 1 --2- 172.21.15.196:0/1800937754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08240b8260 0x7f0824149000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.537 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.531+0000 7f0822d9d700 1 -- 172.21.15.196:0/1800937754 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081c009a70 con 0x7f08241e7f50 2023-07-12T02:03:31.537 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.531+0000 7f0822d9d700 1 --2- 172.21.15.196:0/1800937754 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08241e7f50 0x7f08240c8790 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f082406aec0 tx=0x7f081c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:31.537 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.531+0000 7f0812ffd700 1 -- 172.21.15.196:0/1800937754 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c012430 con 0x7f08241e7f50 2023-07-12T02:03:31.537 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.532+0000 7f0812ffd700 1 -- 172.21.15.196:0/1800937754 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c020070 con 0x7f08241e7f50 2023-07-12T02:03:31.537 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.532+0000 7f0812ffd700 1 -- 172.21.15.196:0/1800937754 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c01ba50 con 0x7f08241e7f50 2023-07-12T02:03:31.537 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.532+0000 7f0828fff700 1 -- 172.21.15.196:0/1800937754 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08241e6f30 con 0x7f08241e7f50 2023-07-12T02:03:31.537 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.532+0000 7f0828fff700 1 -- 172.21.15.196:0/1800937754 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08241e74f0 con 0x7f08241e7f50 2023-07-12T02:03:31.538 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.532+0000 7f0812ffd700 1 -- 172.21.15.196:0/1800937754 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f081c027480 con 0x7f08241e7f50 2023-07-12T02:03:31.538 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.532+0000 7f0812ffd700 1 -- 172.21.15.196:0/1800937754 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f081c022070 con 0x7f08241e7f50 2023-07-12T02:03:31.538 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.533+0000 7f0828fff700 1 -- 172.21.15.196:0/1800937754 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082404ea60 con 0x7f08241e7f50 2023-07-12T02:03:31.539 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.536+0000 7f0812ffd700 1 -- 172.21.15.196:0/1800937754 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f081c02c060 con 0x7f08241e7f50 2023-07-12T02:03:31.539 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:31.536+0000 7f09a6e47200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-12T02:03:31.589 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:31.586+0000 7fa8cbdaa200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-12T02:03:31.625 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.622+0000 7f0828fff700 1 -- 172.21.15.196:0/1800937754 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "acf2cbe4-9e0f-40ac-80e4-3d8832972dc1", "id": 1} v 0) v1 -- 0x7f08240cfed0 con 0x7f08241e7f50 2023-07-12T02:03:31.633 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.630+0000 7f0812ffd700 1 -- 172.21.15.196:0/1800937754 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "acf2cbe4-9e0f-40ac-80e4-3d8832972dc1", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f081c0279e0 con 0x7f08241e7f50 2023-07-12T02:03:31.633 INFO:teuthology.orchestra.run.smithi196.stdout:1 2023-07-12T02:03:31.634 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.631+0000 7f0828fff700 1 -- 172.21.15.196:0/1800937754 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08241e7f50 msgr2=0x7f08240c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:31.634 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.631+0000 7f0828fff700 1 --2- 172.21.15.196:0/1800937754 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08241e7f50 0x7f08240c8790 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f082406aec0 tx=0x7f081c004ad0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.635 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.631+0000 7f0828fff700 1 -- 172.21.15.196:0/1800937754 shutdown_connections 2023-07-12T02:03:31.635 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.631+0000 7f0828fff700 1 --2- 172.21.15.196:0/1800937754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08240b8260 0x7f0824149000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.635 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.631+0000 7f0828fff700 1 --2- 172.21.15.196:0/1800937754 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08241e7f50 0x7f08240c8790 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.635 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.631+0000 7f0828fff700 1 --2- 172.21.15.196:0/1800937754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08240d25c0 0x7f08241e7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.635 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.631+0000 7f0828fff700 1 -- 172.21.15.196:0/1800937754 >> 172.21.15.196:0/1800937754 conn(0x7f08240b4d20 msgr2=0x7f082406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:31.635 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.631+0000 7f0828fff700 1 -- 172.21.15.196:0/1800937754 shutdown_connections 2023-07-12T02:03:31.635 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.631+0000 7f0828fff700 1 -- 172.21.15.196:0/1800937754 wait complete. 2023-07-12T02:03:31.651 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 070d4293-2e9c-44cf-9ee2-2ec76d12a144 2 2023-07-12T02:03:31.785 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:31.783+0000 7f09a6e47200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-12T02:03:31.832 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:31.829+0000 7fa8cbdaa200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-12T02:03:31.843 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.840+0000 7fbc481ff700 1 Processor -- start 2023-07-12T02:03:31.843 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.840+0000 7fbc481ff700 1 -- start start 2023-07-12T02:03:31.845 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.842+0000 7fbc481ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbc400b8260 0x7fbc400cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:31.845 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.842+0000 7fbc481ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc400b4d20 0x7fbc400d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:31.845 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.842+0000 7fbc481ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc40160a00 con 0x7fbc400d25c0 2023-07-12T02:03:31.845 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.842+0000 7fbc481ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc40160ce0 con 0x7fbc400b8260 2023-07-12T02:03:31.846 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.842+0000 7fbc481ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400cd280 con 0x7fbc400b4d20 2023-07-12T02:03:31.847 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.842+0000 7fbc4679c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc400b4d20 0x7fbc400d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:31.847 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.842+0000 7fbc45f9b700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbc400b8260 0x7fbc400cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:31.847 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.842+0000 7fbc45f9b700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbc400b8260 0x7fbc400cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:59094/0 (socket says 172.21.15.196:59094) 2023-07-12T02:03:31.847 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.842+0000 7fbc4679c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc400b4d20 0x7fbc400d0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:52964/0 (socket says 172.21.15.196:52964) 2023-07-12T02:03:31.847 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.842+0000 7fbc45f9b700 1 -- 172.21.15.196:0/2253221413 learned_addr learned my addr 172.21.15.196:0/2253221413 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-07-12T02:03:31.847 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.842+0000 7fbc4579a700 1 --1- 172.21.15.196:0/2253221413 >> v1:172.21.15.196:6789/0 conn(0x7fbc400d25c0 0x7fbc400b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:48854/0 (socket says 172.21.15.196:48854) 2023-07-12T02:03:31.848 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.843+0000 7fbc45f9b700 1 -- 172.21.15.196:0/2253221413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc400b4d20 msgr2=0x7fbc400d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:31.848 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.843+0000 7fbc45f9b700 1 --2- 172.21.15.196:0/2253221413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc400b4d20 0x7fbc400d0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.848 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.843+0000 7fbc45f9b700 1 -- 172.21.15.196:0/2253221413 >> v1:172.21.15.196:6789/0 conn(0x7fbc400d25c0 legacy=0x7fbc400b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:31.848 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.843+0000 7fbc45f9b700 1 -- 172.21.15.196:0/2253221413 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc400cd560 con 0x7fbc400b8260 2023-07-12T02:03:31.848 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.843+0000 7fbc4679c700 1 --2- 172.21.15.196:0/2253221413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc400b4d20 0x7fbc400d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:03:31.848 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.843+0000 7fbc44f99700 1 -- 172.21.15.196:0/2253221413 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682241652 0 0) 0x7fbc40160a00 con 0x7fbc400d25c0 2023-07-12T02:03:31.848 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.843+0000 7fbc45f9b700 1 --2- 172.21.15.196:0/2253221413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc400b8260 0x7fbc400cede0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0098f0 tx=0x7fbc3c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5dc0c4a8be8645b server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:31.849 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.843+0000 7fbc44f99700 1 -- 172.21.15.196:0/2253221413 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c011830 con 0x7fbc400b8260 2023-07-12T02:03:31.849 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.843+0000 7fbc44f99700 1 -- 172.21.15.196:0/2253221413 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c011990 con 0x7fbc400b8260 2023-07-12T02:03:31.849 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.843+0000 7fbc44f99700 1 -- 172.21.15.196:0/2253221413 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c011d20 con 0x7fbc400b8260 2023-07-12T02:03:31.849 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.844+0000 7fbc481ff700 1 -- 172.21.15.196:0/2253221413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc400b8260 msgr2=0x7fbc400cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:31.850 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.844+0000 7fbc481ff700 1 --2- 172.21.15.196:0/2253221413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc400b8260 0x7fbc400cede0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0098f0 tx=0x7fbc3c009c00 comp rx=0 tx=0).stop 2023-07-12T02:03:31.850 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.844+0000 7fbc481ff700 1 -- 172.21.15.196:0/2253221413 shutdown_connections 2023-07-12T02:03:31.850 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.844+0000 7fbc481ff700 1 --2- 172.21.15.196:0/2253221413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc400b4d20 0x7fbc400d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.850 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.844+0000 7fbc481ff700 1 --2- 172.21.15.196:0/2253221413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc400b8260 0x7fbc400cede0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.850 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.844+0000 7fbc481ff700 1 -- 172.21.15.196:0/2253221413 >> 172.21.15.196:0/2253221413 conn(0x7fbc400722b0 msgr2=0x7fbc400cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:31.850 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.844+0000 7fbc481ff700 1 -- 172.21.15.196:0/2253221413 shutdown_connections 2023-07-12T02:03:31.851 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.844+0000 7fbc481ff700 1 -- 172.21.15.196:0/2253221413 wait complete. 2023-07-12T02:03:31.851 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.847+0000 7fbc481ff700 1 Processor -- start 2023-07-12T02:03:31.851 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.847+0000 7fbc481ff700 1 -- start start 2023-07-12T02:03:31.852 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.849+0000 7fbc481ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc400b8260 0x7fbc401f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:31.852 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.849+0000 7fbc481ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc400d25c0 0x7fbc400c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:31.852 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.849+0000 7fbc481ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc400c9280 0x7fbc400cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:31.853 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.849+0000 7fbc481ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400cbd30 con 0x7fbc400c9280 2023-07-12T02:03:31.853 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.849+0000 7fbc481ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400cb770 con 0x7fbc400d25c0 2023-07-12T02:03:31.853 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.849+0000 7fbc481ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400cba50 con 0x7fbc400b8260 2023-07-12T02:03:31.853 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.849+0000 7fbc4579a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc400d25c0 0x7fbc400c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:31.853 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.849+0000 7fbc45f9b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc400b8260 0x7fbc401f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:31.853 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.849+0000 7fbc4579a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc400d25c0 0x7fbc400c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:59104/0 (socket says 172.21.15.196:59104) 2023-07-12T02:03:31.853 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.849+0000 7fbc4579a700 1 -- 172.21.15.196:0/885908295 learned_addr learned my addr 172.21.15.196:0/885908295 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-07-12T02:03:31.854 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.849+0000 7fbc45f9b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc400b8260 0x7fbc401f2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:52974/0 (socket says 172.21.15.196:52974) 2023-07-12T02:03:31.854 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.849+0000 7fbc4679c700 1 --2- 172.21.15.196:0/885908295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc400c9280 0x7fbc400cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:31.855 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.850+0000 7fbc45f9b700 1 -- 172.21.15.196:0/885908295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc400d25c0 msgr2=0x7fbc400c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:31.855 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.850+0000 7fbc45f9b700 1 --2- 172.21.15.196:0/885908295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc400d25c0 0x7fbc400c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.855 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.850+0000 7fbc45f9b700 1 -- 172.21.15.196:0/885908295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc400c9280 msgr2=0x7fbc400cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:31.855 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.850+0000 7fbc45f9b700 1 --2- 172.21.15.196:0/885908295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc400c9280 0x7fbc400cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.855 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.850+0000 7fbc45f9b700 1 -- 172.21.15.196:0/885908295 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc38009a70 con 0x7fbc400b8260 2023-07-12T02:03:31.856 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.850+0000 7fbc4579a700 1 --2- 172.21.15.196:0/885908295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc400d25c0 0x7fbc400c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:03:31.856 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.850+0000 7fbc45f9b700 1 --2- 172.21.15.196:0/885908295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc400b8260 0x7fbc401f2340 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c016000 tx=0x7fbc3c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:31.856 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.850+0000 7fbc367fc700 1 -- 172.21.15.196:0/885908295 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c004340 con 0x7fbc400b8260 2023-07-12T02:03:31.856 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.850+0000 7fbc367fc700 1 -- 172.21.15.196:0/885908295 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c01f070 con 0x7fbc400b8260 2023-07-12T02:03:31.856 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.850+0000 7fbc481ff700 1 -- 172.21.15.196:0/885908295 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3c009550 con 0x7fbc400b8260 2023-07-12T02:03:31.856 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.850+0000 7fbc367fc700 1 -- 172.21.15.196:0/885908295 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c0036a0 con 0x7fbc400b8260 2023-07-12T02:03:31.856 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.850+0000 7fbc481ff700 1 -- 172.21.15.196:0/885908295 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc400c8820 con 0x7fbc400b8260 2023-07-12T02:03:31.856 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.851+0000 7fbc367fc700 1 -- 172.21.15.196:0/885908295 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbc3c021030 con 0x7fbc400b8260 2023-07-12T02:03:31.857 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.851+0000 7fbc367fc700 1 -- 172.21.15.196:0/885908295 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fbc3c01acd0 con 0x7fbc400b8260 2023-07-12T02:03:31.857 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.851+0000 7fbc481ff700 1 -- 172.21.15.196:0/885908295 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc400cd8d0 con 0x7fbc400b8260 2023-07-12T02:03:31.857 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.854+0000 7fbc367fc700 1 -- 172.21.15.196:0/885908295 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7fbc3c015020 con 0x7fbc400b8260 2023-07-12T02:03:31.944 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.941+0000 7fbc481ff700 1 -- 172.21.15.196:0/885908295 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "070d4293-2e9c-44cf-9ee2-2ec76d12a144", "id": 2} v 0) v1 -- 0x7fbc4004ea60 con 0x7fbc400b8260 2023-07-12T02:03:31.950 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.947+0000 7fbc367fc700 1 -- 172.21.15.196:0/885908295 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "070d4293-2e9c-44cf-9ee2-2ec76d12a144", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbc3c01a450 con 0x7fbc400b8260 2023-07-12T02:03:31.950 INFO:teuthology.orchestra.run.smithi196.stdout:2 2023-07-12T02:03:31.952 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.949+0000 7fbc481ff700 1 -- 172.21.15.196:0/885908295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc400b8260 msgr2=0x7fbc401f2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:31.952 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.949+0000 7fbc481ff700 1 --2- 172.21.15.196:0/885908295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc400b8260 0x7fbc401f2340 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c016000 tx=0x7fbc3c004750 comp rx=0 tx=0).stop 2023-07-12T02:03:31.952 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.949+0000 7fbc481ff700 1 -- 172.21.15.196:0/885908295 shutdown_connections 2023-07-12T02:03:31.953 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.949+0000 7fbc481ff700 1 --2- 172.21.15.196:0/885908295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc400c9280 0x7fbc400cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.953 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.949+0000 7fbc481ff700 1 --2- 172.21.15.196:0/885908295 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc400b8260 0x7fbc401f2340 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.953 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.949+0000 7fbc481ff700 1 --2- 172.21.15.196:0/885908295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc400d25c0 0x7fbc400c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:31.953 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.949+0000 7fbc481ff700 1 -- 172.21.15.196:0/885908295 >> 172.21.15.196:0/885908295 conn(0x7fbc400b4d20 msgr2=0x7fbc4006b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:31.953 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.949+0000 7fbc481ff700 1 -- 172.21.15.196:0/885908295 shutdown_connections 2023-07-12T02:03:31.953 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:31.949+0000 7fbc481ff700 1 -- 172.21.15.196:0/885908295 wait complete. 2023-07-12T02:03:31.976 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 51e0df88-11a0-45f9-a66b-f3327ac7b9ff 3 2023-07-12T02:03:32.167 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.164+0000 7fcb501ff700 1 Processor -- start 2023-07-12T02:03:32.167 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.164+0000 7fcb501ff700 1 -- start start 2023-07-12T02:03:32.168 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.165+0000 7fcb501ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcb480d25c0 0x7fcb480cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:32.169 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.165+0000 7fcb501ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb48160a00 con 0x7fcb480b4d20 2023-07-12T02:03:32.169 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.165+0000 7fcb501ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb48160ce0 con 0x7fcb480b8260 2023-07-12T02:03:32.169 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.165+0000 7fcb501ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb480cd280 con 0x7fcb480d25c0 2023-07-12T02:03:32.169 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.166+0000 7fcb4df9b700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fcb480b8260 0x7fcb480b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:48864/0 (socket says 172.21.15.196:48864) 2023-07-12T02:03:32.169 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.166+0000 7fcb4df9b700 1 -- 172.21.15.196:0/4269171933 learned_addr learned my addr 172.21.15.196:0/4269171933 (peer_addr_for_me v1:172.21.15.196:0/0) 2023-07-12T02:03:32.169 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.166+0000 7fcb4e79c700 1 --2- 172.21.15.196:0/4269171933 >> v2:172.21.15.196:3300/0 conn(0x7fcb480d25c0 0x7fcb480cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:32.171 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.166+0000 7fcb4cf99700 1 -- 172.21.15.196:0/4269171933 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761918603 0 0) 0x7fcb48160ce0 con 0x7fcb480b8260 2023-07-12T02:03:32.171 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.166+0000 7fcb4cf99700 1 -- 172.21.15.196:0/4269171933 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb340035b0 con 0x7fcb480b8260 2023-07-12T02:03:32.171 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.166+0000 7fcb4cf99700 1 -- 172.21.15.196:0/4269171933 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524477572 0 0) 0x7fcb48160a00 con 0x7fcb480b4d20 2023-07-12T02:03:32.171 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.166+0000 7fcb4e79c700 1 -- 172.21.15.196:0/4269171933 >> v1:172.21.15.196:6789/0 conn(0x7fcb480b8260 legacy=0x7fcb480b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:32.171 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.166+0000 7fcb4e79c700 1 -- 172.21.15.196:0/4269171933 >> v1:172.21.15.37:6789/0 conn(0x7fcb480b4d20 legacy=0x7fcb480d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:32.171 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.166+0000 7fcb4e79c700 1 -- 172.21.15.196:0/4269171933 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb480cd560 con 0x7fcb480d25c0 2023-07-12T02:03:32.171 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.166+0000 7fcb4e79c700 1 --2- 172.21.15.196:0/4269171933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb480d25c0 0x7fcb480cede0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009d90 tx=0x7fcb4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe469bd2a229daf4 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:32.172 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.167+0000 7fcb4cf99700 1 -- 172.21.15.196:0/4269171933 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4000e070 con 0x7fcb480d25c0 2023-07-12T02:03:32.172 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.167+0000 7fcb4cf99700 1 -- 172.21.15.196:0/4269171933 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4000bb20 con 0x7fcb480d25c0 2023-07-12T02:03:32.172 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.167+0000 7fcb4cf99700 1 -- 172.21.15.196:0/4269171933 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4000bed0 con 0x7fcb480d25c0 2023-07-12T02:03:32.172 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.167+0000 7fcb501ff700 1 -- 172.21.15.196:0/4269171933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb480d25c0 msgr2=0x7fcb480cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:32.172 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.167+0000 7fcb501ff700 1 --2- 172.21.15.196:0/4269171933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb480d25c0 0x7fcb480cede0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009d90 tx=0x7fcb4000b330 comp rx=0 tx=0).stop 2023-07-12T02:03:32.172 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.167+0000 7fcb501ff700 1 -- 172.21.15.196:0/4269171933 shutdown_connections 2023-07-12T02:03:32.172 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.167+0000 7fcb501ff700 1 --2- 172.21.15.196:0/4269171933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb480d25c0 0x7fcb480cede0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.173 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.167+0000 7fcb501ff700 1 -- 172.21.15.196:0/4269171933 >> 172.21.15.196:0/4269171933 conn(0x7fcb480722b0 msgr2=0x7fcb480cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:32.173 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.167+0000 7fcb501ff700 1 -- 172.21.15.196:0/4269171933 shutdown_connections 2023-07-12T02:03:32.173 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.168+0000 7fcb501ff700 1 -- 172.21.15.196:0/4269171933 wait complete. 2023-07-12T02:03:32.173 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.170+0000 7fcb501ff700 1 Processor -- start 2023-07-12T02:03:32.173 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.170+0000 7fcb501ff700 1 -- start start 2023-07-12T02:03:32.174 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.171+0000 7fcb501ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb480b8260 0x7fcb480c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:32.175 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.171+0000 7fcb501ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb480d25c0 0x7fcb481533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:32.175 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.172+0000 7fcb501ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb48153ca0 0x7fcb480b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:32.175 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.172+0000 7fcb501ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480c9c60 con 0x7fcb48153ca0 2023-07-12T02:03:32.175 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.172+0000 7fcb501ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb481e60b0 con 0x7fcb480b8260 2023-07-12T02:03:32.175 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.172+0000 7fcb501ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480c9510 con 0x7fcb480d25c0 2023-07-12T02:03:32.176 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.172+0000 7fcb4df9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb480b8260 0x7fcb480c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:32.177 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.172+0000 7fcb4d79a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb480d25c0 0x7fcb481533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:32.177 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.172+0000 7fcb4df9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb480b8260 0x7fcb480c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:59128/0 (socket says 172.21.15.196:59128) 2023-07-12T02:03:32.177 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.172+0000 7fcb4df9b700 1 -- 172.21.15.196:0/4118952069 learned_addr learned my addr 172.21.15.196:0/4118952069 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-07-12T02:03:32.177 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.172+0000 7fcb4e79c700 1 --2- 172.21.15.196:0/4118952069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb48153ca0 0x7fcb480b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:32.177 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.172+0000 7fcb4d79a700 1 -- 172.21.15.196:0/4118952069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb480b8260 msgr2=0x7fcb480c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:32.177 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.172+0000 7fcb4d79a700 1 --2- 172.21.15.196:0/4118952069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb480b8260 0x7fcb480c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.177 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.172+0000 7fcb4d79a700 1 -- 172.21.15.196:0/4118952069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb48153ca0 msgr2=0x7fcb480b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:32.177 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.172+0000 7fcb4d79a700 1 --2- 172.21.15.196:0/4118952069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb48153ca0 0x7fcb480b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.178 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.172+0000 7fcb4d79a700 1 -- 172.21.15.196:0/4118952069 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40009a70 con 0x7fcb480d25c0 2023-07-12T02:03:32.178 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.172+0000 7fcb4df9b700 1 --2- 172.21.15.196:0/4118952069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb480b8260 0x7fcb480c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:03:32.178 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.173+0000 7fcb4d79a700 1 --2- 172.21.15.196:0/4118952069 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb480d25c0 0x7fcb481533c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcb480b19c0 tx=0x7fcb3800c6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:32.178 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.173+0000 7fcb3e7fc700 1 -- 172.21.15.196:0/4118952069 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb380052d0 con 0x7fcb480d25c0 2023-07-12T02:03:32.178 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.173+0000 7fcb3e7fc700 1 -- 172.21.15.196:0/4118952069 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb38005430 con 0x7fcb480d25c0 2023-07-12T02:03:32.178 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.173+0000 7fcb3e7fc700 1 -- 172.21.15.196:0/4118952069 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb380038a0 con 0x7fcb480d25c0 2023-07-12T02:03:32.178 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.173+0000 7fcb501ff700 1 -- 172.21.15.196:0/4118952069 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb480c8cd0 con 0x7fcb480d25c0 2023-07-12T02:03:32.179 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.173+0000 7fcb501ff700 1 -- 172.21.15.196:0/4118952069 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb480c9230 con 0x7fcb480d25c0 2023-07-12T02:03:32.179 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.173+0000 7fcb3e7fc700 1 -- 172.21.15.196:0/4118952069 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcb38003d00 con 0x7fcb480d25c0 2023-07-12T02:03:32.179 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.173+0000 7fcb3e7fc700 1 -- 172.21.15.196:0/4118952069 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fcb3801c8d0 con 0x7fcb480d25c0 2023-07-12T02:03:32.179 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.174+0000 7fcb501ff700 1 -- 172.21.15.196:0/4118952069 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4804ea60 con 0x7fcb480d25c0 2023-07-12T02:03:32.181 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.178+0000 7fcb3e7fc700 1 -- 172.21.15.196:0/4118952069 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7fcb38017070 con 0x7fcb480d25c0 2023-07-12T02:03:32.267 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.264+0000 7fcb501ff700 1 -- 172.21.15.196:0/4118952069 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "51e0df88-11a0-45f9-a66b-f3327ac7b9ff", "id": 3} v 0) v1 -- 0x7fcb481e61f0 con 0x7fcb480d25c0 2023-07-12T02:03:32.275 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:32.272+0000 7f09a6e47200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-12T02:03:32.275 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.272+0000 7fcb3e7fc700 1 -- 172.21.15.196:0/4118952069 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "51e0df88-11a0-45f9-a66b-f3327ac7b9ff", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcb3801c570 con 0x7fcb480d25c0 2023-07-12T02:03:32.276 INFO:teuthology.orchestra.run.smithi196.stdout:3 2023-07-12T02:03:32.277 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.274+0000 7fcb501ff700 1 -- 172.21.15.196:0/4118952069 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb480d25c0 msgr2=0x7fcb481533c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:32.277 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.274+0000 7fcb501ff700 1 --2- 172.21.15.196:0/4118952069 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb480d25c0 0x7fcb481533c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcb480b19c0 tx=0x7fcb3800c6c0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.277 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.274+0000 7fcb501ff700 1 -- 172.21.15.196:0/4118952069 shutdown_connections 2023-07-12T02:03:32.277 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.274+0000 7fcb501ff700 1 --2- 172.21.15.196:0/4118952069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb48153ca0 0x7fcb480b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.277 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.274+0000 7fcb501ff700 1 --2- 172.21.15.196:0/4118952069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb480b8260 0x7fcb480c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.277 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.274+0000 7fcb501ff700 1 --2- 172.21.15.196:0/4118952069 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb480d25c0 0x7fcb481533c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.278 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.274+0000 7fcb501ff700 1 -- 172.21.15.196:0/4118952069 >> 172.21.15.196:0/4118952069 conn(0x7fcb480b4d20 msgr2=0x7fcb4806b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:32.278 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.274+0000 7fcb501ff700 1 -- 172.21.15.196:0/4118952069 shutdown_connections 2023-07-12T02:03:32.278 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.274+0000 7fcb501ff700 1 -- 172.21.15.196:0/4118952069 wait complete. 2023-07-12T02:03:32.291 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:32.288+0000 7fa8cbdaa200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-12T02:03:32.293 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new f893e297-ed8f-41a2-b59f-3cfecfb42511 4 2023-07-12T02:03:32.484 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.481+0000 7f8e7c7ff700 1 Processor -- start 2023-07-12T02:03:32.484 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.481+0000 7f8e7c7ff700 1 -- start start 2023-07-12T02:03:32.487 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.483+0000 7f8e7c7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e740b8260 0x7f8e740cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:32.487 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.483+0000 7f8e7c7ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8e740d25c0 0x7f8e740b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:32.487 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.483+0000 7f8e7c7ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8e740b4b50 0x7f8e7406b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:32.487 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.483+0000 7f8e7c7ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e740b4fd0 con 0x7f8e740d25c0 2023-07-12T02:03:32.487 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.483+0000 7f8e7c7ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e74160a00 con 0x7f8e740b4b50 2023-07-12T02:03:32.487 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.483+0000 7f8e7c7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e74160ce0 con 0x7f8e740b8260 2023-07-12T02:03:32.487 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.484+0000 7f8e7a59b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e740b8260 0x7f8e740cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:32.488 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.484+0000 7f8e7ad9c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8e740b4b50 0x7f8e7406b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:32.488 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.484+0000 7f8e7a59b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e740b8260 0x7f8e740cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:52994/0 (socket says 172.21.15.196:52994) 2023-07-12T02:03:32.488 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.484+0000 7f8e7ad9c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8e740b4b50 0x7f8e7406b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:59144/0 (socket says 172.21.15.196:59144) 2023-07-12T02:03:32.488 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.484+0000 7f8e7a59b700 1 -- 172.21.15.196:0/1950459392 learned_addr learned my addr 172.21.15.196:0/1950459392 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-07-12T02:03:32.488 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.484+0000 7f8e79d9a700 1 --2- 172.21.15.196:0/1950459392 >> v2:172.21.15.37:3300/0 conn(0x7f8e740d25c0 0x7f8e740b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:32.489 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.484+0000 7f8e7a59b700 1 -- 172.21.15.196:0/1950459392 >> v2:172.21.15.196:3300/0 conn(0x7f8e740b4b50 msgr2=0x7f8e7406b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:32.489 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.484+0000 7f8e7a59b700 1 --2- 172.21.15.196:0/1950459392 >> v2:172.21.15.196:3300/0 conn(0x7f8e740b4b50 0x7f8e7406b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.490 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.484+0000 7f8e7a59b700 1 -- 172.21.15.196:0/1950459392 >> v2:172.21.15.37:3300/0 conn(0x7f8e740d25c0 msgr2=0x7f8e740b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:32.490 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.484+0000 7f8e7a59b700 1 --2- 172.21.15.196:0/1950459392 >> v2:172.21.15.37:3300/0 conn(0x7f8e740d25c0 0x7f8e740b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.490 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.484+0000 7f8e7a59b700 1 -- 172.21.15.196:0/1950459392 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e740cd280 con 0x7f8e740b8260 2023-07-12T02:03:32.490 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.484+0000 7f8e7a59b700 1 --2- 172.21.15.196:0/1950459392 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e740b8260 0x7f8e740cede0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8e740cf5c0 tx=0x7f8e70009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23c98fc57cd64799 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:32.490 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.485+0000 7f8e79599700 1 -- 172.21.15.196:0/1950459392 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70011830 con 0x7f8e740b8260 2023-07-12T02:03:32.490 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.485+0000 7f8e79599700 1 -- 172.21.15.196:0/1950459392 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e70011990 con 0x7f8e740b8260 2023-07-12T02:03:32.490 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.485+0000 7f8e79599700 1 -- 172.21.15.196:0/1950459392 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70011d20 con 0x7f8e740b8260 2023-07-12T02:03:32.491 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.485+0000 7f8e7c7ff700 1 -- 172.21.15.196:0/1950459392 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e740b8260 msgr2=0x7f8e740cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:32.491 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.485+0000 7f8e7c7ff700 1 --2- 172.21.15.196:0/1950459392 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e740b8260 0x7f8e740cede0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8e740cf5c0 tx=0x7f8e70009bd0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.491 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.486+0000 7f8e7c7ff700 1 -- 172.21.15.196:0/1950459392 shutdown_connections 2023-07-12T02:03:32.491 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.486+0000 7f8e7c7ff700 1 --2- 172.21.15.196:0/1950459392 >> v2:172.21.15.196:3300/0 conn(0x7f8e740b4b50 0x7f8e7406b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.491 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.486+0000 7f8e7c7ff700 1 --2- 172.21.15.196:0/1950459392 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e740b8260 0x7f8e740cede0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.491 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.486+0000 7f8e7c7ff700 1 --2- 172.21.15.196:0/1950459392 >> v2:172.21.15.37:3300/0 conn(0x7f8e740d25c0 0x7f8e740b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.491 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.486+0000 7f8e7c7ff700 1 -- 172.21.15.196:0/1950459392 >> 172.21.15.196:0/1950459392 conn(0x7f8e740722b0 msgr2=0x7f8e740cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:32.492 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.486+0000 7f8e7c7ff700 1 -- 172.21.15.196:0/1950459392 shutdown_connections 2023-07-12T02:03:32.492 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.486+0000 7f8e7c7ff700 1 -- 172.21.15.196:0/1950459392 wait complete. 2023-07-12T02:03:32.493 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.487+0000 7f8e7c7ff700 1 Processor -- start 2023-07-12T02:03:32.494 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.488+0000 7f8e7c7ff700 1 -- start start 2023-07-12T02:03:32.494 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.488+0000 7f8e7c7ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e740b8260 0x7f8e741559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:32.494 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.489+0000 7f8e7c7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e740d25c0 0x7f8e7415ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:32.494 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.489+0000 7f8e7c7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e740b7210 0x7f8e740b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:32.494 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.489+0000 7f8e7c7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e740b7bf0 con 0x7f8e740d25c0 2023-07-12T02:03:32.494 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.489+0000 7f8e7c7ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e741f6180 con 0x7f8e740b8260 2023-07-12T02:03:32.494 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.489+0000 7f8e7c7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e741f1b20 con 0x7f8e740b7210 2023-07-12T02:03:32.494 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.489+0000 7f8e7a59b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e740b8260 0x7f8e741559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:32.495 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.489+0000 7f8e7a59b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e740b8260 0x7f8e741559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:59148/0 (socket says 172.21.15.196:59148) 2023-07-12T02:03:32.495 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.489+0000 7f8e7a59b700 1 -- 172.21.15.196:0/1641612517 learned_addr learned my addr 172.21.15.196:0/1641612517 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-07-12T02:03:32.495 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.489+0000 7f8e7ad9c700 1 --2- 172.21.15.196:0/1641612517 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e740b7210 0x7f8e740b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:32.495 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.489+0000 7f8e79d9a700 1 --2- 172.21.15.196:0/1641612517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e740d25c0 0x7f8e7415ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:32.495 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.489+0000 7f8e7a59b700 1 -- 172.21.15.196:0/1641612517 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e740b7210 msgr2=0x7f8e740b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:32.495 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.489+0000 7f8e7a59b700 1 --2- 172.21.15.196:0/1641612517 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e740b7210 0x7f8e740b76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.495 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.489+0000 7f8e7a59b700 1 -- 172.21.15.196:0/1641612517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e740d25c0 msgr2=0x7f8e7415ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:32.495 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.489+0000 7f8e7a59b700 1 --2- 172.21.15.196:0/1641612517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e740d25c0 0x7f8e7415ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.496 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.489+0000 7f8e7a59b700 1 -- 172.21.15.196:0/1641612517 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e70009550 con 0x7f8e740b8260 2023-07-12T02:03:32.496 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.489+0000 7f8e7a59b700 1 --2- 172.21.15.196:0/1641612517 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e740b8260 0x7f8e741559e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009c10 tx=0x7f8e70004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:32.496 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.490+0000 7f8e6affd700 1 -- 172.21.15.196:0/1641612517 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70004240 con 0x7f8e740b8260 2023-07-12T02:03:32.496 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.490+0000 7f8e6affd700 1 -- 172.21.15.196:0/1641612517 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7001f070 con 0x7f8e740b8260 2023-07-12T02:03:32.496 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.490+0000 7f8e7c7ff700 1 -- 172.21.15.196:0/1641612517 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e740c9d90 con 0x7f8e740b8260 2023-07-12T02:03:32.496 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.490+0000 7f8e6affd700 1 -- 172.21.15.196:0/1641612517 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e700036a0 con 0x7f8e740b8260 2023-07-12T02:03:32.496 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.490+0000 7f8e7c7ff700 1 -- 172.21.15.196:0/1641612517 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e74155f20 con 0x7f8e740b8260 2023-07-12T02:03:32.497 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.490+0000 7f8e6affd700 1 -- 172.21.15.196:0/1641612517 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8e70021030 con 0x7f8e740b8260 2023-07-12T02:03:32.497 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.490+0000 7f8e6affd700 1 -- 172.21.15.196:0/1641612517 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f8e7001ab90 con 0x7f8e740b8260 2023-07-12T02:03:32.497 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.491+0000 7f8e7c7ff700 1 -- 172.21.15.196:0/1641612517 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7404ea60 con 0x7f8e740b8260 2023-07-12T02:03:32.497 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.494+0000 7f8e6affd700 1 -- 172.21.15.196:0/1641612517 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f8e70044b80 con 0x7f8e740b8260 2023-07-12T02:03:32.598 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.596+0000 7f8e7c7ff700 1 -- 172.21.15.196:0/1641612517 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f893e297-ed8f-41a2-b59f-3cfecfb42511", "id": 4} v 0) v1 -- 0x7f8e740b8630 con 0x7f8e740b8260 2023-07-12T02:03:32.603 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.600+0000 7f8e6affd700 1 -- 172.21.15.196:0/1641612517 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f893e297-ed8f-41a2-b59f-3cfecfb42511", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e70033070 con 0x7f8e740b8260 2023-07-12T02:03:32.603 INFO:teuthology.orchestra.run.smithi196.stdout:4 2023-07-12T02:03:32.604 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.601+0000 7f8e7c7ff700 1 -- 172.21.15.196:0/1641612517 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e740b8260 msgr2=0x7f8e741559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:32.605 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.601+0000 7f8e7c7ff700 1 --2- 172.21.15.196:0/1641612517 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e740b8260 0x7f8e741559e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009c10 tx=0x7f8e70004750 comp rx=0 tx=0).stop 2023-07-12T02:03:32.605 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.602+0000 7f8e7c7ff700 1 -- 172.21.15.196:0/1641612517 shutdown_connections 2023-07-12T02:03:32.605 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.602+0000 7f8e7c7ff700 1 --2- 172.21.15.196:0/1641612517 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e740b7210 0x7f8e740b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.605 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.602+0000 7f8e7c7ff700 1 --2- 172.21.15.196:0/1641612517 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e740b8260 0x7f8e741559e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.605 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.602+0000 7f8e7c7ff700 1 --2- 172.21.15.196:0/1641612517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e740d25c0 0x7f8e7415ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.605 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.602+0000 7f8e7c7ff700 1 -- 172.21.15.196:0/1641612517 >> 172.21.15.196:0/1641612517 conn(0x7f8e740b4b50 msgr2=0x7f8e7406b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:32.605 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.602+0000 7f8e7c7ff700 1 -- 172.21.15.196:0/1641612517 shutdown_connections 2023-07-12T02:03:32.606 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.602+0000 7f8e7c7ff700 1 -- 172.21.15.196:0/1641612517 wait complete. 2023-07-12T02:03:32.621 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 625fb321-fc02-4779-8edb-c1864a477bbb 5 2023-07-12T02:03:32.811 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.808+0000 7fc8487ff700 1 Processor -- start 2023-07-12T02:03:32.811 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.808+0000 7fc8487ff700 1 -- start start 2023-07-12T02:03:32.813 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.810+0000 7fc8487ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8400b4d20 0x7fc8400cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:32.813 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.810+0000 7fc8487ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc840160a00 con 0x7fc8400b8260 2023-07-12T02:03:32.813 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.810+0000 7fc8487ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc840160ce0 con 0x7fc8400d25c0 2023-07-12T02:03:32.814 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.810+0000 7fc8487ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400cd280 con 0x7fc8400b4d20 2023-07-12T02:03:32.814 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.811+0000 7fc845d9a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8400b4d20 0x7fc8400cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:32.815 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.811+0000 7fc846d9c700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fc8400d25c0 0x7fc8400d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:48866/0 (socket says 172.21.15.196:48866) 2023-07-12T02:03:32.815 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.811+0000 7fc846d9c700 1 -- 172.21.15.196:0/2517081436 learned_addr learned my addr 172.21.15.196:0/2517081436 (peer_addr_for_me v1:172.21.15.196:0/0) 2023-07-12T02:03:32.815 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.811+0000 7fc84659b700 1 --1- 172.21.15.196:0/2517081436 >> v1:172.21.15.37:6789/0 conn(0x7fc8400b8260 0x7fc8400b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.196:48950/0 (socket says 172.21.15.196:48950) 2023-07-12T02:03:32.815 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.811+0000 7fc845d9a700 1 -- 172.21.15.196:0/2517081436 >> v1:172.21.15.196:6789/0 conn(0x7fc8400d25c0 legacy=0x7fc8400d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:32.815 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.811+0000 7fc845599700 1 -- 172.21.15.196:0/2517081436 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268666568 0 0) 0x7fc840160a00 con 0x7fc8400b8260 2023-07-12T02:03:32.815 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.811+0000 7fc845d9a700 1 -- 172.21.15.196:0/2517081436 >> v1:172.21.15.37:6789/0 conn(0x7fc8400b8260 legacy=0x7fc8400b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:32.816 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.811+0000 7fc845d9a700 1 -- 172.21.15.196:0/2517081436 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8400cd560 con 0x7fc8400b4d20 2023-07-12T02:03:32.816 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.811+0000 7fc845d9a700 1 --2- 172.21.15.196:0/2517081436 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8400b4d20 0x7fc8400cede0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc8300097f0 tx=0x7fc830009b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c97414a0a25617 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:32.816 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.812+0000 7fc845599700 1 -- 172.21.15.196:0/2517081436 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830004230 con 0x7fc8400b4d20 2023-07-12T02:03:32.816 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.812+0000 7fc845599700 1 -- 172.21.15.196:0/2517081436 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830004390 con 0x7fc8400b4d20 2023-07-12T02:03:32.816 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.812+0000 7fc845599700 1 -- 172.21.15.196:0/2517081436 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8300036a0 con 0x7fc8400b4d20 2023-07-12T02:03:32.817 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.812+0000 7fc8487ff700 1 -- 172.21.15.196:0/2517081436 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8400b4d20 msgr2=0x7fc8400cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:32.817 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.812+0000 7fc8487ff700 1 --2- 172.21.15.196:0/2517081436 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8400b4d20 0x7fc8400cede0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc8300097f0 tx=0x7fc830009b00 comp rx=0 tx=0).stop 2023-07-12T02:03:32.817 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.812+0000 7fc8487ff700 1 -- 172.21.15.196:0/2517081436 shutdown_connections 2023-07-12T02:03:32.817 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.812+0000 7fc8487ff700 1 --2- 172.21.15.196:0/2517081436 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8400b4d20 0x7fc8400cede0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.817 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.813+0000 7fc8487ff700 1 -- 172.21.15.196:0/2517081436 >> 172.21.15.196:0/2517081436 conn(0x7fc8400722b0 msgr2=0x7fc8400cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:32.817 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.813+0000 7fc8487ff700 1 -- 172.21.15.196:0/2517081436 shutdown_connections 2023-07-12T02:03:32.818 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.813+0000 7fc8487ff700 1 -- 172.21.15.196:0/2517081436 wait complete. 2023-07-12T02:03:32.819 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.814+0000 7fc8487ff700 1 Processor -- start 2023-07-12T02:03:32.819 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.814+0000 7fc8487ff700 1 -- start start 2023-07-12T02:03:32.819 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.815+0000 7fc8487ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8400b8260 0x7fc84015e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:32.819 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.815+0000 7fc8487ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8400d25c0 0x7fc8401e7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:32.819 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.815+0000 7fc8487ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8401e5c10 0x7fc8401e6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:32.820 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.815+0000 7fc8487ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8401e76a0 con 0x7fc8401e5c10 2023-07-12T02:03:32.820 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.815+0000 7fc8487ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84015f990 con 0x7fc8400b8260 2023-07-12T02:03:32.820 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.815+0000 7fc8487ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84014b860 con 0x7fc8400d25c0 2023-07-12T02:03:32.820 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.816+0000 7fc84659b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8400b8260 0x7fc84015e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:32.820 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.816+0000 7fc845d9a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8400d25c0 0x7fc8401e7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:32.820 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.816+0000 7fc84659b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8400b8260 0x7fc84015e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:59152/0 (socket says 172.21.15.196:59152) 2023-07-12T02:03:32.820 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.816+0000 7fc84659b700 1 -- 172.21.15.196:0/1898082814 learned_addr learned my addr 172.21.15.196:0/1898082814 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-07-12T02:03:32.821 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.816+0000 7fc846d9c700 1 --2- 172.21.15.196:0/1898082814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8401e5c10 0x7fc8401e6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:32.821 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.816+0000 7fc845d9a700 1 -- 172.21.15.196:0/1898082814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8400b8260 msgr2=0x7fc84015e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:32.821 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.816+0000 7fc845d9a700 1 --2- 172.21.15.196:0/1898082814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8400b8260 0x7fc84015e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.821 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.816+0000 7fc845d9a700 1 -- 172.21.15.196:0/1898082814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8401e5c10 msgr2=0x7fc8401e6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:32.821 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.816+0000 7fc845d9a700 1 --2- 172.21.15.196:0/1898082814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8401e5c10 0x7fc8401e6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.821 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.816+0000 7fc845d9a700 1 -- 172.21.15.196:0/1898082814 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300094a0 con 0x7fc8400d25c0 2023-07-12T02:03:32.821 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.816+0000 7fc846d9c700 1 --2- 172.21.15.196:0/1898082814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8401e5c10 0x7fc8401e6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:03:32.822 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.816+0000 7fc845d9a700 1 --2- 172.21.15.196:0/1898082814 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8400d25c0 0x7fc8401e7160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc830015000 tx=0x7fc830004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:32.822 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.816+0000 7fc836ffd700 1 -- 172.21.15.196:0/1898082814 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830011630 con 0x7fc8400d25c0 2023-07-12T02:03:32.823 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.817+0000 7fc836ffd700 1 -- 172.21.15.196:0/1898082814 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830011790 con 0x7fc8400d25c0 2023-07-12T02:03:32.823 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.817+0000 7fc8487ff700 1 -- 172.21.15.196:0/1898082814 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8400ccd80 con 0x7fc8400d25c0 2023-07-12T02:03:32.823 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.817+0000 7fc836ffd700 1 -- 172.21.15.196:0/1898082814 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830011b00 con 0x7fc8400d25c0 2023-07-12T02:03:32.823 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.817+0000 7fc8487ff700 1 -- 172.21.15.196:0/1898082814 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84015f060 con 0x7fc8400d25c0 2023-07-12T02:03:32.823 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.817+0000 7fc836ffd700 1 -- 172.21.15.196:0/1898082814 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc830021020 con 0x7fc8400d25c0 2023-07-12T02:03:32.823 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.817+0000 7fc836ffd700 1 -- 172.21.15.196:0/1898082814 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fc83001b440 con 0x7fc8400d25c0 2023-07-12T02:03:32.823 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.818+0000 7fc8487ff700 1 -- 172.21.15.196:0/1898082814 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84004ea60 con 0x7fc8400d25c0 2023-07-12T02:03:32.825 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.822+0000 7fc836ffd700 1 -- 172.21.15.196:0/1898082814 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7fc830029060 con 0x7fc8400d25c0 2023-07-12T02:03:32.909 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.906+0000 7fc8487ff700 1 -- 172.21.15.196:0/1898082814 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "625fb321-fc02-4779-8edb-c1864a477bbb", "id": 5} v 0) v1 -- 0x7fc84015fad0 con 0x7fc8400d25c0 2023-07-12T02:03:32.916 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.911+0000 7fc836ffd700 1 -- 172.21.15.196:0/1898082814 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "625fb321-fc02-4779-8edb-c1864a477bbb", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc83001a530 con 0x7fc8400d25c0 2023-07-12T02:03:32.916 INFO:teuthology.orchestra.run.smithi196.stdout:5 2023-07-12T02:03:32.917 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.912+0000 7fc8487ff700 1 -- 172.21.15.196:0/1898082814 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8400d25c0 msgr2=0x7fc8401e7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:32.917 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.912+0000 7fc8487ff700 1 --2- 172.21.15.196:0/1898082814 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8400d25c0 0x7fc8401e7160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc830015000 tx=0x7fc830004750 comp rx=0 tx=0).stop 2023-07-12T02:03:32.917 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.912+0000 7fc8487ff700 1 -- 172.21.15.196:0/1898082814 shutdown_connections 2023-07-12T02:03:32.918 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.912+0000 7fc8487ff700 1 --2- 172.21.15.196:0/1898082814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8401e5c10 0x7fc8401e6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.918 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.912+0000 7fc8487ff700 1 --2- 172.21.15.196:0/1898082814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8400b8260 0x7fc84015e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.918 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.912+0000 7fc8487ff700 1 --2- 172.21.15.196:0/1898082814 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8400d25c0 0x7fc8401e7160 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:32.918 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.912+0000 7fc8487ff700 1 -- 172.21.15.196:0/1898082814 >> 172.21.15.196:0/1898082814 conn(0x7fc8400b4d20 msgr2=0x7fc8400b7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:32.918 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.913+0000 7fc8487ff700 1 -- 172.21.15.196:0/1898082814 shutdown_connections 2023-07-12T02:03:32.918 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:32.913+0000 7fc8487ff700 1 -- 172.21.15.196:0/1898082814 wait complete. 2023-07-12T02:03:32.938 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8 6 2023-07-12T02:03:33.123 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:33.120+0000 7fa8cbdaa200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-12T02:03:33.133 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.130+0000 7f2ac91ff700 1 Processor -- start 2023-07-12T02:03:33.133 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.130+0000 7f2ac91ff700 1 -- start start 2023-07-12T02:03:33.134 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.131+0000 7f2ac91ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ac40d25c0 0x7f2ac40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:33.135 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.131+0000 7f2ac91ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac4160a00 con 0x7f2ac40b8260 2023-07-12T02:03:33.135 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.132+0000 7f2ac91ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac4160ce0 con 0x7f2ac40b4d20 2023-07-12T02:03:33.135 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.132+0000 7f2ac91ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac40cd280 con 0x7f2ac40d25c0 2023-07-12T02:03:33.135 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.132+0000 7f2abbfff700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f2ac40b4d20 0x7f2ac40d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:48872/0 (socket says 172.21.15.196:48872) 2023-07-12T02:03:33.135 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.132+0000 7f2abbfff700 1 -- 172.21.15.196:0/3182253163 learned_addr learned my addr 172.21.15.196:0/3182253163 (peer_addr_for_me v1:172.21.15.196:0/0) 2023-07-12T02:03:33.135 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.132+0000 7f2ac359e700 1 --2- 172.21.15.196:0/3182253163 >> v2:172.21.15.37:3300/0 conn(0x7f2ac40d25c0 0x7f2ac40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:33.137 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.132+0000 7f2ac259c700 1 -- 172.21.15.196:0/3182253163 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039019116 0 0) 0x7f2ac4160ce0 con 0x7f2ac40b4d20 2023-07-12T02:03:33.137 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.132+0000 7f2ac259c700 1 -- 172.21.15.196:0/3182253163 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ab00035b0 con 0x7f2ac40b4d20 2023-07-12T02:03:33.137 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.132+0000 7f2ac259c700 1 -- 172.21.15.196:0/3182253163 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399822942 0 0) 0x7f2ac4160a00 con 0x7f2ac40b8260 2023-07-12T02:03:33.137 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.132+0000 7f2ac259c700 1 -- 172.21.15.196:0/3182253163 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ac4160ce0 con 0x7f2ac40b8260 2023-07-12T02:03:33.137 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.132+0000 7f2ac359e700 1 -- 172.21.15.196:0/3182253163 >> v1:172.21.15.196:6789/0 conn(0x7f2ac40b4d20 legacy=0x7f2ac40d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:33.138 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.132+0000 7f2ac359e700 1 -- 172.21.15.196:0/3182253163 >> v1:172.21.15.37:6789/0 conn(0x7f2ac40b8260 legacy=0x7f2ac40b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:33.138 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.132+0000 7f2ac359e700 1 -- 172.21.15.196:0/3182253163 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac40cd560 con 0x7f2ac40d25c0 2023-07-12T02:03:33.138 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.133+0000 7f2ac359e700 1 --2- 172.21.15.196:0/3182253163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac40d25c0 0x7f2ac40cede0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009d90 tx=0x7f2abc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db840026003eeea4 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:33.138 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.133+0000 7f2ac259c700 1 -- 172.21.15.196:0/3182253163 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00e070 con 0x7f2ac40d25c0 2023-07-12T02:03:33.138 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.133+0000 7f2ac259c700 1 -- 172.21.15.196:0/3182253163 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc00bb20 con 0x7f2ac40d25c0 2023-07-12T02:03:33.138 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.133+0000 7f2ac259c700 1 -- 172.21.15.196:0/3182253163 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc012430 con 0x7f2ac40d25c0 2023-07-12T02:03:33.138 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.133+0000 7f2ac91ff700 1 -- 172.21.15.196:0/3182253163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac40d25c0 msgr2=0x7f2ac40cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:33.138 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.133+0000 7f2ac91ff700 1 --2- 172.21.15.196:0/3182253163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac40d25c0 0x7f2ac40cede0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009d90 tx=0x7f2abc00b330 comp rx=0 tx=0).stop 2023-07-12T02:03:33.139 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.133+0000 7f2ac91ff700 1 -- 172.21.15.196:0/3182253163 shutdown_connections 2023-07-12T02:03:33.139 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.133+0000 7f2ac91ff700 1 --2- 172.21.15.196:0/3182253163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac40d25c0 0x7f2ac40cede0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.139 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.133+0000 7f2ac91ff700 1 -- 172.21.15.196:0/3182253163 >> 172.21.15.196:0/3182253163 conn(0x7f2ac40722b0 msgr2=0x7f2ac40cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:33.139 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.133+0000 7f2ac91ff700 1 -- 172.21.15.196:0/3182253163 shutdown_connections 2023-07-12T02:03:33.139 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.134+0000 7f2ac91ff700 1 -- 172.21.15.196:0/3182253163 wait complete. 2023-07-12T02:03:33.139 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:33.135+0000 7f09a6e47200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-12T02:03:33.141 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.135+0000 7f2ac91ff700 1 Processor -- start 2023-07-12T02:03:33.142 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.135+0000 7f2ac91ff700 1 -- start start 2023-07-12T02:03:33.142 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.136+0000 7f2ac91ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac40b8260 0x7f2ac414a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:33.142 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.136+0000 7f2ac91ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ac40d25c0 0x7f2ac415c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:33.142 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.136+0000 7f2ac91ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ac40cc750 0x7f2ac40b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:33.142 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.136+0000 7f2ac91ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac415cf00 con 0x7f2ac40b8260 2023-07-12T02:03:33.142 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.136+0000 7f2ac91ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac40cb3d0 con 0x7f2ac40cc750 2023-07-12T02:03:33.142 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.136+0000 7f2ac91ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac40cb6b0 con 0x7f2ac40d25c0 2023-07-12T02:03:33.142 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.137+0000 7f2abbfff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ac40d25c0 0x7f2ac415c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:33.143 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.137+0000 7f2abbfff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ac40d25c0 0x7f2ac415c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:53024/0 (socket says 172.21.15.196:53024) 2023-07-12T02:03:33.143 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.137+0000 7f2abbfff700 1 -- 172.21.15.196:0/904857808 learned_addr learned my addr 172.21.15.196:0/904857808 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-07-12T02:03:33.143 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.137+0000 7f2ac359e700 1 --2- 172.21.15.196:0/904857808 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ac40cc750 0x7f2ac40b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:33.143 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.137+0000 7f2ac2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac40b8260 0x7f2ac414a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:33.143 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.137+0000 7f2ac359e700 1 -- 172.21.15.196:0/904857808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ac40d25c0 msgr2=0x7f2ac415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:33.143 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.137+0000 7f2ac359e700 1 --2- 172.21.15.196:0/904857808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ac40d25c0 0x7f2ac415c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.143 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.137+0000 7f2ac359e700 1 -- 172.21.15.196:0/904857808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac40b8260 msgr2=0x7f2ac414a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:33.144 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.137+0000 7f2ac359e700 1 --2- 172.21.15.196:0/904857808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac40b8260 0x7f2ac414a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.144 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.137+0000 7f2ac359e700 1 -- 172.21.15.196:0/904857808 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc009a70 con 0x7f2ac40cc750 2023-07-12T02:03:33.144 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.137+0000 7f2abbfff700 1 --2- 172.21.15.196:0/904857808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ac40d25c0 0x7f2ac415c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:03:33.144 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.137+0000 7f2ac359e700 1 --2- 172.21.15.196:0/904857808 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ac40cc750 0x7f2ac40b6e60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2abc016000 tx=0x7f2abc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:33.144 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.138+0000 7f2abb7fe700 1 -- 172.21.15.196:0/904857808 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc012430 con 0x7f2ac40cc750 2023-07-12T02:03:33.144 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.138+0000 7f2abb7fe700 1 -- 172.21.15.196:0/904857808 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc020070 con 0x7f2ac40cc750 2023-07-12T02:03:33.144 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.138+0000 7f2abb7fe700 1 -- 172.21.15.196:0/904857808 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc01ba90 con 0x7f2ac40cc750 2023-07-12T02:03:33.144 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.138+0000 7f2ac91ff700 1 -- 172.21.15.196:0/904857808 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac40cb990 con 0x7f2ac40cc750 2023-07-12T02:03:33.145 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.138+0000 7f2ac91ff700 1 -- 172.21.15.196:0/904857808 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac40cbf50 con 0x7f2ac40cc750 2023-07-12T02:03:33.145 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.138+0000 7f2abb7fe700 1 -- 172.21.15.196:0/904857808 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2abc027480 con 0x7f2ac40cc750 2023-07-12T02:03:33.145 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.138+0000 7f2abb7fe700 1 -- 172.21.15.196:0/904857808 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f2abc022070 con 0x7f2ac40cc750 2023-07-12T02:03:33.145 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.139+0000 7f2ac91ff700 1 -- 172.21.15.196:0/904857808 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac404ea60 con 0x7f2ac40cc750 2023-07-12T02:03:33.145 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.141+0000 7f2abb7fe700 1 -- 172.21.15.196:0/904857808 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f2abc02c060 con 0x7f2ac40cc750 2023-07-12T02:03:33.219 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:33.216+0000 7fa8cbdaa200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-12T02:03:33.228 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.225+0000 7f2ac91ff700 1 -- 172.21.15.196:0/904857808 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8", "id": 6} v 0) v1 -- 0x7f2ac40cfed0 con 0x7f2ac40cc750 2023-07-12T02:03:33.233 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:33.230+0000 7f09a6e47200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-12T02:03:33.233 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.230+0000 7f2abb7fe700 1 -- 172.21.15.196:0/904857808 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2abc0360b0 con 0x7f2ac40cc750 2023-07-12T02:03:33.233 INFO:teuthology.orchestra.run.smithi196.stdout:6 2023-07-12T02:03:33.234 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.231+0000 7f2ac91ff700 1 -- 172.21.15.196:0/904857808 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ac40cc750 msgr2=0x7f2ac40b6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:33.234 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.231+0000 7f2ac91ff700 1 --2- 172.21.15.196:0/904857808 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ac40cc750 0x7f2ac40b6e60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2abc016000 tx=0x7f2abc004ad0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.234 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.231+0000 7f2ac91ff700 1 -- 172.21.15.196:0/904857808 shutdown_connections 2023-07-12T02:03:33.235 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.231+0000 7f2ac91ff700 1 --2- 172.21.15.196:0/904857808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac40b8260 0x7f2ac414a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.235 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.231+0000 7f2ac91ff700 1 --2- 172.21.15.196:0/904857808 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ac40cc750 0x7f2ac40b6e60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.235 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.231+0000 7f2ac91ff700 1 --2- 172.21.15.196:0/904857808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ac40d25c0 0x7f2ac415c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.235 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.231+0000 7f2ac91ff700 1 -- 172.21.15.196:0/904857808 >> 172.21.15.196:0/904857808 conn(0x7f2ac40b4d20 msgr2=0x7f2ac40b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:33.235 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.231+0000 7f2ac91ff700 1 -- 172.21.15.196:0/904857808 shutdown_connections 2023-07-12T02:03:33.235 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.231+0000 7f2ac91ff700 1 -- 172.21.15.196:0/904857808 wait complete. 2023-07-12T02:03:33.251 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new ce737012-d478-4c4d-aab8-83c231e41cca 7 2023-07-12T02:03:33.394 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:33.391+0000 7fa8cbdaa200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-12T02:03:33.411 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:33.408+0000 7f09a6e47200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-12T02:03:33.439 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.436+0000 7f946a7ff700 1 Processor -- start 2023-07-12T02:03:33.440 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.437+0000 7f946a7ff700 1 -- start start 2023-07-12T02:03:33.441 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.438+0000 7f946a7ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f94640d25c0 0x7f94640cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:33.441 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.438+0000 7f946a7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9464160a00 con 0x7f94640b8260 2023-07-12T02:03:33.441 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.438+0000 7f946a7ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9464160ce0 con 0x7f94640b4d20 2023-07-12T02:03:33.441 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.438+0000 7f946a7ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94640cd280 con 0x7f94640d25c0 2023-07-12T02:03:33.442 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.438+0000 7f94637fe700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f94640b4d20 0x7f94640d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:48876/0 (socket says 172.21.15.196:48876) 2023-07-12T02:03:33.442 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.438+0000 7f94637fe700 1 -- 172.21.15.196:0/3456058763 learned_addr learned my addr 172.21.15.196:0/3456058763 (peer_addr_for_me v1:172.21.15.196:0/0) 2023-07-12T02:03:33.443 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.438+0000 7f9468d9c700 1 --2- 172.21.15.196:0/3456058763 >> v2:172.21.15.196:3300/0 conn(0x7f94640d25c0 0x7f94640cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:33.443 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.438+0000 7f9462ffd700 1 -- 172.21.15.196:0/3456058763 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677665831 0 0) 0x7f9464160ce0 con 0x7f94640b4d20 2023-07-12T02:03:33.443 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.439+0000 7f9462ffd700 1 -- 172.21.15.196:0/3456058763 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f944c0035b0 con 0x7f94640b4d20 2023-07-12T02:03:33.443 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.439+0000 7f9462ffd700 1 -- 172.21.15.196:0/3456058763 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965601677 0 0) 0x7f9464160a00 con 0x7f94640b8260 2023-07-12T02:03:33.443 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.439+0000 7f9462ffd700 1 -- 172.21.15.196:0/3456058763 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9464160ce0 con 0x7f94640b8260 2023-07-12T02:03:33.443 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.439+0000 7f9468d9c700 1 -- 172.21.15.196:0/3456058763 >> v1:172.21.15.196:6789/0 conn(0x7f94640b4d20 legacy=0x7f94640d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:33.443 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.439+0000 7f9468d9c700 1 -- 172.21.15.196:0/3456058763 >> v1:172.21.15.37:6789/0 conn(0x7f94640b8260 legacy=0x7f94640b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:33.444 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.439+0000 7f9468d9c700 1 -- 172.21.15.196:0/3456058763 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94640cd560 con 0x7f94640d25c0 2023-07-12T02:03:33.444 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.439+0000 7f9468d9c700 1 --2- 172.21.15.196:0/3456058763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94640d25c0 0x7f94640cede0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f945c009d90 tx=0x7f945c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d6a06dce229c4c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:33.444 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.439+0000 7f9462ffd700 1 -- 172.21.15.196:0/3456058763 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c00e070 con 0x7f94640d25c0 2023-07-12T02:03:33.444 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.439+0000 7f9462ffd700 1 -- 172.21.15.196:0/3456058763 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945c00bb20 con 0x7f94640d25c0 2023-07-12T02:03:33.444 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.439+0000 7f9462ffd700 1 -- 172.21.15.196:0/3456058763 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c012430 con 0x7f94640d25c0 2023-07-12T02:03:33.445 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.440+0000 7f946a7ff700 1 -- 172.21.15.196:0/3456058763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94640d25c0 msgr2=0x7f94640cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:33.445 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.440+0000 7f946a7ff700 1 --2- 172.21.15.196:0/3456058763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94640d25c0 0x7f94640cede0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f945c009d90 tx=0x7f945c00b330 comp rx=0 tx=0).stop 2023-07-12T02:03:33.445 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.440+0000 7f946a7ff700 1 -- 172.21.15.196:0/3456058763 shutdown_connections 2023-07-12T02:03:33.445 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.440+0000 7f946a7ff700 1 --2- 172.21.15.196:0/3456058763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94640d25c0 0x7f94640cede0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.446 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.440+0000 7f946a7ff700 1 -- 172.21.15.196:0/3456058763 >> 172.21.15.196:0/3456058763 conn(0x7f94640722b0 msgr2=0x7f94640cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:33.446 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.440+0000 7f946a7ff700 1 -- 172.21.15.196:0/3456058763 shutdown_connections 2023-07-12T02:03:33.446 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.440+0000 7f946a7ff700 1 -- 172.21.15.196:0/3456058763 wait complete. 2023-07-12T02:03:33.446 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.442+0000 7f946a7ff700 1 Processor -- start 2023-07-12T02:03:33.446 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.442+0000 7f946a7ff700 1 -- start start 2023-07-12T02:03:33.448 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.443+0000 7f946a7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94640b8260 0x7f9464159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:33.448 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.443+0000 7f946a7ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94640d25c0 0x7f94640caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:33.448 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.443+0000 7f946a7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f94641597d0 0x7f94640cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:33.448 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.443+0000 7f946a7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94640cb510 con 0x7f94640b8260 2023-07-12T02:03:33.448 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.443+0000 7f946a7ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94640cb7c0 con 0x7f94640d25c0 2023-07-12T02:03:33.448 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.443+0000 7f946a7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94640cbaa0 con 0x7f94641597d0 2023-07-12T02:03:33.448 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.443+0000 7f94637fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94640d25c0 0x7f94640caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:33.449 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.443+0000 7f94637fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94640d25c0 0x7f94640caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:59176/0 (socket says 172.21.15.196:59176) 2023-07-12T02:03:33.449 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.443+0000 7f94637fe700 1 -- 172.21.15.196:0/1782249156 learned_addr learned my addr 172.21.15.196:0/1782249156 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-07-12T02:03:33.449 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.443+0000 7f9468d9c700 1 --2- 172.21.15.196:0/1782249156 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f94641597d0 0x7f94640cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:33.449 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.443+0000 7f9463fff700 1 --2- 172.21.15.196:0/1782249156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94640b8260 0x7f9464159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:33.449 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.444+0000 7f94637fe700 1 -- 172.21.15.196:0/1782249156 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f94641597d0 msgr2=0x7f94640cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:33.449 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.444+0000 7f94637fe700 1 --2- 172.21.15.196:0/1782249156 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f94641597d0 0x7f94640cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.449 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.444+0000 7f94637fe700 1 -- 172.21.15.196:0/1782249156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94640b8260 msgr2=0x7f9464159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:33.449 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.444+0000 7f94637fe700 1 --2- 172.21.15.196:0/1782249156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94640b8260 0x7f9464159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.450 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.444+0000 7f94637fe700 1 -- 172.21.15.196:0/1782249156 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c009a70 con 0x7f94640d25c0 2023-07-12T02:03:33.450 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.444+0000 7f94637fe700 1 --2- 172.21.15.196:0/1782249156 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94640d25c0 0x7f94640caa90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f945800c410 tx=0x7f945800c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:33.450 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.444+0000 7f9460ff9700 1 -- 172.21.15.196:0/1782249156 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458005d70 con 0x7f94640d25c0 2023-07-12T02:03:33.450 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.444+0000 7f9460ff9700 1 -- 172.21.15.196:0/1782249156 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945800ce20 con 0x7f94640d25c0 2023-07-12T02:03:33.450 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.444+0000 7f946a7ff700 1 -- 172.21.15.196:0/1782249156 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94640cbd80 con 0x7f94640d25c0 2023-07-12T02:03:33.450 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.444+0000 7f9460ff9700 1 -- 172.21.15.196:0/1782249156 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458007310 con 0x7f94640d25c0 2023-07-12T02:03:33.450 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.444+0000 7f946a7ff700 1 -- 172.21.15.196:0/1782249156 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94640cc340 con 0x7f94640d25c0 2023-07-12T02:03:33.451 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.444+0000 7f9460ff9700 1 -- 172.21.15.196:0/1782249156 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f945801c440 con 0x7f94640d25c0 2023-07-12T02:03:33.451 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.444+0000 7f9460ff9700 1 -- 172.21.15.196:0/1782249156 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f94580077c0 con 0x7f94640d25c0 2023-07-12T02:03:33.451 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.445+0000 7f946a7ff700 1 -- 172.21.15.196:0/1782249156 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946404ea60 con 0x7f94640d25c0 2023-07-12T02:03:33.451 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.447+0000 7f9460ff9700 1 -- 172.21.15.196:0/1782249156 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f9458017070 con 0x7f94640d25c0 2023-07-12T02:03:33.488 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:33.484+0000 7fa8cbdaa200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-12T02:03:33.508 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:33.505+0000 7f09a6e47200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-12T02:03:33.537 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.534+0000 7f946a7ff700 1 -- 172.21.15.196:0/1782249156 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ce737012-d478-4c4d-aab8-83c231e41cca", "id": 7} v 0) v1 -- 0x7f94640cfed0 con 0x7f94640d25c0 2023-07-12T02:03:33.543 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.541+0000 7f9460ff9700 1 -- 172.21.15.196:0/1782249156 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ce737012-d478-4c4d-aab8-83c231e41cca", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9458012b80 con 0x7f94640d25c0 2023-07-12T02:03:33.544 INFO:teuthology.orchestra.run.smithi196.stdout:7 2023-07-12T02:03:33.545 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.542+0000 7f946a7ff700 1 -- 172.21.15.196:0/1782249156 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94640d25c0 msgr2=0x7f94640caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:33.545 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.542+0000 7f946a7ff700 1 --2- 172.21.15.196:0/1782249156 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94640d25c0 0x7f94640caa90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f945800c410 tx=0x7f945800c720 comp rx=0 tx=0).stop 2023-07-12T02:03:33.545 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.542+0000 7f946a7ff700 1 -- 172.21.15.196:0/1782249156 shutdown_connections 2023-07-12T02:03:33.545 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.542+0000 7f946a7ff700 1 --2- 172.21.15.196:0/1782249156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94640b8260 0x7f9464159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.545 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.542+0000 7f946a7ff700 1 --2- 172.21.15.196:0/1782249156 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f94641597d0 0x7f94640cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.545 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.542+0000 7f946a7ff700 1 --2- 172.21.15.196:0/1782249156 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94640d25c0 0x7f94640caa90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.546 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.542+0000 7f946a7ff700 1 -- 172.21.15.196:0/1782249156 >> 172.21.15.196:0/1782249156 conn(0x7f94640b4d20 msgr2=0x7f94640b4500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:33.546 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.542+0000 7f946a7ff700 1 -- 172.21.15.196:0/1782249156 shutdown_connections 2023-07-12T02:03:33.546 INFO:teuthology.orchestra.run.smithi196.stderr:2023-07-12T02:03:33.542+0000 7f946a7ff700 1 -- 172.21.15.196:0/1782249156 wait complete. 2023-07-12T02:03:33.562 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-12T02:03:33.562 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-12T02:03:33.568 INFO:tasks.ceph.osd.0:Started 2023-07-12T02:03:33.568 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-12T02:03:33.568 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-12T02:03:33.573 INFO:tasks.ceph.osd.1:Started 2023-07-12T02:03:33.574 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-12T02:03:33.574 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-12T02:03:33.579 INFO:tasks.ceph.osd.2:Started 2023-07-12T02:03:33.579 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-12T02:03:33.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-12T02:03:33.585 INFO:tasks.ceph.osd.3:Started 2023-07-12T02:03:33.586 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-12T02:03:33.586 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-12T02:03:33.590 INFO:tasks.ceph.osd.4:Started 2023-07-12T02:03:33.590 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-12T02:03:33.591 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-12T02:03:33.595 INFO:tasks.ceph.osd.5:Started 2023-07-12T02:03:33.595 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-12T02:03:33.596 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-12T02:03:33.600 INFO:tasks.ceph.osd.6:Started 2023-07-12T02:03:33.601 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-12T02:03:33.601 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-12T02:03:33.605 INFO:tasks.ceph.osd.7:Started 2023-07-12T02:03:33.606 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:03:33.757 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:33.754+0000 7fa8cbdaa200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-12T02:03:33.759 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:33.756+0000 7f09a6e47200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-12T02:03:33.866 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:33.863+0000 7f09a6e47200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-12T02:03:33.880 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:33.877+0000 7fa8cbdaa200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-12T02:03:33.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.886+0000 7fae80bff700 1 Processor -- start 2023-07-12T02:03:33.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.886+0000 7fae80bff700 1 -- start start 2023-07-12T02:03:33.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.887+0000 7fae80bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fae7c15c460 0x7fae7c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:33.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.887+0000 7fae80bff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae7c0d2640 0x7fae7c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:33.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.887+0000 7fae80bff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fae7c0cf720 0x7fae7c0cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:33.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.887+0000 7fae80bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c0cedd0 con 0x7fae7c15c460 2023-07-12T02:03:33.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.887+0000 7fae80bff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c0d1790 con 0x7fae7c0cf720 2023-07-12T02:03:33.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.887+0000 7fae80bff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0cd950 con 0x7fae7c0d2640 2023-07-12T02:03:33.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.887+0000 7fae7a59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fae7c15c460 0x7fae7c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:33.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.887+0000 7fae7a59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fae7c15c460 0x7fae7c0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60962/0 (socket says 172.21.15.37:60962) 2023-07-12T02:03:33.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.887+0000 7fae7a59c700 1 -- 172.21.15.37:0/2785867356 learned_addr learned my addr 172.21.15.37:0/2785867356 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:33.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.887+0000 7fae73fff700 1 --2- 172.21.15.37:0/2785867356 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae7c0d2640 0x7fae7c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:33.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.887+0000 7fae7ad9d700 1 --2- 172.21.15.37:0/2785867356 >> v2:172.21.15.196:3300/0 conn(0x7fae7c0cf720 0x7fae7c0cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:33.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.888+0000 7fae7a59c700 1 -- 172.21.15.37:0/2785867356 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae7c0d2640 msgr2=0x7fae7c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:33.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.888+0000 7fae7a59c700 1 --2- 172.21.15.37:0/2785867356 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae7c0d2640 0x7fae7c0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.888+0000 7fae7a59c700 1 -- 172.21.15.37:0/2785867356 >> v2:172.21.15.196:3300/0 conn(0x7fae7c0cf720 msgr2=0x7fae7c0cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.888+0000 7fae7a59c700 1 --2- 172.21.15.37:0/2785867356 >> v2:172.21.15.196:3300/0 conn(0x7fae7c0cf720 0x7fae7c0cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.888+0000 7fae7a59c700 1 -- 172.21.15.37:0/2785867356 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c0d14b0 con 0x7fae7c15c460 2023-07-12T02:03:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.888+0000 7fae7a59c700 1 --2- 172.21.15.37:0/2785867356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae7c15c460 0x7fae7c0b59d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fae7c08bf90 tx=0x7fae6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2e36c33565213 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.888+0000 7fae79d9b700 1 -- 172.21.15.37:0/2785867356 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c011830 con 0x7fae7c15c460 2023-07-12T02:03:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.888+0000 7fae79d9b700 1 -- 172.21.15.37:0/2785867356 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c011990 con 0x7fae7c15c460 2023-07-12T02:03:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.888+0000 7fae79d9b700 1 -- 172.21.15.37:0/2785867356 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c011d20 con 0x7fae7c15c460 2023-07-12T02:03:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.889+0000 7fae80bff700 1 -- 172.21.15.37:0/2785867356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae7c15c460 msgr2=0x7fae7c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.889+0000 7fae80bff700 1 --2- 172.21.15.37:0/2785867356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae7c15c460 0x7fae7c0b59d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fae7c08bf90 tx=0x7fae6c009bd0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.889+0000 7fae80bff700 1 -- 172.21.15.37:0/2785867356 shutdown_connections 2023-07-12T02:03:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.889+0000 7fae80bff700 1 --2- 172.21.15.37:0/2785867356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae7c15c460 0x7fae7c0b59d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.889+0000 7fae80bff700 1 --2- 172.21.15.37:0/2785867356 >> v2:172.21.15.196:3300/0 conn(0x7fae7c0cf720 0x7fae7c0cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.889+0000 7fae80bff700 1 --2- 172.21.15.37:0/2785867356 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae7c0d2640 0x7fae7c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.889+0000 7fae80bff700 1 -- 172.21.15.37:0/2785867356 >> 172.21.15.37:0/2785867356 conn(0x7fae7c071660 msgr2=0x7fae7c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.889+0000 7fae80bff700 1 -- 172.21.15.37:0/2785867356 shutdown_connections 2023-07-12T02:03:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.889+0000 7fae80bff700 1 -- 172.21.15.37:0/2785867356 wait complete. 2023-07-12T02:03:33.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.891+0000 7fae80bff700 1 Processor -- start 2023-07-12T02:03:33.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.891+0000 7fae80bff700 1 -- start start 2023-07-12T02:03:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.892+0000 7fae80bff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae7c0cf720 0x7fae7c157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.892+0000 7fae80bff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae7c0d2640 0x7fae7c157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.892+0000 7fae80bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae7c15c460 0x7fae7c1e6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.892+0000 7fae80bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c1579a0 con 0x7fae7c15c460 2023-07-12T02:03:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.892+0000 7fae80bff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c1f23e0 con 0x7fae7c0d2640 2023-07-12T02:03:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.892+0000 7fae80bff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c1e6ea0 con 0x7fae7c0cf720 2023-07-12T02:03:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.892+0000 7fae7ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae7c15c460 0x7fae7c1e6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.892+0000 7fae7a59c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae7c0cf720 0x7fae7c157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:33.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.892+0000 7fae7ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae7c15c460 0x7fae7c1e6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60970/0 (socket says 172.21.15.37:60970) 2023-07-12T02:03:33.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.892+0000 7fae7ad9d700 1 -- 172.21.15.37:0/1169371038 learned_addr learned my addr 172.21.15.37:0/1169371038 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:33.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.892+0000 7fae73fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae7c0d2640 0x7fae7c157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:33.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.893+0000 7fae7ad9d700 1 -- 172.21.15.37:0/1169371038 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae7c0cf720 msgr2=0x7fae7c157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:33.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.893+0000 7fae7ad9d700 1 --2- 172.21.15.37:0/1169371038 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae7c0cf720 0x7fae7c157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.893+0000 7fae7ad9d700 1 -- 172.21.15.37:0/1169371038 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae7c0d2640 msgr2=0x7fae7c157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:33.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.893+0000 7fae7ad9d700 1 --2- 172.21.15.37:0/1169371038 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae7c0d2640 0x7fae7c157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.893+0000 7fae7ad9d700 1 -- 172.21.15.37:0/1169371038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c009550 con 0x7fae7c15c460 2023-07-12T02:03:33.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.893+0000 7fae7ad9d700 1 --2- 172.21.15.37:0/1169371038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae7c15c460 0x7fae7c1e6650 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fae7400eed0 tx=0x7fae74009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:33.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.893+0000 7fae72ffd700 1 -- 172.21.15.37:0/1169371038 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae74010040 con 0x7fae7c15c460 2023-07-12T02:03:33.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.893+0000 7fae72ffd700 1 -- 172.21.15.37:0/1169371038 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7400b9e0 con 0x7fae7c15c460 2023-07-12T02:03:33.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.893+0000 7fae80bff700 1 -- 172.21.15.37:0/1169371038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c1e7180 con 0x7fae7c15c460 2023-07-12T02:03:33.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.893+0000 7fae72ffd700 1 -- 172.21.15.37:0/1169371038 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae74009b20 con 0x7fae7c15c460 2023-07-12T02:03:33.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.894+0000 7fae80bff700 1 -- 172.21.15.37:0/1169371038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c1f2660 con 0x7fae7c15c460 2023-07-12T02:03:33.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.894+0000 7fae72ffd700 1 -- 172.21.15.37:0/1169371038 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fae7401d700 con 0x7fae7c15c460 2023-07-12T02:03:33.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.894+0000 7fae72ffd700 1 -- 172.21.15.37:0/1169371038 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fae7400bd90 con 0x7fae7c15c460 2023-07-12T02:03:33.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.895+0000 7fae80bff700 1 -- 172.21.15.37:0/1169371038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c066e80 con 0x7fae7c15c460 2023-07-12T02:03:33.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.898+0000 7fae72ffd700 1 -- 172.21.15.37:0/1169371038 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7fae7403bb80 con 0x7fae7c15c460 2023-07-12T02:03:33.964 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:33.962+0000 7f09a6e47200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-12T02:03:33.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.972+0000 7fae80bff700 1 -- 172.21.15.37:0/1169371038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae7c04ea60 con 0x7fae7c15c460 2023-07-12T02:03:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.972+0000 7fae72ffd700 1 -- 172.21.15.37:0/1169371038 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fae7402a030 con 0x7fae7c15c460 2023-07-12T02:03:33.976 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:03:33.976 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":10,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:03:33.536148+0000","last_up_change":"0.000000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:03:33.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.973+0000 7fae80bff700 1 -- 172.21.15.37:0/1169371038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae7c15c460 msgr2=0x7fae7c1e6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:33.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.973+0000 7fae80bff700 1 --2- 172.21.15.37:0/1169371038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae7c15c460 0x7fae7c1e6650 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fae7400eed0 tx=0x7fae74009f60 comp rx=0 tx=0).stop 2023-07-12T02:03:33.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.973+0000 7fae80bff700 1 -- 172.21.15.37:0/1169371038 shutdown_connections 2023-07-12T02:03:33.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.973+0000 7fae80bff700 1 --2- 172.21.15.37:0/1169371038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae7c15c460 0x7fae7c1e6650 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.973+0000 7fae80bff700 1 --2- 172.21.15.37:0/1169371038 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae7c0cf720 0x7fae7c157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.973+0000 7fae80bff700 1 --2- 172.21.15.37:0/1169371038 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae7c0d2640 0x7fae7c157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:33.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.973+0000 7fae80bff700 1 -- 172.21.15.37:0/1169371038 >> 172.21.15.37:0/1169371038 conn(0x7fae7c071660 msgr2=0x7fae7c06b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:33.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.974+0000 7fae80bff700 1 -- 172.21.15.37:0/1169371038 shutdown_connections 2023-07-12T02:03:33.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:33.974+0000 7fae80bff700 1 -- 172.21.15.37:0/1169371038 wait complete. 2023-07-12T02:03:33.986 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:33.983+0000 7fa8cbdaa200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-12T02:03:33.994 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-12T02:03:33.994 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-12T02:03:34.074 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:34.071+0000 7f09a6e47200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-12T02:03:34.099 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:34.096+0000 7fa8cbdaa200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-12T02:03:34.277 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-12T02:03:34.274+0000 7fd361973640 -1 Falling back to public interface 2023-07-12T02:03:34.296 INFO:tasks.ceph.osd.5.smithi196.stderr:2023-07-12T02:03:34.294+0000 7f4d33f7d640 -1 Falling back to public interface 2023-07-12T02:03:34.301 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:34.298+0000 7f09a6e47200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-12T02:03:34.306 INFO:tasks.ceph.osd.6.smithi196.stderr:2023-07-12T02:03:34.304+0000 7f220a800640 -1 Falling back to public interface 2023-07-12T02:03:34.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-12T02:03:34.313+0000 7f5d8843e640 -1 Falling back to public interface 2023-07-12T02:03:34.317 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-07-12T02:03:34.314+0000 7f4a8ed2f640 -1 Falling back to public interface 2023-07-12T02:03:34.323 INFO:tasks.ceph.osd.4.smithi196.stderr:2023-07-12T02:03:34.321+0000 7f0bbccb5640 -1 Falling back to public interface 2023-07-12T02:03:34.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-12T02:03:34.329+0000 7f1c0c5a5640 -1 Falling back to public interface 2023-07-12T02:03:34.333 INFO:tasks.ceph.osd.7.smithi196.stderr:2023-07-12T02:03:34.330+0000 7f4652e3f640 -1 Falling back to public interface 2023-07-12T02:03:34.339 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:34.335+0000 7fa8cbdaa200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-12T02:03:34.407 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:34.404+0000 7f09a6e47200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-12T02:03:34.448 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:34.445+0000 7fa8cbdaa200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-12T02:03:34.767 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:34.764+0000 7f09a6e47200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-12T02:03:34.799 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-12T02:03:34.810 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:34.806+0000 7fa8cbdaa200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-12T02:03:34.855 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:34.853+0000 7f09a6e47200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-12T02:03:34.906 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:34.903+0000 7fa8cbdaa200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-12T02:03:34.978 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.974+0000 7f5b849ff700 1 Processor -- start 2023-07-12T02:03:34.978 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.974+0000 7f5b849ff700 1 -- start start 2023-07-12T02:03:34.979 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.975+0000 7f5b849ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5b800d0980 0x7f5b800cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:34.979 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.975+0000 7f5b849ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5b800d3200 0x7f5b800d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:34.979 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.976+0000 7f5b849ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b800cd570 con 0x7f5b800d1290 2023-07-12T02:03:34.979 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.976+0000 7f5b849ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b800b4fd0 con 0x7f5b800d3200 2023-07-12T02:03:34.979 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.976+0000 7f5b849ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b800d2720 con 0x7f5b800d0980 2023-07-12T02:03:34.981 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.976+0000 7f5b77fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5b800d3200 0x7f5b800d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:34.981 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.976+0000 7f5b7ed9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5b800d1290 0x7f5b800b5990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35802/0 (socket says 172.21.15.37:35802) 2023-07-12T02:03:34.981 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.976+0000 7f5b7ed9d700 1 -- 172.21.15.37:0/2300865140 learned_addr learned my addr 172.21.15.37:0/2300865140 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:03:34.981 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.976+0000 7f5b7e59c700 1 --2- 172.21.15.37:0/2300865140 >> v2:172.21.15.196:3300/0 conn(0x7f5b800d0980 0x7f5b800cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:34.981 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.976+0000 7f5b77fff700 1 -- 172.21.15.37:0/2300865140 >> v2:172.21.15.196:3300/0 conn(0x7f5b800d0980 msgr2=0x7f5b800cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:34.981 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.976+0000 7f5b77fff700 1 --2- 172.21.15.37:0/2300865140 >> v2:172.21.15.196:3300/0 conn(0x7f5b800d0980 0x7f5b800cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:34.981 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.976+0000 7f5b77fff700 1 -- 172.21.15.37:0/2300865140 >> v1:172.21.15.37:6789/0 conn(0x7f5b800d1290 legacy=0x7f5b800b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:34.982 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.976+0000 7f5b77fff700 1 -- 172.21.15.37:0/2300865140 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b800d2a00 con 0x7f5b800d3200 2023-07-12T02:03:34.982 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.976+0000 7f5b7dd9b700 1 -- 172.21.15.37:0/2300865140 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366217255 0 0) 0x7f5b800cd570 con 0x7f5b800d1290 2023-07-12T02:03:34.982 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.977+0000 7f5b77fff700 1 --2- 172.21.15.37:0/2300865140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b800d3200 0x7f5b800d0d50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5b8006c740 tx=0x7f5b68009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf93a8368fea112 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:34.982 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.977+0000 7f5b7dd9b700 1 -- 172.21.15.37:0/2300865140 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68011830 con 0x7f5b800d3200 2023-07-12T02:03:34.982 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.977+0000 7f5b7dd9b700 1 -- 172.21.15.37:0/2300865140 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b68011990 con 0x7f5b800d3200 2023-07-12T02:03:34.982 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.977+0000 7f5b7dd9b700 1 -- 172.21.15.37:0/2300865140 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68011d20 con 0x7f5b800d3200 2023-07-12T02:03:34.983 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.978+0000 7f5b849ff700 1 -- 172.21.15.37:0/2300865140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b800d3200 msgr2=0x7f5b800d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:34.983 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.978+0000 7f5b849ff700 1 --2- 172.21.15.37:0/2300865140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b800d3200 0x7f5b800d0d50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5b8006c740 tx=0x7f5b68009b20 comp rx=0 tx=0).stop 2023-07-12T02:03:34.983 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.978+0000 7f5b849ff700 1 -- 172.21.15.37:0/2300865140 shutdown_connections 2023-07-12T02:03:34.984 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.978+0000 7f5b849ff700 1 --2- 172.21.15.37:0/2300865140 >> v2:172.21.15.196:3300/0 conn(0x7f5b800d0980 0x7f5b800cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:34.984 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.978+0000 7f5b849ff700 1 --2- 172.21.15.37:0/2300865140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b800d3200 0x7f5b800d0d50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:34.984 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.978+0000 7f5b849ff700 1 -- 172.21.15.37:0/2300865140 >> 172.21.15.37:0/2300865140 conn(0x7f5b8006b3f0 msgr2=0x7f5b8006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:34.984 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.978+0000 7f5b849ff700 1 -- 172.21.15.37:0/2300865140 shutdown_connections 2023-07-12T02:03:34.984 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.978+0000 7f5b849ff700 1 -- 172.21.15.37:0/2300865140 wait complete. 2023-07-12T02:03:34.984 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.980+0000 7f5b849ff700 1 Processor -- start 2023-07-12T02:03:34.984 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.980+0000 7f5b849ff700 1 -- start start 2023-07-12T02:03:34.986 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.981+0000 7f5b849ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b800d0980 0x7f5b8015a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:34.986 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.981+0000 7f5b849ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5b800d1290 0x7f5b801e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:34.987 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.981+0000 7f5b849ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b800d3200 0x7f5b8015ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:34.987 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.981+0000 7f5b849ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b801e52d0 con 0x7f5b800d0980 2023-07-12T02:03:34.987 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.981+0000 7f5b849ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b801e55b0 con 0x7f5b800d3200 2023-07-12T02:03:34.987 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.981+0000 7f5b849ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b801e5890 con 0x7f5b800d1290 2023-07-12T02:03:34.987 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.981+0000 7f5b7e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b800d0980 0x7f5b8015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:34.987 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.981+0000 7f5b7e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b800d0980 0x7f5b8015a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60988/0 (socket says 172.21.15.37:60988) 2023-07-12T02:03:34.987 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.981+0000 7f5b7e59c700 1 -- 172.21.15.37:0/2464845186 learned_addr learned my addr 172.21.15.37:0/2464845186 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:34.987 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.981+0000 7f5b7ed9d700 1 --2- 172.21.15.37:0/2464845186 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b800d3200 0x7f5b8015ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:34.988 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.981+0000 7f5b77fff700 1 --2- 172.21.15.37:0/2464845186 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5b800d1290 0x7f5b801e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:34.988 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.981+0000 7f5b7e59c700 1 -- 172.21.15.37:0/2464845186 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5b800d1290 msgr2=0x7f5b801e4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:34.988 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.981+0000 7f5b7e59c700 1 --2- 172.21.15.37:0/2464845186 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5b800d1290 0x7f5b801e4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:34.988 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.981+0000 7f5b7e59c700 1 -- 172.21.15.37:0/2464845186 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b800d3200 msgr2=0x7f5b8015ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:34.988 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.981+0000 7f5b7e59c700 1 --2- 172.21.15.37:0/2464845186 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b800d3200 0x7f5b8015ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:34.988 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.981+0000 7f5b7e59c700 1 -- 172.21.15.37:0/2464845186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680094a0 con 0x7f5b800d0980 2023-07-12T02:03:34.988 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.982+0000 7f5b7ed9d700 1 --2- 172.21.15.37:0/2464845186 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b800d3200 0x7f5b8015ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:03:34.989 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.982+0000 7f5b7e59c700 1 --2- 172.21.15.37:0/2464845186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b800d0980 0x7f5b8015a420 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000e850 tx=0x7f5b7000eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:34.989 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.982+0000 7f5b76ffd700 1 -- 172.21.15.37:0/2464845186 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70013680 con 0x7f5b800d0980 2023-07-12T02:03:34.989 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.982+0000 7f5b76ffd700 1 -- 172.21.15.37:0/2464845186 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b70013800 con 0x7f5b800d0980 2023-07-12T02:03:34.989 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.982+0000 7f5b76ffd700 1 -- 172.21.15.37:0/2464845186 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70013bb0 con 0x7f5b800d0980 2023-07-12T02:03:34.989 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.982+0000 7f5b849ff700 1 -- 172.21.15.37:0/2464845186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b801e5b70 con 0x7f5b800d0980 2023-07-12T02:03:34.989 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.982+0000 7f5b849ff700 1 -- 172.21.15.37:0/2464845186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b801e4fc0 con 0x7f5b800d0980 2023-07-12T02:03:34.989 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.982+0000 7f5b76ffd700 1 -- 172.21.15.37:0/2464845186 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5b70005d20 con 0x7f5b800d0980 2023-07-12T02:03:34.989 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.983+0000 7f5b76ffd700 1 -- 172.21.15.37:0/2464845186 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5b700067f0 con 0x7f5b800d0980 2023-07-12T02:03:34.990 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.983+0000 7f5b849ff700 1 -- 172.21.15.37:0/2464845186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b80067920 con 0x7f5b800d0980 2023-07-12T02:03:34.990 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:34.986+0000 7f5b76ffd700 1 -- 172.21.15.37:0/2464845186 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f5b70021060 con 0x7f5b800d0980 2023-07-12T02:03:35.063 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:35.060+0000 7f5b849ff700 1 -- 172.21.15.37:0/2464845186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b80073970 con 0x7f5b800d0980 2023-07-12T02:03:35.064 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:35.061+0000 7f5b76ffd700 1 -- 172.21.15.37:0/2464845186 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5b70029020 con 0x7f5b800d0980 2023-07-12T02:03:35.064 INFO:teuthology.misc.health.smithi037.stdout: 2023-07-12T02:03:35.065 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":10,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:03:33.536148+0000","last_up_change":"0.000000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:03:35.065 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:35.062+0000 7f5b849ff700 1 -- 172.21.15.37:0/2464845186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b800d0980 msgr2=0x7f5b8015a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:35.065 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:35.062+0000 7f5b849ff700 1 --2- 172.21.15.37:0/2464845186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b800d0980 0x7f5b8015a420 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000e850 tx=0x7f5b7000eb60 comp rx=0 tx=0).stop 2023-07-12T02:03:35.066 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:35.062+0000 7f5b849ff700 1 -- 172.21.15.37:0/2464845186 shutdown_connections 2023-07-12T02:03:35.066 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:35.062+0000 7f5b849ff700 1 --2- 172.21.15.37:0/2464845186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b800d0980 0x7f5b8015a420 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:35.066 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:35.062+0000 7f5b849ff700 1 --2- 172.21.15.37:0/2464845186 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b800d3200 0x7f5b8015ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:35.066 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:35.062+0000 7f5b849ff700 1 --2- 172.21.15.37:0/2464845186 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5b800d1290 0x7f5b801e4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:35.066 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:35.062+0000 7f5b849ff700 1 -- 172.21.15.37:0/2464845186 >> 172.21.15.37:0/2464845186 conn(0x7f5b8006b3f0 msgr2=0x7f5b800d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:35.066 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:35.062+0000 7f5b849ff700 1 -- 172.21.15.37:0/2464845186 shutdown_connections 2023-07-12T02:03:35.066 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:35.062+0000 7f5b849ff700 1 -- 172.21.15.37:0/2464845186 wait complete. 2023-07-12T02:03:35.080 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-12T02:03:35.478 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:35.475+0000 7f09a6e47200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-12T02:03:35.558 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:35.555+0000 7fa8cbdaa200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-12T02:03:35.863 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:35.860+0000 7f09a6e47200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-12T02:03:35.947 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:35.943+0000 7fa8cbdaa200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-12T02:03:36.045 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:36.042+0000 7f09a6e47200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-12T02:03:36.133 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:36.129+0000 7fa8cbdaa200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-12T02:03:36.486 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:36.483+0000 7f09a6e47200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-12T02:03:36.591 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:36.588+0000 7fa8cbdaa200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-12T02:03:36.672 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:36.669+0000 7f09a6e47200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-12T02:03:36.783 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:36.780+0000 7fa8cbdaa200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-12T02:03:36.882 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:36.879+0000 7f09a6e47200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-12T02:03:37.003 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:37.000+0000 7fa8cbdaa200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-12T02:03:37.328 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:37.325+0000 7f09a6e47200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-12T02:03:37.479 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-12T02:03:37.476+0000 7fa8cbdaa200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-12T02:03:37.797 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-12T02:03:37.794+0000 7fd361973640 -1 osd.0 0 log_to_monitors true 2023-07-12T02:03:37.856 INFO:tasks.ceph.osd.6.smithi196.stderr:2023-07-12T02:03:37.853+0000 7f220a800640 -1 osd.6 0 log_to_monitors true 2023-07-12T02:03:37.882 INFO:tasks.ceph.osd.7.smithi196.stderr:2023-07-12T02:03:37.879+0000 7f4652e3f640 -1 osd.7 0 log_to_monitors true 2023-07-12T02:03:37.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-12T02:03:37.880+0000 7f5d8843e640 -1 osd.1 0 log_to_monitors true 2023-07-12T02:03:37.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-12T02:03:37.911+0000 7f1c0c5a5640 -1 osd.2 0 log_to_monitors true 2023-07-12T02:03:38.069 INFO:tasks.ceph.osd.5.smithi196.stderr:2023-07-12T02:03:38.066+0000 7f4d33f7d640 -1 osd.5 0 log_to_monitors true 2023-07-12T02:03:38.126 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-07-12T02:03:38.123+0000 7f4a8ed2f640 -1 osd.3 0 log_to_monitors true 2023-07-12T02:03:38.138 INFO:tasks.ceph.osd.4.smithi196.stderr:2023-07-12T02:03:38.135+0000 7f0bbccb5640 -1 osd.4 0 log_to_monitors true 2023-07-12T02:03:38.348 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:38.345+0000 7f09609fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-12T02:03:38.351 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-07-12T02:03:38.348+0000 7f09609fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-12T02:03:39.148 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:03:39.154 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:03:41.373 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-07-12T02:03:41.369+0000 7f4a7dbf7700 -1 osd.3 0 waiting for initial osdmap 2023-07-12T02:03:41.375 INFO:tasks.ceph.osd.4.smithi196.stderr:2023-07-12T02:03:41.370+0000 7f0babbf7700 -1 osd.4 0 waiting for initial osdmap 2023-07-12T02:03:41.389 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-07-12T02:03:41.386+0000 7f4a753fa700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-12T02:03:41.416 INFO:tasks.ceph.osd.4.smithi196.stderr:2023-07-12T02:03:41.413+0000 7f0ba33fa700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-12T02:03:41.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-12T02:03:41.433+0000 7f5d773f7700 -1 osd.1 0 waiting for initial osdmap 2023-07-12T02:03:41.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-12T02:03:41.464+0000 7f5d6ebfa700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-12T02:03:41.562 INFO:tasks.ceph.osd.6.smithi196.stderr:2023-07-12T02:03:41.559+0000 7f21f95f7700 -1 osd.6 0 waiting for initial osdmap 2023-07-12T02:03:41.569 INFO:tasks.ceph.osd.5.smithi196.stderr:2023-07-12T02:03:41.566+0000 7f4d22df7700 -1 osd.5 0 waiting for initial osdmap 2023-07-12T02:03:41.576 INFO:tasks.ceph.osd.6.smithi196.stderr:2023-07-12T02:03:41.573+0000 7f21f0dfa700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-12T02:03:41.576 INFO:tasks.ceph.osd.7.smithi196.stderr:2023-07-12T02:03:41.574+0000 7f4641df7700 -1 osd.7 0 waiting for initial osdmap 2023-07-12T02:03:41.587 INFO:tasks.ceph.osd.5.smithi196.stderr:2023-07-12T02:03:41.584+0000 7f4d1a5fa700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-12T02:03:41.590 INFO:tasks.ceph.osd.7.smithi196.stderr:2023-07-12T02:03:41.587+0000 7f46395fa700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-12T02:03:41.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-12T02:03:41.657+0000 7f1bfbbf8700 -1 osd.2 0 waiting for initial osdmap 2023-07-12T02:03:41.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-12T02:03:41.685+0000 7f1bf2bfa700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-12T02:03:41.772 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-12T02:03:41.768+0000 7fd350ff8700 -1 osd.0 0 waiting for initial osdmap 2023-07-12T02:03:41.787 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-12T02:03:41.784+0000 7fd347ffa700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-12T02:03:41.886 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-12T02:03:42.062 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.059+0000 7f0944fff700 1 Processor -- start 2023-07-12T02:03:42.063 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.059+0000 7f0944fff700 1 -- start start 2023-07-12T02:03:42.064 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.060+0000 7f0944fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f09400b0cf0 0x7f09401581d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:42.064 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.060+0000 7f0944fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094015c3d0 con 0x7f09400b10c0 2023-07-12T02:03:42.064 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.060+0000 7f0944fff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094015c670 con 0x7f09400cba10 2023-07-12T02:03:42.064 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.060+0000 7f0944fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094015d010 con 0x7f09400b0cf0 2023-07-12T02:03:42.064 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.061+0000 7f093e59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f09400b0cf0 0x7f09401581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:42.065 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.061+0000 7f093e59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f09400b0cf0 0x7f09401581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39188/0 (socket says 172.21.15.37:39188) 2023-07-12T02:03:42.065 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.061+0000 7f093e59c700 1 -- 172.21.15.37:0/270440303 learned_addr learned my addr 172.21.15.37:0/270440303 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:42.066 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.061+0000 7f093e59c700 1 -- 172.21.15.37:0/270440303 >> v1:172.21.15.196:6789/0 conn(0x7f09400cba10 legacy=0x7f09400af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:42.066 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.061+0000 7f093e59c700 1 -- 172.21.15.37:0/270440303 >> v1:172.21.15.37:6789/0 conn(0x7f09400b10c0 legacy=0x7f09400cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:42.066 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.061+0000 7f093e59c700 1 -- 172.21.15.37:0/270440303 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094015c950 con 0x7f09400b0cf0 2023-07-12T02:03:42.066 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.061+0000 7f093e59c700 1 --2- 172.21.15.37:0/270440303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09400b0cf0 0x7f09401581d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f09300098f0 tx=0x7f0930009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba5b46a693b638b server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:42.066 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.061+0000 7f093d59a700 1 -- 172.21.15.37:0/270440303 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093000b8a0 con 0x7f09400b0cf0 2023-07-12T02:03:42.066 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.062+0000 7f093d59a700 1 -- 172.21.15.37:0/270440303 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093000ba00 con 0x7f09400b0cf0 2023-07-12T02:03:42.067 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.062+0000 7f093d59a700 1 -- 172.21.15.37:0/270440303 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093000bd90 con 0x7f09400b0cf0 2023-07-12T02:03:42.067 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.062+0000 7f0944fff700 1 -- 172.21.15.37:0/270440303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09400b0cf0 msgr2=0x7f09401581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:42.067 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.062+0000 7f0944fff700 1 --2- 172.21.15.37:0/270440303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09400b0cf0 0x7f09401581d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f09300098f0 tx=0x7f0930009c00 comp rx=0 tx=0).stop 2023-07-12T02:03:42.067 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.062+0000 7f0944fff700 1 -- 172.21.15.37:0/270440303 shutdown_connections 2023-07-12T02:03:42.067 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.062+0000 7f0944fff700 1 --2- 172.21.15.37:0/270440303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09400b0cf0 0x7f09401581d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:42.067 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.062+0000 7f0944fff700 1 -- 172.21.15.37:0/270440303 >> 172.21.15.37:0/270440303 conn(0x7f0940069f30 msgr2=0x7f094006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:42.067 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.062+0000 7f0944fff700 1 -- 172.21.15.37:0/270440303 shutdown_connections 2023-07-12T02:03:42.067 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.062+0000 7f0944fff700 1 -- 172.21.15.37:0/270440303 wait complete. 2023-07-12T02:03:42.068 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.064+0000 7f0944fff700 1 Processor -- start 2023-07-12T02:03:42.068 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.064+0000 7f0944fff700 1 -- start start 2023-07-12T02:03:42.069 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.065+0000 7f0944fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09400b0cf0 0x7f09400c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:42.070 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.065+0000 7f0944fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09400b10c0 0x7f0940144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:42.070 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.065+0000 7f0944fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09400cba10 0x7f0940144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:42.070 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.065+0000 7f0944fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0940145580 con 0x7f09400cba10 2023-07-12T02:03:42.070 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.065+0000 7f0944fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0940145860 con 0x7f09400b10c0 2023-07-12T02:03:42.070 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.065+0000 7f0944fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0940145b40 con 0x7f09400b0cf0 2023-07-12T02:03:42.070 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.065+0000 7f093ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09400cba10 0x7f0940144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:42.070 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.065+0000 7f093ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09400cba10 0x7f0940144f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39192/0 (socket says 172.21.15.37:39192) 2023-07-12T02:03:42.071 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.066+0000 7f093ed9d700 1 -- 172.21.15.37:0/967191832 learned_addr learned my addr 172.21.15.37:0/967191832 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:42.071 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.066+0000 7f093e59c700 1 --2- 172.21.15.37:0/967191832 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09400b0cf0 0x7f09400c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:42.071 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.066+0000 7f093dd9b700 1 --2- 172.21.15.37:0/967191832 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09400b10c0 0x7f0940144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:42.071 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.066+0000 7f093ed9d700 1 -- 172.21.15.37:0/967191832 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09400b0cf0 msgr2=0x7f09400c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:42.071 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.066+0000 7f093ed9d700 1 --2- 172.21.15.37:0/967191832 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09400b0cf0 0x7f09400c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:42.071 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.066+0000 7f093ed9d700 1 -- 172.21.15.37:0/967191832 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09400b10c0 msgr2=0x7f0940144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:42.071 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.066+0000 7f093ed9d700 1 --2- 172.21.15.37:0/967191832 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09400b10c0 0x7f0940144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:42.072 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.066+0000 7f093ed9d700 1 -- 172.21.15.37:0/967191832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0930009550 con 0x7f09400cba10 2023-07-12T02:03:42.072 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.066+0000 7f093ed9d700 1 --2- 172.21.15.37:0/967191832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09400cba10 0x7f0940144f50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f093800cb50 tx=0x7f093800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:42.073 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.066+0000 7f092effd700 1 -- 172.21.15.37:0/967191832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938003c00 con 0x7f09400cba10 2023-07-12T02:03:42.073 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.066+0000 7f092effd700 1 -- 172.21.15.37:0/967191832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0938003d60 con 0x7f09400cba10 2023-07-12T02:03:42.073 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.066+0000 7f092effd700 1 -- 172.21.15.37:0/967191832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800aa20 con 0x7f09400cba10 2023-07-12T02:03:42.073 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.066+0000 7f0944fff700 1 -- 172.21.15.37:0/967191832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0940145e20 con 0x7f09400cba10 2023-07-12T02:03:42.073 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.067+0000 7f0944fff700 1 -- 172.21.15.37:0/967191832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0940156660 con 0x7f09400cba10 2023-07-12T02:03:42.073 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.068+0000 7f0944fff700 1 -- 172.21.15.37:0/967191832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0940146340 con 0x7f09400cba10 2023-07-12T02:03:42.073 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.069+0000 7f092effd700 1 -- 172.21.15.37:0/967191832 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f093800ab80 con 0x7f09400cba10 2023-07-12T02:03:42.074 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.069+0000 7f092effd700 1 --2- 172.21.15.37:0/967191832 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f092006ac50 0x7f092006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:42.074 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.070+0000 7f092effd700 1 -- 172.21.15.37:0/967191832 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f0938088400 con 0x7f09400cba10 2023-07-12T02:03:42.074 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.070+0000 7f093e59c700 1 --2- 172.21.15.37:0/967191832 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f092006ac50 0x7f092006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:42.074 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.071+0000 7f093e59c700 1 --2- 172.21.15.37:0/967191832 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f092006ac50 0x7f092006d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0930009c40 tx=0x7f0930008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:42.078 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.075+0000 7f092effd700 1 -- 172.21.15.37:0/967191832 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0938054480 con 0x7f09400cba10 2023-07-12T02:03:42.286 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.283+0000 7f0944fff700 1 -- 172.21.15.37:0/967191832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09401596d0 con 0x7f09400cba10 2023-07-12T02:03:42.287 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.284+0000 7f092effd700 1 -- 172.21.15.37:0/967191832 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0938057aa0 con 0x7f09400cba10 2023-07-12T02:03:42.288 INFO:teuthology.misc.health.smithi037.stdout: 2023-07-12T02:03:42.288 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":12,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:03:39.389362+0000","last_up_change":"0.000000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:03:42.290 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.286+0000 7f0944fff700 1 -- 172.21.15.37:0/967191832 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f092006ac50 msgr2=0x7f092006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:42.290 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.286+0000 7f0944fff700 1 --2- 172.21.15.37:0/967191832 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f092006ac50 0x7f092006d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0930009c40 tx=0x7f0930008030 comp rx=0 tx=0).stop 2023-07-12T02:03:42.290 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.286+0000 7f0944fff700 1 -- 172.21.15.37:0/967191832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09400cba10 msgr2=0x7f0940144f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:42.290 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.286+0000 7f0944fff700 1 --2- 172.21.15.37:0/967191832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09400cba10 0x7f0940144f50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f093800cb50 tx=0x7f093800ce60 comp rx=0 tx=0).stop 2023-07-12T02:03:42.290 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.286+0000 7f0944fff700 1 -- 172.21.15.37:0/967191832 shutdown_connections 2023-07-12T02:03:42.291 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.286+0000 7f0944fff700 1 --2- 172.21.15.37:0/967191832 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f092006ac50 0x7f092006d100 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:42.291 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.286+0000 7f0944fff700 1 --2- 172.21.15.37:0/967191832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09400cba10 0x7f0940144f50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:42.291 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.286+0000 7f0944fff700 1 --2- 172.21.15.37:0/967191832 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09400b0cf0 0x7f09400c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:42.291 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.286+0000 7f0944fff700 1 --2- 172.21.15.37:0/967191832 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09400b10c0 0x7f0940144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:42.291 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.286+0000 7f0944fff700 1 -- 172.21.15.37:0/967191832 >> 172.21.15.37:0/967191832 conn(0x7f0940069f30 msgr2=0x7f09400ca8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:42.291 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.286+0000 7f0944fff700 1 -- 172.21.15.37:0/967191832 shutdown_connections 2023-07-12T02:03:42.291 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:42.286+0000 7f0944fff700 1 -- 172.21.15.37:0/967191832 wait complete. 2023-07-12T02:03:42.305 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-12T02:03:49.110 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-12T02:03:49.297 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.293+0000 7ffaab9ff700 1 Processor -- start 2023-07-12T02:03:49.297 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.294+0000 7ffaab9ff700 1 -- start start 2023-07-12T02:03:49.299 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.295+0000 7ffaab9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffaa40d0980 0x7ffaa40cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:49.299 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.295+0000 7ffaab9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffaa40d3200 0x7ffaa40d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:49.299 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.295+0000 7ffaab9ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ffaa40d1290 0x7ffaa40b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:49.299 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.295+0000 7ffaab9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa40b4fd0 con 0x7ffaa40d3200 2023-07-12T02:03:49.299 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.295+0000 7ffaab9ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa40cd570 con 0x7ffaa40d1290 2023-07-12T02:03:49.299 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.295+0000 7ffaab9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40d2720 con 0x7ffaa40d0980 2023-07-12T02:03:49.300 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.295+0000 7ffaa8f9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffaa40d3200 0x7ffaa40d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:49.300 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.295+0000 7ffaa8f9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffaa40d3200 0x7ffaa40d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39196/0 (socket says 172.21.15.37:39196) 2023-07-12T02:03:49.300 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.295+0000 7ffaa8f9a700 1 -- 172.21.15.37:0/3145238156 learned_addr learned my addr 172.21.15.37:0/3145238156 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:49.300 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.295+0000 7ffaa9f9c700 1 --2- 172.21.15.37:0/3145238156 >> v2:172.21.15.196:3300/0 conn(0x7ffaa40d1290 0x7ffaa40b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:49.300 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.295+0000 7ffaa979b700 1 --2- 172.21.15.37:0/3145238156 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffaa40d0980 0x7ffaa40cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:49.301 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.296+0000 7ffaa8f9a700 1 -- 172.21.15.37:0/3145238156 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffaa40d0980 msgr2=0x7ffaa40cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:49.302 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.296+0000 7ffaa8f9a700 1 --2- 172.21.15.37:0/3145238156 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffaa40d0980 0x7ffaa40cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.302 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.296+0000 7ffaa8f9a700 1 -- 172.21.15.37:0/3145238156 >> v2:172.21.15.196:3300/0 conn(0x7ffaa40d1290 msgr2=0x7ffaa40b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:49.302 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.296+0000 7ffaa8f9a700 1 --2- 172.21.15.37:0/3145238156 >> v2:172.21.15.196:3300/0 conn(0x7ffaa40d1290 0x7ffaa40b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.302 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.296+0000 7ffaa8f9a700 1 -- 172.21.15.37:0/3145238156 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa40d2a00 con 0x7ffaa40d3200 2023-07-12T02:03:49.302 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.296+0000 7ffaa8f9a700 1 --2- 172.21.15.37:0/3145238156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaa40d3200 0x7ffaa40d0d50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffaa408bd50 tx=0x7ffa94009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751a1a9fb52d529d server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:49.302 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.296+0000 7ffa9bfff700 1 -- 172.21.15.37:0/3145238156 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94011830 con 0x7ffaa40d3200 2023-07-12T02:03:49.302 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.296+0000 7ffa9bfff700 1 -- 172.21.15.37:0/3145238156 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa94011990 con 0x7ffaa40d3200 2023-07-12T02:03:49.303 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.296+0000 7ffa9bfff700 1 -- 172.21.15.37:0/3145238156 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94011d20 con 0x7ffaa40d3200 2023-07-12T02:03:49.303 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.297+0000 7ffaab9ff700 1 -- 172.21.15.37:0/3145238156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaa40d3200 msgr2=0x7ffaa40d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:49.303 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.297+0000 7ffaab9ff700 1 --2- 172.21.15.37:0/3145238156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaa40d3200 0x7ffaa40d0d50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffaa408bd50 tx=0x7ffa94009bd0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.303 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.297+0000 7ffaab9ff700 1 -- 172.21.15.37:0/3145238156 shutdown_connections 2023-07-12T02:03:49.303 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.297+0000 7ffaab9ff700 1 --2- 172.21.15.37:0/3145238156 >> v2:172.21.15.196:3300/0 conn(0x7ffaa40d1290 0x7ffaa40b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.303 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.297+0000 7ffaab9ff700 1 --2- 172.21.15.37:0/3145238156 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffaa40d0980 0x7ffaa40cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.303 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.297+0000 7ffaab9ff700 1 --2- 172.21.15.37:0/3145238156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaa40d3200 0x7ffaa40d0d50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.304 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.297+0000 7ffaab9ff700 1 -- 172.21.15.37:0/3145238156 >> 172.21.15.37:0/3145238156 conn(0x7ffaa406b3f0 msgr2=0x7ffaa406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:49.304 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.297+0000 7ffaab9ff700 1 -- 172.21.15.37:0/3145238156 shutdown_connections 2023-07-12T02:03:49.304 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.297+0000 7ffaab9ff700 1 -- 172.21.15.37:0/3145238156 wait complete. 2023-07-12T02:03:49.305 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.299+0000 7ffaab9ff700 1 Processor -- start 2023-07-12T02:03:49.305 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.300+0000 7ffaab9ff700 1 -- start start 2023-07-12T02:03:49.305 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.301+0000 7ffaab9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaa40d0980 0x7ffaa415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:49.306 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.301+0000 7ffaab9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffaa40d1290 0x7ffaa40b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:49.306 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.301+0000 7ffaab9ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffaa40d3200 0x7ffaa40b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:49.306 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.301+0000 7ffaab9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa41f5ee0 con 0x7ffaa40d0980 2023-07-12T02:03:49.306 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.301+0000 7ffaab9ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa41f52d0 con 0x7ffaa40d3200 2023-07-12T02:03:49.306 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.301+0000 7ffaab9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa41f55b0 con 0x7ffaa40d1290 2023-07-12T02:03:49.306 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.301+0000 7ffaa979b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaa40d0980 0x7ffaa415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:49.306 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.301+0000 7ffaa979b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaa40d0980 0x7ffaa415aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39212/0 (socket says 172.21.15.37:39212) 2023-07-12T02:03:49.306 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.301+0000 7ffaa979b700 1 -- 172.21.15.37:0/2099543694 learned_addr learned my addr 172.21.15.37:0/2099543694 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:49.307 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.301+0000 7ffaa9f9c700 1 --2- 172.21.15.37:0/2099543694 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffaa40d3200 0x7ffaa40b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:49.307 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.301+0000 7ffaa8f9a700 1 --2- 172.21.15.37:0/2099543694 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffaa40d1290 0x7ffaa40b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:49.307 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.302+0000 7ffaa979b700 1 -- 172.21.15.37:0/2099543694 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffaa40d1290 msgr2=0x7ffaa40b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:49.307 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.302+0000 7ffaa979b700 1 --2- 172.21.15.37:0/2099543694 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffaa40d1290 0x7ffaa40b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.307 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.302+0000 7ffaa979b700 1 -- 172.21.15.37:0/2099543694 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffaa40d3200 msgr2=0x7ffaa40b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:49.307 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.302+0000 7ffaa979b700 1 --2- 172.21.15.37:0/2099543694 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffaa40d3200 0x7ffaa40b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.307 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.302+0000 7ffaa979b700 1 -- 172.21.15.37:0/2099543694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa94009550 con 0x7ffaa40d0980 2023-07-12T02:03:49.308 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.302+0000 7ffaa9f9c700 1 --2- 172.21.15.37:0/2099543694 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffaa40d3200 0x7ffaa40b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:03:49.308 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.302+0000 7ffaa979b700 1 --2- 172.21.15.37:0/2099543694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaa40d0980 0x7ffaa415aa60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000e870 tx=0x7ffaa000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:49.308 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.302+0000 7ffa99ffb700 1 -- 172.21.15.37:0/2099543694 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0009590 con 0x7ffaa40d0980 2023-07-12T02:03:49.309 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.302+0000 7ffa99ffb700 1 -- 172.21.15.37:0/2099543694 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa000ee70 con 0x7ffaa40d0980 2023-07-12T02:03:49.309 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.302+0000 7ffaab9ff700 1 -- 172.21.15.37:0/2099543694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa41f5890 con 0x7ffaa40d0980 2023-07-12T02:03:49.309 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.302+0000 7ffa99ffb700 1 -- 172.21.15.37:0/2099543694 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000ca50 con 0x7ffaa40d0980 2023-07-12T02:03:49.309 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.302+0000 7ffaab9ff700 1 -- 172.21.15.37:0/2099543694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa415afa0 con 0x7ffaa40d0980 2023-07-12T02:03:49.309 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.303+0000 7ffaab9ff700 1 -- 172.21.15.37:0/2099543694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa41f61c0 con 0x7ffaa40d0980 2023-07-12T02:03:49.309 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.304+0000 7ffa99ffb700 1 -- 172.21.15.37:0/2099543694 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffaa000cbb0 con 0x7ffaa40d0980 2023-07-12T02:03:49.310 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.305+0000 7ffa99ffb700 1 --2- 172.21.15.37:0/2099543694 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffa8806ace0 0x7ffa8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:49.310 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.306+0000 7ffa99ffb700 1 -- 172.21.15.37:0/2099543694 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffaa0088fb0 con 0x7ffaa40d0980 2023-07-12T02:03:49.310 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.306+0000 7ffaa8f9a700 1 --2- 172.21.15.37:0/2099543694 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffa8806ace0 0x7ffa8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:49.310 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.307+0000 7ffaa8f9a700 1 --2- 172.21.15.37:0/2099543694 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffa8806ace0 0x7ffa8806d190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009c10 tx=0x7ffa94008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:49.314 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.310+0000 7ffa99ffb700 1 -- 172.21.15.37:0/2099543694 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ffaa0057f90 con 0x7ffaa40d0980 2023-07-12T02:03:49.522 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.518+0000 7ffaab9ff700 1 -- 172.21.15.37:0/2099543694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaa4073970 con 0x7ffaa40d0980 2023-07-12T02:03:49.523 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.519+0000 7ffa99ffb700 1 -- 172.21.15.37:0/2099543694 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12802 (secure 0 0 0) 0x7ffaa0021020 con 0x7ffaa40d0980 2023-07-12T02:03:49.523 INFO:teuthology.misc.health.smithi037.stdout: 2023-07-12T02:03:49.523 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":16,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:03:45.578459+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:03:49.525 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.522+0000 7ffaab9ff700 1 -- 172.21.15.37:0/2099543694 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffa8806ace0 msgr2=0x7ffa8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:49.526 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.522+0000 7ffaab9ff700 1 --2- 172.21.15.37:0/2099543694 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffa8806ace0 0x7ffa8806d190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009c10 tx=0x7ffa94008030 comp rx=0 tx=0).stop 2023-07-12T02:03:49.526 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.522+0000 7ffaab9ff700 1 -- 172.21.15.37:0/2099543694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaa40d0980 msgr2=0x7ffaa415aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:49.526 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.522+0000 7ffaab9ff700 1 --2- 172.21.15.37:0/2099543694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaa40d0980 0x7ffaa415aa60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000e870 tx=0x7ffaa000ec30 comp rx=0 tx=0).stop 2023-07-12T02:03:49.526 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.522+0000 7ffaab9ff700 1 -- 172.21.15.37:0/2099543694 shutdown_connections 2023-07-12T02:03:49.526 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.522+0000 7ffaab9ff700 1 --2- 172.21.15.37:0/2099543694 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffa8806ace0 0x7ffa8806d190 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.526 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.522+0000 7ffaab9ff700 1 --2- 172.21.15.37:0/2099543694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaa40d0980 0x7ffaa415aa60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.526 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.522+0000 7ffaab9ff700 1 --2- 172.21.15.37:0/2099543694 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffaa40d3200 0x7ffaa40b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.527 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.522+0000 7ffaab9ff700 1 --2- 172.21.15.37:0/2099543694 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffaa40d1290 0x7ffaa40b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.527 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.522+0000 7ffaab9ff700 1 -- 172.21.15.37:0/2099543694 >> 172.21.15.37:0/2099543694 conn(0x7ffaa406b3f0 msgr2=0x7ffaa40b61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:49.527 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.522+0000 7ffaab9ff700 1 -- 172.21.15.37:0/2099543694 shutdown_connections 2023-07-12T02:03:49.527 INFO:teuthology.misc.health.smithi037.stderr:2023-07-12T02:03:49.522+0000 7ffaab9ff700 1 -- 172.21.15.37:0/2099543694 wait complete. 2023-07-12T02:03:49.541 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-12T02:03:49.541 INFO:tasks.ceph:Creating RBD pool 2023-07-12T02:03:49.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-12T02:03:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.733+0000 7f7acc9ff700 1 Processor -- start 2023-07-12T02:03:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.733+0000 7f7acc9ff700 1 -- start start 2023-07-12T02:03:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.735+0000 7f7acc9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ac80b8430 0x7f7ac80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.735+0000 7f7acc9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ac80d3730 0x7f7ac80cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.735+0000 7f7acc9ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac80d0b20 con 0x7f7ac80cfa90 2023-07-12T02:03:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.735+0000 7f7acc9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac80b8800 con 0x7f7ac80b8430 2023-07-12T02:03:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.735+0000 7f7acc9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80cfeb0 con 0x7f7ac80d3730 2023-07-12T02:03:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.735+0000 7f7ac659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ac80b8430 0x7f7ac80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.735+0000 7f7ac659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ac80b8430 0x7f7ac80cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39224/0 (socket says 172.21.15.37:39224) 2023-07-12T02:03:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.735+0000 7f7ac659c700 1 -- 172.21.15.37:0/2127145087 learned_addr learned my addr 172.21.15.37:0/2127145087 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.735+0000 7f7ac6d9d700 1 --1- 172.21.15.37:0/2127145087 >> v1:172.21.15.37:6789/0 conn(0x7f7ac80cfa90 0x7f7ac815feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34478/0 (socket says 172.21.15.37:34478) 2023-07-12T02:03:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.735+0000 7f7abffff700 1 --2- 172.21.15.37:0/2127145087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ac80d3730 0x7f7ac80cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.735+0000 7f7ac659c700 1 -- 172.21.15.37:0/2127145087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ac80d3730 msgr2=0x7f7ac80cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.735+0000 7f7ac659c700 1 --2- 172.21.15.37:0/2127145087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ac80d3730 0x7f7ac80cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.735+0000 7f7ac659c700 1 -- 172.21.15.37:0/2127145087 >> v1:172.21.15.37:6789/0 conn(0x7f7ac80cfa90 legacy=0x7f7ac815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.735+0000 7f7ac659c700 1 -- 172.21.15.37:0/2127145087 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac80b4ee0 con 0x7f7ac80b8430 2023-07-12T02:03:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.735+0000 7f7abffff700 1 --2- 172.21.15.37:0/2127145087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ac80d3730 0x7f7ac80cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:03:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.735+0000 7f7ac5d9b700 1 -- 172.21.15.37:0/2127145087 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952525526 0 0) 0x7f7ac80d0b20 con 0x7f7ac80cfa90 2023-07-12T02:03:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.736+0000 7f7ac659c700 1 --2- 172.21.15.37:0/2127145087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac80b8430 0x7f7ac80cd320 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80098f0 tx=0x7f7ab8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea30f512bf93114 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.736+0000 7f7ac5d9b700 1 -- 172.21.15.37:0/2127145087 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab800b8a0 con 0x7f7ac80b8430 2023-07-12T02:03:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.736+0000 7f7ac5d9b700 1 -- 172.21.15.37:0/2127145087 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab800ba00 con 0x7f7ac80b8430 2023-07-12T02:03:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.736+0000 7f7ac5d9b700 1 -- 172.21.15.37:0/2127145087 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab800bd90 con 0x7f7ac80b8430 2023-07-12T02:03:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.736+0000 7f7acc9ff700 1 -- 172.21.15.37:0/2127145087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac80b8430 msgr2=0x7f7ac80cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.736+0000 7f7acc9ff700 1 --2- 172.21.15.37:0/2127145087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac80b8430 0x7f7ac80cd320 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80098f0 tx=0x7f7ab8009c00 comp rx=0 tx=0).stop 2023-07-12T02:03:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.736+0000 7f7acc9ff700 1 -- 172.21.15.37:0/2127145087 shutdown_connections 2023-07-12T02:03:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.736+0000 7f7acc9ff700 1 --2- 172.21.15.37:0/2127145087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac80b8430 0x7f7ac80cd320 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.736+0000 7f7acc9ff700 1 --2- 172.21.15.37:0/2127145087 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ac80d3730 0x7f7ac80cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.736+0000 7f7acc9ff700 1 -- 172.21.15.37:0/2127145087 >> 172.21.15.37:0/2127145087 conn(0x7f7ac806b3f0 msgr2=0x7f7ac806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.737+0000 7f7acc9ff700 1 -- 172.21.15.37:0/2127145087 shutdown_connections 2023-07-12T02:03:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.737+0000 7f7acc9ff700 1 -- 172.21.15.37:0/2127145087 wait complete. 2023-07-12T02:03:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.738+0000 7f7acc9ff700 1 Processor -- start 2023-07-12T02:03:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.738+0000 7f7acc9ff700 1 -- start start 2023-07-12T02:03:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.739+0000 7f7acc9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ac80b8430 0x7f7ac80c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.739+0000 7f7acc9ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ac80cfa90 0x7f7ac8153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.739+0000 7f7acc9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac80d3730 0x7f7ac815d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:49.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.739+0000 7f7acc9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80c78a0 con 0x7f7ac80d3730 2023-07-12T02:03:49.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.739+0000 7f7acc9ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80c6c90 con 0x7f7ac80cfa90 2023-07-12T02:03:49.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.739+0000 7f7acc9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80c6f70 con 0x7f7ac80b8430 2023-07-12T02:03:49.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.739+0000 7f7ac6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac80d3730 0x7f7ac815d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:49.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.740+0000 7f7ac6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac80d3730 0x7f7ac815d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39228/0 (socket says 172.21.15.37:39228) 2023-07-12T02:03:49.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.740+0000 7f7ac6d9d700 1 -- 172.21.15.37:0/1087825973 learned_addr learned my addr 172.21.15.37:0/1087825973 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:49.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.740+0000 7f7abffff700 1 --2- 172.21.15.37:0/1087825973 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ac80cfa90 0x7f7ac8153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:49.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.740+0000 7f7ac659c700 1 --2- 172.21.15.37:0/1087825973 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ac80b8430 0x7f7ac80c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:49.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.740+0000 7f7ac6d9d700 1 -- 172.21.15.37:0/1087825973 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ac80b8430 msgr2=0x7f7ac80c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:49.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.740+0000 7f7ac6d9d700 1 --2- 172.21.15.37:0/1087825973 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ac80b8430 0x7f7ac80c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.740+0000 7f7ac6d9d700 1 -- 172.21.15.37:0/1087825973 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ac80cfa90 msgr2=0x7f7ac8153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:49.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.740+0000 7f7ac6d9d700 1 --2- 172.21.15.37:0/1087825973 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ac80cfa90 0x7f7ac8153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:49.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.740+0000 7f7ac6d9d700 1 -- 172.21.15.37:0/1087825973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab8009550 con 0x7f7ac80d3730 2023-07-12T02:03:49.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.740+0000 7f7abffff700 1 --2- 172.21.15.37:0/1087825973 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ac80cfa90 0x7f7ac8153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:03:49.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.740+0000 7f7ac6d9d700 1 --2- 172.21.15.37:0/1087825973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac80d3730 0x7f7ac815d4b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0002230 tx=0x7f7ac000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:49.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.740+0000 7f7abeffd700 1 -- 172.21.15.37:0/1087825973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac000ac20 con 0x7f7ac80d3730 2023-07-12T02:03:49.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.740+0000 7f7abeffd700 1 -- 172.21.15.37:0/1087825973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac000ada0 con 0x7f7ac80d3730 2023-07-12T02:03:49.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.740+0000 7f7acc9ff700 1 -- 172.21.15.37:0/1087825973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac80c7250 con 0x7f7ac80d3730 2023-07-12T02:03:49.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.741+0000 7f7abeffd700 1 -- 172.21.15.37:0/1087825973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0007310 con 0x7f7ac80d3730 2023-07-12T02:03:49.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.741+0000 7f7acc9ff700 1 -- 172.21.15.37:0/1087825973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac81540e0 con 0x7f7ac80d3730 2023-07-12T02:03:49.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.742+0000 7f7acc9ff700 1 -- 172.21.15.37:0/1087825973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac804ea60 con 0x7f7ac80d3730 2023-07-12T02:03:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.743+0000 7f7abeffd700 1 -- 172.21.15.37:0/1087825973 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ac0007470 con 0x7f7ac80d3730 2023-07-12T02:03:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.743+0000 7f7abeffd700 1 --2- 172.21.15.37:0/1087825973 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7aa806ace0 0x7f7aa806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.744+0000 7f7abeffd700 1 -- 172.21.15.37:0/1087825973 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7ac0088f90 con 0x7f7ac80d3730 2023-07-12T02:03:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.744+0000 7f7ac659c700 1 --2- 172.21.15.37:0/1087825973 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7aa806ace0 0x7f7aa806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.745+0000 7f7ac659c700 1 --2- 172.21.15.37:0/1087825973 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7aa806ace0 0x7f7aa806d190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8014040 tx=0x7f7ab8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.748+0000 7f7abeffd700 1 -- 172.21.15.37:0/1087825973 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7ac0054450 con 0x7f7ac80d3730 2023-07-12T02:03:49.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:49.957+0000 7f7acc9ff700 1 -- 172.21.15.37:0/1087825973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f7ac815b030 con 0x7f7ac80d3730 2023-07-12T02:03:50.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:50.893+0000 7f7abeffd700 1 -- 172.21.15.37:0/1087825973 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f7ac0018020 con 0x7f7ac80d3730 2023-07-12T02:03:50.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:50.897+0000 7f7acc9ff700 1 -- 172.21.15.37:0/1087825973 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7aa806ace0 msgr2=0x7f7aa806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:50.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:50.897+0000 7f7acc9ff700 1 --2- 172.21.15.37:0/1087825973 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7aa806ace0 0x7f7aa806d190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8014040 tx=0x7f7ab8008030 comp rx=0 tx=0).stop 2023-07-12T02:03:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:50.897+0000 7f7acc9ff700 1 -- 172.21.15.37:0/1087825973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac80d3730 msgr2=0x7f7ac815d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:50.897+0000 7f7acc9ff700 1 --2- 172.21.15.37:0/1087825973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac80d3730 0x7f7ac815d4b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0002230 tx=0x7f7ac000a060 comp rx=0 tx=0).stop 2023-07-12T02:03:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:50.897+0000 7f7acc9ff700 1 -- 172.21.15.37:0/1087825973 shutdown_connections 2023-07-12T02:03:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:50.898+0000 7f7acc9ff700 1 --2- 172.21.15.37:0/1087825973 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7aa806ace0 0x7f7aa806d190 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:50.898+0000 7f7acc9ff700 1 --2- 172.21.15.37:0/1087825973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac80d3730 0x7f7ac815d4b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:50.898+0000 7f7acc9ff700 1 --2- 172.21.15.37:0/1087825973 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ac80b8430 0x7f7ac80c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:50.898+0000 7f7acc9ff700 1 --2- 172.21.15.37:0/1087825973 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ac80cfa90 0x7f7ac8153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:50.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:50.898+0000 7f7acc9ff700 1 -- 172.21.15.37:0/1087825973 >> 172.21.15.37:0/1087825973 conn(0x7f7ac806b3f0 msgr2=0x7f7ac80b6500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:50.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:50.898+0000 7f7acc9ff700 1 -- 172.21.15.37:0/1087825973 shutdown_connections 2023-07-12T02:03:50.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:50.898+0000 7f7acc9ff700 1 -- 172.21.15.37:0/1087825973 wait complete. 2023-07-12T02:03:50.903 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'rbd' created 2023-07-12T02:03:50.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-12T02:03:51.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.119+0000 7f45a55ff700 1 Processor -- start 2023-07-12T02:03:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.119+0000 7f45a55ff700 1 -- start start 2023-07-12T02:03:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.120+0000 7f45a55ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f45a00b82c0 0x7f45a0160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.120+0000 7f45a55ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45a00b1f00 0x7f45a00ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.120+0000 7f45a55ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45a00cf4d0 0x7f45a00cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.120+0000 7f45a55ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a00b8690 con 0x7f45a00b1f00 2023-07-12T02:03:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.120+0000 7f45a55ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a0160db0 con 0x7f45a00b82c0 2023-07-12T02:03:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.120+0000 7f45a55ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a00cfe90 con 0x7f45a00cf4d0 2023-07-12T02:03:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.121+0000 7f459e7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45a00b1f00 0x7f45a00ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.121+0000 7f459e7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45a00b1f00 0x7f45a00ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39240/0 (socket says 172.21.15.37:39240) 2023-07-12T02:03:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.121+0000 7f459e7fc700 1 -- 172.21.15.37:0/1366332310 learned_addr learned my addr 172.21.15.37:0/1366332310 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:51.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.121+0000 7f459effd700 1 --2- 172.21.15.37:0/1366332310 >> v2:172.21.15.196:3300/0 conn(0x7f45a00b82c0 0x7f45a0160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.121+0000 7f459f7fe700 1 --2- 172.21.15.37:0/1366332310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45a00cf4d0 0x7f45a00cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.121+0000 7f459e7fc700 1 -- 172.21.15.37:0/1366332310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45a00cf4d0 msgr2=0x7f45a00cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.121+0000 7f459e7fc700 1 --2- 172.21.15.37:0/1366332310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45a00cf4d0 0x7f45a00cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.121+0000 7f459e7fc700 1 -- 172.21.15.37:0/1366332310 >> v2:172.21.15.196:3300/0 conn(0x7f45a00b82c0 msgr2=0x7f45a0160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.121+0000 7f459e7fc700 1 --2- 172.21.15.37:0/1366332310 >> v2:172.21.15.196:3300/0 conn(0x7f45a00b82c0 0x7f45a0160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.121+0000 7f459e7fc700 1 -- 172.21.15.37:0/1366332310 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a015fe20 con 0x7f45a00b1f00 2023-07-12T02:03:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.121+0000 7f459f7fe700 1 --2- 172.21.15.37:0/1366332310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45a00cf4d0 0x7f45a00cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:03:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.121+0000 7f459effd700 1 --2- 172.21.15.37:0/1366332310 >> v2:172.21.15.196:3300/0 conn(0x7f45a00b82c0 0x7f45a0160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:03:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.121+0000 7f459e7fc700 1 --2- 172.21.15.37:0/1366332310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00b1f00 0x7f45a00ceca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f45a006aaf0 tx=0x7f4594009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a23db0de775d883 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.122+0000 7f459dffb700 1 -- 172.21.15.37:0/1366332310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459400b870 con 0x7f45a00b1f00 2023-07-12T02:03:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.122+0000 7f459dffb700 1 -- 172.21.15.37:0/1366332310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459400b9d0 con 0x7f45a00b1f00 2023-07-12T02:03:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.122+0000 7f459dffb700 1 -- 172.21.15.37:0/1366332310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459400bd60 con 0x7f45a00b1f00 2023-07-12T02:03:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.122+0000 7f45a55ff700 1 -- 172.21.15.37:0/1366332310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00b1f00 msgr2=0x7f45a00ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.122+0000 7f45a55ff700 1 --2- 172.21.15.37:0/1366332310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00b1f00 0x7f45a00ceca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f45a006aaf0 tx=0x7f4594009bd0 comp rx=0 tx=0).stop 2023-07-12T02:03:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.122+0000 7f45a55ff700 1 -- 172.21.15.37:0/1366332310 shutdown_connections 2023-07-12T02:03:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.122+0000 7f45a55ff700 1 --2- 172.21.15.37:0/1366332310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45a00cf4d0 0x7f45a00cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.122+0000 7f45a55ff700 1 --2- 172.21.15.37:0/1366332310 >> v2:172.21.15.196:3300/0 conn(0x7f45a00b82c0 0x7f45a0160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.122+0000 7f45a55ff700 1 --2- 172.21.15.37:0/1366332310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00b1f00 0x7f45a00ceca0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.122+0000 7f45a55ff700 1 -- 172.21.15.37:0/1366332310 >> 172.21.15.37:0/1366332310 conn(0x7f45a0071660 msgr2=0x7f45a0071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.122+0000 7f45a55ff700 1 -- 172.21.15.37:0/1366332310 shutdown_connections 2023-07-12T02:03:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.122+0000 7f45a55ff700 1 -- 172.21.15.37:0/1366332310 wait complete. 2023-07-12T02:03:51.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.124+0000 7f45a55ff700 1 Processor -- start 2023-07-12T02:03:51.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.124+0000 7f45a55ff700 1 -- start start 2023-07-12T02:03:51.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.125+0000 7f45a55ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45a00b1f00 0x7f45a01540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:51.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.125+0000 7f45a55ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00b82c0 0x7f45a015c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:51.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.125+0000 7f45a55ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45a00cf4d0 0x7f45a0153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:51.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.125+0000 7f45a55ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a00c8660 con 0x7f45a00b82c0 2023-07-12T02:03:51.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.125+0000 7f45a55ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a015d9b0 con 0x7f45a00cf4d0 2023-07-12T02:03:51.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.125+0000 7f45a55ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a015ce60 con 0x7f45a00b1f00 2023-07-12T02:03:51.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.125+0000 7f459e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00b82c0 0x7f45a015c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:51.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.125+0000 7f459e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00b82c0 0x7f45a015c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39250/0 (socket says 172.21.15.37:39250) 2023-07-12T02:03:51.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.125+0000 7f459e7fc700 1 -- 172.21.15.37:0/3746413028 learned_addr learned my addr 172.21.15.37:0/3746413028 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:51.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.126+0000 7f459f7fe700 1 --2- 172.21.15.37:0/3746413028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45a00cf4d0 0x7f45a0153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.126+0000 7f459effd700 1 --2- 172.21.15.37:0/3746413028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45a00b1f00 0x7f45a01540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.126+0000 7f459e7fc700 1 -- 172.21.15.37:0/3746413028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45a00b1f00 msgr2=0x7f45a01540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.126+0000 7f459e7fc700 1 --2- 172.21.15.37:0/3746413028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45a00b1f00 0x7f45a01540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.126+0000 7f459e7fc700 1 -- 172.21.15.37:0/3746413028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45a00cf4d0 msgr2=0x7f45a0153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.126+0000 7f459e7fc700 1 --2- 172.21.15.37:0/3746413028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45a00cf4d0 0x7f45a0153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.126+0000 7f459e7fc700 1 -- 172.21.15.37:0/3746413028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4594009550 con 0x7f45a00b82c0 2023-07-12T02:03:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.126+0000 7f459f7fe700 1 --2- 172.21.15.37:0/3746413028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45a00cf4d0 0x7f45a0153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:03:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.126+0000 7f459effd700 1 --2- 172.21.15.37:0/3746413028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45a00b1f00 0x7f45a01540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:03:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.126+0000 7f459e7fc700 1 --2- 172.21.15.37:0/3746413028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00b82c0 0x7f45a015c920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4594014040 tx=0x7f4594004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.126+0000 7f45877fe700 1 -- 172.21.15.37:0/3746413028 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594004520 con 0x7f45a00b82c0 2023-07-12T02:03:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.126+0000 7f45877fe700 1 -- 172.21.15.37:0/3746413028 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459401e070 con 0x7f45a00b82c0 2023-07-12T02:03:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.126+0000 7f45877fe700 1 -- 172.21.15.37:0/3746413028 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45940038e0 con 0x7f45a00b82c0 2023-07-12T02:03:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.126+0000 7f45a55ff700 1 -- 172.21.15.37:0/3746413028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a015d110 con 0x7f45a00b82c0 2023-07-12T02:03:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.127+0000 7f45a55ff700 1 -- 172.21.15.37:0/3746413028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a015d6d0 con 0x7f45a00b82c0 2023-07-12T02:03:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.127+0000 7f45a55ff700 1 -- 172.21.15.37:0/3746413028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a00c83c0 con 0x7f45a00b82c0 2023-07-12T02:03:51.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.129+0000 7f45877fe700 1 -- 172.21.15.37:0/3746413028 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4594003a40 con 0x7f45a00b82c0 2023-07-12T02:03:51.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.130+0000 7f45877fe700 1 --2- 172.21.15.37:0/3746413028 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f458c06ace0 0x7f458c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:51.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.130+0000 7f45877fe700 1 -- 172.21.15.37:0/3746413028 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f4594020070 con 0x7f45a00b82c0 2023-07-12T02:03:51.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.130+0000 7f459effd700 1 --2- 172.21.15.37:0/3746413028 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f458c06ace0 0x7f458c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.131+0000 7f459effd700 1 --2- 172.21.15.37:0/3746413028 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f458c06ace0 0x7f458c06d190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4590006fd0 tx=0x7f4590008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:51.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.135+0000 7f45877fe700 1 -- 172.21.15.37:0/3746413028 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f45a00c83c0 con 0x7f45a00b82c0 2023-07-12T02:03:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.343+0000 7f45a55ff700 1 -- 172.21.15.37:0/3746413028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f45a00c87a0 con 0x7f45a00b82c0 2023-07-12T02:03:51.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.899+0000 7f45877fe700 1 -- 172.21.15.37:0/3746413028 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f45a00c87a0 con 0x7f45a00b82c0 2023-07-12T02:03:51.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.903+0000 7f45a55ff700 1 -- 172.21.15.37:0/3746413028 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f458c06ace0 msgr2=0x7f458c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:51.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.903+0000 7f45a55ff700 1 --2- 172.21.15.37:0/3746413028 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f458c06ace0 0x7f458c06d190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4590006fd0 tx=0x7f4590008040 comp rx=0 tx=0).stop 2023-07-12T02:03:51.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.903+0000 7f45a55ff700 1 -- 172.21.15.37:0/3746413028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00b82c0 msgr2=0x7f45a015c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:51.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.903+0000 7f45a55ff700 1 --2- 172.21.15.37:0/3746413028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00b82c0 0x7f45a015c920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4594014040 tx=0x7f4594004750 comp rx=0 tx=0).stop 2023-07-12T02:03:51.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.903+0000 7f45a55ff700 1 -- 172.21.15.37:0/3746413028 shutdown_connections 2023-07-12T02:03:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.903+0000 7f45a55ff700 1 --2- 172.21.15.37:0/3746413028 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f458c06ace0 0x7f458c06d190 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.903+0000 7f45a55ff700 1 --2- 172.21.15.37:0/3746413028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45a00cf4d0 0x7f45a0153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.903+0000 7f45a55ff700 1 --2- 172.21.15.37:0/3746413028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45a00b1f00 0x7f45a01540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.903+0000 7f45a55ff700 1 --2- 172.21.15.37:0/3746413028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a00b82c0 0x7f45a015c920 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.903+0000 7f45a55ff700 1 -- 172.21.15.37:0/3746413028 >> 172.21.15.37:0/3746413028 conn(0x7f45a0071660 msgr2=0x7f45a00b7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.904+0000 7f45a55ff700 1 -- 172.21.15.37:0/3746413028 shutdown_connections 2023-07-12T02:03:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:51.904+0000 7f45a55ff700 1 -- 172.21.15.37:0/3746413028 wait complete. 2023-07-12T02:03:51.910 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-12T02:03:51.929 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-12T02:03:51.929 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-12T02:03:51.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-12T02:03:51.933 INFO:tasks.ceph.mds.a:Started 2023-07-12T02:03:51.934 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-12T02:03:51.934 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-12T02:03:51.938 INFO:tasks.ceph.mds.c:Started 2023-07-12T02:03:51.938 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-12T02:03:51.939 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-12T02:03:51.943 INFO:tasks.ceph.mds.b:Started 2023-07-12T02:03:51.943 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-12T02:03:51.944 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-12T02:03:51.947 INFO:tasks.ceph.mds.d:Started 2023-07-12T02:03:51.948 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-12T02:03:51.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:03:52.088 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-12T02:03:52.089 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-12T02:03:52.098 INFO:tasks.ceph.mds.b.smithi196.stdout:starting mds.b at 2023-07-12T02:03:52.099 INFO:tasks.ceph.mds.d.smithi196.stdout:starting mds.d at 2023-07-12T02:03:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.160+0000 7f9e407ff700 1 Processor -- start 2023-07-12T02:03:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.160+0000 7f9e407ff700 1 -- start start 2023-07-12T02:03:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.161+0000 7f9e407ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9e38157f10 0x7f9e3806a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.161+0000 7f9e407ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3815e210 con 0x7f9e38070340 2023-07-12T02:03:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.161+0000 7f9e407ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3815dee0 con 0x7f9e38070a50 2023-07-12T02:03:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.161+0000 7f9e407ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3806d900 con 0x7f9e38157f10 2023-07-12T02:03:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.162+0000 7f9e3dd9a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9e38070340 0x7f9e3815e6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48054/0 (socket says 172.21.15.37:48054) 2023-07-12T02:03:52.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.162+0000 7f9e3dd9a700 1 -- 172.21.15.37:0/716761391 learned_addr learned my addr 172.21.15.37:0/716761391 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:03:52.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.162+0000 7f9e3e59b700 1 --2- 172.21.15.37:0/716761391 >> v2:172.21.15.196:3300/0 conn(0x7f9e38157f10 0x7f9e3806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.162+0000 7f9e3d599700 1 -- 172.21.15.37:0/716761391 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355532721 0 0) 0x7f9e3815e210 con 0x7f9e38070340 2023-07-12T02:03:52.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.162+0000 7f9e3d599700 1 -- 172.21.15.37:0/716761391 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e240035b0 con 0x7f9e38070340 2023-07-12T02:03:52.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.162+0000 7f9e3d599700 1 -- 172.21.15.37:0/716761391 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630918093 0 0) 0x7f9e3815dee0 con 0x7f9e38070a50 2023-07-12T02:03:52.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.162+0000 7f9e3d599700 1 -- 172.21.15.37:0/716761391 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e3815e210 con 0x7f9e38070a50 2023-07-12T02:03:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.162+0000 7f9e3d599700 1 -- 172.21.15.37:0/716761391 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1931432180 0 0) 0x7f9e240035b0 con 0x7f9e38070340 2023-07-12T02:03:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.162+0000 7f9e3d599700 1 -- 172.21.15.37:0/716761391 >> v2:172.21.15.196:3300/0 conn(0x7f9e38157f10 msgr2=0x7f9e3806a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.162+0000 7f9e3d599700 1 --2- 172.21.15.37:0/716761391 >> v2:172.21.15.196:3300/0 conn(0x7f9e38157f10 0x7f9e3806a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.162+0000 7f9e3d599700 1 -- 172.21.15.37:0/716761391 >> v1:172.21.15.196:6789/0 conn(0x7f9e38070a50 legacy=0x7f9e38070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.162+0000 7f9e3d599700 1 -- 172.21.15.37:0/716761391 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e380c8f40 con 0x7f9e38070340 2023-07-12T02:03:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.162+0000 7f9e3d599700 1 -- 172.21.15.37:0/716761391 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7f9e280015f0 con 0x7f9e38070340 2023-07-12T02:03:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.162+0000 7f9e3d599700 1 -- 172.21.15.37:0/716761391 >> v1:172.21.15.37:6789/0 conn(0x7f9e38070340 legacy=0x7f9e3815e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.162+0000 7f9e3d599700 1 --2- 172.21.15.37:0/716761391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e24003be0 0x7f9e24003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.163+0000 7f9e3d599700 1 --2- 172.21.15.37:0/716761391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e24004850 0x7f9e24004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.163+0000 7f9e3d599700 1 --2- 172.21.15.37:0/716761391 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e240052c0 0x7f9e2400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.163+0000 7f9e3d599700 1 -- 172.21.15.37:0/716761391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3806d900 con 0x7f9e24004850 2023-07-12T02:03:52.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.163+0000 7f9e3d599700 1 -- 172.21.15.37:0/716761391 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2400c200 con 0x7f9e24003be0 2023-07-12T02:03:52.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.163+0000 7f9e3d599700 1 -- 172.21.15.37:0/716761391 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2400c3c0 con 0x7f9e240052c0 2023-07-12T02:03:52.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.163+0000 7f9e3dd9a700 1 --2- 172.21.15.37:0/716761391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e24004850 0x7f9e24004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.163+0000 7f9e3e59b700 1 --2- 172.21.15.37:0/716761391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e24003be0 0x7f9e24003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.163+0000 7f9e3ed9c700 1 --2- 172.21.15.37:0/716761391 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e240052c0 0x7f9e2400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.163+0000 7f9e3dd9a700 1 -- 172.21.15.37:0/716761391 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e240052c0 msgr2=0x7f9e2400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.163+0000 7f9e3dd9a700 1 --2- 172.21.15.37:0/716761391 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e240052c0 0x7f9e2400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.163+0000 7f9e3dd9a700 1 -- 172.21.15.37:0/716761391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e24003be0 msgr2=0x7f9e24003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.163+0000 7f9e3dd9a700 1 --2- 172.21.15.37:0/716761391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e24003be0 0x7f9e24003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.163+0000 7f9e3dd9a700 1 -- 172.21.15.37:0/716761391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e240035b0 con 0x7f9e24004850 2023-07-12T02:03:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.163+0000 7f9e3ed9c700 1 -- 172.21.15.37:0/716761391 reap_dead start 2023-07-12T02:03:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.163+0000 7f9e3dd9a700 1 --2- 172.21.15.37:0/716761391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e24004850 0x7f9e24004cc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9e28007fb0 tx=0x7f9e24005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea97eef38f5be6f server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.164+0000 7f9e3d599700 1 -- 172.21.15.37:0/716761391 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800cc50 con 0x7f9e24004850 2023-07-12T02:03:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.164+0000 7f9e3d599700 1 -- 172.21.15.37:0/716761391 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2800cdb0 con 0x7f9e24004850 2023-07-12T02:03:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.164+0000 7f9e3d599700 1 -- 172.21.15.37:0/716761391 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e28005b80 con 0x7f9e24004850 2023-07-12T02:03:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.164+0000 7f9e407ff700 1 -- 172.21.15.37:0/716761391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e24004850 msgr2=0x7f9e24004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.164+0000 7f9e407ff700 1 --2- 172.21.15.37:0/716761391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e24004850 0x7f9e24004cc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9e28007fb0 tx=0x7f9e24005880 comp rx=0 tx=0).stop 2023-07-12T02:03:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.164+0000 7f9e407ff700 1 -- 172.21.15.37:0/716761391 shutdown_connections 2023-07-12T02:03:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.164+0000 7f9e407ff700 1 --2- 172.21.15.37:0/716761391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e24004850 0x7f9e24004cc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.164+0000 7f9e407ff700 1 -- 172.21.15.37:0/716761391 >> 172.21.15.37:0/716761391 conn(0x7f9e380b0390 msgr2=0x7f9e380b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:52.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.164+0000 7f9e407ff700 1 -- 172.21.15.37:0/716761391 shutdown_connections 2023-07-12T02:03:52.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.164+0000 7f9e407ff700 1 -- 172.21.15.37:0/716761391 wait complete. 2023-07-12T02:03:52.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.166+0000 7f9e407ff700 1 Processor -- start 2023-07-12T02:03:52.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.166+0000 7f9e407ff700 1 -- start start 2023-07-12T02:03:52.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.167+0000 7f9e407ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e24004850 0x7f9e3815a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.167+0000 7f9e407ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e380af1c0 0x7f9e3814da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.167+0000 7f9e407ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e38158da0 0x7f9e380b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.167+0000 7f9e407ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38158350 con 0x7f9e380af1c0 2023-07-12T02:03:52.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.167+0000 7f9e407ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380afa10 con 0x7f9e38158da0 2023-07-12T02:03:52.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.167+0000 7f9e407ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380afcf0 con 0x7f9e24004850 2023-07-12T02:03:52.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.167+0000 7f9e3dd9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e380af1c0 0x7f9e3814da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.168+0000 7f9e3dd9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e380af1c0 0x7f9e3814da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49978/0 (socket says 172.21.15.37:49978) 2023-07-12T02:03:52.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.168+0000 7f9e3dd9a700 1 -- 172.21.15.37:0/536620208 learned_addr learned my addr 172.21.15.37:0/536620208 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:52.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.168+0000 7f9e3e59b700 1 --2- 172.21.15.37:0/536620208 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e24004850 0x7f9e3815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.168+0000 7f9e3dd9a700 1 -- 172.21.15.37:0/536620208 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e24004850 msgr2=0x7f9e3815a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.168+0000 7f9e3dd9a700 1 --2- 172.21.15.37:0/536620208 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e24004850 0x7f9e3815a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.168+0000 7f9e3dd9a700 1 -- 172.21.15.37:0/536620208 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e38158da0 msgr2=0x7f9e380b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.168+0000 7f9e3dd9a700 1 --2- 172.21.15.37:0/536620208 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e38158da0 0x7f9e380b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.168+0000 7f9e3dd9a700 1 -- 172.21.15.37:0/536620208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e381585a0 con 0x7f9e380af1c0 2023-07-12T02:03:52.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.168+0000 7f9e3dd9a700 1 --2- 172.21.15.37:0/536620208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e380af1c0 0x7f9e3814da20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400c1d0 tx=0x7f9e380717a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:52.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.168+0000 7f9e2effd700 1 -- 172.21.15.37:0/536620208 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e28001a40 con 0x7f9e380af1c0 2023-07-12T02:03:52.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.168+0000 7f9e2effd700 1 -- 172.21.15.37:0/536620208 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e28004c80 con 0x7f9e380af1c0 2023-07-12T02:03:52.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.168+0000 7f9e407ff700 1 -- 172.21.15.37:0/536620208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e38158350 con 0x7f9e380af1c0 2023-07-12T02:03:52.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.168+0000 7f9e2effd700 1 -- 172.21.15.37:0/536620208 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e280070d0 con 0x7f9e380af1c0 2023-07-12T02:03:52.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.169+0000 7f9e407ff700 1 -- 172.21.15.37:0/536620208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3814df60 con 0x7f9e380af1c0 2023-07-12T02:03:52.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.170+0000 7f9e407ff700 1 -- 172.21.15.37:0/536620208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3804ea60 con 0x7f9e380af1c0 2023-07-12T02:03:52.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.171+0000 7f9e2effd700 1 -- 172.21.15.37:0/536620208 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9e28007250 con 0x7f9e380af1c0 2023-07-12T02:03:52.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.172+0000 7f9e2effd700 1 --2- 172.21.15.37:0/536620208 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9e1c06ace0 0x7f9e1c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.172+0000 7f9e2effd700 1 -- 172.21.15.37:0/536620208 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9e28089f50 con 0x7f9e380af1c0 2023-07-12T02:03:52.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.172+0000 7f9e3e59b700 1 --2- 172.21.15.37:0/536620208 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9e1c06ace0 0x7f9e1c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.173+0000 7f9e3e59b700 1 --2- 172.21.15.37:0/536620208 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9e1c06ace0 0x7f9e1c06d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009b40 tx=0x7f9e34008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:52.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.176+0000 7f9e2effd700 1 -- 172.21.15.37:0/536620208 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9e28055340 con 0x7f9e380af1c0 2023-07-12T02:03:52.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.385+0000 7f9e407ff700 1 -- 172.21.15.37:0/536620208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e3806e590 con 0x7f9e380af1c0 2023-07-12T02:03:52.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.386+0000 7f9e2effd700 1 -- 172.21.15.37:0/536620208 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14601 (secure 0 0 0) 0x7f9e28021090 con 0x7f9e380af1c0 2023-07-12T02:03:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:03:52.390 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:03:51.893151+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:03:52.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.389+0000 7f9e407ff700 1 -- 172.21.15.37:0/536620208 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9e1c06ace0 msgr2=0x7f9e1c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.389+0000 7f9e407ff700 1 --2- 172.21.15.37:0/536620208 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9e1c06ace0 0x7f9e1c06d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009b40 tx=0x7f9e34008040 comp rx=0 tx=0).stop 2023-07-12T02:03:52.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.389+0000 7f9e407ff700 1 -- 172.21.15.37:0/536620208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e380af1c0 msgr2=0x7f9e3814da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.389+0000 7f9e407ff700 1 --2- 172.21.15.37:0/536620208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e380af1c0 0x7f9e3814da20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400c1d0 tx=0x7f9e380717a0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.389+0000 7f9e407ff700 1 -- 172.21.15.37:0/536620208 shutdown_connections 2023-07-12T02:03:52.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.389+0000 7f9e407ff700 1 --2- 172.21.15.37:0/536620208 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9e1c06ace0 0x7f9e1c06d190 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.389+0000 7f9e407ff700 1 --2- 172.21.15.37:0/536620208 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e38158da0 0x7f9e380b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.389+0000 7f9e407ff700 1 --2- 172.21.15.37:0/536620208 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e24004850 0x7f9e3815a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.389+0000 7f9e407ff700 1 --2- 172.21.15.37:0/536620208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e380af1c0 0x7f9e3814da20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.389+0000 7f9e407ff700 1 -- 172.21.15.37:0/536620208 >> 172.21.15.37:0/536620208 conn(0x7f9e380b0390 msgr2=0x7f9e380c9680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:52.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.389+0000 7f9e407ff700 1 -- 172.21.15.37:0/536620208 shutdown_connections 2023-07-12T02:03:52.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.389+0000 7f9e407ff700 1 -- 172.21.15.37:0/536620208 wait complete. 2023-07-12T02:03:52.410 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-12T02:03:52.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:03:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.610+0000 7f0d08dff700 1 Processor -- start 2023-07-12T02:03:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.610+0000 7f0d08dff700 1 -- start start 2023-07-12T02:03:52.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.611+0000 7f0d08dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0d040b8430 0x7f0d040cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.611+0000 7f0d08dff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0d040d3730 0x7f0d040cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.611+0000 7f0d08dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d040cfa90 0x7f0d0415feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.611+0000 7f0d08dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d040b8800 con 0x7f0d040b8430 2023-07-12T02:03:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.611+0000 7f0d08dff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d040d0b20 con 0x7f0d040d3730 2023-07-12T02:03:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.611+0000 7f0d08dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040cfeb0 con 0x7f0d040cfa90 2023-07-12T02:03:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.611+0000 7f0d0259c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0d040b8430 0x7f0d040cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.611+0000 7f0d0259c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0d040b8430 0x7f0d040cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49992/0 (socket says 172.21.15.37:49992) 2023-07-12T02:03:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.611+0000 7f0d0259c700 1 -- 172.21.15.37:0/4027957912 learned_addr learned my addr 172.21.15.37:0/4027957912 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.611+0000 7f0d02d9d700 1 --2- 172.21.15.37:0/4027957912 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d040cfa90 0x7f0d0415feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.611+0000 7f0d01d9b700 1 --2- 172.21.15.37:0/4027957912 >> v2:172.21.15.196:3300/0 conn(0x7f0d040d3730 0x7f0d040cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.612+0000 7f0d0259c700 1 -- 172.21.15.37:0/4027957912 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d040cfa90 msgr2=0x7f0d0415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.612+0000 7f0d0259c700 1 --2- 172.21.15.37:0/4027957912 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d040cfa90 0x7f0d0415feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.612+0000 7f0d0259c700 1 -- 172.21.15.37:0/4027957912 >> v2:172.21.15.196:3300/0 conn(0x7f0d040d3730 msgr2=0x7f0d040cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.612+0000 7f0d0259c700 1 --2- 172.21.15.37:0/4027957912 >> v2:172.21.15.196:3300/0 conn(0x7f0d040d3730 0x7f0d040cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.612+0000 7f0d0259c700 1 -- 172.21.15.37:0/4027957912 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d040b4ee0 con 0x7f0d040b8430 2023-07-12T02:03:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.612+0000 7f0d02d9d700 1 --2- 172.21.15.37:0/4027957912 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d040cfa90 0x7f0d0415feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:03:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.612+0000 7f0d0259c700 1 --2- 172.21.15.37:0/4027957912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d040b8430 0x7f0d040cd320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0d04160f50 tx=0x7f0cf4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1392b817bd92bb server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.612+0000 7f0d0159a700 1 -- 172.21.15.37:0/4027957912 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf400b870 con 0x7f0d040b8430 2023-07-12T02:03:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.612+0000 7f0d0159a700 1 -- 172.21.15.37:0/4027957912 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf400b9d0 con 0x7f0d040b8430 2023-07-12T02:03:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.612+0000 7f0d0159a700 1 -- 172.21.15.37:0/4027957912 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf400bd60 con 0x7f0d040b8430 2023-07-12T02:03:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.613+0000 7f0d08dff700 1 -- 172.21.15.37:0/4027957912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d040b8430 msgr2=0x7f0d040cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.613+0000 7f0d08dff700 1 --2- 172.21.15.37:0/4027957912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d040b8430 0x7f0d040cd320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0d04160f50 tx=0x7f0cf4009bd0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.613+0000 7f0d08dff700 1 -- 172.21.15.37:0/4027957912 shutdown_connections 2023-07-12T02:03:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.613+0000 7f0d08dff700 1 --2- 172.21.15.37:0/4027957912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d040b8430 0x7f0d040cd320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.613+0000 7f0d08dff700 1 --2- 172.21.15.37:0/4027957912 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d040cfa90 0x7f0d0415feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.613+0000 7f0d08dff700 1 --2- 172.21.15.37:0/4027957912 >> v2:172.21.15.196:3300/0 conn(0x7f0d040d3730 0x7f0d040cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.613+0000 7f0d08dff700 1 -- 172.21.15.37:0/4027957912 >> 172.21.15.37:0/4027957912 conn(0x7f0d0406b3f0 msgr2=0x7f0d0406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.613+0000 7f0d08dff700 1 -- 172.21.15.37:0/4027957912 shutdown_connections 2023-07-12T02:03:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.613+0000 7f0d08dff700 1 -- 172.21.15.37:0/4027957912 wait complete. 2023-07-12T02:03:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.615+0000 7f0d08dff700 1 Processor -- start 2023-07-12T02:03:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.615+0000 7f0d08dff700 1 -- start start 2023-07-12T02:03:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.616+0000 7f0d08dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d040b8430 0x7f0d040c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.616+0000 7f0d08dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d040cfa90 0x7f0d0414cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.616+0000 7f0d08dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d040d3730 0x7f0d040c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.616+0000 7f0d08dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0414d530 con 0x7f0d040b8430 2023-07-12T02:03:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.616+0000 7f0d08dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0415e350 con 0x7f0d040d3730 2023-07-12T02:03:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.616+0000 7f0d08dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040c93d0 con 0x7f0d040cfa90 2023-07-12T02:03:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.616+0000 7f0d0259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d040b8430 0x7f0d040c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.616+0000 7f0d0259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d040b8430 0x7f0d040c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50004/0 (socket says 172.21.15.37:50004) 2023-07-12T02:03:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.616+0000 7f0d0259c700 1 -- 172.21.15.37:0/3426430516 learned_addr learned my addr 172.21.15.37:0/3426430516 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.616+0000 7f0d0259c700 1 -- 172.21.15.37:0/3426430516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d040cfa90 msgr2=0x7f0d0414cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.616+0000 7f0d0259c700 1 --2- 172.21.15.37:0/3426430516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d040cfa90 0x7f0d0414cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.616+0000 7f0d0259c700 1 -- 172.21.15.37:0/3426430516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d040d3730 msgr2=0x7f0d040c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.616+0000 7f0d0259c700 1 --2- 172.21.15.37:0/3426430516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d040d3730 0x7f0d040c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.616+0000 7f0d0259c700 1 -- 172.21.15.37:0/3426430516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf4009550 con 0x7f0d040b8430 2023-07-12T02:03:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.617+0000 7f0d0259c700 1 --2- 172.21.15.37:0/3426430516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d040b8430 0x7f0d040c8cf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4000c00 tx=0x7f0cf4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.617+0000 7f0cf2ffd700 1 -- 172.21.15.37:0/3426430516 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4004520 con 0x7f0d040b8430 2023-07-12T02:03:52.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.617+0000 7f0cf2ffd700 1 -- 172.21.15.37:0/3426430516 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf401e070 con 0x7f0d040b8430 2023-07-12T02:03:52.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.617+0000 7f0cf2ffd700 1 -- 172.21.15.37:0/3426430516 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40038c0 con 0x7f0d040b8430 2023-07-12T02:03:52.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.617+0000 7f0d08dff700 1 -- 172.21.15.37:0/3426430516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0415e5a0 con 0x7f0d040b8430 2023-07-12T02:03:52.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.617+0000 7f0d08dff700 1 -- 172.21.15.37:0/3426430516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0415eb60 con 0x7f0d040b8430 2023-07-12T02:03:52.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.618+0000 7f0d08dff700 1 -- 172.21.15.37:0/3426430516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d04066e80 con 0x7f0d040b8430 2023-07-12T02:03:52.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.619+0000 7f0cf2ffd700 1 -- 172.21.15.37:0/3426430516 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0cf4003a20 con 0x7f0d040b8430 2023-07-12T02:03:52.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.620+0000 7f0cf2ffd700 1 --2- 172.21.15.37:0/3426430516 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0ce406ace0 0x7f0ce406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.620+0000 7f0cf2ffd700 1 -- 172.21.15.37:0/3426430516 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0cf4020070 con 0x7f0d040b8430 2023-07-12T02:03:52.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.620+0000 7f0d01d9b700 1 --2- 172.21.15.37:0/3426430516 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0ce406ace0 0x7f0ce406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.621+0000 7f0d01d9b700 1 --2- 172.21.15.37:0/3426430516 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0ce406ace0 0x7f0ce406d190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0d041f51e0 tx=0x7f0cf8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:52.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.624+0000 7f0cf2ffd700 1 -- 172.21.15.37:0/3426430516 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0cf4055af0 con 0x7f0d040b8430 2023-07-12T02:03:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.828+0000 7f0d08dff700 1 -- 172.21.15.37:0/3426430516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d0404ea60 con 0x7f0d040b8430 2023-07-12T02:03:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.828+0000 7f0cf2ffd700 1 -- 172.21.15.37:0/3426430516 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0cf4059110 con 0x7f0d040b8430 2023-07-12T02:03:52.832 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:03:52.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.831+0000 7f0d08dff700 1 -- 172.21.15.37:0/3426430516 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0ce406ace0 msgr2=0x7f0ce406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.831+0000 7f0d08dff700 1 --2- 172.21.15.37:0/3426430516 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0ce406ace0 0x7f0ce406d190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0d041f51e0 tx=0x7f0cf8008040 comp rx=0 tx=0).stop 2023-07-12T02:03:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.831+0000 7f0d08dff700 1 -- 172.21.15.37:0/3426430516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d040b8430 msgr2=0x7f0d040c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.831+0000 7f0d08dff700 1 --2- 172.21.15.37:0/3426430516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d040b8430 0x7f0d040c8cf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4000c00 tx=0x7f0cf4004750 comp rx=0 tx=0).stop 2023-07-12T02:03:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.831+0000 7f0d08dff700 1 -- 172.21.15.37:0/3426430516 shutdown_connections 2023-07-12T02:03:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.831+0000 7f0d08dff700 1 --2- 172.21.15.37:0/3426430516 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0ce406ace0 0x7f0ce406d190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.831+0000 7f0d08dff700 1 --2- 172.21.15.37:0/3426430516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d040b8430 0x7f0d040c8cf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.831+0000 7f0d08dff700 1 --2- 172.21.15.37:0/3426430516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d040d3730 0x7f0d040c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.831+0000 7f0d08dff700 1 --2- 172.21.15.37:0/3426430516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d040cfa90 0x7f0d0414cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.831+0000 7f0d08dff700 1 -- 172.21.15.37:0/3426430516 >> 172.21.15.37:0/3426430516 conn(0x7f0d0406b3f0 msgr2=0x7f0d040d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:52.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.831+0000 7f0d08dff700 1 -- 172.21.15.37:0/3426430516 shutdown_connections 2023-07-12T02:03:52.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:52.831+0000 7f0d08dff700 1 -- 172.21.15.37:0/3426430516 wait complete. 2023-07-12T02:03:52.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:03:53.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.053+0000 7f675e3ff700 1 Processor -- start 2023-07-12T02:03:53.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.053+0000 7f675e3ff700 1 -- start start 2023-07-12T02:03:53.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.054+0000 7f675e3ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f67580b8430 0x7f67580cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:53.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.054+0000 7f675e3ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67580d0b20 con 0x7f67580cfc60 2023-07-12T02:03:53.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.054+0000 7f675e3ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67580b4ee0 con 0x7f67580d3730 2023-07-12T02:03:53.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.054+0000 7f675e3ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67580b8800 con 0x7f67580b8430 2023-07-12T02:03:53.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.055+0000 7f675c99c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f67580cfc60 0x7f67580d0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48068/0 (socket says 172.21.15.37:48068) 2023-07-12T02:03:53.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.055+0000 7f675c99c700 1 -- 172.21.15.37:0/3973714610 learned_addr learned my addr 172.21.15.37:0/3973714610 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:03:53.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.055+0000 7f6757fff700 1 --2- 172.21.15.37:0/3973714610 >> v2:172.21.15.196:3300/0 conn(0x7f67580b8430 0x7f67580cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:53.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.055+0000 7f6756ffd700 1 -- 172.21.15.37:0/3973714610 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405015499 0 0) 0x7f67580d0b20 con 0x7f67580cfc60 2023-07-12T02:03:53.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.055+0000 7f6756ffd700 1 -- 172.21.15.37:0/3973714610 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67400035b0 con 0x7f67580cfc60 2023-07-12T02:03:53.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.055+0000 7f6756ffd700 1 -- 172.21.15.37:0/3973714610 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337792416 0 0) 0x7f67580b4ee0 con 0x7f67580d3730 2023-07-12T02:03:53.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.055+0000 7f6756ffd700 1 -- 172.21.15.37:0/3973714610 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67580d0b20 con 0x7f67580d3730 2023-07-12T02:03:53.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.055+0000 7f6756ffd700 1 -- 172.21.15.37:0/3973714610 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1142150108 0 0) 0x7f67400035b0 con 0x7f67580cfc60 2023-07-12T02:03:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.055+0000 7f6757fff700 1 -- 172.21.15.37:0/3973714610 >> v1:172.21.15.196:6789/0 conn(0x7f67580d3730 legacy=0x7f67580cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.055+0000 7f6757fff700 1 -- 172.21.15.37:0/3973714610 >> v1:172.21.15.37:6789/0 conn(0x7f67580cfc60 legacy=0x7f67580d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.055+0000 7f6757fff700 1 -- 172.21.15.37:0/3973714610 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67580b51c0 con 0x7f67580b8430 2023-07-12T02:03:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.056+0000 7f6757fff700 1 --2- 172.21.15.37:0/3973714610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67580b8430 0x7f67580cd320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6748009840 tx=0x7f6748009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e587e4a6e34f167 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.056+0000 7f6756ffd700 1 -- 172.21.15.37:0/3973714610 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67500019f0 con 0x7f67580b8430 2023-07-12T02:03:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.056+0000 7f6756ffd700 1 -- 172.21.15.37:0/3973714610 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6748004030 con 0x7f67580b8430 2023-07-12T02:03:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.056+0000 7f6756ffd700 1 -- 172.21.15.37:0/3973714610 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67480043c0 con 0x7f67580b8430 2023-07-12T02:03:53.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.056+0000 7f675e3ff700 1 -- 172.21.15.37:0/3973714610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67580b8430 msgr2=0x7f67580cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.056+0000 7f675e3ff700 1 --2- 172.21.15.37:0/3973714610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67580b8430 0x7f67580cd320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6748009840 tx=0x7f6748009b50 comp rx=0 tx=0).stop 2023-07-12T02:03:53.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.057+0000 7f675e3ff700 1 -- 172.21.15.37:0/3973714610 shutdown_connections 2023-07-12T02:03:53.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.057+0000 7f675e3ff700 1 --2- 172.21.15.37:0/3973714610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67580b8430 0x7f67580cd320 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.057+0000 7f675e3ff700 1 -- 172.21.15.37:0/3973714610 >> 172.21.15.37:0/3973714610 conn(0x7f675806b3f0 msgr2=0x7f675806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:53.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.057+0000 7f675e3ff700 1 -- 172.21.15.37:0/3973714610 shutdown_connections 2023-07-12T02:03:53.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.057+0000 7f675e3ff700 1 -- 172.21.15.37:0/3973714610 wait complete. 2023-07-12T02:03:53.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.058+0000 7f675e3ff700 1 Processor -- start 2023-07-12T02:03:53.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.059+0000 7f675e3ff700 1 -- start start 2023-07-12T02:03:53.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.059+0000 7f675e3ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f67580b8430 0x7f675815f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:53.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.059+0000 7f675e3ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67580cfc60 0x7f67581e9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:53.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.059+0000 7f675e3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67580d3730 0x7f67580b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:53.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.059+0000 7f675e3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67581f4e50 con 0x7f67580d3730 2023-07-12T02:03:53.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.059+0000 7f675e3ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67581f50a0 con 0x7f67580cfc60 2023-07-12T02:03:53.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.059+0000 7f675e3ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67581f5380 con 0x7f67580b8430 2023-07-12T02:03:53.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.060+0000 7f675c99c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67580d3730 0x7f67580b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:53.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.060+0000 7f675c99c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67580d3730 0x7f67580b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50018/0 (socket says 172.21.15.37:50018) 2023-07-12T02:03:53.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.060+0000 7f675c99c700 1 -- 172.21.15.37:0/2384728308 learned_addr learned my addr 172.21.15.37:0/2384728308 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:53.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.060+0000 7f6757fff700 1 --2- 172.21.15.37:0/2384728308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f67580b8430 0x7f675815f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:53.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.060+0000 7f67577fe700 1 --2- 172.21.15.37:0/2384728308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67580cfc60 0x7f67581e9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:53.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.060+0000 7f675c99c700 1 -- 172.21.15.37:0/2384728308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f67580b8430 msgr2=0x7f675815f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.060+0000 7f675c99c700 1 --2- 172.21.15.37:0/2384728308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f67580b8430 0x7f675815f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.060+0000 7f675c99c700 1 -- 172.21.15.37:0/2384728308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67580cfc60 msgr2=0x7f67581e9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.060+0000 7f675c99c700 1 --2- 172.21.15.37:0/2384728308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67580cfc60 0x7f67581e9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.060+0000 7f675c99c700 1 -- 172.21.15.37:0/2384728308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67480094a0 con 0x7f67580d3730 2023-07-12T02:03:53.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.060+0000 7f675c99c700 1 --2- 172.21.15.37:0/2384728308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67580d3730 0x7f67580b2480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f675000cc50 tx=0x7f675000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:53.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.061+0000 7f6754ff9700 1 -- 172.21.15.37:0/2384728308 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675000ab80 con 0x7f67580d3730 2023-07-12T02:03:53.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.061+0000 7f6754ff9700 1 -- 172.21.15.37:0/2384728308 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675000ace0 con 0x7f67580d3730 2023-07-12T02:03:53.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.061+0000 7f6754ff9700 1 -- 172.21.15.37:0/2384728308 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6750007310 con 0x7f67580d3730 2023-07-12T02:03:53.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.061+0000 7f675e3ff700 1 -- 172.21.15.37:0/2384728308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67581f5660 con 0x7f67580d3730 2023-07-12T02:03:53.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.061+0000 7f675e3ff700 1 -- 172.21.15.37:0/2384728308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675815f6b0 con 0x7f67580d3730 2023-07-12T02:03:53.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.062+0000 7f675e3ff700 1 -- 172.21.15.37:0/2384728308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67581f5b80 con 0x7f67580d3730 2023-07-12T02:03:53.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.063+0000 7f6754ff9700 1 -- 172.21.15.37:0/2384728308 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6750007470 con 0x7f67580d3730 2023-07-12T02:03:53.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.065+0000 7f6754ff9700 1 --2- 172.21.15.37:0/2384728308 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f674406ace0 0x7f674406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:53.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.065+0000 7f6754ff9700 1 -- 172.21.15.37:0/2384728308 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6750088d20 con 0x7f67580d3730 2023-07-12T02:03:53.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.065+0000 7f6757fff700 1 --2- 172.21.15.37:0/2384728308 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f674406ace0 0x7f674406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:53.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.066+0000 7f6757fff700 1 --2- 172.21.15.37:0/2384728308 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f674406ace0 0x7f674406d190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f67480090b0 tx=0x7f6748008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.069+0000 7f6754ff9700 1 -- 172.21.15.37:0/2384728308 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f67581f5b80 con 0x7f67580d3730 2023-07-12T02:03:53.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.277+0000 7f675e3ff700 1 -- 172.21.15.37:0/2384728308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f67581f5b80 con 0x7f67580d3730 2023-07-12T02:03:53.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.277+0000 7f6754ff9700 1 -- 172.21.15.37:0/2384728308 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f67581f5b80 con 0x7f67580d3730 2023-07-12T02:03:53.281 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:03:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.280+0000 7f675e3ff700 1 -- 172.21.15.37:0/2384728308 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f674406ace0 msgr2=0x7f674406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.280+0000 7f675e3ff700 1 --2- 172.21.15.37:0/2384728308 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f674406ace0 0x7f674406d190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f67480090b0 tx=0x7f6748008030 comp rx=0 tx=0).stop 2023-07-12T02:03:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.280+0000 7f675e3ff700 1 -- 172.21.15.37:0/2384728308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67580d3730 msgr2=0x7f67580b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.280+0000 7f675e3ff700 1 --2- 172.21.15.37:0/2384728308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67580d3730 0x7f67580b2480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f675000cc50 tx=0x7f675000cf60 comp rx=0 tx=0).stop 2023-07-12T02:03:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.280+0000 7f675e3ff700 1 -- 172.21.15.37:0/2384728308 shutdown_connections 2023-07-12T02:03:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.280+0000 7f675e3ff700 1 --2- 172.21.15.37:0/2384728308 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f674406ace0 0x7f674406d190 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.280+0000 7f675e3ff700 1 --2- 172.21.15.37:0/2384728308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67580d3730 0x7f67580b2480 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.280+0000 7f675e3ff700 1 --2- 172.21.15.37:0/2384728308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f67580b8430 0x7f675815f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.280+0000 7f675e3ff700 1 --2- 172.21.15.37:0/2384728308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67580cfc60 0x7f67581e9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.280+0000 7f675e3ff700 1 -- 172.21.15.37:0/2384728308 >> 172.21.15.37:0/2384728308 conn(0x7f675806b3f0 msgr2=0x7f67580cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:53.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.280+0000 7f675e3ff700 1 -- 172.21.15.37:0/2384728308 shutdown_connections 2023-07-12T02:03:53.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.280+0000 7f675e3ff700 1 -- 172.21.15.37:0/2384728308 wait complete. 2023-07-12T02:03:53.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:03:53.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.498+0000 7f2283fff700 1 Processor -- start 2023-07-12T02:03:53.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.498+0000 7f2283fff700 1 -- start start 2023-07-12T02:03:53.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.499+0000 7f2283fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f227c15c460 0x7f227c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:53.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.500+0000 7f2283fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f227c0cf8f0 0x7f227c15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:53.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.500+0000 7f2283fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227c0d1790 con 0x7f227c0d2640 2023-07-12T02:03:53.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.500+0000 7f2283fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c0cedd0 con 0x7f227c15c460 2023-07-12T02:03:53.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.500+0000 7f2283fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c0cd950 con 0x7f227c0cf8f0 2023-07-12T02:03:53.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.500+0000 7f2281d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f227c15c460 0x7f227c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:53.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.500+0000 7f228159a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f227c0d2640 0x7f227c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48070/0 (socket says 172.21.15.37:48070) 2023-07-12T02:03:53.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.500+0000 7f228159a700 1 -- 172.21.15.37:0/235466640 learned_addr learned my addr 172.21.15.37:0/235466640 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:03:53.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.500+0000 7f228259c700 1 --2- 172.21.15.37:0/235466640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f227c0cf8f0 0x7f227c15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:53.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.500+0000 7f2280d99700 1 -- 172.21.15.37:0/235466640 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730632162 0 0) 0x7f227c0d1790 con 0x7f227c0d2640 2023-07-12T02:03:53.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.500+0000 7f2281d9b700 1 -- 172.21.15.37:0/235466640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f227c0cf8f0 msgr2=0x7f227c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:53.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.500+0000 7f2281d9b700 1 --2- 172.21.15.37:0/235466640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f227c0cf8f0 0x7f227c15fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.500+0000 7f2281d9b700 1 -- 172.21.15.37:0/235466640 >> v1:172.21.15.37:6789/0 conn(0x7f227c0d2640 legacy=0x7f227c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.500+0000 7f2281d9b700 1 -- 172.21.15.37:0/235466640 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c0d14b0 con 0x7f227c15c460 2023-07-12T02:03:53.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.501+0000 7f2281d9b700 1 --2- 172.21.15.37:0/235466640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f227c15c460 0x7f227c0b59d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2278009840 tx=0x7f2278009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d517db394e173631 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:53.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.501+0000 7f2280d99700 1 -- 172.21.15.37:0/235466640 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278011830 con 0x7f227c15c460 2023-07-12T02:03:53.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.501+0000 7f2280d99700 1 -- 172.21.15.37:0/235466640 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2278011990 con 0x7f227c15c460 2023-07-12T02:03:53.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.501+0000 7f2280d99700 1 -- 172.21.15.37:0/235466640 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278011d20 con 0x7f227c15c460 2023-07-12T02:03:53.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.501+0000 7f2283fff700 1 -- 172.21.15.37:0/235466640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f227c15c460 msgr2=0x7f227c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.501+0000 7f2283fff700 1 --2- 172.21.15.37:0/235466640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f227c15c460 0x7f227c0b59d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2278009840 tx=0x7f2278009b50 comp rx=0 tx=0).stop 2023-07-12T02:03:53.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.501+0000 7f2283fff700 1 -- 172.21.15.37:0/235466640 shutdown_connections 2023-07-12T02:03:53.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.501+0000 7f2283fff700 1 --2- 172.21.15.37:0/235466640 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f227c0cf8f0 0x7f227c15fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.501+0000 7f2283fff700 1 --2- 172.21.15.37:0/235466640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f227c15c460 0x7f227c0b59d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.501+0000 7f2283fff700 1 -- 172.21.15.37:0/235466640 >> 172.21.15.37:0/235466640 conn(0x7f227c071660 msgr2=0x7f227c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:53.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.501+0000 7f2283fff700 1 -- 172.21.15.37:0/235466640 shutdown_connections 2023-07-12T02:03:53.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.502+0000 7f2283fff700 1 -- 172.21.15.37:0/235466640 wait complete. 2023-07-12T02:03:53.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.503+0000 7f2283fff700 1 Processor -- start 2023-07-12T02:03:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.503+0000 7f2283fff700 1 -- start start 2023-07-12T02:03:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.504+0000 7f2283fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f227c0cf8f0 0x7f227c154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.504+0000 7f2283fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f227c0d2640 0x7f227c1f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.504+0000 7f2283fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f227c15c460 0x7f227c1f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.504+0000 7f2283fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c1552c0 con 0x7f227c0d2640 2023-07-12T02:03:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.504+0000 7f2283fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c0cbc80 con 0x7f227c0cf8f0 2023-07-12T02:03:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.504+0000 7f2283fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c0c6750 con 0x7f227c15c460 2023-07-12T02:03:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.505+0000 7f228159a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f227c0d2640 0x7f227c1f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.505+0000 7f228159a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f227c0d2640 0x7f227c1f4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50040/0 (socket says 172.21.15.37:50040) 2023-07-12T02:03:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.505+0000 7f228159a700 1 -- 172.21.15.37:0/3447474244 learned_addr learned my addr 172.21.15.37:0/3447474244 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.505+0000 7f2281d9b700 1 --2- 172.21.15.37:0/3447474244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f227c0cf8f0 0x7f227c154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.505+0000 7f228259c700 1 --2- 172.21.15.37:0/3447474244 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f227c15c460 0x7f227c1f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.505+0000 7f228159a700 1 -- 172.21.15.37:0/3447474244 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f227c15c460 msgr2=0x7f227c1f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.505+0000 7f228159a700 1 --2- 172.21.15.37:0/3447474244 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f227c15c460 0x7f227c1f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.505+0000 7f228159a700 1 -- 172.21.15.37:0/3447474244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f227c0cf8f0 msgr2=0x7f227c154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.505+0000 7f228159a700 1 --2- 172.21.15.37:0/3447474244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f227c0cf8f0 0x7f227c154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.505+0000 7f228159a700 1 -- 172.21.15.37:0/3447474244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22780094a0 con 0x7f227c0d2640 2023-07-12T02:03:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.505+0000 7f228159a700 1 --2- 172.21.15.37:0/3447474244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f227c0d2640 0x7f227c1f4fa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f226c0011e0 tx=0x7f226c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.506+0000 7f22727fc700 1 -- 172.21.15.37:0/3447474244 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c004c80 con 0x7f227c0d2640 2023-07-12T02:03:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.506+0000 7f22727fc700 1 -- 172.21.15.37:0/3447474244 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c004e00 con 0x7f227c0d2640 2023-07-12T02:03:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.506+0000 7f22727fc700 1 -- 172.21.15.37:0/3447474244 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c007310 con 0x7f227c0d2640 2023-07-12T02:03:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.506+0000 7f2283fff700 1 -- 172.21.15.37:0/3447474244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c0c6a30 con 0x7f227c0d2640 2023-07-12T02:03:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.506+0000 7f2283fff700 1 -- 172.21.15.37:0/3447474244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c0cbf60 con 0x7f227c0d2640 2023-07-12T02:03:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.507+0000 7f2283fff700 1 -- 172.21.15.37:0/3447474244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c0c6f50 con 0x7f227c0d2640 2023-07-12T02:03:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.508+0000 7f22727fc700 1 -- 172.21.15.37:0/3447474244 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f226c007470 con 0x7f227c0d2640 2023-07-12T02:03:53.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.509+0000 7f22727fc700 1 --2- 172.21.15.37:0/3447474244 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f226006ace0 0x7f226006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:53.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.509+0000 7f22727fc700 1 -- 172.21.15.37:0/3447474244 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f226c088e00 con 0x7f227c0d2640 2023-07-12T02:03:53.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.509+0000 7f2281d9b700 1 --2- 172.21.15.37:0/3447474244 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f226006ace0 0x7f226006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:53.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.510+0000 7f2281d9b700 1 --2- 172.21.15.37:0/3447474244 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f226006ace0 0x7f226006d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f22780090b0 tx=0x7f2278008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:53.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.513+0000 7f22727fc700 1 -- 172.21.15.37:0/3447474244 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f227c0c6f50 con 0x7f227c0d2640 2023-07-12T02:03:53.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.764+0000 7f2283fff700 1 -- 172.21.15.37:0/3447474244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f227c0c6f50 con 0x7f227c0d2640 2023-07-12T02:03:53.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.765+0000 7f22727fc700 1 -- 172.21.15.37:0/3447474244 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f227c0c6f50 con 0x7f227c0d2640 2023-07-12T02:03:53.769 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:03:53.769 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/2496042538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":2496042538},{"type":"v1","addr":"172.21.15.196:6836","nonce":2496042538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2193116262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":2193116262},{"type":"v1","addr":"172.21.15.196:6837","nonce":2193116262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3195008737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3195008737},{"type":"v1","addr":"172.21.15.37:6834","nonce":3195008737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/4264740807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4264740807},{"type":"v1","addr":"172.21.15.37:6835","nonce":4264740807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-12T02:03:53.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.767+0000 7f2283fff700 1 -- 172.21.15.37:0/3447474244 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f226006ace0 msgr2=0x7f226006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.767+0000 7f2283fff700 1 --2- 172.21.15.37:0/3447474244 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f226006ace0 0x7f226006d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f22780090b0 tx=0x7f2278008030 comp rx=0 tx=0).stop 2023-07-12T02:03:53.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.767+0000 7f2283fff700 1 -- 172.21.15.37:0/3447474244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f227c0d2640 msgr2=0x7f227c1f4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.767+0000 7f2283fff700 1 --2- 172.21.15.37:0/3447474244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f227c0d2640 0x7f227c1f4fa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f226c0011e0 tx=0x7f226c00ca30 comp rx=0 tx=0).stop 2023-07-12T02:03:53.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.767+0000 7f2283fff700 1 -- 172.21.15.37:0/3447474244 shutdown_connections 2023-07-12T02:03:53.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.767+0000 7f2283fff700 1 --2- 172.21.15.37:0/3447474244 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f226006ace0 0x7f226006d190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.767+0000 7f2283fff700 1 --2- 172.21.15.37:0/3447474244 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f227c15c460 0x7f227c1f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.767+0000 7f2283fff700 1 --2- 172.21.15.37:0/3447474244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f227c0cf8f0 0x7f227c154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.767+0000 7f2283fff700 1 --2- 172.21.15.37:0/3447474244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f227c0d2640 0x7f227c1f4fa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.767+0000 7f2283fff700 1 -- 172.21.15.37:0/3447474244 >> 172.21.15.37:0/3447474244 conn(0x7f227c071660 msgr2=0x7f227c15c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:53.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.767+0000 7f2283fff700 1 -- 172.21.15.37:0/3447474244 shutdown_connections 2023-07-12T02:03:53.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.768+0000 7f2283fff700 1 -- 172.21.15.37:0/3447474244 wait complete. 2023-07-12T02:03:53.773 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 3 2023-07-12T02:03:53.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:03:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.986+0000 7f83257ff700 1 Processor -- start 2023-07-12T02:03:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.986+0000 7f83257ff700 1 -- start start 2023-07-12T02:03:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.987+0000 7f83257ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f83200d2640 0x7f83200b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.987+0000 7f83257ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83200cf8f0 0x7f832015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.987+0000 7f83257ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83200d1790 con 0x7f832015c460 2023-07-12T02:03:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.987+0000 7f83257ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83200cedd0 con 0x7f83200d2640 2023-07-12T02:03:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.987+0000 7f83257ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83200cd950 con 0x7f83200cf8f0 2023-07-12T02:03:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.988+0000 7f831f7fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83200cf8f0 0x7f832015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.988+0000 7f831f7fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83200cf8f0 0x7f832015fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:55850/0 (socket says 172.21.15.37:55850) 2023-07-12T02:03:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.988+0000 7f831f7fe700 1 -- 172.21.15.37:0/2442062475 learned_addr learned my addr 172.21.15.37:0/2442062475 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.988+0000 7f831effd700 1 --1- 172.21.15.37:0/2442062475 >> v1:172.21.15.196:6789/0 conn(0x7f832015c460 0x7f83200cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:54494/0 (socket says 172.21.15.37:54494) 2023-07-12T02:03:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.988+0000 7f831e7fc700 1 --2- 172.21.15.37:0/2442062475 >> v2:172.21.15.196:3300/0 conn(0x7f83200d2640 0x7f83200b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.988+0000 7f831f7fe700 1 -- 172.21.15.37:0/2442062475 >> v2:172.21.15.196:3300/0 conn(0x7f83200d2640 msgr2=0x7f83200b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.988+0000 7f831dffb700 1 -- 172.21.15.37:0/2442062475 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4179188572 0 0) 0x7f83200d1790 con 0x7f832015c460 2023-07-12T02:03:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.988+0000 7f831f7fe700 1 --2- 172.21.15.37:0/2442062475 >> v2:172.21.15.196:3300/0 conn(0x7f83200d2640 0x7f83200b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.988+0000 7f831f7fe700 1 -- 172.21.15.37:0/2442062475 >> v1:172.21.15.196:6789/0 conn(0x7f832015c460 legacy=0x7f83200cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.988+0000 7f831f7fe700 1 -- 172.21.15.37:0/2442062475 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83200d14b0 con 0x7f83200cf8f0 2023-07-12T02:03:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.988+0000 7f831f7fe700 1 --2- 172.21.15.37:0/2442062475 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83200cf8f0 0x7f832015fe20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8318009e50 tx=0x7f831800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a1e14fab16f4078 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.989+0000 7f831dffb700 1 -- 172.21.15.37:0/2442062475 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831800e070 con 0x7f83200cf8f0 2023-07-12T02:03:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.989+0000 7f831dffb700 1 -- 172.21.15.37:0/2442062475 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831800b910 con 0x7f83200cf8f0 2023-07-12T02:03:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.989+0000 7f831dffb700 1 -- 172.21.15.37:0/2442062475 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831800bcc0 con 0x7f83200cf8f0 2023-07-12T02:03:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.989+0000 7f83257ff700 1 -- 172.21.15.37:0/2442062475 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83200cf8f0 msgr2=0x7f832015fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.989+0000 7f83257ff700 1 --2- 172.21.15.37:0/2442062475 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83200cf8f0 0x7f832015fe20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8318009e50 tx=0x7f831800b330 comp rx=0 tx=0).stop 2023-07-12T02:03:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.989+0000 7f83257ff700 1 -- 172.21.15.37:0/2442062475 shutdown_connections 2023-07-12T02:03:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.989+0000 7f83257ff700 1 --2- 172.21.15.37:0/2442062475 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83200cf8f0 0x7f832015fe20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.989+0000 7f83257ff700 1 --2- 172.21.15.37:0/2442062475 >> v2:172.21.15.196:3300/0 conn(0x7f83200d2640 0x7f83200b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.989+0000 7f83257ff700 1 -- 172.21.15.37:0/2442062475 >> 172.21.15.37:0/2442062475 conn(0x7f8320071660 msgr2=0x7f8320071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.989+0000 7f83257ff700 1 -- 172.21.15.37:0/2442062475 shutdown_connections 2023-07-12T02:03:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.989+0000 7f83257ff700 1 -- 172.21.15.37:0/2442062475 wait complete. 2023-07-12T02:03:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.991+0000 7f83257ff700 1 Processor -- start 2023-07-12T02:03:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.991+0000 7f83257ff700 1 -- start start 2023-07-12T02:03:53.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.992+0000 7f83257ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83200cf8f0 0x7f83201e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:53.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.992+0000 7f83257ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83200d2640 0x7f83200ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:53.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.992+0000 7f83257ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832015c460 0x7f83200cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.992+0000 7f83257ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83201e7320 con 0x7f832015c460 2023-07-12T02:03:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.992+0000 7f83257ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83201e7600 con 0x7f83200d2640 2023-07-12T02:03:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.992+0000 7f83257ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83201e78e0 con 0x7f83200cf8f0 2023-07-12T02:03:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.992+0000 7f831f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832015c460 0x7f83200cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.992+0000 7f831f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832015c460 0x7f83200cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50044/0 (socket says 172.21.15.37:50044) 2023-07-12T02:03:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.992+0000 7f831f7fe700 1 -- 172.21.15.37:0/4243340311 learned_addr learned my addr 172.21.15.37:0/4243340311 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.992+0000 7f831effd700 1 --2- 172.21.15.37:0/4243340311 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83200cf8f0 0x7f83201e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.992+0000 7f831e7fc700 1 --2- 172.21.15.37:0/4243340311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83200d2640 0x7f83200ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.993+0000 7f831f7fe700 1 -- 172.21.15.37:0/4243340311 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83200cf8f0 msgr2=0x7f83201e6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.993+0000 7f831f7fe700 1 --2- 172.21.15.37:0/4243340311 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83200cf8f0 0x7f83201e6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.993+0000 7f831f7fe700 1 -- 172.21.15.37:0/4243340311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83200d2640 msgr2=0x7f83200ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.993+0000 7f831f7fe700 1 --2- 172.21.15.37:0/4243340311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83200d2640 0x7f83200ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.993+0000 7f831f7fe700 1 -- 172.21.15.37:0/4243340311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8318009b30 con 0x7f832015c460 2023-07-12T02:03:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.993+0000 7f831f7fe700 1 --2- 172.21.15.37:0/4243340311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832015c460 0x7f83200cbeb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f831800b680 tx=0x7f8318004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.993+0000 7f83077fe700 1 -- 172.21.15.37:0/4243340311 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83180048b0 con 0x7f832015c460 2023-07-12T02:03:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.993+0000 7f83077fe700 1 -- 172.21.15.37:0/4243340311 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83180099b0 con 0x7f832015c460 2023-07-12T02:03:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.993+0000 7f83077fe700 1 -- 172.21.15.37:0/4243340311 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831801b670 con 0x7f832015c460 2023-07-12T02:03:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.993+0000 7f83257ff700 1 -- 172.21.15.37:0/4243340311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83201e7bc0 con 0x7f832015c460 2023-07-12T02:03:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.993+0000 7f83257ff700 1 -- 172.21.15.37:0/4243340311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8320156360 con 0x7f832015c460 2023-07-12T02:03:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.994+0000 7f83257ff700 1 -- 172.21.15.37:0/4243340311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832004ea60 con 0x7f832015c460 2023-07-12T02:03:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.995+0000 7f83077fe700 1 -- 172.21.15.37:0/4243340311 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f831801b7d0 con 0x7f832015c460 2023-07-12T02:03:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.996+0000 7f83077fe700 1 --2- 172.21.15.37:0/4243340311 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f830c06ace0 0x7f830c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.996+0000 7f83077fe700 1 -- 172.21.15.37:0/4243340311 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f831808a600 con 0x7f832015c460 2023-07-12T02:03:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.997+0000 7f831effd700 1 --2- 172.21.15.37:0/4243340311 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f830c06ace0 0x7f830c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:53.997+0000 7f831effd700 1 --2- 172.21.15.37:0/4243340311 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f830c06ace0 0x7f830c06d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8310000f60 tx=0x7f8310007e70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:54.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.000+0000 7f83077fe700 1 -- 172.21.15.37:0/4243340311 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f83180559f0 con 0x7f832015c460 2023-07-12T02:03:54.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.216+0000 7f83257ff700 1 -- 172.21.15.37:0/4243340311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83200b4fa0 con 0x7f832015c460 2023-07-12T02:03:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.217+0000 7f83077fe700 1 -- 172.21.15.37:0/4243340311 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14588 (secure 0 0 0) 0x7f8318059010 con 0x7f832015c460 2023-07-12T02:03:54.220 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:03:54.221 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:03:52.898202+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:03:54.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.220+0000 7f83257ff700 1 -- 172.21.15.37:0/4243340311 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f830c06ace0 msgr2=0x7f830c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.220+0000 7f83257ff700 1 --2- 172.21.15.37:0/4243340311 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f830c06ace0 0x7f830c06d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8310000f60 tx=0x7f8310007e70 comp rx=0 tx=0).stop 2023-07-12T02:03:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.220+0000 7f83257ff700 1 -- 172.21.15.37:0/4243340311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832015c460 msgr2=0x7f83200cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.220+0000 7f83257ff700 1 --2- 172.21.15.37:0/4243340311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832015c460 0x7f83200cbeb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f831800b680 tx=0x7f8318004ad0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.220+0000 7f83257ff700 1 -- 172.21.15.37:0/4243340311 shutdown_connections 2023-07-12T02:03:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.220+0000 7f83257ff700 1 --2- 172.21.15.37:0/4243340311 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f830c06ace0 0x7f830c06d190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.220+0000 7f83257ff700 1 --2- 172.21.15.37:0/4243340311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832015c460 0x7f83200cbeb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.220+0000 7f83257ff700 1 --2- 172.21.15.37:0/4243340311 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83200cf8f0 0x7f83201e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.220+0000 7f83257ff700 1 --2- 172.21.15.37:0/4243340311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83200d2640 0x7f83200ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.220+0000 7f83257ff700 1 -- 172.21.15.37:0/4243340311 >> 172.21.15.37:0/4243340311 conn(0x7f8320071660 msgr2=0x7f8320071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.220+0000 7f83257ff700 1 -- 172.21.15.37:0/4243340311 shutdown_connections 2023-07-12T02:03:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.220+0000 7f83257ff700 1 -- 172.21.15.37:0/4243340311 wait complete. 2023-07-12T02:03:54.241 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-12T02:03:54.242 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:03:54.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.442+0000 7fed66dff700 1 Processor -- start 2023-07-12T02:03:54.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.442+0000 7fed66dff700 1 -- start start 2023-07-12T02:03:54.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.443+0000 7fed66dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6015c690 0x7fed600adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:54.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.443+0000 7fed66dff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fed600ca1f0 0x7fed600ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:54.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.443+0000 7fed66dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed600c9750 con 0x7fed600cd0a0 2023-07-12T02:03:54.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.443+0000 7fed66dff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed600cabb0 con 0x7fed600ca1f0 2023-07-12T02:03:54.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.443+0000 7fed66dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed600cf1c0 con 0x7fed6015c690 2023-07-12T02:03:54.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.444+0000 7fed5ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fed600cd0a0 0x7fed6006c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48082/0 (socket says 172.21.15.37:48082) 2023-07-12T02:03:54.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.444+0000 7fed5ffff700 1 -- 172.21.15.37:0/1135652825 learned_addr learned my addr 172.21.15.37:0/1135652825 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:03:54.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.444+0000 7fed64b9b700 1 --2- 172.21.15.37:0/1135652825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6015c690 0x7fed600adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:54.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.444+0000 7fed6539c700 1 --2- 172.21.15.37:0/1135652825 >> v2:172.21.15.196:3300/0 conn(0x7fed600ca1f0 0x7fed600ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:54.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.444+0000 7fed5f7fe700 1 -- 172.21.15.37:0/1135652825 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576918071 0 0) 0x7fed600c9750 con 0x7fed600cd0a0 2023-07-12T02:03:54.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.444+0000 7fed5f7fe700 1 -- 172.21.15.37:0/1135652825 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed500035b0 con 0x7fed600cd0a0 2023-07-12T02:03:54.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.444+0000 7fed64b9b700 1 -- 172.21.15.37:0/1135652825 >> v2:172.21.15.196:3300/0 conn(0x7fed600ca1f0 msgr2=0x7fed600ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:54.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.444+0000 7fed64b9b700 1 --2- 172.21.15.37:0/1135652825 >> v2:172.21.15.196:3300/0 conn(0x7fed600ca1f0 0x7fed600ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.444+0000 7fed64b9b700 1 -- 172.21.15.37:0/1135652825 >> v1:172.21.15.37:6789/0 conn(0x7fed600cd0a0 legacy=0x7fed6006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:54.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.444+0000 7fed64b9b700 1 -- 172.21.15.37:0/1135652825 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed600cd610 con 0x7fed6015c690 2023-07-12T02:03:54.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.445+0000 7fed64b9b700 1 --2- 172.21.15.37:0/1135652825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6015c690 0x7fed600adc60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fed54009840 tx=0x7fed54009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dc2f1e87c2498f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:54.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.445+0000 7fed5f7fe700 1 -- 172.21.15.37:0/1135652825 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54011830 con 0x7fed6015c690 2023-07-12T02:03:54.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.445+0000 7fed5f7fe700 1 -- 172.21.15.37:0/1135652825 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed54011990 con 0x7fed6015c690 2023-07-12T02:03:54.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.445+0000 7fed5f7fe700 1 -- 172.21.15.37:0/1135652825 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54011d00 con 0x7fed6015c690 2023-07-12T02:03:54.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.445+0000 7fed66dff700 1 -- 172.21.15.37:0/1135652825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6015c690 msgr2=0x7fed600adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:54.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.445+0000 7fed66dff700 1 --2- 172.21.15.37:0/1135652825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6015c690 0x7fed600adc60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fed54009840 tx=0x7fed54009b50 comp rx=0 tx=0).stop 2023-07-12T02:03:54.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.446+0000 7fed66dff700 1 -- 172.21.15.37:0/1135652825 shutdown_connections 2023-07-12T02:03:54.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.446+0000 7fed66dff700 1 --2- 172.21.15.37:0/1135652825 >> v2:172.21.15.196:3300/0 conn(0x7fed600ca1f0 0x7fed600ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.446+0000 7fed66dff700 1 --2- 172.21.15.37:0/1135652825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6015c690 0x7fed600adc60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.446+0000 7fed66dff700 1 -- 172.21.15.37:0/1135652825 >> 172.21.15.37:0/1135652825 conn(0x7fed600b0fd0 msgr2=0x7fed600ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:54.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.446+0000 7fed66dff700 1 -- 172.21.15.37:0/1135652825 shutdown_connections 2023-07-12T02:03:54.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.446+0000 7fed66dff700 1 -- 172.21.15.37:0/1135652825 wait complete. 2023-07-12T02:03:54.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.447+0000 7fed66dff700 1 Processor -- start 2023-07-12T02:03:54.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.448+0000 7fed66dff700 1 -- start start 2023-07-12T02:03:54.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.449+0000 7fed66dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed600ca1f0 0x7fed600b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:54.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.449+0000 7fed66dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed600cd0a0 0x7fed600b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:54.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.449+0000 7fed66dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed6015c690 0x7fed60149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:54.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.449+0000 7fed66dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed60165540 con 0x7fed600ca1f0 2023-07-12T02:03:54.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.449+0000 7fed66dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed60165820 con 0x7fed6015c690 2023-07-12T02:03:54.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.449+0000 7fed66dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed60165b00 con 0x7fed600cd0a0 2023-07-12T02:03:54.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.449+0000 7fed64b9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed600ca1f0 0x7fed600b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:54.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.449+0000 7fed64b9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed600ca1f0 0x7fed600b3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50058/0 (socket says 172.21.15.37:50058) 2023-07-12T02:03:54.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.449+0000 7fed64b9b700 1 -- 172.21.15.37:0/2056855717 learned_addr learned my addr 172.21.15.37:0/2056855717 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:54.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.449+0000 7fed5ffff700 1 --2- 172.21.15.37:0/2056855717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed600cd0a0 0x7fed600b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:54.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.449+0000 7fed6539c700 1 --2- 172.21.15.37:0/2056855717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed6015c690 0x7fed60149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:54.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.449+0000 7fed64b9b700 1 -- 172.21.15.37:0/2056855717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed600cd0a0 msgr2=0x7fed600b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:54.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.449+0000 7fed64b9b700 1 --2- 172.21.15.37:0/2056855717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed600cd0a0 0x7fed600b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.449+0000 7fed64b9b700 1 -- 172.21.15.37:0/2056855717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed6015c690 msgr2=0x7fed60149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.449+0000 7fed64b9b700 1 --2- 172.21.15.37:0/2056855717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed6015c690 0x7fed60149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.449+0000 7fed64b9b700 1 -- 172.21.15.37:0/2056855717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed540094a0 con 0x7fed600ca1f0 2023-07-12T02:03:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.450+0000 7fed64b9b700 1 --2- 172.21.15.37:0/2056855717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed600ca1f0 0x7fed600b3210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fed54014040 tx=0x7fed54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.450+0000 7fed5d7fa700 1 -- 172.21.15.37:0/2056855717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54004550 con 0x7fed600ca1f0 2023-07-12T02:03:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.450+0000 7fed5d7fa700 1 -- 172.21.15.37:0/2056855717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5401f070 con 0x7fed600ca1f0 2023-07-12T02:03:54.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.450+0000 7fed5d7fa700 1 -- 172.21.15.37:0/2056855717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540038a0 con 0x7fed600ca1f0 2023-07-12T02:03:54.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.450+0000 7fed66dff700 1 -- 172.21.15.37:0/2056855717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed60165de0 con 0x7fed600ca1f0 2023-07-12T02:03:54.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.450+0000 7fed66dff700 1 -- 172.21.15.37:0/2056855717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed600c3c70 con 0x7fed600ca1f0 2023-07-12T02:03:54.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.451+0000 7fed66dff700 1 -- 172.21.15.37:0/2056855717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed60066a70 con 0x7fed600ca1f0 2023-07-12T02:03:54.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.452+0000 7fed5d7fa700 1 -- 172.21.15.37:0/2056855717 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed54003a00 con 0x7fed600ca1f0 2023-07-12T02:03:54.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.453+0000 7fed5d7fa700 1 --2- 172.21.15.37:0/2056855717 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fed4406ace0 0x7fed4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:54.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.453+0000 7fed5d7fa700 1 -- 172.21.15.37:0/2056855717 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fed54021070 con 0x7fed600ca1f0 2023-07-12T02:03:54.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.454+0000 7fed5ffff700 1 --2- 172.21.15.37:0/2056855717 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fed4406ace0 0x7fed4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:54.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.454+0000 7fed5ffff700 1 --2- 172.21.15.37:0/2056855717 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fed4406ace0 0x7fed4406d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fed600b3e60 tx=0x7fed4c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:54.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.457+0000 7fed5d7fa700 1 -- 172.21.15.37:0/2056855717 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fed54055ca0 con 0x7fed600ca1f0 2023-07-12T02:03:54.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.664+0000 7fed66dff700 1 -- 172.21.15.37:0/2056855717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed60165680 con 0x7fed600ca1f0 2023-07-12T02:03:54.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.665+0000 7fed5d7fa700 1 -- 172.21.15.37:0/2056855717 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed60165680 con 0x7fed600ca1f0 2023-07-12T02:03:54.669 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:03:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.667+0000 7fed66dff700 1 -- 172.21.15.37:0/2056855717 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fed4406ace0 msgr2=0x7fed4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.667+0000 7fed66dff700 1 --2- 172.21.15.37:0/2056855717 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fed4406ace0 0x7fed4406d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fed600b3e60 tx=0x7fed4c009040 comp rx=0 tx=0).stop 2023-07-12T02:03:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.667+0000 7fed66dff700 1 -- 172.21.15.37:0/2056855717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed600ca1f0 msgr2=0x7fed600b3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.667+0000 7fed66dff700 1 --2- 172.21.15.37:0/2056855717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed600ca1f0 0x7fed600b3210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fed54014040 tx=0x7fed54004750 comp rx=0 tx=0).stop 2023-07-12T02:03:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.667+0000 7fed66dff700 1 -- 172.21.15.37:0/2056855717 shutdown_connections 2023-07-12T02:03:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.667+0000 7fed66dff700 1 --2- 172.21.15.37:0/2056855717 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fed4406ace0 0x7fed4406d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.667+0000 7fed66dff700 1 --2- 172.21.15.37:0/2056855717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed600ca1f0 0x7fed600b3210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.667+0000 7fed66dff700 1 --2- 172.21.15.37:0/2056855717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed6015c690 0x7fed60149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.667+0000 7fed66dff700 1 --2- 172.21.15.37:0/2056855717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed600cd0a0 0x7fed600b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.667+0000 7fed66dff700 1 -- 172.21.15.37:0/2056855717 >> 172.21.15.37:0/2056855717 conn(0x7fed600b0fd0 msgr2=0x7fed600aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.668+0000 7fed66dff700 1 -- 172.21.15.37:0/2056855717 shutdown_connections 2023-07-12T02:03:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.668+0000 7fed66dff700 1 -- 172.21.15.37:0/2056855717 wait complete. 2023-07-12T02:03:54.689 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:03:54.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.889+0000 7f345e5ff700 1 Processor -- start 2023-07-12T02:03:54.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.889+0000 7f345e5ff700 1 -- start start 2023-07-12T02:03:54.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.890+0000 7f345e5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34580b8430 0x7f34580cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:54.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.890+0000 7f345e5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34580d3730 0x7f34580cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:54.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.890+0000 7f345e5ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34580d0b20 con 0x7f34580cfa90 2023-07-12T02:03:54.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.890+0000 7f345e5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34580b8800 con 0x7f34580b8430 2023-07-12T02:03:54.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.890+0000 7f345e5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34580cfeb0 con 0x7f34580d3730 2023-07-12T02:03:54.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.890+0000 7f3457fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34580b8430 0x7f34580cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:54.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.890+0000 7f345cb9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f34580cfa90 0x7f345815feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48084/0 (socket says 172.21.15.37:48084) 2023-07-12T02:03:54.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.890+0000 7f345cb9c700 1 -- 172.21.15.37:0/2970602540 learned_addr learned my addr 172.21.15.37:0/2970602540 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:03:54.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.890+0000 7f34577fe700 1 --2- 172.21.15.37:0/2970602540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34580d3730 0x7f34580cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:54.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.891+0000 7f3456ffd700 1 -- 172.21.15.37:0/2970602540 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279737155 0 0) 0x7f34580d0b20 con 0x7f34580cfa90 2023-07-12T02:03:54.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.891+0000 7f3456ffd700 1 -- 172.21.15.37:0/2970602540 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34400035b0 con 0x7f34580cfa90 2023-07-12T02:03:54.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.891+0000 7f3457fff700 1 -- 172.21.15.37:0/2970602540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34580d3730 msgr2=0x7f34580cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.891+0000 7f3457fff700 1 --2- 172.21.15.37:0/2970602540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34580d3730 0x7f34580cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.891+0000 7f3457fff700 1 -- 172.21.15.37:0/2970602540 >> v1:172.21.15.37:6789/0 conn(0x7f34580cfa90 legacy=0x7f345815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.891+0000 7f3457fff700 1 -- 172.21.15.37:0/2970602540 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34580b4ee0 con 0x7f34580b8430 2023-07-12T02:03:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.891+0000 7f3457fff700 1 --2- 172.21.15.37:0/2970602540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580b8430 0x7f34580cd320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3448009840 tx=0x7f3448009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8acf20bc1dd176 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.891+0000 7f3456ffd700 1 -- 172.21.15.37:0/2970602540 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448011830 con 0x7f34580b8430 2023-07-12T02:03:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.891+0000 7f3456ffd700 1 -- 172.21.15.37:0/2970602540 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3448011990 con 0x7f34580b8430 2023-07-12T02:03:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.891+0000 7f3456ffd700 1 -- 172.21.15.37:0/2970602540 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448011d20 con 0x7f34580b8430 2023-07-12T02:03:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.892+0000 7f345e5ff700 1 -- 172.21.15.37:0/2970602540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580b8430 msgr2=0x7f34580cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.892+0000 7f345e5ff700 1 --2- 172.21.15.37:0/2970602540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580b8430 0x7f34580cd320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3448009840 tx=0x7f3448009b50 comp rx=0 tx=0).stop 2023-07-12T02:03:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.892+0000 7f345e5ff700 1 -- 172.21.15.37:0/2970602540 shutdown_connections 2023-07-12T02:03:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.892+0000 7f345e5ff700 1 --2- 172.21.15.37:0/2970602540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580b8430 0x7f34580cd320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.892+0000 7f345e5ff700 1 --2- 172.21.15.37:0/2970602540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34580d3730 0x7f34580cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.892+0000 7f345e5ff700 1 -- 172.21.15.37:0/2970602540 >> 172.21.15.37:0/2970602540 conn(0x7f345806b3f0 msgr2=0x7f345806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.892+0000 7f345e5ff700 1 -- 172.21.15.37:0/2970602540 shutdown_connections 2023-07-12T02:03:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.892+0000 7f345e5ff700 1 -- 172.21.15.37:0/2970602540 wait complete. 2023-07-12T02:03:54.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.894+0000 7f345e5ff700 1 Processor -- start 2023-07-12T02:03:54.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.894+0000 7f345e5ff700 1 -- start start 2023-07-12T02:03:54.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.895+0000 7f345e5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34580b8430 0x7f345815d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:54.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.895+0000 7f345e5ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34580cfa90 0x7f34580cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:54.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.895+0000 7f345e5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580d3730 0x7f34580c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:54.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.895+0000 7f345e5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34581f5d90 con 0x7f34580d3730 2023-07-12T02:03:54.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.895+0000 7f345e5ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34580c9480 con 0x7f34580cfa90 2023-07-12T02:03:54.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.895+0000 7f345e5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34580c6780 con 0x7f34580b8430 2023-07-12T02:03:54.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.895+0000 7f345cb9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580d3730 0x7f34580c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:54.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.895+0000 7f345cb9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580d3730 0x7f34580c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50076/0 (socket says 172.21.15.37:50076) 2023-07-12T02:03:54.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.895+0000 7f345cb9c700 1 -- 172.21.15.37:0/3852651938 learned_addr learned my addr 172.21.15.37:0/3852651938 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:54.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.895+0000 7f34577fe700 1 --2- 172.21.15.37:0/3852651938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34580cfa90 0x7f34580cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:54.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.895+0000 7f3457fff700 1 --2- 172.21.15.37:0/3852651938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34580b8430 0x7f345815d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:54.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.895+0000 7f345cb9c700 1 -- 172.21.15.37:0/3852651938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34580b8430 msgr2=0x7f345815d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:54.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.895+0000 7f345cb9c700 1 --2- 172.21.15.37:0/3852651938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34580b8430 0x7f345815d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.895+0000 7f345cb9c700 1 -- 172.21.15.37:0/3852651938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34580cfa90 msgr2=0x7f34580cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:54.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.895+0000 7f345cb9c700 1 --2- 172.21.15.37:0/3852651938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34580cfa90 0x7f34580cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:54.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.895+0000 7f345cb9c700 1 -- 172.21.15.37:0/3852651938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34480094a0 con 0x7f34580d3730 2023-07-12T02:03:54.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.896+0000 7f345cb9c700 1 --2- 172.21.15.37:0/3852651938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580d3730 0x7f34580c8f40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f345000cb70 tx=0x7f345000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:54.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.896+0000 7f3454ff9700 1 -- 172.21.15.37:0/3852651938 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345000aab0 con 0x7f34580d3730 2023-07-12T02:03:54.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.896+0000 7f3454ff9700 1 -- 172.21.15.37:0/3852651938 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345000ac10 con 0x7f34580d3730 2023-07-12T02:03:54.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.896+0000 7f3454ff9700 1 -- 172.21.15.37:0/3852651938 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3450012400 con 0x7f34580d3730 2023-07-12T02:03:54.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.896+0000 7f345e5ff700 1 -- 172.21.15.37:0/3852651938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345815d930 con 0x7f34580d3730 2023-07-12T02:03:54.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.896+0000 7f345e5ff700 1 -- 172.21.15.37:0/3852651938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345815def0 con 0x7f34580d3730 2023-07-12T02:03:54.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.897+0000 7f345e5ff700 1 -- 172.21.15.37:0/3852651938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34580c9c10 con 0x7f34580d3730 2023-07-12T02:03:54.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.898+0000 7f3454ff9700 1 -- 172.21.15.37:0/3852651938 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f345001b3b0 con 0x7f34580d3730 2023-07-12T02:03:54.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.899+0000 7f3454ff9700 1 --2- 172.21.15.37:0/3852651938 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f344406ace0 0x7f344406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:54.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.899+0000 7f3454ff9700 1 -- 172.21.15.37:0/3852651938 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3450088f70 con 0x7f34580d3730 2023-07-12T02:03:54.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.899+0000 7f3457fff700 1 --2- 172.21.15.37:0/3852651938 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f344406ace0 0x7f344406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:54.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.900+0000 7f3457fff700 1 --2- 172.21.15.37:0/3852651938 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f344406ace0 0x7f344406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3448000c00 tx=0x7f344801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:54.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:54.903+0000 7f3454ff9700 1 -- 172.21.15.37:0/3852651938 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f34500542d0 con 0x7f34580d3730 2023-07-12T02:03:55.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.110+0000 7f345e5ff700 1 -- 172.21.15.37:0/3852651938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f345804ea60 con 0x7f34580d3730 2023-07-12T02:03:55.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.110+0000 7f3454ff9700 1 -- 172.21.15.37:0/3852651938 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f34500170a0 con 0x7f34580d3730 2023-07-12T02:03:55.114 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:03:55.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.112+0000 7f345e5ff700 1 -- 172.21.15.37:0/3852651938 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f344406ace0 msgr2=0x7f344406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:55.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.112+0000 7f345e5ff700 1 --2- 172.21.15.37:0/3852651938 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f344406ace0 0x7f344406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3448000c00 tx=0x7f344801c040 comp rx=0 tx=0).stop 2023-07-12T02:03:55.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.112+0000 7f345e5ff700 1 -- 172.21.15.37:0/3852651938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580d3730 msgr2=0x7f34580c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:55.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.112+0000 7f345e5ff700 1 --2- 172.21.15.37:0/3852651938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580d3730 0x7f34580c8f40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f345000cb70 tx=0x7f345000cf30 comp rx=0 tx=0).stop 2023-07-12T02:03:55.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.112+0000 7f345e5ff700 1 -- 172.21.15.37:0/3852651938 shutdown_connections 2023-07-12T02:03:55.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.112+0000 7f345e5ff700 1 --2- 172.21.15.37:0/3852651938 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f344406ace0 0x7f344406d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.112+0000 7f345e5ff700 1 --2- 172.21.15.37:0/3852651938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580d3730 0x7f34580c8f40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.112+0000 7f345e5ff700 1 --2- 172.21.15.37:0/3852651938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34580b8430 0x7f345815d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.112+0000 7f345e5ff700 1 --2- 172.21.15.37:0/3852651938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34580cfa90 0x7f34580cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.112+0000 7f345e5ff700 1 -- 172.21.15.37:0/3852651938 >> 172.21.15.37:0/3852651938 conn(0x7f345806b3f0 msgr2=0x7f34580b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:55.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.112+0000 7f345e5ff700 1 -- 172.21.15.37:0/3852651938 shutdown_connections 2023-07-12T02:03:55.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.113+0000 7f345e5ff700 1 -- 172.21.15.37:0/3852651938 wait complete. 2023-07-12T02:03:55.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-12T02:03:55.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.330+0000 7f1cc43ff700 1 Processor -- start 2023-07-12T02:03:55.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.330+0000 7f1cc43ff700 1 -- start start 2023-07-12T02:03:55.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.331+0000 7f1cc43ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1cbc15c460 0x7f1cbc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:55.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.331+0000 7f1cc43ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1cbc0d2640 0x7f1cbc0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:55.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.331+0000 7f1cc43ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc0d1790 con 0x7f1cbc0cf720 2023-07-12T02:03:55.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.331+0000 7f1cc43ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cbc0cedd0 con 0x7f1cbc0d2640 2023-07-12T02:03:55.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.331+0000 7f1cc43ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cbc0cd950 con 0x7f1cbc15c460 2023-07-12T02:03:55.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.331+0000 7f1cc199a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1cbc0d2640 0x7f1cbc0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:55.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.331+0000 7f1cc199a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1cbc0d2640 0x7f1cbc0cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50082/0 (socket says 172.21.15.37:50082) 2023-07-12T02:03:55.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.331+0000 7f1cc199a700 1 -- 172.21.15.37:0/2162652067 learned_addr learned my addr 172.21.15.37:0/2162652067 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:55.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.331+0000 7f1cc219b700 1 --2- 172.21.15.37:0/2162652067 >> v2:172.21.15.196:3300/0 conn(0x7f1cbc15c460 0x7f1cbc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:55.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.332+0000 7f1cc199a700 1 -- 172.21.15.37:0/2162652067 >> v2:172.21.15.196:3300/0 conn(0x7f1cbc15c460 msgr2=0x7f1cbc0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:55.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.332+0000 7f1cc199a700 1 --2- 172.21.15.37:0/2162652067 >> v2:172.21.15.196:3300/0 conn(0x7f1cbc15c460 0x7f1cbc0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.332+0000 7f1cc199a700 1 -- 172.21.15.37:0/2162652067 >> v1:172.21.15.196:6789/0 conn(0x7f1cbc0cf720 legacy=0x7f1cbc0d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.332+0000 7f1cc199a700 1 -- 172.21.15.37:0/2162652067 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc0d14b0 con 0x7f1cbc0d2640 2023-07-12T02:03:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.332+0000 7f1cc199a700 1 --2- 172.21.15.37:0/2162652067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cbc0d2640 0x7f1cbc0cf1e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc0b4f00 tx=0x7f1cac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d38e644f049f9c server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.332+0000 7f1cc1199700 1 -- 172.21.15.37:0/2162652067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac004230 con 0x7f1cbc0d2640 2023-07-12T02:03:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.332+0000 7f1cc1199700 1 -- 172.21.15.37:0/2162652067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac004390 con 0x7f1cbc0d2640 2023-07-12T02:03:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.332+0000 7f1cc1199700 1 -- 172.21.15.37:0/2162652067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac0036a0 con 0x7f1cbc0d2640 2023-07-12T02:03:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.333+0000 7f1cc43ff700 1 -- 172.21.15.37:0/2162652067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cbc0d2640 msgr2=0x7f1cbc0cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.333+0000 7f1cc43ff700 1 --2- 172.21.15.37:0/2162652067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cbc0d2640 0x7f1cbc0cf1e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc0b4f00 tx=0x7f1cac009bd0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.333+0000 7f1cc43ff700 1 -- 172.21.15.37:0/2162652067 shutdown_connections 2023-07-12T02:03:55.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.333+0000 7f1cc43ff700 1 --2- 172.21.15.37:0/2162652067 >> v2:172.21.15.196:3300/0 conn(0x7f1cbc15c460 0x7f1cbc0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.333+0000 7f1cc43ff700 1 --2- 172.21.15.37:0/2162652067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cbc0d2640 0x7f1cbc0cf1e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.333+0000 7f1cc43ff700 1 -- 172.21.15.37:0/2162652067 >> 172.21.15.37:0/2162652067 conn(0x7f1cbc071660 msgr2=0x7f1cbc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:55.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.333+0000 7f1cc43ff700 1 -- 172.21.15.37:0/2162652067 shutdown_connections 2023-07-12T02:03:55.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.333+0000 7f1cc43ff700 1 -- 172.21.15.37:0/2162652067 wait complete. 2023-07-12T02:03:55.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.335+0000 7f1cc43ff700 1 Processor -- start 2023-07-12T02:03:55.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.335+0000 7f1cc43ff700 1 -- start start 2023-07-12T02:03:55.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.336+0000 7f1cc43ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cbc0cf720 0x7f1cbc150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:55.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.336+0000 7f1cc43ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cbc0d2640 0x7f1cbc0b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:55.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.336+0000 7f1cc43ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cbc15c460 0x7f1cbc0b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:55.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.336+0000 7f1cc43ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0c7e30 con 0x7f1cbc15c460 2023-07-12T02:03:55.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.336+0000 7f1cc43ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc150ec0 con 0x7f1cbc0d2640 2023-07-12T02:03:55.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.336+0000 7f1cc43ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0c71d0 con 0x7f1cbc0cf720 2023-07-12T02:03:55.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.336+0000 7f1cc219b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cbc0cf720 0x7f1cbc150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:55.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.336+0000 7f1cc299c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cbc15c460 0x7f1cbc0b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:55.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.336+0000 7f1cc219b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cbc0cf720 0x7f1cbc150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:55892/0 (socket says 172.21.15.37:55892) 2023-07-12T02:03:55.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.336+0000 7f1cc199a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cbc0d2640 0x7f1cbc0b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:55.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.336+0000 7f1cc219b700 1 -- 172.21.15.37:0/746589134 learned_addr learned my addr 172.21.15.37:0/746589134 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:55.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.337+0000 7f1cc299c700 1 -- 172.21.15.37:0/746589134 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cbc0cf720 msgr2=0x7f1cbc150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:55.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.337+0000 7f1cc299c700 1 --2- 172.21.15.37:0/746589134 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cbc0cf720 0x7f1cbc150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.337+0000 7f1cc299c700 1 -- 172.21.15.37:0/746589134 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cbc0d2640 msgr2=0x7f1cbc0b73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:55.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.337+0000 7f1cc299c700 1 --2- 172.21.15.37:0/746589134 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cbc0d2640 0x7f1cbc0b73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.337+0000 7f1cc299c700 1 -- 172.21.15.37:0/746589134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac009550 con 0x7f1cbc15c460 2023-07-12T02:03:55.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.337+0000 7f1cc299c700 1 --2- 172.21.15.37:0/746589134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cbc15c460 0x7f1cbc0b78e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400be00 tx=0x7f1cb4009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:55.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.337+0000 7f1cb2ffd700 1 -- 172.21.15.37:0/746589134 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb400cb90 con 0x7f1cbc15c460 2023-07-12T02:03:55.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.337+0000 7f1cb2ffd700 1 -- 172.21.15.37:0/746589134 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb400ccf0 con 0x7f1cbc15c460 2023-07-12T02:03:55.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.337+0000 7f1cc43ff700 1 -- 172.21.15.37:0/746589134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cbc0c7490 con 0x7f1cbc15c460 2023-07-12T02:03:55.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.337+0000 7f1cb2ffd700 1 -- 172.21.15.37:0/746589134 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4014680 con 0x7f1cbc15c460 2023-07-12T02:03:55.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.337+0000 7f1cc43ff700 1 -- 172.21.15.37:0/746589134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cbc0c7a50 con 0x7f1cbc15c460 2023-07-12T02:03:55.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.338+0000 7f1cc43ff700 1 -- 172.21.15.37:0/746589134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cbc0c7f70 con 0x7f1cbc15c460 2023-07-12T02:03:55.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.339+0000 7f1cb2ffd700 1 -- 172.21.15.37:0/746589134 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1cb401d3b0 con 0x7f1cbc15c460 2023-07-12T02:03:55.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.340+0000 7f1cb2ffd700 1 --2- 172.21.15.37:0/746589134 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1ca006ace0 0x7f1ca006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:55.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.340+0000 7f1cb2ffd700 1 -- 172.21.15.37:0/746589134 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1cb4088f20 con 0x7f1cbc15c460 2023-07-12T02:03:55.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.341+0000 7f1cc219b700 1 --2- 172.21.15.37:0/746589134 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1ca006ace0 0x7f1ca006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:55.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.342+0000 7f1cc219b700 1 --2- 172.21.15.37:0/746589134 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1ca006ace0 0x7f1ca006d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009a90 tx=0x7f1cb8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:55.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.344+0000 7f1cb2ffd700 1 -- 172.21.15.37:0/746589134 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1cbc0c7f70 con 0x7f1cbc15c460 2023-07-12T02:03:55.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.552+0000 7f1cc43ff700 1 -- 172.21.15.37:0/746589134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1cbc0c7f70 con 0x7f1cbc15c460 2023-07-12T02:03:55.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.552+0000 7f1cb2ffd700 1 -- 172.21.15.37:0/746589134 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f1cb4019090 con 0x7f1cbc15c460 2023-07-12T02:03:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:03:55.556 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-12T02:03:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:03:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-07-12T02:03:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-07-12T02:03:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:03:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:03:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-07-12T02:03:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-07-12T02:03:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:03:55.558 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-12T02:03:55.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.555+0000 7f1cc43ff700 1 -- 172.21.15.37:0/746589134 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1ca006ace0 msgr2=0x7f1ca006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:55.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.555+0000 7f1cc43ff700 1 --2- 172.21.15.37:0/746589134 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1ca006ace0 0x7f1ca006d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009a90 tx=0x7f1cb8008040 comp rx=0 tx=0).stop 2023-07-12T02:03:55.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.555+0000 7f1cc43ff700 1 -- 172.21.15.37:0/746589134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cbc15c460 msgr2=0x7f1cbc0b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:55.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.555+0000 7f1cc43ff700 1 --2- 172.21.15.37:0/746589134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cbc15c460 0x7f1cbc0b78e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400be00 tx=0x7f1cb4009ed0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.555+0000 7f1cc43ff700 1 -- 172.21.15.37:0/746589134 shutdown_connections 2023-07-12T02:03:55.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.555+0000 7f1cc43ff700 1 --2- 172.21.15.37:0/746589134 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1ca006ace0 0x7f1ca006d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.555+0000 7f1cc43ff700 1 --2- 172.21.15.37:0/746589134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cbc15c460 0x7f1cbc0b78e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.555+0000 7f1cc43ff700 1 --2- 172.21.15.37:0/746589134 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cbc0cf720 0x7f1cbc150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.555+0000 7f1cc43ff700 1 --2- 172.21.15.37:0/746589134 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cbc0d2640 0x7f1cbc0b73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.555+0000 7f1cc43ff700 1 -- 172.21.15.37:0/746589134 >> 172.21.15.37:0/746589134 conn(0x7f1cbc071660 msgr2=0x7f1cbc160580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.555+0000 7f1cc43ff700 1 -- 172.21.15.37:0/746589134 shutdown_connections 2023-07-12T02:03:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.555+0000 7f1cc43ff700 1 -- 172.21.15.37:0/746589134 wait complete. 2023-07-12T02:03:55.576 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-12T02:03:55.576 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-12T02:03:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.777+0000 7ffa6f7ff700 1 Processor -- start 2023-07-12T02:03:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.778+0000 7ffa6f7ff700 1 -- start start 2023-07-12T02:03:55.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.779+0000 7ffa6f7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa680b82c0 0x7ffa68160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:55.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.779+0000 7ffa6f7ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ffa680cf4d0 0x7ffa680cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:55.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.779+0000 7ffa6f7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa68160db0 con 0x7ffa680b1f00 2023-07-12T02:03:55.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.779+0000 7ffa6f7ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa680b8690 con 0x7ffa680cf4d0 2023-07-12T02:03:55.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.779+0000 7ffa6f7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa680cfe90 con 0x7ffa680b82c0 2023-07-12T02:03:55.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.779+0000 7ffa6cd9a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffa680b1f00 0x7ffa680ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48098/0 (socket says 172.21.15.37:48098) 2023-07-12T02:03:55.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.779+0000 7ffa6cd9a700 1 -- 172.21.15.37:0/4087740379 learned_addr learned my addr 172.21.15.37:0/4087740379 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:03:55.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.779+0000 7ffa6d59b700 1 --2- 172.21.15.37:0/4087740379 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa680b82c0 0x7ffa68160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:55.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.779+0000 7ffa6dd9c700 1 --2- 172.21.15.37:0/4087740379 >> v2:172.21.15.196:3300/0 conn(0x7ffa680cf4d0 0x7ffa680cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:55.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.780+0000 7ffa5ffff700 1 -- 172.21.15.37:0/4087740379 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188462823 0 0) 0x7ffa58001110 con 0x7ffa680b1f00 2023-07-12T02:03:55.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.780+0000 7ffa5ffff700 1 -- 172.21.15.37:0/4087740379 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa540035b0 con 0x7ffa680b1f00 2023-07-12T02:03:55.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.780+0000 7ffa6d59b700 1 -- 172.21.15.37:0/4087740379 >> v2:172.21.15.196:3300/0 conn(0x7ffa680cf4d0 msgr2=0x7ffa680cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:55.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.780+0000 7ffa6d59b700 1 --2- 172.21.15.37:0/4087740379 >> v2:172.21.15.196:3300/0 conn(0x7ffa680cf4d0 0x7ffa680cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.780+0000 7ffa6d59b700 1 -- 172.21.15.37:0/4087740379 >> v1:172.21.15.37:6789/0 conn(0x7ffa680b1f00 legacy=0x7ffa680ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:55.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.780+0000 7ffa6d59b700 1 -- 172.21.15.37:0/4087740379 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6815fe20 con 0x7ffa680b82c0 2023-07-12T02:03:55.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.780+0000 7ffa6d59b700 1 --2- 172.21.15.37:0/4087740379 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa680b82c0 0x7ffa68160870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009840 tx=0x7ffa64009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=614c533eaeaab79d server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:55.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.780+0000 7ffa5ffff700 1 -- 172.21.15.37:0/4087740379 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64011830 con 0x7ffa680b82c0 2023-07-12T02:03:55.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.780+0000 7ffa5ffff700 1 -- 172.21.15.37:0/4087740379 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa64011990 con 0x7ffa680b82c0 2023-07-12T02:03:55.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.781+0000 7ffa5ffff700 1 -- 172.21.15.37:0/4087740379 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64011d20 con 0x7ffa680b82c0 2023-07-12T02:03:55.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.781+0000 7ffa6f7ff700 1 -- 172.21.15.37:0/4087740379 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa680b82c0 msgr2=0x7ffa68160870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:55.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.781+0000 7ffa6f7ff700 1 --2- 172.21.15.37:0/4087740379 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa680b82c0 0x7ffa68160870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009840 tx=0x7ffa64009b50 comp rx=0 tx=0).stop 2023-07-12T02:03:55.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.781+0000 7ffa6f7ff700 1 -- 172.21.15.37:0/4087740379 shutdown_connections 2023-07-12T02:03:55.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.781+0000 7ffa6f7ff700 1 --2- 172.21.15.37:0/4087740379 >> v2:172.21.15.196:3300/0 conn(0x7ffa680cf4d0 0x7ffa680cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.781+0000 7ffa6f7ff700 1 --2- 172.21.15.37:0/4087740379 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa680b82c0 0x7ffa68160870 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.781+0000 7ffa6f7ff700 1 -- 172.21.15.37:0/4087740379 >> 172.21.15.37:0/4087740379 conn(0x7ffa68071660 msgr2=0x7ffa68071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:55.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.781+0000 7ffa6f7ff700 1 -- 172.21.15.37:0/4087740379 shutdown_connections 2023-07-12T02:03:55.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.781+0000 7ffa6f7ff700 1 -- 172.21.15.37:0/4087740379 wait complete. 2023-07-12T02:03:55.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.783+0000 7ffa6f7ff700 1 Processor -- start 2023-07-12T02:03:55.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.783+0000 7ffa6f7ff700 1 -- start start 2023-07-12T02:03:55.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.784+0000 7ffa6f7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa680b1f00 0x7ffa68151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:55.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.784+0000 7ffa6f7ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa680b82c0 0x7ffa6815b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:55.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.784+0000 7ffa6f7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa680cf4d0 0x7ffa6815b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:55.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.784+0000 7ffa6f7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6815d9a0 con 0x7ffa680cf4d0 2023-07-12T02:03:55.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.784+0000 7ffa6f7ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6815d510 con 0x7ffa680b82c0 2023-07-12T02:03:55.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.784+0000 7ffa6f7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6815c900 con 0x7ffa680b1f00 2023-07-12T02:03:55.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.784+0000 7ffa6dd9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa680cf4d0 0x7ffa6815b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:55.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.784+0000 7ffa6dd9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa680cf4d0 0x7ffa6815b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50100/0 (socket says 172.21.15.37:50100) 2023-07-12T02:03:55.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.784+0000 7ffa6dd9c700 1 -- 172.21.15.37:0/169865233 learned_addr learned my addr 172.21.15.37:0/169865233 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:55.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.785+0000 7ffa6d59b700 1 --2- 172.21.15.37:0/169865233 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa680b1f00 0x7ffa68151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:55.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.785+0000 7ffa6cd9a700 1 --2- 172.21.15.37:0/169865233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa680b82c0 0x7ffa6815b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:55.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.785+0000 7ffa6dd9c700 1 -- 172.21.15.37:0/169865233 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa680b1f00 msgr2=0x7ffa68151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:55.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.785+0000 7ffa6dd9c700 1 --2- 172.21.15.37:0/169865233 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa680b1f00 0x7ffa68151b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.785+0000 7ffa6dd9c700 1 -- 172.21.15.37:0/169865233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa680b82c0 msgr2=0x7ffa6815b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:55.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.785+0000 7ffa6dd9c700 1 --2- 172.21.15.37:0/169865233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa680b82c0 0x7ffa6815b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:55.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.785+0000 7ffa6dd9c700 1 -- 172.21.15.37:0/169865233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa640094a0 con 0x7ffa680cf4d0 2023-07-12T02:03:55.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.785+0000 7ffa6cd9a700 1 --2- 172.21.15.37:0/169865233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa680b82c0 0x7ffa6815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:03:55.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.785+0000 7ffa6dd9c700 1 --2- 172.21.15.37:0/169865233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa680cf4d0 0x7ffa6815b630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000efc0 tx=0x7ffa6000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:55.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.785+0000 7ffa5dffb700 1 -- 172.21.15.37:0/169865233 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60009ea0 con 0x7ffa680cf4d0 2023-07-12T02:03:55.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.785+0000 7ffa5dffb700 1 -- 172.21.15.37:0/169865233 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6000f040 con 0x7ffa680cf4d0 2023-07-12T02:03:55.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.785+0000 7ffa5dffb700 1 -- 172.21.15.37:0/169865233 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60014480 con 0x7ffa680cf4d0 2023-07-12T02:03:55.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.785+0000 7ffa6f7ff700 1 -- 172.21.15.37:0/169865233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6815cbe0 con 0x7ffa680cf4d0 2023-07-12T02:03:55.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.786+0000 7ffa6f7ff700 1 -- 172.21.15.37:0/169865233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6815d1a0 con 0x7ffa680cf4d0 2023-07-12T02:03:55.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.787+0000 7ffa6f7ff700 1 -- 172.21.15.37:0/169865233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6815d680 con 0x7ffa680cf4d0 2023-07-12T02:03:55.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.788+0000 7ffa5dffb700 1 -- 172.21.15.37:0/169865233 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffa600145e0 con 0x7ffa680cf4d0 2023-07-12T02:03:55.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.788+0000 7ffa5dffb700 1 --2- 172.21.15.37:0/169865233 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffa4c06ace0 0x7ffa4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:55.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.789+0000 7ffa5dffb700 1 -- 172.21.15.37:0/169865233 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ffa600899e0 con 0x7ffa680cf4d0 2023-07-12T02:03:55.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.789+0000 7ffa6d59b700 1 --2- 172.21.15.37:0/169865233 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffa4c06ace0 0x7ffa4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:55.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.790+0000 7ffa6d59b700 1 --2- 172.21.15.37:0/169865233 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffa4c06ace0 0x7ffa4c06d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009fd0 tx=0x7ffa6401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:55.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.793+0000 7ffa5dffb700 1 -- 172.21.15.37:0/169865233 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ffa60054de0 con 0x7ffa680cf4d0 2023-07-12T02:03:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:55.999+0000 7ffa6f7ff700 1 -- 172.21.15.37:0/169865233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ffa68074180 con 0x7ffa680cf4d0 2023-07-12T02:03:56.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.114+0000 7ffa5dffb700 1 -- 172.21.15.37:0/169865233 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7ffa60058400 con 0x7ffa680cf4d0 2023-07-12T02:03:56.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.118+0000 7ffa6f7ff700 1 -- 172.21.15.37:0/169865233 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffa4c06ace0 msgr2=0x7ffa4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:56.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.118+0000 7ffa6f7ff700 1 --2- 172.21.15.37:0/169865233 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffa4c06ace0 0x7ffa4c06d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009fd0 tx=0x7ffa6401c040 comp rx=0 tx=0).stop 2023-07-12T02:03:56.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.118+0000 7ffa6f7ff700 1 -- 172.21.15.37:0/169865233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa680cf4d0 msgr2=0x7ffa6815b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:56.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.118+0000 7ffa6f7ff700 1 --2- 172.21.15.37:0/169865233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa680cf4d0 0x7ffa6815b630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000efc0 tx=0x7ffa6000c3a0 comp rx=0 tx=0).stop 2023-07-12T02:03:56.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.118+0000 7ffa6f7ff700 1 -- 172.21.15.37:0/169865233 shutdown_connections 2023-07-12T02:03:56.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.118+0000 7ffa6f7ff700 1 --2- 172.21.15.37:0/169865233 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffa4c06ace0 0x7ffa4c06d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:56.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.118+0000 7ffa6f7ff700 1 --2- 172.21.15.37:0/169865233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa680cf4d0 0x7ffa6815b630 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:56.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.118+0000 7ffa6f7ff700 1 --2- 172.21.15.37:0/169865233 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa680b1f00 0x7ffa68151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:56.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.118+0000 7ffa6f7ff700 1 --2- 172.21.15.37:0/169865233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa680b82c0 0x7ffa6815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:56.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.118+0000 7ffa6f7ff700 1 -- 172.21.15.37:0/169865233 >> 172.21.15.37:0/169865233 conn(0x7ffa68071660 msgr2=0x7ffa680b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:56.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.120+0000 7ffa6f7ff700 1 -- 172.21.15.37:0/169865233 shutdown_connections 2023-07-12T02:03:56.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.120+0000 7ffa6f7ff700 1 -- 172.21.15.37:0/169865233 wait complete. 2023-07-12T02:03:56.126 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-07-12T02:03:56.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-07-12T02:03:56.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.346+0000 7efc4fbff700 1 Processor -- start 2023-07-12T02:03:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.346+0000 7efc4fbff700 1 -- start start 2023-07-12T02:03:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.347+0000 7efc4fbff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7efc480b8430 0x7efc480cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.347+0000 7efc4fbff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc480d0b20 con 0x7efc480cfc60 2023-07-12T02:03:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.347+0000 7efc4fbff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc480b4ee0 con 0x7efc480d3730 2023-07-12T02:03:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.347+0000 7efc4fbff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc480b8800 con 0x7efc480b8430 2023-07-12T02:03:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.348+0000 7efc4e19c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efc480cfc60 0x7efc480d0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48112/0 (socket says 172.21.15.37:48112) 2023-07-12T02:03:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.348+0000 7efc4e19c700 1 -- 172.21.15.37:0/3447941364 learned_addr learned my addr 172.21.15.37:0/3447941364 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:03:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.348+0000 7efc4d99b700 1 --2- 172.21.15.37:0/3447941364 >> v2:172.21.15.196:3300/0 conn(0x7efc480b8430 0x7efc480cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.348+0000 7efc4c999700 1 -- 172.21.15.37:0/3447941364 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873698010 0 0) 0x7efc480d0b20 con 0x7efc480cfc60 2023-07-12T02:03:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.348+0000 7efc4c999700 1 -- 172.21.15.37:0/3447941364 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc340035b0 con 0x7efc480cfc60 2023-07-12T02:03:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.348+0000 7efc4c999700 1 -- 172.21.15.37:0/3447941364 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617402626 0 0) 0x7efc480b4ee0 con 0x7efc480d3730 2023-07-12T02:03:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.348+0000 7efc4c999700 1 -- 172.21.15.37:0/3447941364 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc480d0b20 con 0x7efc480d3730 2023-07-12T02:03:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.348+0000 7efc4d99b700 1 -- 172.21.15.37:0/3447941364 >> v1:172.21.15.196:6789/0 conn(0x7efc480d3730 legacy=0x7efc480cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.348+0000 7efc4d99b700 1 -- 172.21.15.37:0/3447941364 >> v1:172.21.15.37:6789/0 conn(0x7efc480cfc60 legacy=0x7efc480d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.348+0000 7efc4d99b700 1 -- 172.21.15.37:0/3447941364 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc480b51c0 con 0x7efc480b8430 2023-07-12T02:03:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.349+0000 7efc4d99b700 1 --2- 172.21.15.37:0/3447941364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc480b8430 0x7efc480cd320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efc44009840 tx=0x7efc44009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b9057e114b392ad server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.349+0000 7efc4c999700 1 -- 172.21.15.37:0/3447941364 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44011830 con 0x7efc480b8430 2023-07-12T02:03:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.349+0000 7efc4c999700 1 -- 172.21.15.37:0/3447941364 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc44011990 con 0x7efc480b8430 2023-07-12T02:03:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.349+0000 7efc4c999700 1 -- 172.21.15.37:0/3447941364 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44011d20 con 0x7efc480b8430 2023-07-12T02:03:56.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.349+0000 7efc4fbff700 1 -- 172.21.15.37:0/3447941364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc480b8430 msgr2=0x7efc480cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:56.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.349+0000 7efc4fbff700 1 --2- 172.21.15.37:0/3447941364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc480b8430 0x7efc480cd320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efc44009840 tx=0x7efc44009b50 comp rx=0 tx=0).stop 2023-07-12T02:03:56.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.349+0000 7efc4fbff700 1 -- 172.21.15.37:0/3447941364 shutdown_connections 2023-07-12T02:03:56.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.349+0000 7efc4fbff700 1 --2- 172.21.15.37:0/3447941364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc480b8430 0x7efc480cd320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:56.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.349+0000 7efc4fbff700 1 -- 172.21.15.37:0/3447941364 >> 172.21.15.37:0/3447941364 conn(0x7efc4806b3f0 msgr2=0x7efc4806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:56.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.350+0000 7efc4fbff700 1 -- 172.21.15.37:0/3447941364 shutdown_connections 2023-07-12T02:03:56.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.350+0000 7efc4fbff700 1 -- 172.21.15.37:0/3447941364 wait complete. 2023-07-12T02:03:56.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.352+0000 7efc4fbff700 1 Processor -- start 2023-07-12T02:03:56.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.352+0000 7efc4fbff700 1 -- start start 2023-07-12T02:03:56.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.353+0000 7efc4fbff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc480b8430 0x7efc480cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:56.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.353+0000 7efc4fbff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc480cfc60 0x7efc480cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:56.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.353+0000 7efc4fbff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc480d3730 0x7efc481f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:56.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.353+0000 7efc4fbff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc480cce20 con 0x7efc480cfc60 2023-07-12T02:03:56.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.353+0000 7efc4fbff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc481f2e30 con 0x7efc480b8430 2023-07-12T02:03:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.353+0000 7efc4fbff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc481f3110 con 0x7efc480d3730 2023-07-12T02:03:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.354+0000 7efc4d19a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc480cfc60 0x7efc480cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.354+0000 7efc4d19a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc480cfc60 0x7efc480cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50108/0 (socket says 172.21.15.37:50108) 2023-07-12T02:03:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.354+0000 7efc4d19a700 1 -- 172.21.15.37:0/3744334663 learned_addr learned my addr 172.21.15.37:0/3744334663 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.354+0000 7efc4d99b700 1 --2- 172.21.15.37:0/3744334663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc480b8430 0x7efc480cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.354+0000 7efc4e19c700 1 --2- 172.21.15.37:0/3744334663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc480d3730 0x7efc481f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.354+0000 7efc4d19a700 1 -- 172.21.15.37:0/3744334663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc480d3730 msgr2=0x7efc481f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:56.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.354+0000 7efc4d19a700 1 --2- 172.21.15.37:0/3744334663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc480d3730 0x7efc481f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:56.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.354+0000 7efc4d19a700 1 -- 172.21.15.37:0/3744334663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc480b8430 msgr2=0x7efc480cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:56.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.354+0000 7efc4d19a700 1 --2- 172.21.15.37:0/3744334663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc480b8430 0x7efc480cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:56.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.354+0000 7efc4d19a700 1 -- 172.21.15.37:0/3744334663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc440094a0 con 0x7efc480cfc60 2023-07-12T02:03:56.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.354+0000 7efc4e19c700 1 --2- 172.21.15.37:0/3744334663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc480d3730 0x7efc481f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:03:56.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.354+0000 7efc4d19a700 1 --2- 172.21.15.37:0/3744334663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc480cfc60 0x7efc480cae80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc3800c500 tx=0x7efc3800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:56.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.355+0000 7efc3e7fc700 1 -- 172.21.15.37:0/3744334663 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380052d0 con 0x7efc480cfc60 2023-07-12T02:03:56.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.355+0000 7efc3e7fc700 1 -- 172.21.15.37:0/3744334663 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc38005450 con 0x7efc480cfc60 2023-07-12T02:03:56.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.355+0000 7efc3e7fc700 1 -- 172.21.15.37:0/3744334663 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380038c0 con 0x7efc480cfc60 2023-07-12T02:03:56.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.355+0000 7efc4fbff700 1 -- 172.21.15.37:0/3744334663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc481f33f0 con 0x7efc480cfc60 2023-07-12T02:03:56.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.355+0000 7efc4fbff700 1 -- 172.21.15.37:0/3744334663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc481f5df0 con 0x7efc480cfc60 2023-07-12T02:03:56.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.356+0000 7efc4fbff700 1 -- 172.21.15.37:0/3744334663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc480cd320 con 0x7efc480cfc60 2023-07-12T02:03:56.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.357+0000 7efc3e7fc700 1 -- 172.21.15.37:0/3744334663 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efc38003a20 con 0x7efc480cfc60 2023-07-12T02:03:56.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.358+0000 7efc3e7fc700 1 --2- 172.21.15.37:0/3744334663 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efc2c06ace0 0x7efc2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:56.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.358+0000 7efc3e7fc700 1 -- 172.21.15.37:0/3744334663 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7efc38088790 con 0x7efc480cfc60 2023-07-12T02:03:56.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.359+0000 7efc4d99b700 1 --2- 172.21.15.37:0/3744334663 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efc2c06ace0 0x7efc2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:56.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.360+0000 7efc4d99b700 1 --2- 172.21.15.37:0/3744334663 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efc2c06ace0 0x7efc2c06d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efc44009fd0 tx=0x7efc4401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:56.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.363+0000 7efc3e7fc700 1 -- 172.21.15.37:0/3744334663 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7efc38053980 con 0x7efc480cfc60 2023-07-12T02:03:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:56.571+0000 7efc4fbff700 1 -- 172.21.15.37:0/3744334663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7efc481f35e0 con 0x7efc480cfc60 2023-07-12T02:03:57.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.122+0000 7efc3e7fc700 1 -- 172.21.15.37:0/3744334663 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7efc38056fa0 con 0x7efc480cfc60 2023-07-12T02:03:57.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.127+0000 7efc4fbff700 1 -- 172.21.15.37:0/3744334663 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efc2c06ace0 msgr2=0x7efc2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:57.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.127+0000 7efc4fbff700 1 --2- 172.21.15.37:0/3744334663 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efc2c06ace0 0x7efc2c06d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efc44009fd0 tx=0x7efc4401c040 comp rx=0 tx=0).stop 2023-07-12T02:03:57.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.127+0000 7efc4fbff700 1 -- 172.21.15.37:0/3744334663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc480cfc60 msgr2=0x7efc480cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:57.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.127+0000 7efc4fbff700 1 --2- 172.21.15.37:0/3744334663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc480cfc60 0x7efc480cae80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc3800c500 tx=0x7efc3800c810 comp rx=0 tx=0).stop 2023-07-12T02:03:57.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.128+0000 7efc4fbff700 1 -- 172.21.15.37:0/3744334663 shutdown_connections 2023-07-12T02:03:57.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.128+0000 7efc4fbff700 1 --2- 172.21.15.37:0/3744334663 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efc2c06ace0 0x7efc2c06d190 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efc44009fd0 tx=0x7efc4401c040 comp rx=0 tx=0).stop 2023-07-12T02:03:57.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.128+0000 7efc4fbff700 1 --2- 172.21.15.37:0/3744334663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc480d3730 0x7efc481f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:57.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.128+0000 7efc4fbff700 1 --2- 172.21.15.37:0/3744334663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc480b8430 0x7efc480cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:57.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.128+0000 7efc4fbff700 1 --2- 172.21.15.37:0/3744334663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc480cfc60 0x7efc480cae80 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc3800c500 tx=0x7efc3800c810 comp rx=0 tx=0).stop 2023-07-12T02:03:57.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.128+0000 7efc4fbff700 1 -- 172.21.15.37:0/3744334663 >> 172.21.15.37:0/3744334663 conn(0x7efc4806b3f0 msgr2=0x7efc480d1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:57.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.130+0000 7efc4fbff700 1 -- 172.21.15.37:0/3744334663 shutdown_connections 2023-07-12T02:03:57.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.131+0000 7efc4fbff700 1 -- 172.21.15.37:0/3744334663 wait complete. 2023-07-12T02:03:57.136 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-07-12T02:03:57.162 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-12T02:03:57.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.364+0000 7f7f853ff700 1 Processor -- start 2023-07-12T02:03:57.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.365+0000 7f7f853ff700 1 -- start start 2023-07-12T02:03:57.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.366+0000 7f7f853ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f800b4590 0x7f7f800b4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:57.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.366+0000 7f7f853ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7f8006bda0 0x7f7f800d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:57.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.366+0000 7f7f853ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8006c210 0x7f7f800d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:57.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.366+0000 7f7f853ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8006b390 con 0x7f7f800b4590 2023-07-12T02:03:57.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.366+0000 7f7f853ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f800d1490 con 0x7f7f8006bda0 2023-07-12T02:03:57.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.366+0000 7f7f853ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f800b4ea0 con 0x7f7f8006c210 2023-07-12T02:03:57.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.366+0000 7f7f7effd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f800b4590 0x7f7f800b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.366+0000 7f7f7effd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f800b4590 0x7f7f800b4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50124/0 (socket says 172.21.15.37:50124) 2023-07-12T02:03:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.366+0000 7f7f7effd700 1 -- 172.21.15.37:0/2541542332 learned_addr learned my addr 172.21.15.37:0/2541542332 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.366+0000 7f7f77fff700 1 --2- 172.21.15.37:0/2541542332 >> v2:172.21.15.196:3300/0 conn(0x7f7f8006bda0 0x7f7f800d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.366+0000 7f7f7f7fe700 1 --2- 172.21.15.37:0/2541542332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8006c210 0x7f7f800d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.367+0000 7f7f7effd700 1 -- 172.21.15.37:0/2541542332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8006c210 msgr2=0x7f7f800d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.367+0000 7f7f7effd700 1 --2- 172.21.15.37:0/2541542332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8006c210 0x7f7f800d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.367+0000 7f7f7effd700 1 -- 172.21.15.37:0/2541542332 >> v2:172.21.15.196:3300/0 conn(0x7f7f8006bda0 msgr2=0x7f7f800d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.367+0000 7f7f7effd700 1 --2- 172.21.15.37:0/2541542332 >> v2:172.21.15.196:3300/0 conn(0x7f7f8006bda0 0x7f7f800d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.367+0000 7f7f7effd700 1 -- 172.21.15.37:0/2541542332 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8015d3d0 con 0x7f7f800b4590 2023-07-12T02:03:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.367+0000 7f7f77fff700 1 --2- 172.21.15.37:0/2541542332 >> v2:172.21.15.196:3300/0 conn(0x7f7f8006bda0 0x7f7f800d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:03:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.367+0000 7f7f7effd700 1 --2- 172.21.15.37:0/2541542332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f800b4590 0x7f7f800b4960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f800b1a40 tx=0x7f7f70009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd32e06e399977 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.367+0000 7f7f7e7fc700 1 -- 172.21.15.37:0/2541542332 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000b870 con 0x7f7f800b4590 2023-07-12T02:03:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.367+0000 7f7f7e7fc700 1 -- 172.21.15.37:0/2541542332 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7000b9d0 con 0x7f7f800b4590 2023-07-12T02:03:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.367+0000 7f7f7e7fc700 1 -- 172.21.15.37:0/2541542332 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000bd60 con 0x7f7f800b4590 2023-07-12T02:03:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.368+0000 7f7f853ff700 1 -- 172.21.15.37:0/2541542332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f800b4590 msgr2=0x7f7f800b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.368+0000 7f7f853ff700 1 --2- 172.21.15.37:0/2541542332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f800b4590 0x7f7f800b4960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f800b1a40 tx=0x7f7f70009bd0 comp rx=0 tx=0).stop 2023-07-12T02:03:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.368+0000 7f7f853ff700 1 -- 172.21.15.37:0/2541542332 shutdown_connections 2023-07-12T02:03:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.368+0000 7f7f853ff700 1 --2- 172.21.15.37:0/2541542332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f800b4590 0x7f7f800b4960 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.368+0000 7f7f853ff700 1 --2- 172.21.15.37:0/2541542332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8006c210 0x7f7f800d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.368+0000 7f7f853ff700 1 --2- 172.21.15.37:0/2541542332 >> v2:172.21.15.196:3300/0 conn(0x7f7f8006bda0 0x7f7f800d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.368+0000 7f7f853ff700 1 -- 172.21.15.37:0/2541542332 >> 172.21.15.37:0/2541542332 conn(0x7f7f800cf590 msgr2=0x7f7f800cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.368+0000 7f7f853ff700 1 -- 172.21.15.37:0/2541542332 shutdown_connections 2023-07-12T02:03:57.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.368+0000 7f7f853ff700 1 -- 172.21.15.37:0/2541542332 wait complete. 2023-07-12T02:03:57.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.370+0000 7f7f853ff700 1 Processor -- start 2023-07-12T02:03:57.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.370+0000 7f7f853ff700 1 -- start start 2023-07-12T02:03:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f853ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f8006bda0 0x7f7f80155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f853ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8006c210 0x7f7f800d2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f853ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f800b4590 0x7f7f800d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f853ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f800c9da0 con 0x7f7f8006c210 2023-07-12T02:03:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f853ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f800ca080 con 0x7f7f8006bda0 2023-07-12T02:03:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f853ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f800ca360 con 0x7f7f800b4590 2023-07-12T02:03:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f77fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8006c210 0x7f7f800d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f77fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8006c210 0x7f7f800d2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50130/0 (socket says 172.21.15.37:50130) 2023-07-12T02:03:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f77fff700 1 -- 172.21.15.37:0/2859412203 learned_addr learned my addr 172.21.15.37:0/2859412203 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f7effd700 1 --2- 172.21.15.37:0/2859412203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f8006bda0 0x7f7f80155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f7f7fe700 1 --2- 172.21.15.37:0/2859412203 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f800b4590 0x7f7f800d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f77fff700 1 -- 172.21.15.37:0/2859412203 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f800b4590 msgr2=0x7f7f800d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f77fff700 1 --2- 172.21.15.37:0/2859412203 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f800b4590 0x7f7f800d26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f77fff700 1 -- 172.21.15.37:0/2859412203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f8006bda0 msgr2=0x7f7f80155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f77fff700 1 --2- 172.21.15.37:0/2859412203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f8006bda0 0x7f7f80155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f77fff700 1 -- 172.21.15.37:0/2859412203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f70009550 con 0x7f7f8006c210 2023-07-12T02:03:57.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.371+0000 7f7f7effd700 1 --2- 172.21.15.37:0/2859412203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f8006bda0 0x7f7f80155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:03:57.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.372+0000 7f7f77fff700 1 --2- 172.21.15.37:0/2859412203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8006c210 0x7f7f800d2180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800e810 tx=0x7f7f6800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:57.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.372+0000 7f7f777fe700 1 -- 172.21.15.37:0/2859412203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68013610 con 0x7f7f8006c210 2023-07-12T02:03:57.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.372+0000 7f7f777fe700 1 -- 172.21.15.37:0/2859412203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f68013770 con 0x7f7f8006c210 2023-07-12T02:03:57.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.372+0000 7f7f777fe700 1 -- 172.21.15.37:0/2859412203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68013b20 con 0x7f7f8006c210 2023-07-12T02:03:57.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.372+0000 7f7f853ff700 1 -- 172.21.15.37:0/2859412203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f800ca640 con 0x7f7f8006c210 2023-07-12T02:03:57.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.372+0000 7f7f853ff700 1 -- 172.21.15.37:0/2859412203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f801560d0 con 0x7f7f8006c210 2023-07-12T02:03:57.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.373+0000 7f7f853ff700 1 -- 172.21.15.37:0/2859412203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f800cab60 con 0x7f7f8006c210 2023-07-12T02:03:57.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.374+0000 7f7f777fe700 1 -- 172.21.15.37:0/2859412203 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f68013c80 con 0x7f7f8006c210 2023-07-12T02:03:57.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.376+0000 7f7f777fe700 1 --2- 172.21.15.37:0/2859412203 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7f6006ace0 0x7f7f6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:57.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.376+0000 7f7f777fe700 1 -- 172.21.15.37:0/2859412203 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f7f68089100 con 0x7f7f8006c210 2023-07-12T02:03:57.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.376+0000 7f7f7effd700 1 --2- 172.21.15.37:0/2859412203 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7f6006ace0 0x7f7f6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:57.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.377+0000 7f7f7effd700 1 --2- 172.21.15.37:0/2859412203 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7f6006ace0 0x7f7f6006d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7f70014040 tx=0x7f7f70008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:57.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.380+0000 7f7f777fe700 1 -- 172.21.15.37:0/2859412203 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7f800cab60 con 0x7f7f8006c210 2023-07-12T02:03:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:57.646+0000 7f7f853ff700 1 -- 172.21.15.37:0/2859412203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7f800cab60 con 0x7f7f8006c210 2023-07-12T02:03:58.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.131+0000 7f7f777fe700 1 -- 172.21.15.37:0/2859412203 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7f800cab60 con 0x7f7f8006c210 2023-07-12T02:03:58.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.143+0000 7f7f853ff700 1 -- 172.21.15.37:0/2859412203 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7f6006ace0 msgr2=0x7f7f6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:58.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.143+0000 7f7f853ff700 1 --2- 172.21.15.37:0/2859412203 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7f6006ace0 0x7f7f6006d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7f70014040 tx=0x7f7f70008030 comp rx=0 tx=0).stop 2023-07-12T02:03:58.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.143+0000 7f7f853ff700 1 -- 172.21.15.37:0/2859412203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8006c210 msgr2=0x7f7f800d2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:58.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.143+0000 7f7f853ff700 1 --2- 172.21.15.37:0/2859412203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8006c210 0x7f7f800d2180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800e810 tx=0x7f7f6800ebd0 comp rx=0 tx=0).stop 2023-07-12T02:03:58.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.149+0000 7f7f853ff700 1 -- 172.21.15.37:0/2859412203 shutdown_connections 2023-07-12T02:03:58.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.149+0000 7f7f853ff700 1 --2- 172.21.15.37:0/2859412203 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7f6006ace0 0x7f7f6006d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:58.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.149+0000 7f7f853ff700 1 --2- 172.21.15.37:0/2859412203 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f800b4590 0x7f7f800d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:58.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.149+0000 7f7f853ff700 1 --2- 172.21.15.37:0/2859412203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f8006bda0 0x7f7f80155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:58.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.149+0000 7f7f853ff700 1 --2- 172.21.15.37:0/2859412203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f8006c210 0x7f7f800d2180 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:58.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.149+0000 7f7f853ff700 1 -- 172.21.15.37:0/2859412203 >> 172.21.15.37:0/2859412203 conn(0x7f7f800cf590 msgr2=0x7f7f800cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:58.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.150+0000 7f7f853ff700 1 -- 172.21.15.37:0/2859412203 shutdown_connections 2023-07-12T02:03:58.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.150+0000 7f7f853ff700 1 -- 172.21.15.37:0/2859412203 wait complete. 2023-07-12T02:03:58.173 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 3 and data pool 4 2023-07-12T02:03:58.189 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-07-12T02:03:58.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-07-12T02:03:58.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.394+0000 7fd2061ff700 1 Processor -- start 2023-07-12T02:03:58.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.395+0000 7fd2061ff700 1 -- start start 2023-07-12T02:03:58.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.396+0000 7fd2061ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2000b1f00 0x7fd200160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:58.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.396+0000 7fd2061ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd200160db0 con 0x7fd2000cf4d0 2023-07-12T02:03:58.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.396+0000 7fd2061ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20015fe20 con 0x7fd2000b82c0 2023-07-12T02:03:58.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.396+0000 7fd2061ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000b8690 con 0x7fd2000b1f00 2023-07-12T02:03:58.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.396+0000 7fd1fffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd2000cf4d0 0x7fd2000d06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48114/0 (socket says 172.21.15.37:48114) 2023-07-12T02:03:58.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.396+0000 7fd1fffff700 1 -- 172.21.15.37:0/2596982121 learned_addr learned my addr 172.21.15.37:0/2596982121 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:03:58.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.396+0000 7fd1f7fff700 1 --2- 172.21.15.37:0/2596982121 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2000b1f00 0x7fd200160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:58.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.397+0000 7fd1feffd700 1 -- 172.21.15.37:0/2596982121 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052840451 0 0) 0x7fd1f8001490 con 0x7fd2000cf4d0 2023-07-12T02:03:58.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.397+0000 7fd1feffd700 1 -- 172.21.15.37:0/2596982121 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1ec0035b0 con 0x7fd2000cf4d0 2023-07-12T02:03:58.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.397+0000 7fd1feffd700 1 -- 172.21.15.37:0/2596982121 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119251854 0 0) 0x7fd20015fe20 con 0x7fd2000b82c0 2023-07-12T02:03:58.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.397+0000 7fd1f7fff700 1 -- 172.21.15.37:0/2596982121 >> v1:172.21.15.196:6789/0 conn(0x7fd2000b82c0 legacy=0x7fd2000ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:58.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.397+0000 7fd1f7fff700 1 -- 172.21.15.37:0/2596982121 >> v1:172.21.15.37:6789/0 conn(0x7fd2000cf4d0 legacy=0x7fd2000d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:58.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.397+0000 7fd1f7fff700 1 -- 172.21.15.37:0/2596982121 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2001603e0 con 0x7fd2000b1f00 2023-07-12T02:03:58.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.397+0000 7fd1f7fff700 1 --2- 172.21.15.37:0/2596982121 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2000b1f00 0x7fd200160870 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009870 tx=0x7fd1e8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2361499102ef2ce server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:58.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.397+0000 7fd1feffd700 1 -- 172.21.15.37:0/2596982121 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8011830 con 0x7fd2000b1f00 2023-07-12T02:03:58.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.398+0000 7fd1feffd700 1 -- 172.21.15.37:0/2596982121 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e8011990 con 0x7fd2000b1f00 2023-07-12T02:03:58.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.398+0000 7fd1feffd700 1 -- 172.21.15.37:0/2596982121 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8011d20 con 0x7fd2000b1f00 2023-07-12T02:03:58.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.398+0000 7fd2061ff700 1 -- 172.21.15.37:0/2596982121 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2000b1f00 msgr2=0x7fd200160870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:58.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.398+0000 7fd2061ff700 1 --2- 172.21.15.37:0/2596982121 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2000b1f00 0x7fd200160870 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009870 tx=0x7fd1e8009b80 comp rx=0 tx=0).stop 2023-07-12T02:03:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.398+0000 7fd2061ff700 1 -- 172.21.15.37:0/2596982121 shutdown_connections 2023-07-12T02:03:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.398+0000 7fd2061ff700 1 --2- 172.21.15.37:0/2596982121 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2000b1f00 0x7fd200160870 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.398+0000 7fd2061ff700 1 -- 172.21.15.37:0/2596982121 >> 172.21.15.37:0/2596982121 conn(0x7fd200071660 msgr2=0x7fd200071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.398+0000 7fd2061ff700 1 -- 172.21.15.37:0/2596982121 shutdown_connections 2023-07-12T02:03:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.398+0000 7fd2061ff700 1 -- 172.21.15.37:0/2596982121 wait complete. 2023-07-12T02:03:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.400+0000 7fd2061ff700 1 Processor -- start 2023-07-12T02:03:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.400+0000 7fd2061ff700 1 -- start start 2023-07-12T02:03:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.401+0000 7fd2061ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2000b1f00 0x7fd200159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.401+0000 7fd2061ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2000b82c0 0x7fd2000c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.401+0000 7fd2061ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2000cf4d0 0x7fd2000cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.401+0000 7fd2061ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000c7320 con 0x7fd2000b1f00 2023-07-12T02:03:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.401+0000 7fd2061ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000caba0 con 0x7fd2000b82c0 2023-07-12T02:03:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.401+0000 7fd2061ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20015a380 con 0x7fd2000cf4d0 2023-07-12T02:03:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.401+0000 7fd1ff7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2000b1f00 0x7fd200159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.401+0000 7fd1ff7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2000b1f00 0x7fd200159e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50134/0 (socket says 172.21.15.37:50134) 2023-07-12T02:03:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.401+0000 7fd1ff7fe700 1 -- 172.21.15.37:0/3735148028 learned_addr learned my addr 172.21.15.37:0/3735148028 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.402+0000 7fd1f7fff700 1 --2- 172.21.15.37:0/3735148028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2000b82c0 0x7fd2000c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.402+0000 7fd1ff7fe700 1 -- 172.21.15.37:0/3735148028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2000cf4d0 msgr2=0x7fd2000cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.402+0000 7fd1fffff700 1 --2- 172.21.15.37:0/3735148028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2000cf4d0 0x7fd2000cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.402+0000 7fd1ff7fe700 1 --2- 172.21.15.37:0/3735148028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2000cf4d0 0x7fd2000cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:58.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.402+0000 7fd1ff7fe700 1 -- 172.21.15.37:0/3735148028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2000b82c0 msgr2=0x7fd2000c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:58.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.402+0000 7fd1ff7fe700 1 --2- 172.21.15.37:0/3735148028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2000b82c0 0x7fd2000c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:58.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.402+0000 7fd1ff7fe700 1 -- 172.21.15.37:0/3735148028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e80094a0 con 0x7fd2000b1f00 2023-07-12T02:03:58.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.402+0000 7fd1f7fff700 1 --2- 172.21.15.37:0/3735148028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2000b82c0 0x7fd2000c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:03:58.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.402+0000 7fd1fffff700 1 --2- 172.21.15.37:0/3735148028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2000cf4d0 0x7fd2000cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:03:58.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.402+0000 7fd1ff7fe700 1 --2- 172.21.15.37:0/3735148028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2000b1f00 0x7fd200159e40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000c550 tx=0x7fd1f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:58.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.402+0000 7fd1fcff9700 1 -- 172.21.15.37:0/3735148028 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f00054e0 con 0x7fd2000b1f00 2023-07-12T02:03:58.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.402+0000 7fd1fcff9700 1 -- 172.21.15.37:0/3735148028 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f0003680 con 0x7fd2000b1f00 2023-07-12T02:03:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.402+0000 7fd2061ff700 1 -- 172.21.15.37:0/3735148028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2000cc530 con 0x7fd2000b1f00 2023-07-12T02:03:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.402+0000 7fd1fcff9700 1 -- 172.21.15.37:0/3735148028 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0003a30 con 0x7fd2000b1f00 2023-07-12T02:03:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.402+0000 7fd2061ff700 1 -- 172.21.15.37:0/3735148028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2000ca830 con 0x7fd2000b1f00 2023-07-12T02:03:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.403+0000 7fd2061ff700 1 -- 172.21.15.37:0/3735148028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2000cca50 con 0x7fd2000b1f00 2023-07-12T02:03:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.404+0000 7fd1fcff9700 1 -- 172.21.15.37:0/3735148028 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd1f0003b90 con 0x7fd2000b1f00 2023-07-12T02:03:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.405+0000 7fd1fcff9700 1 --2- 172.21.15.37:0/3735148028 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd1e006ace0 0x7fd1e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.405+0000 7fd1fcff9700 1 -- 172.21.15.37:0/3735148028 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd1f0088970 con 0x7fd2000b1f00 2023-07-12T02:03:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.406+0000 7fd1f7fff700 1 --2- 172.21.15.37:0/3735148028 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd1e006ace0 0x7fd1e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.406+0000 7fd1f7fff700 1 --2- 172.21.15.37:0/3735148028 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd1e006ace0 0x7fd1e006d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd2000b3050 tx=0x7fd1e801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.410+0000 7fd1fcff9700 1 -- 172.21.15.37:0/3735148028 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd2000cca50 con 0x7fd2000b1f00 2023-07-12T02:03:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:58.629+0000 7fd2061ff700 1 -- 172.21.15.37:0/3735148028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fd2000ca690 con 0x7fd2000b1f00 2023-07-12T02:03:59.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.148+0000 7fd1fcff9700 1 -- 172.21.15.37:0/3735148028 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7fd2000ca690 con 0x7fd2000b1f00 2023-07-12T02:03:59.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.151+0000 7fd2061ff700 1 -- 172.21.15.37:0/3735148028 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd1e006ace0 msgr2=0x7fd1e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:59.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.151+0000 7fd2061ff700 1 --2- 172.21.15.37:0/3735148028 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd1e006ace0 0x7fd1e006d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd2000b3050 tx=0x7fd1e801c040 comp rx=0 tx=0).stop 2023-07-12T02:03:59.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.151+0000 7fd2061ff700 1 -- 172.21.15.37:0/3735148028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2000b1f00 msgr2=0x7fd200159e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:59.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.151+0000 7fd2061ff700 1 --2- 172.21.15.37:0/3735148028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2000b1f00 0x7fd200159e40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000c550 tx=0x7fd1f000c910 comp rx=0 tx=0).stop 2023-07-12T02:03:59.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.151+0000 7fd2061ff700 1 -- 172.21.15.37:0/3735148028 shutdown_connections 2023-07-12T02:03:59.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.151+0000 7fd2061ff700 1 --2- 172.21.15.37:0/3735148028 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd1e006ace0 0x7fd1e006d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:59.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.151+0000 7fd2061ff700 1 --2- 172.21.15.37:0/3735148028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2000b1f00 0x7fd200159e40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:59.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.151+0000 7fd2061ff700 1 --2- 172.21.15.37:0/3735148028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2000cf4d0 0x7fd2000cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:59.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.151+0000 7fd2061ff700 1 --2- 172.21.15.37:0/3735148028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2000b82c0 0x7fd2000c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:59.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.151+0000 7fd2061ff700 1 -- 172.21.15.37:0/3735148028 >> 172.21.15.37:0/3735148028 conn(0x7fd200071660 msgr2=0x7fd2000b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:59.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.151+0000 7fd2061ff700 1 -- 172.21.15.37:0/3735148028 shutdown_connections 2023-07-12T02:03:59.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.151+0000 7fd2061ff700 1 -- 172.21.15.37:0/3735148028 wait complete. 2023-07-12T02:03:59.174 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-07-12T02:03:59.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.382+0000 7f7ea33ff700 1 Processor -- start 2023-07-12T02:03:59.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.382+0000 7f7ea33ff700 1 -- start start 2023-07-12T02:03:59.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.383+0000 7f7ea33ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7e9c15c350 0x7f7e9c15d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:59.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.383+0000 7f7ea33ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9c0cdad0 con 0x7f7e9c0cef30 2023-07-12T02:03:59.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.383+0000 7f7ea33ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9c0cd250 con 0x7f7e9c0d3150 2023-07-12T02:03:59.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.383+0000 7f7ea33ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9c0b55b0 con 0x7f7e9c15c350 2023-07-12T02:03:59.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7ea099a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7e9c0cef30 0x7f7e9c0d07d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48118/0 (socket says 172.21.15.37:48118) 2023-07-12T02:03:59.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7ea099a700 1 -- 172.21.15.37:0/3407883265 learned_addr learned my addr 172.21.15.37:0/3407883265 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:03:59.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7ea119b700 1 --2- 172.21.15.37:0/3407883265 >> v2:172.21.15.196:3300/0 conn(0x7f7e9c15c350 0x7f7e9c15d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:59.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 -- 172.21.15.37:0/3407883265 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553031472 0 0) 0x7f7e9c0cdad0 con 0x7f7e9c0cef30 2023-07-12T02:03:59.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 -- 172.21.15.37:0/3407883265 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e880035b0 con 0x7f7e9c0cef30 2023-07-12T02:03:59.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 -- 172.21.15.37:0/3407883265 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689628575 0 0) 0x7f7e9c0cd250 con 0x7f7e9c0d3150 2023-07-12T02:03:59.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 -- 172.21.15.37:0/3407883265 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e9c0cdad0 con 0x7f7e9c0d3150 2023-07-12T02:03:59.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 -- 172.21.15.37:0/3407883265 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 996479288 0 0) 0x7f7e880035b0 con 0x7f7e9c0cef30 2023-07-12T02:03:59.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 -- 172.21.15.37:0/3407883265 >> v2:172.21.15.196:3300/0 conn(0x7f7e9c15c350 msgr2=0x7f7e9c15d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:59.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 --2- 172.21.15.37:0/3407883265 >> v2:172.21.15.196:3300/0 conn(0x7f7e9c15c350 0x7f7e9c15d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:59.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 -- 172.21.15.37:0/3407883265 >> v1:172.21.15.196:6789/0 conn(0x7f7e9c0d3150 legacy=0x7f7e9c0cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:59.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 -- 172.21.15.37:0/3407883265 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c0cd510 con 0x7f7e9c0cef30 2023-07-12T02:03:59.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 -- 172.21.15.37:0/3407883265 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7f7e8c001670 con 0x7f7e9c0cef30 2023-07-12T02:03:59.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 -- 172.21.15.37:0/3407883265 >> v1:172.21.15.37:6789/0 conn(0x7f7e9c0cef30 legacy=0x7f7e9c0d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:59.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 --2- 172.21.15.37:0/3407883265 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e88003be0 0x7f7e88003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:59.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 --2- 172.21.15.37:0/3407883265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e88004850 0x7f7e88004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:59.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 --2- 172.21.15.37:0/3407883265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e88005250 0x7f7e8800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:59.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 -- 172.21.15.37:0/3407883265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0b55b0 con 0x7f7e88004850 2023-07-12T02:03:59.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 -- 172.21.15.37:0/3407883265 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8800c160 con 0x7f7e88003be0 2023-07-12T02:03:59.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.384+0000 7f7e93fff700 1 -- 172.21.15.37:0/3407883265 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8800c320 con 0x7f7e88005250 2023-07-12T02:03:59.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.385+0000 7f7ea099a700 1 --2- 172.21.15.37:0/3407883265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e88004850 0x7f7e88004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:59.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.385+0000 7f7ea119b700 1 --2- 172.21.15.37:0/3407883265 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e88003be0 0x7f7e88003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:59.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.385+0000 7f7ea199c700 1 --2- 172.21.15.37:0/3407883265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e88005250 0x7f7e8800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:59.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.385+0000 7f7ea099a700 1 -- 172.21.15.37:0/3407883265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e88005250 msgr2=0x7f7e8800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:59.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.385+0000 7f7ea099a700 1 --2- 172.21.15.37:0/3407883265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e88005250 0x7f7e8800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:59.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.385+0000 7f7ea099a700 1 -- 172.21.15.37:0/3407883265 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e88003be0 msgr2=0x7f7e88003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:59.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.385+0000 7f7ea099a700 1 --2- 172.21.15.37:0/3407883265 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e88003be0 0x7f7e88003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:59.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.385+0000 7f7ea099a700 1 -- 172.21.15.37:0/3407883265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e880035b0 con 0x7f7e88004850 2023-07-12T02:03:59.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.385+0000 7f7ea199c700 1 -- 172.21.15.37:0/3407883265 reap_dead start 2023-07-12T02:03:59.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.385+0000 7f7ea099a700 1 --2- 172.21.15.37:0/3407883265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e88004850 0x7f7e88004cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00c0e0 tx=0x7f7e88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed0f730d6e6ef05 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:59.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.386+0000 7f7e93fff700 1 -- 172.21.15.37:0/3407883265 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00cc80 con 0x7f7e88004850 2023-07-12T02:03:59.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.386+0000 7f7e93fff700 1 -- 172.21.15.37:0/3407883265 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c00cde0 con 0x7f7e88004850 2023-07-12T02:03:59.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.386+0000 7f7e93fff700 1 -- 172.21.15.37:0/3407883265 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c005ba0 con 0x7f7e88004850 2023-07-12T02:03:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.386+0000 7f7ea33ff700 1 -- 172.21.15.37:0/3407883265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e88004850 msgr2=0x7f7e88004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.386+0000 7f7ea33ff700 1 --2- 172.21.15.37:0/3407883265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e88004850 0x7f7e88004cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00c0e0 tx=0x7f7e88005880 comp rx=0 tx=0).stop 2023-07-12T02:03:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.386+0000 7f7ea33ff700 1 -- 172.21.15.37:0/3407883265 shutdown_connections 2023-07-12T02:03:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.386+0000 7f7ea33ff700 1 --2- 172.21.15.37:0/3407883265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e88004850 0x7f7e88004cc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.386+0000 7f7ea33ff700 1 -- 172.21.15.37:0/3407883265 >> 172.21.15.37:0/3407883265 conn(0x7f7e9c06b460 msgr2=0x7f7e9c06b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.386+0000 7f7ea33ff700 1 -- 172.21.15.37:0/3407883265 shutdown_connections 2023-07-12T02:03:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.386+0000 7f7ea33ff700 1 -- 172.21.15.37:0/3407883265 wait complete. 2023-07-12T02:03:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.388+0000 7f7ea33ff700 1 Processor -- start 2023-07-12T02:03:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.388+0000 7f7ea33ff700 1 -- start start 2023-07-12T02:03:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.389+0000 7f7ea33ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e88004850 0x7f7e9c159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.389+0000 7f7ea33ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e9c15b730 0x7f7e9c1f28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.389+0000 7f7ea33ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e9c160210 0x7f7e9c160680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.389+0000 7f7ea33ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c160bc0 con 0x7f7e88004850 2023-07-12T02:03:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.389+0000 7f7ea33ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c1efa60 con 0x7f7e9c160210 2023-07-12T02:03:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.389+0000 7f7ea33ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0b1410 con 0x7f7e9c15b730 2023-07-12T02:03:59.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.389+0000 7f7ea119b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e88004850 0x7f7e9c159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:59.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.390+0000 7f7ea119b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e88004850 0x7f7e9c159320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50150/0 (socket says 172.21.15.37:50150) 2023-07-12T02:03:59.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.390+0000 7f7ea119b700 1 -- 172.21.15.37:0/4279800908 learned_addr learned my addr 172.21.15.37:0/4279800908 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:03:59.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.390+0000 7f7ea099a700 1 --2- 172.21.15.37:0/4279800908 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e9c15b730 0x7f7e9c1f28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:59.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.390+0000 7f7ea199c700 1 --2- 172.21.15.37:0/4279800908 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e9c160210 0x7f7e9c160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:59.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.390+0000 7f7ea119b700 1 -- 172.21.15.37:0/4279800908 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e9c15b730 msgr2=0x7f7e9c1f28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:59.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.390+0000 7f7ea119b700 1 --2- 172.21.15.37:0/4279800908 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e9c15b730 0x7f7e9c1f28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.390+0000 7f7ea119b700 1 -- 172.21.15.37:0/4279800908 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e9c160210 msgr2=0x7f7e9c160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.390+0000 7f7ea119b700 1 --2- 172.21.15.37:0/4279800908 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e9c160210 0x7f7e9c160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.390+0000 7f7ea119b700 1 -- 172.21.15.37:0/4279800908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c1f2fe0 con 0x7f7e88004850 2023-07-12T02:03:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.390+0000 7f7ea199c700 1 --2- 172.21.15.37:0/4279800908 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e9c160210 0x7f7e9c160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:03:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.390+0000 7f7ea119b700 1 --2- 172.21.15.37:0/4279800908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e88004850 0x7f7e9c159320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7e98011a30 tx=0x7f7e98011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.390+0000 7f7e91ffb700 1 -- 172.21.15.37:0/4279800908 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e98009630 con 0x7f7e88004850 2023-07-12T02:03:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.390+0000 7f7e91ffb700 1 -- 172.21.15.37:0/4279800908 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e98004240 con 0x7f7e88004850 2023-07-12T02:03:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.390+0000 7f7e91ffb700 1 -- 172.21.15.37:0/4279800908 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e980036a0 con 0x7f7e88004850 2023-07-12T02:03:59.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.391+0000 7f7ea33ff700 1 -- 172.21.15.37:0/4279800908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c1f32a0 con 0x7f7e88004850 2023-07-12T02:03:59.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.391+0000 7f7ea33ff700 1 -- 172.21.15.37:0/4279800908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9c1f3860 con 0x7f7e88004850 2023-07-12T02:03:59.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.392+0000 7f7ea33ff700 1 -- 172.21.15.37:0/4279800908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9c0cf380 con 0x7f7e88004850 2023-07-12T02:03:59.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.392+0000 7f7e91ffb700 1 -- 172.21.15.37:0/4279800908 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7e98003800 con 0x7f7e88004850 2023-07-12T02:03:59.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.393+0000 7f7e91ffb700 1 --2- 172.21.15.37:0/4279800908 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7e8006ad10 0x7f7e8006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:59.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.393+0000 7f7e91ffb700 1 -- 172.21.15.37:0/4279800908 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f7e980898c0 con 0x7f7e88004850 2023-07-12T02:03:59.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.394+0000 7f7ea099a700 1 --2- 172.21.15.37:0/4279800908 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7e8006ad10 0x7f7e8006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:59.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.394+0000 7f7ea099a700 1 --2- 172.21.15.37:0/4279800908 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7e8006ad10 0x7f7e8006d1c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00c0e0 tx=0x7f7e8c007000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:59.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.398+0000 7f7e91ffb700 1 -- 172.21.15.37:0/4279800908 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7e9c0cf380 con 0x7f7e88004850 2023-07-12T02:03:59.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:03:59.608+0000 7f7ea33ff700 1 -- 172.21.15.37:0/4279800908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7e9c0cf380 con 0x7f7e88004850 2023-07-12T02:04:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.162+0000 7f7e91ffb700 1 -- 172.21.15.37:0/4279800908 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7f7e9c0cf380 con 0x7f7e88004850 2023-07-12T02:04:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.167+0000 7f7ea33ff700 1 -- 172.21.15.37:0/4279800908 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7e8006ad10 msgr2=0x7f7e8006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.167+0000 7f7ea33ff700 1 --2- 172.21.15.37:0/4279800908 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7e8006ad10 0x7f7e8006d1c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00c0e0 tx=0x7f7e8c007000 comp rx=0 tx=0).stop 2023-07-12T02:04:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.167+0000 7f7ea33ff700 1 -- 172.21.15.37:0/4279800908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e88004850 msgr2=0x7f7e9c159320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.167+0000 7f7ea33ff700 1 --2- 172.21.15.37:0/4279800908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e88004850 0x7f7e9c159320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7e98011a30 tx=0x7f7e98011d40 comp rx=0 tx=0).stop 2023-07-12T02:04:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.168+0000 7f7ea33ff700 1 -- 172.21.15.37:0/4279800908 shutdown_connections 2023-07-12T02:04:01.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.168+0000 7f7ea33ff700 1 --2- 172.21.15.37:0/4279800908 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7e8006ad10 0x7f7e8006d1c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:01.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.168+0000 7f7ea33ff700 1 --2- 172.21.15.37:0/4279800908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e88004850 0x7f7e9c159320 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:01.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.168+0000 7f7ea33ff700 1 --2- 172.21.15.37:0/4279800908 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e9c160210 0x7f7e9c160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:01.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.168+0000 7f7ea33ff700 1 --2- 172.21.15.37:0/4279800908 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e9c15b730 0x7f7e9c1f28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:01.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.168+0000 7f7ea33ff700 1 -- 172.21.15.37:0/4279800908 >> 172.21.15.37:0/4279800908 conn(0x7f7e9c06b460 msgr2=0x7f7e9c0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:01.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.169+0000 7f7ea33ff700 1 -- 172.21.15.37:0/4279800908 shutdown_connections 2023-07-12T02:04:01.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.173+0000 7f7ea33ff700 1 -- 172.21.15.37:0/4279800908 wait complete. 2023-07-12T02:04:01.182 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data_ec' created 2023-07-12T02:04:01.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-07-12T02:04:01.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.406+0000 7f437a7ff700 1 Processor -- start 2023-07-12T02:04:01.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.406+0000 7f437a7ff700 1 -- start start 2023-07-12T02:04:01.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.407+0000 7f437a7ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f43740d11a0 0x7f43740b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:01.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.407+0000 7f437a7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43740cd210 con 0x7f437415fe60 2023-07-12T02:04:01.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.407+0000 7f437a7ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43740d1630 con 0x7f4374160940 2023-07-12T02:04:01.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.407+0000 7f437a7ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43740b5f30 con 0x7f43740d11a0 2023-07-12T02:04:01.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.407+0000 7f4373fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f437415fe60 0x7f4374160230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48120/0 (socket says 172.21.15.37:48120) 2023-07-12T02:04:01.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.407+0000 7f4373fff700 1 -- 172.21.15.37:0/1926317718 learned_addr learned my addr 172.21.15.37:0/1926317718 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:01.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.408+0000 7f43737fe700 1 --2- 172.21.15.37:0/1926317718 >> v2:172.21.15.196:3300/0 conn(0x7f43740d11a0 0x7f43740b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:01.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.408+0000 7f4372ffd700 1 -- 172.21.15.37:0/1926317718 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234022461 0 0) 0x7f43740cd210 con 0x7f437415fe60 2023-07-12T02:04:01.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.408+0000 7f4372ffd700 1 -- 172.21.15.37:0/1926317718 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f435c0035b0 con 0x7f437415fe60 2023-07-12T02:04:01.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.408+0000 7f4372ffd700 1 -- 172.21.15.37:0/1926317718 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970617709 0 0) 0x7f43740d1630 con 0x7f4374160940 2023-07-12T02:04:01.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.408+0000 7f4372ffd700 1 -- 172.21.15.37:0/1926317718 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43740cd210 con 0x7f4374160940 2023-07-12T02:04:01.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.408+0000 7f43737fe700 1 -- 172.21.15.37:0/1926317718 >> v1:172.21.15.196:6789/0 conn(0x7f4374160940 legacy=0x7f43740cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.408+0000 7f4372ffd700 1 -- 172.21.15.37:0/1926317718 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1846346233 0 0) 0x7f435c0035b0 con 0x7f437415fe60 2023-07-12T02:04:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.408+0000 7f43737fe700 1 -- 172.21.15.37:0/1926317718 >> v1:172.21.15.37:6789/0 conn(0x7f437415fe60 legacy=0x7f4374160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.408+0000 7f43737fe700 1 -- 172.21.15.37:0/1926317718 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43740cd460 con 0x7f43740d11a0 2023-07-12T02:04:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.408+0000 7f43737fe700 1 --2- 172.21.15.37:0/1926317718 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43740d11a0 0x7f43740b59f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4368009840 tx=0x7f4368009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dad8b8a8a9274cd3 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.409+0000 7f4372ffd700 1 -- 172.21.15.37:0/1926317718 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364001670 con 0x7f43740d11a0 2023-07-12T02:04:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.409+0000 7f4372ffd700 1 -- 172.21.15.37:0/1926317718 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4368004030 con 0x7f43740d11a0 2023-07-12T02:04:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.409+0000 7f4372ffd700 1 -- 172.21.15.37:0/1926317718 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43680043c0 con 0x7f43740d11a0 2023-07-12T02:04:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.409+0000 7f437a7ff700 1 -- 172.21.15.37:0/1926317718 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43740d11a0 msgr2=0x7f43740b59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.409+0000 7f437a7ff700 1 --2- 172.21.15.37:0/1926317718 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43740d11a0 0x7f43740b59f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4368009840 tx=0x7f4368009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.409+0000 7f437a7ff700 1 -- 172.21.15.37:0/1926317718 shutdown_connections 2023-07-12T02:04:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.409+0000 7f437a7ff700 1 --2- 172.21.15.37:0/1926317718 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43740d11a0 0x7f43740b59f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.409+0000 7f437a7ff700 1 -- 172.21.15.37:0/1926317718 >> 172.21.15.37:0/1926317718 conn(0x7f437406b460 msgr2=0x7f437406b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.409+0000 7f437a7ff700 1 -- 172.21.15.37:0/1926317718 shutdown_connections 2023-07-12T02:04:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.409+0000 7f437a7ff700 1 -- 172.21.15.37:0/1926317718 wait complete. 2023-07-12T02:04:01.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.411+0000 7f437a7ff700 1 Processor -- start 2023-07-12T02:04:01.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.411+0000 7f437a7ff700 1 -- start start 2023-07-12T02:04:01.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.412+0000 7f437a7ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43740d11a0 0x7f43740cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:01.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.412+0000 7f437a7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f437415fe60 0x7f4374149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:01.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.412+0000 7f437a7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4374160940 0x7f437414a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:01.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.412+0000 7f437a7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437414a7f0 con 0x7f4374160940 2023-07-12T02:04:01.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.412+0000 7f437a7ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437415c1c0 con 0x7f43740d11a0 2023-07-12T02:04:01.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.412+0000 7f437a7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437415c4a0 con 0x7f437415fe60 2023-07-12T02:04:01.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.412+0000 7f4378d9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4374160940 0x7f437414a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:01.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.412+0000 7f4378d9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4374160940 0x7f437414a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50156/0 (socket says 172.21.15.37:50156) 2023-07-12T02:04:01.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.412+0000 7f4378d9c700 1 -- 172.21.15.37:0/866161635 learned_addr learned my addr 172.21.15.37:0/866161635 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:01.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.412+0000 7f4373fff700 1 --2- 172.21.15.37:0/866161635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43740d11a0 0x7f43740cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.412+0000 7f43737fe700 1 --2- 172.21.15.37:0/866161635 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f437415fe60 0x7f4374149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.413+0000 7f4378d9c700 1 -- 172.21.15.37:0/866161635 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f437415fe60 msgr2=0x7f4374149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.413+0000 7f4378d9c700 1 --2- 172.21.15.37:0/866161635 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f437415fe60 0x7f4374149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.413+0000 7f4378d9c700 1 -- 172.21.15.37:0/866161635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43740d11a0 msgr2=0x7f43740cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.413+0000 7f4378d9c700 1 --2- 172.21.15.37:0/866161635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43740d11a0 0x7f43740cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.413+0000 7f4378d9c700 1 -- 172.21.15.37:0/866161635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43680094a0 con 0x7f4374160940 2023-07-12T02:04:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.413+0000 7f4373fff700 1 --2- 172.21.15.37:0/866161635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43740d11a0 0x7f43740cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:04:01.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.413+0000 7f4378d9c700 1 --2- 172.21.15.37:0/866161635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4374160940 0x7f437414a0e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f436c00cbc0 tx=0x7f436c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.413+0000 7f4370ff9700 1 -- 172.21.15.37:0/866161635 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c003c00 con 0x7f4374160940 2023-07-12T02:04:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.413+0000 7f4370ff9700 1 -- 172.21.15.37:0/866161635 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c003d60 con 0x7f4374160940 2023-07-12T02:04:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.413+0000 7f437a7ff700 1 -- 172.21.15.37:0/866161635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437415c780 con 0x7f4374160940 2023-07-12T02:04:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.413+0000 7f4370ff9700 1 -- 172.21.15.37:0/866161635 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c00aaa0 con 0x7f4374160940 2023-07-12T02:04:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.414+0000 7f437a7ff700 1 -- 172.21.15.37:0/866161635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43740cc610 con 0x7f4374160940 2023-07-12T02:04:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.415+0000 7f437a7ff700 1 -- 172.21.15.37:0/866161635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4374074180 con 0x7f4374160940 2023-07-12T02:04:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.416+0000 7f4370ff9700 1 -- 172.21.15.37:0/866161635 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f436c00ac00 con 0x7f4374160940 2023-07-12T02:04:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.417+0000 7f4370ff9700 1 --2- 172.21.15.37:0/866161635 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f436006ace0 0x7f436006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.417+0000 7f4370ff9700 1 -- 172.21.15.37:0/866161635 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f436c0897b0 con 0x7f4374160940 2023-07-12T02:04:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.417+0000 7f4373fff700 1 --2- 172.21.15.37:0/866161635 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f436006ace0 0x7f436006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:01.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.418+0000 7f4373fff700 1 --2- 172.21.15.37:0/866161635 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f436006ace0 0x7f436006d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f43640011e0 tx=0x7f4364000ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:01.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.422+0000 7f4370ff9700 1 -- 172.21.15.37:0/866161635 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f436c0544f0 con 0x7f4374160940 2023-07-12T02:04:01.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:01.627+0000 7f437a7ff700 1 -- 172.21.15.37:0/866161635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f43740b19e0 con 0x7f4374160940 2023-07-12T02:04:02.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.170+0000 7f4370ff9700 1 -- 172.21.15.37:0/866161635 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f436c057b10 con 0x7f4374160940 2023-07-12T02:04:02.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.178+0000 7f437a7ff700 1 -- 172.21.15.37:0/866161635 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f436006ace0 msgr2=0x7f436006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:02.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.178+0000 7f437a7ff700 1 --2- 172.21.15.37:0/866161635 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f436006ace0 0x7f436006d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f43640011e0 tx=0x7f4364000ed0 comp rx=0 tx=0).stop 2023-07-12T02:04:02.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.178+0000 7f437a7ff700 1 -- 172.21.15.37:0/866161635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4374160940 msgr2=0x7f437414a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:02.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.178+0000 7f437a7ff700 1 --2- 172.21.15.37:0/866161635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4374160940 0x7f437414a0e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f436c00cbc0 tx=0x7f436c00ced0 comp rx=0 tx=0).stop 2023-07-12T02:04:02.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.180+0000 7f437a7ff700 1 -- 172.21.15.37:0/866161635 shutdown_connections 2023-07-12T02:04:02.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.180+0000 7f437a7ff700 1 --2- 172.21.15.37:0/866161635 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f436006ace0 0x7f436006d190 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f43640011e0 tx=0x7f4364000ed0 comp rx=0 tx=0).stop 2023-07-12T02:04:02.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.180+0000 7f437a7ff700 1 --2- 172.21.15.37:0/866161635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4374160940 0x7f437414a0e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:02.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.180+0000 7f437a7ff700 1 --2- 172.21.15.37:0/866161635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43740d11a0 0x7f43740cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:02.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.180+0000 7f437a7ff700 1 --2- 172.21.15.37:0/866161635 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f437415fe60 0x7f4374149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:02.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.180+0000 7f437a7ff700 1 -- 172.21.15.37:0/866161635 >> 172.21.15.37:0/866161635 conn(0x7f437406b460 msgr2=0x7f43740c9280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:02.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.183+0000 7f437a7ff700 1 -- 172.21.15.37:0/866161635 shutdown_connections 2023-07-12T02:04:02.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.185+0000 7f437a7ff700 1 -- 172.21.15.37:0/866161635 wait complete. 2023-07-12T02:04:02.211 INFO:teuthology.orchestra.run.smithi037.stderr:set pool 5 allow_ec_overwrites to true 2023-07-12T02:04:02.226 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-07-12T02:04:02.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.427+0000 7f9ee9fff700 1 Processor -- start 2023-07-12T02:04:02.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.427+0000 7f9ee9fff700 1 -- start start 2023-07-12T02:04:02.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.428+0000 7f9ee9fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9ee40b8260 0x7f9ee40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:02.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.428+0000 7f9ee9fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ee40d25c0 0x7f9ee40b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:02.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.428+0000 7f9ee9fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee40b4fb0 con 0x7f9ee40b4b50 2023-07-12T02:04:02.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.428+0000 7f9ee9fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee4160a00 con 0x7f9ee40d25c0 2023-07-12T02:04:02.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.428+0000 7f9ee9fff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee4160ce0 con 0x7f9ee40b8260 2023-07-12T02:04:02.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.429+0000 7f9ee2ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ee40d25c0 0x7f9ee40b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:02.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.429+0000 7f9ee3fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9ee40b4b50 0x7f9ee406b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53288/0 (socket says 172.21.15.37:53288) 2023-07-12T02:04:02.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.429+0000 7f9ee3fff700 1 -- 172.21.15.37:0/60599693 learned_addr learned my addr 172.21.15.37:0/60599693 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:02.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.429+0000 7f9ee37fe700 1 --2- 172.21.15.37:0/60599693 >> v2:172.21.15.196:3300/0 conn(0x7f9ee40b8260 0x7f9ee40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:02.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.429+0000 7f9ee27fc700 1 -- 172.21.15.37:0/60599693 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115188412 0 0) 0x7f9ee40b4fb0 con 0x7f9ee40b4b50 2023-07-12T02:04:02.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.429+0000 7f9ee2ffd700 1 -- 172.21.15.37:0/60599693 >> v2:172.21.15.196:3300/0 conn(0x7f9ee40b8260 msgr2=0x7f9ee40cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:02.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.429+0000 7f9ee2ffd700 1 --2- 172.21.15.37:0/60599693 >> v2:172.21.15.196:3300/0 conn(0x7f9ee40b8260 0x7f9ee40cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:02.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.429+0000 7f9ee2ffd700 1 -- 172.21.15.37:0/60599693 >> v1:172.21.15.37:6789/0 conn(0x7f9ee40b4b50 legacy=0x7f9ee406b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:02.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.429+0000 7f9ee2ffd700 1 -- 172.21.15.37:0/60599693 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee40cd280 con 0x7f9ee40d25c0 2023-07-12T02:04:02.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.429+0000 7f9ee2ffd700 1 --2- 172.21.15.37:0/60599693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ee40d25c0 0x7f9ee40b4610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40b5780 tx=0x7f9ed8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d6e98be7a2e412 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:02.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.430+0000 7f9ee27fc700 1 -- 172.21.15.37:0/60599693 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8011830 con 0x7f9ee40d25c0 2023-07-12T02:04:02.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.430+0000 7f9ee27fc700 1 -- 172.21.15.37:0/60599693 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed8011990 con 0x7f9ee40d25c0 2023-07-12T02:04:02.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.430+0000 7f9ee27fc700 1 -- 172.21.15.37:0/60599693 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8011d20 con 0x7f9ee40d25c0 2023-07-12T02:04:02.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.430+0000 7f9ee9fff700 1 -- 172.21.15.37:0/60599693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ee40d25c0 msgr2=0x7f9ee40b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:02.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.430+0000 7f9ee9fff700 1 --2- 172.21.15.37:0/60599693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ee40d25c0 0x7f9ee40b4610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40b5780 tx=0x7f9ed8009b20 comp rx=0 tx=0).stop 2023-07-12T02:04:02.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.430+0000 7f9ee9fff700 1 -- 172.21.15.37:0/60599693 shutdown_connections 2023-07-12T02:04:02.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.430+0000 7f9ee9fff700 1 --2- 172.21.15.37:0/60599693 >> v2:172.21.15.196:3300/0 conn(0x7f9ee40b8260 0x7f9ee40cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:02.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.430+0000 7f9ee9fff700 1 --2- 172.21.15.37:0/60599693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ee40d25c0 0x7f9ee40b4610 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:02.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.430+0000 7f9ee9fff700 1 -- 172.21.15.37:0/60599693 >> 172.21.15.37:0/60599693 conn(0x7f9ee40722b0 msgr2=0x7f9ee40cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:02.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.430+0000 7f9ee9fff700 1 -- 172.21.15.37:0/60599693 shutdown_connections 2023-07-12T02:04:02.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.430+0000 7f9ee9fff700 1 -- 172.21.15.37:0/60599693 wait complete. 2023-07-12T02:04:02.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.432+0000 7f9ee9fff700 1 Processor -- start 2023-07-12T02:04:02.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.432+0000 7f9ee9fff700 1 -- start start 2023-07-12T02:04:02.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.433+0000 7f9ee9fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ee40b8260 0x7f9ee40c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:02.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.433+0000 7f9ee9fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee40d25c0 0x7f9ee40c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:02.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.433+0000 7f9ee9fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ee4159d40 0x7f9ee415ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:02.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.433+0000 7f9ee9fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee41f2a50 con 0x7f9ee40b8260 2023-07-12T02:04:02.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.433+0000 7f9ee9fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee41f1be0 con 0x7f9ee40d25c0 2023-07-12T02:04:02.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.433+0000 7f9ee9fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee41f1e40 con 0x7f9ee4159d40 2023-07-12T02:04:02.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.433+0000 7f9ee37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ee40b8260 0x7f9ee40c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:02.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.433+0000 7f9ee37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ee40b8260 0x7f9ee40c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45330/0 (socket says 172.21.15.37:45330) 2023-07-12T02:04:02.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.433+0000 7f9ee37fe700 1 -- 172.21.15.37:0/2143471892 learned_addr learned my addr 172.21.15.37:0/2143471892 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:02.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.433+0000 7f9ee2ffd700 1 --2- 172.21.15.37:0/2143471892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee40d25c0 0x7f9ee40c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:02.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.433+0000 7f9ee3fff700 1 --2- 172.21.15.37:0/2143471892 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ee4159d40 0x7f9ee415ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:02.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.434+0000 7f9ee37fe700 1 -- 172.21.15.37:0/2143471892 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ee4159d40 msgr2=0x7f9ee415ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:02.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.434+0000 7f9ee37fe700 1 --2- 172.21.15.37:0/2143471892 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ee4159d40 0x7f9ee415ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:02.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.434+0000 7f9ee37fe700 1 -- 172.21.15.37:0/2143471892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee40d25c0 msgr2=0x7f9ee40c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:02.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.434+0000 7f9ee37fe700 1 --2- 172.21.15.37:0/2143471892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee40d25c0 0x7f9ee40c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:02.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.434+0000 7f9ee37fe700 1 -- 172.21.15.37:0/2143471892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed80094a0 con 0x7f9ee40b8260 2023-07-12T02:04:02.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.434+0000 7f9ee37fe700 1 --2- 172.21.15.37:0/2143471892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ee40b8260 0x7f9ee40c8870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400e9b0 tx=0x7f9ed400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:02.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.434+0000 7f9ecbfff700 1 -- 172.21.15.37:0/2143471892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4009710 con 0x7f9ee40b8260 2023-07-12T02:04:02.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.434+0000 7f9ecbfff700 1 -- 172.21.15.37:0/2143471892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed400ee50 con 0x7f9ee40b8260 2023-07-12T02:04:02.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.434+0000 7f9ee9fff700 1 -- 172.21.15.37:0/2143471892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee41f2120 con 0x7f9ee40b8260 2023-07-12T02:04:02.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.434+0000 7f9ecbfff700 1 -- 172.21.15.37:0/2143471892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed400ca50 con 0x7f9ee40b8260 2023-07-12T02:04:02.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.434+0000 7f9ee9fff700 1 -- 172.21.15.37:0/2143471892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee41f26e0 con 0x7f9ee40b8260 2023-07-12T02:04:02.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.435+0000 7f9ee9fff700 1 -- 172.21.15.37:0/2143471892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee404ea60 con 0x7f9ee40b8260 2023-07-12T02:04:02.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.436+0000 7f9ecbfff700 1 -- 172.21.15.37:0/2143471892 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9ed400cbb0 con 0x7f9ee40b8260 2023-07-12T02:04:02.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.437+0000 7f9ecbfff700 1 --2- 172.21.15.37:0/2143471892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9ed006ace0 0x7f9ed006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:02.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.437+0000 7f9ecbfff700 1 -- 172.21.15.37:0/2143471892 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f9ed4089810 con 0x7f9ee40b8260 2023-07-12T02:04:02.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.438+0000 7f9ee2ffd700 1 --2- 172.21.15.37:0/2143471892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9ed006ace0 0x7f9ed006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:02.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.438+0000 7f9ee2ffd700 1 --2- 172.21.15.37:0/2143471892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9ed006ace0 0x7f9ed006d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80090b0 tx=0x7f9ed801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:02.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.442+0000 7f9ecbfff700 1 -- 172.21.15.37:0/2143471892 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9ed4057fe0 con 0x7f9ee40b8260 2023-07-12T02:04:02.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:02.700+0000 7f9ee9fff700 1 -- 172.21.15.37:0/2143471892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f9ee406c030 con 0x7f9ee40b8260 2023-07-12T02:04:03.108 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-07-12T02:04:03.104+0000 7f72b4bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-12T02:04:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.171+0000 7f9ecbfff700 1 -- 172.21.15.37:0/2143471892 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f9ed400ce60 con 0x7f9ee40b8260 2023-07-12T02:04:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.174+0000 7f9ee9fff700 1 -- 172.21.15.37:0/2143471892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9ed006ace0 msgr2=0x7f9ed006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.174+0000 7f9ee9fff700 1 --2- 172.21.15.37:0/2143471892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9ed006ace0 0x7f9ed006d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80090b0 tx=0x7f9ed801c040 comp rx=0 tx=0).stop 2023-07-12T02:04:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.174+0000 7f9ee9fff700 1 -- 172.21.15.37:0/2143471892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ee40b8260 msgr2=0x7f9ee40c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.174+0000 7f9ee9fff700 1 --2- 172.21.15.37:0/2143471892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ee40b8260 0x7f9ee40c8870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400e9b0 tx=0x7f9ed400ecc0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.174+0000 7f9ee9fff700 1 -- 172.21.15.37:0/2143471892 shutdown_connections 2023-07-12T02:04:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.174+0000 7f9ee9fff700 1 --2- 172.21.15.37:0/2143471892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9ed006ace0 0x7f9ed006d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.174+0000 7f9ee9fff700 1 --2- 172.21.15.37:0/2143471892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ee40b8260 0x7f9ee40c8870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.174+0000 7f9ee9fff700 1 --2- 172.21.15.37:0/2143471892 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ee4159d40 0x7f9ee415ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.174+0000 7f9ee9fff700 1 --2- 172.21.15.37:0/2143471892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee40d25c0 0x7f9ee40c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.174+0000 7f9ee9fff700 1 -- 172.21.15.37:0/2143471892 >> 172.21.15.37:0/2143471892 conn(0x7f9ee40b4b50 msgr2=0x7f9ee4072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.174+0000 7f9ee9fff700 1 -- 172.21.15.37:0/2143471892 shutdown_connections 2023-07-12T02:04:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.175+0000 7f9ee9fff700 1 -- 172.21.15.37:0/2143471892 wait complete. 2023-07-12T02:04:03.180 INFO:teuthology.orchestra.run.smithi037.stderr:added data pool 5 to fsmap 2023-07-12T02:04:03.197 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:04:03.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.396+0000 7f6a79dff700 1 Processor -- start 2023-07-12T02:04:03.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.396+0000 7f6a79dff700 1 -- start start 2023-07-12T02:04:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.398+0000 7f6a79dff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6a740cbb60 0x7f6a740ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.398+0000 7f6a79dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7406cd50 con 0x7f6a741588b0 2023-07-12T02:04:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.398+0000 7f6a79dff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a740c8ff0 con 0x7f6a7406a640 2023-07-12T02:04:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.398+0000 7f6a79dff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7406d280 con 0x7f6a740cbb60 2023-07-12T02:04:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.398+0000 7f6a737fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6a741588b0 0x7f6a74069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53298/0 (socket says 172.21.15.37:53298) 2023-07-12T02:04:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.398+0000 7f6a737fe700 1 -- 172.21.15.37:0/3412049014 learned_addr learned my addr 172.21.15.37:0/3412049014 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:03.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.398+0000 7f6a73fff700 1 --2- 172.21.15.37:0/3412049014 >> v2:172.21.15.196:3300/0 conn(0x7f6a740cbb60 0x7f6a740ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:03.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.398+0000 7f6a72ffd700 1 -- 172.21.15.37:0/3412049014 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913767953 0 0) 0x7f6a7406cd50 con 0x7f6a741588b0 2023-07-12T02:04:03.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.398+0000 7f6a72ffd700 1 -- 172.21.15.37:0/3412049014 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a600035b0 con 0x7f6a741588b0 2023-07-12T02:04:03.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.399+0000 7f6a72ffd700 1 -- 172.21.15.37:0/3412049014 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 161153960 0 0) 0x7f6a600035b0 con 0x7f6a741588b0 2023-07-12T02:04:03.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.399+0000 7f6a72ffd700 1 -- 172.21.15.37:0/3412049014 >> v2:172.21.15.196:3300/0 conn(0x7f6a740cbb60 msgr2=0x7f6a740ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:03.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.399+0000 7f6a72ffd700 1 --2- 172.21.15.37:0/3412049014 >> v2:172.21.15.196:3300/0 conn(0x7f6a740cbb60 0x7f6a740ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.399+0000 7f6a72ffd700 1 -- 172.21.15.37:0/3412049014 >> v1:172.21.15.196:6789/0 conn(0x7f6a7406a640 legacy=0x7f6a740c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:03.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.399+0000 7f6a72ffd700 1 -- 172.21.15.37:0/3412049014 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7406d880 con 0x7f6a741588b0 2023-07-12T02:04:03.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.399+0000 7f6a72ffd700 1 -- 172.21.15.37:0/3412049014 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7f6a64001670 con 0x7f6a741588b0 2023-07-12T02:04:03.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.399+0000 7f6a72ffd700 1 -- 172.21.15.37:0/3412049014 >> v1:172.21.15.37:6789/0 conn(0x7f6a741588b0 legacy=0x7f6a74069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.399+0000 7f6a72ffd700 1 --2- 172.21.15.37:0/3412049014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a60003a00 0x7f6a60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.399+0000 7f6a72ffd700 1 --2- 172.21.15.37:0/3412049014 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a600043f0 0x7f6a600048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.399+0000 7f6a72ffd700 1 --2- 172.21.15.37:0/3412049014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a60005150 0x7f6a6000dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.399+0000 7f6a72ffd700 1 -- 172.21.15.37:0/3412049014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7406d280 con 0x7f6a60005150 2023-07-12T02:04:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.399+0000 7f6a72ffd700 1 -- 172.21.15.37:0/3412049014 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6000e290 con 0x7f6a600043f0 2023-07-12T02:04:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.399+0000 7f6a72ffd700 1 -- 172.21.15.37:0/3412049014 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6000e450 con 0x7f6a60003a00 2023-07-12T02:04:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.399+0000 7f6a73fff700 1 --2- 172.21.15.37:0/3412049014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a60005150 0x7f6a6000dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.399+0000 7f6a737fe700 1 --2- 172.21.15.37:0/3412049014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a60003a00 0x7f6a60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.399+0000 7f6a6bfff700 1 --2- 172.21.15.37:0/3412049014 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a600043f0 0x7f6a600048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.400+0000 7f6a73fff700 1 -- 172.21.15.37:0/3412049014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a60003a00 msgr2=0x7f6a60003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.400+0000 7f6a73fff700 1 --2- 172.21.15.37:0/3412049014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a60003a00 0x7f6a60003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.400+0000 7f6a73fff700 1 -- 172.21.15.37:0/3412049014 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a600043f0 msgr2=0x7f6a600048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.400+0000 7f6a73fff700 1 --2- 172.21.15.37:0/3412049014 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a600043f0 0x7f6a600048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.400+0000 7f6a73fff700 1 -- 172.21.15.37:0/3412049014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a600035b0 con 0x7f6a60005150 2023-07-12T02:04:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.400+0000 7f6a73fff700 1 -- 172.21.15.37:0/3412049014 reap_dead start 2023-07-12T02:04:03.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.400+0000 7f6a73fff700 1 --2- 172.21.15.37:0/3412049014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a60005150 0x7f6a6000dc20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009f90 tx=0x7f6a60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1ada3dc774539f server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:03.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.400+0000 7f6a72ffd700 1 -- 172.21.15.37:0/3412049014 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c003a20 con 0x7f6a60005150 2023-07-12T02:04:03.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.400+0000 7f6a72ffd700 1 -- 172.21.15.37:0/3412049014 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c00f040 con 0x7f6a60005150 2023-07-12T02:04:03.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.400+0000 7f6a72ffd700 1 -- 172.21.15.37:0/3412049014 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c003de0 con 0x7f6a60005150 2023-07-12T02:04:03.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.401+0000 7f6a79dff700 1 -- 172.21.15.37:0/3412049014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a60005150 msgr2=0x7f6a6000dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:03.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.401+0000 7f6a79dff700 1 --2- 172.21.15.37:0/3412049014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a60005150 0x7f6a6000dc20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009f90 tx=0x7f6a60005880 comp rx=0 tx=0).stop 2023-07-12T02:04:03.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.401+0000 7f6a79dff700 1 -- 172.21.15.37:0/3412049014 shutdown_connections 2023-07-12T02:04:03.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.401+0000 7f6a79dff700 1 --2- 172.21.15.37:0/3412049014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a60005150 0x7f6a6000dc20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.401+0000 7f6a79dff700 1 -- 172.21.15.37:0/3412049014 >> 172.21.15.37:0/3412049014 conn(0x7f6a740b0390 msgr2=0x7f6a740b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:03.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.401+0000 7f6a79dff700 1 -- 172.21.15.37:0/3412049014 shutdown_connections 2023-07-12T02:04:03.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.401+0000 7f6a79dff700 1 -- 172.21.15.37:0/3412049014 wait complete. 2023-07-12T02:04:03.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.403+0000 7f6a79dff700 1 Processor -- start 2023-07-12T02:04:03.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.403+0000 7f6a79dff700 1 -- start start 2023-07-12T02:04:03.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a79dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a60005150 0x7f6a740b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:03.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a79dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a74153860 0x7f6a740c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:03.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a79dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740c5bb0 0x7f6a740c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:03.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a79dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a740acf70 con 0x7f6a740c5bb0 2023-07-12T02:04:03.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a79dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a74154110 con 0x7f6a74153860 2023-07-12T02:04:03.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a79dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a740b1c70 con 0x7f6a60005150 2023-07-12T02:04:03.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a73fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740c5bb0 0x7f6a740c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:03.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a73fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740c5bb0 0x7f6a740c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45358/0 (socket says 172.21.15.37:45358) 2023-07-12T02:04:03.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a73fff700 1 -- 172.21.15.37:0/1173157759 learned_addr learned my addr 172.21.15.37:0/1173157759 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:03.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a737fe700 1 --2- 172.21.15.37:0/1173157759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a60005150 0x7f6a740b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:03.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a6bfff700 1 --2- 172.21.15.37:0/1173157759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a74153860 0x7f6a740c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:03.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a73fff700 1 -- 172.21.15.37:0/1173157759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a60005150 msgr2=0x7f6a740b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:03.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a73fff700 1 --2- 172.21.15.37:0/1173157759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a60005150 0x7f6a740b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a73fff700 1 -- 172.21.15.37:0/1173157759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a74153860 msgr2=0x7f6a740c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:03.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a73fff700 1 --2- 172.21.15.37:0/1173157759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a74153860 0x7f6a740c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a73fff700 1 -- 172.21.15.37:0/1173157759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a740b1f50 con 0x7f6a740c5bb0 2023-07-12T02:04:03.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.404+0000 7f6a6bfff700 1 --2- 172.21.15.37:0/1173157759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a74153860 0x7f6a740c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:03.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.405+0000 7f6a73fff700 1 --2- 172.21.15.37:0/1173157759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740c5bb0 0x7f6a740c6050 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a7406aa10 tx=0x7f6a6c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:03.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.405+0000 7f6a70ff9700 1 -- 172.21.15.37:0/1173157759 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c003e90 con 0x7f6a740c5bb0 2023-07-12T02:04:03.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.405+0000 7f6a70ff9700 1 -- 172.21.15.37:0/1173157759 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c004230 con 0x7f6a740c5bb0 2023-07-12T02:04:03.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.405+0000 7f6a70ff9700 1 -- 172.21.15.37:0/1173157759 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0045e0 con 0x7f6a740c5bb0 2023-07-12T02:04:03.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.405+0000 7f6a79dff700 1 -- 172.21.15.37:0/1173157759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a740b2230 con 0x7f6a740c5bb0 2023-07-12T02:04:03.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.405+0000 7f6a79dff700 1 -- 172.21.15.37:0/1173157759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a740b27f0 con 0x7f6a740c5bb0 2023-07-12T02:04:03.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.406+0000 7f6a79dff700 1 -- 172.21.15.37:0/1173157759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a74153c30 con 0x7f6a740c5bb0 2023-07-12T02:04:03.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.407+0000 7f6a70ff9700 1 -- 172.21.15.37:0/1173157759 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a6c004740 con 0x7f6a740c5bb0 2023-07-12T02:04:03.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.408+0000 7f6a70ff9700 1 --2- 172.21.15.37:0/1173157759 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6a5406ace0 0x7f6a5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:03.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.408+0000 7f6a70ff9700 1 -- 172.21.15.37:0/1173157759 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6a6c08a9a0 con 0x7f6a740c5bb0 2023-07-12T02:04:03.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.408+0000 7f6a737fe700 1 --2- 172.21.15.37:0/1173157759 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6a5406ace0 0x7f6a5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:03.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.409+0000 7f6a737fe700 1 --2- 172.21.15.37:0/1173157759 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6a5406ace0 0x7f6a5406d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6a64000c00 tx=0x7f6a64000f80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:03.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.412+0000 7f6a70ff9700 1 -- 172.21.15.37:0/1173157759 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6a74153c30 con 0x7f6a740c5bb0 2023-07-12T02:04:03.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.665+0000 7f6a79dff700 1 -- 172.21.15.37:0/1173157759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a74153c30 con 0x7f6a740c5bb0 2023-07-12T02:04:03.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.666+0000 7f6a70ff9700 1 -- 172.21.15.37:0/1173157759 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f6a74153c30 con 0x7f6a740c5bb0 2023-07-12T02:04:03.670 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:03.670 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/2496042538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":2496042538},{"type":"v1","addr":"172.21.15.196:6836","nonce":2496042538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2193116262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":2193116262},{"type":"v1","addr":"172.21.15.196:6837","nonce":2193116262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3195008737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3195008737},{"type":"v1","addr":"172.21.15.37:6834","nonce":3195008737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:03:57.647919+0000","modified":"2023-07-12T02:04:02.702370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/4264740807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4264740807},{"type":"v1","addr":"172.21.15.37:6835","nonce":4264740807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-12T02:04:03.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.668+0000 7f6a79dff700 1 -- 172.21.15.37:0/1173157759 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6a5406ace0 msgr2=0x7f6a5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:03.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.668+0000 7f6a79dff700 1 --2- 172.21.15.37:0/1173157759 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6a5406ace0 0x7f6a5406d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6a64000c00 tx=0x7f6a64000f80 comp rx=0 tx=0).stop 2023-07-12T02:04:03.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.668+0000 7f6a79dff700 1 -- 172.21.15.37:0/1173157759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740c5bb0 msgr2=0x7f6a740c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:03.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.668+0000 7f6a79dff700 1 --2- 172.21.15.37:0/1173157759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740c5bb0 0x7f6a740c6050 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a7406aa10 tx=0x7f6a6c004b40 comp rx=0 tx=0).stop 2023-07-12T02:04:03.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.668+0000 7f6a79dff700 1 -- 172.21.15.37:0/1173157759 shutdown_connections 2023-07-12T02:04:03.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.668+0000 7f6a79dff700 1 --2- 172.21.15.37:0/1173157759 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6a5406ace0 0x7f6a5406d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.668+0000 7f6a79dff700 1 --2- 172.21.15.37:0/1173157759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740c5bb0 0x7f6a740c6050 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.668+0000 7f6a79dff700 1 --2- 172.21.15.37:0/1173157759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a60005150 0x7f6a740b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.668+0000 7f6a79dff700 1 --2- 172.21.15.37:0/1173157759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a74153860 0x7f6a740c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.669+0000 7f6a79dff700 1 -- 172.21.15.37:0/1173157759 >> 172.21.15.37:0/1173157759 conn(0x7f6a740b0390 msgr2=0x7f6a740cb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:03.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.669+0000 7f6a79dff700 1 -- 172.21.15.37:0/1173157759 shutdown_connections 2023-07-12T02:04:03.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.669+0000 7f6a79dff700 1 -- 172.21.15.37:0/1173157759 wait complete. 2023-07-12T02:04:03.674 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-07-12T02:04:03.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:04:03.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.890+0000 7f0b6adff700 1 Processor -- start 2023-07-12T02:04:03.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.891+0000 7f0b6adff700 1 -- start start 2023-07-12T02:04:03.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.892+0000 7f0b6adff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b6415c460 0x7f0b640b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:03.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.892+0000 7f0b6adff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b640d2640 0x7f0b640cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:03.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.892+0000 7f0b6adff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b640d1790 con 0x7f0b640cf720 2023-07-12T02:04:03.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.892+0000 7f0b6adff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b640cedd0 con 0x7f0b6415c460 2023-07-12T02:04:03.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.892+0000 7f0b6adff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640cd950 con 0x7f0b640d2640 2023-07-12T02:04:03.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.892+0000 7f0b68b9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b6415c460 0x7f0b640b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:03.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.892+0000 7f0b6939c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0b640cf720 0x7f0b640d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53308/0 (socket says 172.21.15.37:53308) 2023-07-12T02:04:03.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.892+0000 7f0b6939c700 1 -- 172.21.15.37:0/1739346764 learned_addr learned my addr 172.21.15.37:0/1739346764 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:03.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.892+0000 7f0b63fff700 1 --2- 172.21.15.37:0/1739346764 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b640d2640 0x7f0b640cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:03.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.893+0000 7f0b68b9b700 1 -- 172.21.15.37:0/1739346764 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b640d2640 msgr2=0x7f0b640cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:03.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.893+0000 7f0b68b9b700 1 --2- 172.21.15.37:0/1739346764 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b640d2640 0x7f0b640cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.893+0000 7f0b68b9b700 1 -- 172.21.15.37:0/1739346764 >> v1:172.21.15.37:6789/0 conn(0x7f0b640cf720 legacy=0x7f0b640d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:03.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.893+0000 7f0b68b9b700 1 -- 172.21.15.37:0/1739346764 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b640d14b0 con 0x7f0b6415c460 2023-07-12T02:04:03.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.893+0000 7f0b637fe700 1 -- 172.21.15.37:0/1739346764 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523310753 0 0) 0x7f0b640d1790 con 0x7f0b640cf720 2023-07-12T02:04:03.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.893+0000 7f0b68b9b700 1 --2- 172.21.15.37:0/1739346764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b6415c460 0x7f0b640b59d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009840 tx=0x7f0b58009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4a042d1989f147 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:03.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.893+0000 7f0b637fe700 1 -- 172.21.15.37:0/1739346764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58011830 con 0x7f0b6415c460 2023-07-12T02:04:03.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.893+0000 7f0b637fe700 1 -- 172.21.15.37:0/1739346764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b58011990 con 0x7f0b6415c460 2023-07-12T02:04:03.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.893+0000 7f0b637fe700 1 -- 172.21.15.37:0/1739346764 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58011d20 con 0x7f0b6415c460 2023-07-12T02:04:03.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.894+0000 7f0b6adff700 1 -- 172.21.15.37:0/1739346764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b6415c460 msgr2=0x7f0b640b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:03.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.894+0000 7f0b6adff700 1 --2- 172.21.15.37:0/1739346764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b6415c460 0x7f0b640b59d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009840 tx=0x7f0b58009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:03.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.894+0000 7f0b6adff700 1 -- 172.21.15.37:0/1739346764 shutdown_connections 2023-07-12T02:04:03.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.894+0000 7f0b6adff700 1 --2- 172.21.15.37:0/1739346764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b6415c460 0x7f0b640b59d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.894+0000 7f0b6adff700 1 --2- 172.21.15.37:0/1739346764 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b640d2640 0x7f0b640cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.894+0000 7f0b6adff700 1 -- 172.21.15.37:0/1739346764 >> 172.21.15.37:0/1739346764 conn(0x7f0b64071660 msgr2=0x7f0b64071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:03.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.894+0000 7f0b6adff700 1 -- 172.21.15.37:0/1739346764 shutdown_connections 2023-07-12T02:04:03.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.894+0000 7f0b6adff700 1 -- 172.21.15.37:0/1739346764 wait complete. 2023-07-12T02:04:03.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.896+0000 7f0b6adff700 1 Processor -- start 2023-07-12T02:04:03.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.896+0000 7f0b6adff700 1 -- start start 2023-07-12T02:04:03.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.897+0000 7f0b6adff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b640cf720 0x7f0b6414de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:03.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.897+0000 7f0b6adff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b640d2640 0x7f0b6414ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:03.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.897+0000 7f0b6adff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b6415c460 0x7f0b640c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:03.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.897+0000 7f0b6adff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6414f0f0 con 0x7f0b640d2640 2023-07-12T02:04:03.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.897+0000 7f0b6adff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b641510c0 con 0x7f0b640cf720 2023-07-12T02:04:03.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.897+0000 7f0b6adff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640c96f0 con 0x7f0b6415c460 2023-07-12T02:04:03.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.897+0000 7f0b63fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b640d2640 0x7f0b6414ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:03.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.898+0000 7f0b63fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b640d2640 0x7f0b6414ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45378/0 (socket says 172.21.15.37:45378) 2023-07-12T02:04:03.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.898+0000 7f0b63fff700 1 -- 172.21.15.37:0/1068666595 learned_addr learned my addr 172.21.15.37:0/1068666595 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:03.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.898+0000 7f0b6939c700 1 --2- 172.21.15.37:0/1068666595 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b6415c460 0x7f0b640c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:03.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.898+0000 7f0b68b9b700 1 --2- 172.21.15.37:0/1068666595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b640cf720 0x7f0b6414de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:03.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.898+0000 7f0b63fff700 1 -- 172.21.15.37:0/1068666595 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b6415c460 msgr2=0x7f0b640c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:03.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.898+0000 7f0b63fff700 1 --2- 172.21.15.37:0/1068666595 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b6415c460 0x7f0b640c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.898+0000 7f0b63fff700 1 -- 172.21.15.37:0/1068666595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b640cf720 msgr2=0x7f0b6414de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:03.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.898+0000 7f0b63fff700 1 --2- 172.21.15.37:0/1068666595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b640cf720 0x7f0b6414de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:03.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.898+0000 7f0b63fff700 1 -- 172.21.15.37:0/1068666595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b580094a0 con 0x7f0b640d2640 2023-07-12T02:04:03.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.898+0000 7f0b63fff700 1 --2- 172.21.15.37:0/1068666595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b640d2640 0x7f0b6414ebb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000e870 tx=0x7f0b5000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:03.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.898+0000 7f0b617fa700 1 -- 172.21.15.37:0/1068666595 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50009590 con 0x7f0b640d2640 2023-07-12T02:04:03.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.899+0000 7f0b617fa700 1 -- 172.21.15.37:0/1068666595 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b50013680 con 0x7f0b640d2640 2023-07-12T02:04:03.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.899+0000 7f0b617fa700 1 -- 172.21.15.37:0/1068666595 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b500139f0 con 0x7f0b640d2640 2023-07-12T02:04:03.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.899+0000 7f0b6adff700 1 -- 172.21.15.37:0/1068666595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b64151360 con 0x7f0b640d2640 2023-07-12T02:04:03.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.899+0000 7f0b6adff700 1 -- 172.21.15.37:0/1068666595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b64151920 con 0x7f0b640d2640 2023-07-12T02:04:03.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.900+0000 7f0b6adff700 1 -- 172.21.15.37:0/1068666595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b64151ae0 con 0x7f0b640d2640 2023-07-12T02:04:03.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.902+0000 7f0b617fa700 1 -- 172.21.15.37:0/1068666595 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b50013b50 con 0x7f0b640d2640 2023-07-12T02:04:03.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.903+0000 7f0b617fa700 1 --2- 172.21.15.37:0/1068666595 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0b4806ace0 0x7f0b4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:03.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.903+0000 7f0b617fa700 1 -- 172.21.15.37:0/1068666595 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0b500894e0 con 0x7f0b640d2640 2023-07-12T02:04:03.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.904+0000 7f0b68b9b700 1 --2- 172.21.15.37:0/1068666595 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0b4806ace0 0x7f0b4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:03.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.904+0000 7f0b68b9b700 1 --2- 172.21.15.37:0/1068666595 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0b4806ace0 0x7f0b4806d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009fd0 tx=0x7f0b58008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:03.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:03.907+0000 7f0b617fa700 1 -- 172.21.15.37:0/1068666595 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0b50057dc0 con 0x7f0b640d2640 2023-07-12T02:04:04.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.115+0000 7f0b6adff700 1 -- 172.21.15.37:0/1068666595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b6404ea60 con 0x7f0b640d2640 2023-07-12T02:04:04.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.117+0000 7f0b617fa700 1 -- 172.21.15.37:0/1068666595 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f0b50057950 con 0x7f0b640d2640 2023-07-12T02:04:04.121 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:04.121 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:02.702198+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:04:04.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.119+0000 7f0b6adff700 1 -- 172.21.15.37:0/1068666595 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0b4806ace0 msgr2=0x7f0b4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:04.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.119+0000 7f0b6adff700 1 --2- 172.21.15.37:0/1068666595 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0b4806ace0 0x7f0b4806d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009fd0 tx=0x7f0b58008030 comp rx=0 tx=0).stop 2023-07-12T02:04:04.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.119+0000 7f0b6adff700 1 -- 172.21.15.37:0/1068666595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b640d2640 msgr2=0x7f0b6414ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:04.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.119+0000 7f0b6adff700 1 --2- 172.21.15.37:0/1068666595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b640d2640 0x7f0b6414ebb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000e870 tx=0x7f0b5000eb80 comp rx=0 tx=0).stop 2023-07-12T02:04:04.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.119+0000 7f0b6adff700 1 -- 172.21.15.37:0/1068666595 shutdown_connections 2023-07-12T02:04:04.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.119+0000 7f0b6adff700 1 --2- 172.21.15.37:0/1068666595 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0b4806ace0 0x7f0b4806d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.119+0000 7f0b6adff700 1 --2- 172.21.15.37:0/1068666595 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b6415c460 0x7f0b640c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.119+0000 7f0b6adff700 1 --2- 172.21.15.37:0/1068666595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b640cf720 0x7f0b6414de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.119+0000 7f0b6adff700 1 --2- 172.21.15.37:0/1068666595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b640d2640 0x7f0b6414ebb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.119+0000 7f0b6adff700 1 -- 172.21.15.37:0/1068666595 >> 172.21.15.37:0/1068666595 conn(0x7f0b64071660 msgr2=0x7f0b640b7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:04.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.119+0000 7f0b6adff700 1 -- 172.21.15.37:0/1068666595 shutdown_connections 2023-07-12T02:04:04.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.119+0000 7f0b6adff700 1 -- 172.21.15.37:0/1068666595 wait complete. 2023-07-12T02:04:04.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:04:04.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.339+0000 7fe58adff700 1 Processor -- start 2023-07-12T02:04:04.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.339+0000 7fe58adff700 1 -- start start 2023-07-12T02:04:04.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.340+0000 7fe58adff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5840d2640 0x7fe5840b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:04.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.340+0000 7fe58adff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe5840cf8f0 0x7fe58415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:04.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.340+0000 7fe58adff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5840d1790 con 0x7fe58415c460 2023-07-12T02:04:04.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.340+0000 7fe58adff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5840cedd0 con 0x7fe5840cf8f0 2023-07-12T02:04:04.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.340+0000 7fe58adff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5840cd950 con 0x7fe5840d2640 2023-07-12T02:04:04.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.341+0000 7fe583fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5840d2640 0x7fe5840b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:04.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.341+0000 7fe583fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5840d2640 0x7fe5840b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:33410/0 (socket says 172.21.15.37:33410) 2023-07-12T02:04:04.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.341+0000 7fe583fff700 1 -- 172.21.15.37:0/3229354877 learned_addr learned my addr 172.21.15.37:0/3229354877 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:04.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.341+0000 7fe588b9b700 1 --1- 172.21.15.37:0/3229354877 >> v1:172.21.15.196:6789/0 conn(0x7fe58415c460 0x7fe5840cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:55816/0 (socket says 172.21.15.37:55816) 2023-07-12T02:04:04.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.341+0000 7fe58939c700 1 --2- 172.21.15.37:0/3229354877 >> v2:172.21.15.196:3300/0 conn(0x7fe5840cf8f0 0x7fe58415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:04.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.341+0000 7fe5837fe700 1 -- 172.21.15.37:0/3229354877 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449578500 0 0) 0x7fe5840d1790 con 0x7fe58415c460 2023-07-12T02:04:04.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.341+0000 7fe583fff700 1 -- 172.21.15.37:0/3229354877 >> v2:172.21.15.196:3300/0 conn(0x7fe5840cf8f0 msgr2=0x7fe58415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:04.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.341+0000 7fe583fff700 1 --2- 172.21.15.37:0/3229354877 >> v2:172.21.15.196:3300/0 conn(0x7fe5840cf8f0 0x7fe58415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.341+0000 7fe583fff700 1 -- 172.21.15.37:0/3229354877 >> v1:172.21.15.196:6789/0 conn(0x7fe58415c460 legacy=0x7fe5840cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:04.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.341+0000 7fe583fff700 1 -- 172.21.15.37:0/3229354877 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5840d14b0 con 0x7fe5840d2640 2023-07-12T02:04:04.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.342+0000 7fe583fff700 1 --2- 172.21.15.37:0/3229354877 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5840d2640 0x7fe5840b59d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe5700098f0 tx=0x7fe570009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b8e06ba04817a75 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:04.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.342+0000 7fe5837fe700 1 -- 172.21.15.37:0/3229354877 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe570011830 con 0x7fe5840d2640 2023-07-12T02:04:04.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.342+0000 7fe5837fe700 1 -- 172.21.15.37:0/3229354877 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe570011990 con 0x7fe5840d2640 2023-07-12T02:04:04.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.342+0000 7fe5837fe700 1 -- 172.21.15.37:0/3229354877 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe570011d20 con 0x7fe5840d2640 2023-07-12T02:04:04.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.343+0000 7fe58adff700 1 -- 172.21.15.37:0/3229354877 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5840d2640 msgr2=0x7fe5840b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:04.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.343+0000 7fe58adff700 1 --2- 172.21.15.37:0/3229354877 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5840d2640 0x7fe5840b59d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe5700098f0 tx=0x7fe570009c00 comp rx=0 tx=0).stop 2023-07-12T02:04:04.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.343+0000 7fe58adff700 1 -- 172.21.15.37:0/3229354877 shutdown_connections 2023-07-12T02:04:04.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.343+0000 7fe58adff700 1 --2- 172.21.15.37:0/3229354877 >> v2:172.21.15.196:3300/0 conn(0x7fe5840cf8f0 0x7fe58415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.343+0000 7fe58adff700 1 --2- 172.21.15.37:0/3229354877 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5840d2640 0x7fe5840b59d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.343+0000 7fe58adff700 1 -- 172.21.15.37:0/3229354877 >> 172.21.15.37:0/3229354877 conn(0x7fe584071660 msgr2=0x7fe584071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:04.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.343+0000 7fe58adff700 1 -- 172.21.15.37:0/3229354877 shutdown_connections 2023-07-12T02:04:04.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.343+0000 7fe58adff700 1 -- 172.21.15.37:0/3229354877 wait complete. 2023-07-12T02:04:04.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.345+0000 7fe58adff700 1 Processor -- start 2023-07-12T02:04:04.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.346+0000 7fe58adff700 1 -- start start 2023-07-12T02:04:04.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.347+0000 7fe58adff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5840cf8f0 0x7fe58415f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:04.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.347+0000 7fe58adff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5840d2640 0x7fe58415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:04.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.347+0000 7fe58adff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe58415c460 0x7fe58414cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:04.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.347+0000 7fe58adff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5840c7460 con 0x7fe5840cf8f0 2023-07-12T02:04:04.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.347+0000 7fe58adff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5840cbbb0 con 0x7fe5840d2640 2023-07-12T02:04:04.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.347+0000 7fe58adff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5840cbe90 con 0x7fe58415c460 2023-07-12T02:04:04.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.347+0000 7fe588b9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5840cf8f0 0x7fe58415f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:04.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.347+0000 7fe588b9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5840cf8f0 0x7fe58415f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45384/0 (socket says 172.21.15.37:45384) 2023-07-12T02:04:04.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.347+0000 7fe588b9b700 1 -- 172.21.15.37:0/1683745216 learned_addr learned my addr 172.21.15.37:0/1683745216 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:04.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.347+0000 7fe58939c700 1 --2- 172.21.15.37:0/1683745216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe58415c460 0x7fe58414cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:04.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.347+0000 7fe583fff700 1 --2- 172.21.15.37:0/1683745216 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5840d2640 0x7fe58415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:04.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.348+0000 7fe588b9b700 1 -- 172.21.15.37:0/1683745216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe58415c460 msgr2=0x7fe58414cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:04.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.348+0000 7fe588b9b700 1 --2- 172.21.15.37:0/1683745216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe58415c460 0x7fe58414cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.348+0000 7fe588b9b700 1 -- 172.21.15.37:0/1683745216 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5840d2640 msgr2=0x7fe58415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:04.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.348+0000 7fe588b9b700 1 --2- 172.21.15.37:0/1683745216 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5840d2640 0x7fe58415ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.348+0000 7fe588b9b700 1 -- 172.21.15.37:0/1683745216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe570009550 con 0x7fe5840cf8f0 2023-07-12T02:04:04.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.348+0000 7fe583fff700 1 --2- 172.21.15.37:0/1683745216 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5840d2640 0x7fe58415ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:04.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.348+0000 7fe588b9b700 1 --2- 172.21.15.37:0/1683745216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5840cf8f0 0x7fe58415f140 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe5780011e0 tx=0x7fe57800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:04.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.348+0000 7fe5817fa700 1 -- 172.21.15.37:0/1683745216 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578004c80 con 0x7fe5840cf8f0 2023-07-12T02:04:04.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.348+0000 7fe5817fa700 1 -- 172.21.15.37:0/1683745216 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe578004de0 con 0x7fe5840cf8f0 2023-07-12T02:04:04.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.348+0000 7fe5817fa700 1 -- 172.21.15.37:0/1683745216 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578007310 con 0x7fe5840cf8f0 2023-07-12T02:04:04.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.348+0000 7fe58adff700 1 -- 172.21.15.37:0/1683745216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5840cc170 con 0x7fe5840cf8f0 2023-07-12T02:04:04.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.348+0000 7fe58adff700 1 -- 172.21.15.37:0/1683745216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58415f680 con 0x7fe5840cf8f0 2023-07-12T02:04:04.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.349+0000 7fe58adff700 1 -- 172.21.15.37:0/1683745216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe58404ea60 con 0x7fe5840cf8f0 2023-07-12T02:04:04.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.350+0000 7fe5817fa700 1 -- 172.21.15.37:0/1683745216 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe578007470 con 0x7fe5840cf8f0 2023-07-12T02:04:04.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.351+0000 7fe5817fa700 1 --2- 172.21.15.37:0/1683745216 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe56806ace0 0x7fe56806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:04.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.351+0000 7fe5817fa700 1 -- 172.21.15.37:0/1683745216 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe5780894e0 con 0x7fe5840cf8f0 2023-07-12T02:04:04.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.352+0000 7fe583fff700 1 --2- 172.21.15.37:0/1683745216 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe56806ace0 0x7fe56806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:04.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.352+0000 7fe583fff700 1 --2- 172.21.15.37:0/1683745216 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe56806ace0 0x7fe56806d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe570014040 tx=0x7fe570008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:04.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.355+0000 7fe5817fa700 1 -- 172.21.15.37:0/1683745216 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe578054200 con 0x7fe5840cf8f0 2023-07-12T02:04:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.566+0000 7fe58adff700 1 -- 172.21.15.37:0/1683745216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5840b4fa0 con 0x7fe5840cf8f0 2023-07-12T02:04:04.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.568+0000 7fe5817fa700 1 -- 172.21.15.37:0/1683745216 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7fe578057820 con 0x7fe5840cf8f0 2023-07-12T02:04:04.572 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:04.572 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:02.702198+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:04:04.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.570+0000 7fe58adff700 1 -- 172.21.15.37:0/1683745216 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe56806ace0 msgr2=0x7fe56806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:04.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.570+0000 7fe58adff700 1 --2- 172.21.15.37:0/1683745216 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe56806ace0 0x7fe56806d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe570014040 tx=0x7fe570008030 comp rx=0 tx=0).stop 2023-07-12T02:04:04.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.570+0000 7fe58adff700 1 -- 172.21.15.37:0/1683745216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5840cf8f0 msgr2=0x7fe58415f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:04.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.570+0000 7fe58adff700 1 --2- 172.21.15.37:0/1683745216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5840cf8f0 0x7fe58415f140 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe5780011e0 tx=0x7fe57800ca30 comp rx=0 tx=0).stop 2023-07-12T02:04:04.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.570+0000 7fe58adff700 1 -- 172.21.15.37:0/1683745216 shutdown_connections 2023-07-12T02:04:04.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.570+0000 7fe58adff700 1 --2- 172.21.15.37:0/1683745216 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe56806ace0 0x7fe56806d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.570+0000 7fe58adff700 1 --2- 172.21.15.37:0/1683745216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5840cf8f0 0x7fe58415f140 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.570+0000 7fe58adff700 1 --2- 172.21.15.37:0/1683745216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe58415c460 0x7fe58414cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.570+0000 7fe58adff700 1 --2- 172.21.15.37:0/1683745216 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5840d2640 0x7fe58415ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.570+0000 7fe58adff700 1 -- 172.21.15.37:0/1683745216 >> 172.21.15.37:0/1683745216 conn(0x7fe584071660 msgr2=0x7fe58406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:04.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.570+0000 7fe58adff700 1 -- 172.21.15.37:0/1683745216 shutdown_connections 2023-07-12T02:04:04.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.570+0000 7fe58adff700 1 -- 172.21.15.37:0/1683745216 wait complete. 2023-07-12T02:04:04.606 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:04:04.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.802+0000 7f215e5ff700 1 Processor -- start 2023-07-12T02:04:04.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.803+0000 7f215e5ff700 1 -- start start 2023-07-12T02:04:04.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.804+0000 7f215e5ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f21580b8320 0x7f21580cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:04.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.804+0000 7f215e5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21580d1cd0 0x7f21581608e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:04.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.804+0000 7f215e5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21580b45b0 0x7f21580b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:04.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.804+0000 7f215e5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2158160e20 con 0x7f21580d1cd0 2023-07-12T02:04:04.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.804+0000 7f215e5ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21580b4f50 con 0x7f21580b8320 2023-07-12T02:04:04.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.804+0000 7f215e5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21580cf3b0 con 0x7f21580b45b0 2023-07-12T02:04:04.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.804+0000 7f21577fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21580d1cd0 0x7f21581608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:04.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.804+0000 7f21577fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21580d1cd0 0x7f21581608e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45398/0 (socket says 172.21.15.37:45398) 2023-07-12T02:04:04.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.804+0000 7f21577fe700 1 -- 172.21.15.37:0/1799291962 learned_addr learned my addr 172.21.15.37:0/1799291962 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:04.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.804+0000 7f2157fff700 1 --2- 172.21.15.37:0/1799291962 >> v2:172.21.15.196:3300/0 conn(0x7f21580b8320 0x7f21580cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:04.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.804+0000 7f215cb9c700 1 --2- 172.21.15.37:0/1799291962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21580b45b0 0x7f21580b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:04.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.805+0000 7f21577fe700 1 -- 172.21.15.37:0/1799291962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21580b45b0 msgr2=0x7f21580b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:04.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.805+0000 7f21577fe700 1 --2- 172.21.15.37:0/1799291962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21580b45b0 0x7f21580b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.805+0000 7f21577fe700 1 -- 172.21.15.37:0/1799291962 >> v2:172.21.15.196:3300/0 conn(0x7f21580b8320 msgr2=0x7f21580cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:04.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.805+0000 7f21577fe700 1 --2- 172.21.15.37:0/1799291962 >> v2:172.21.15.196:3300/0 conn(0x7f21580b8320 0x7f21580cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.805+0000 7f21577fe700 1 -- 172.21.15.37:0/1799291962 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21580b86f0 con 0x7f21580d1cd0 2023-07-12T02:04:04.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.805+0000 7f2157fff700 1 --2- 172.21.15.37:0/1799291962 >> v2:172.21.15.196:3300/0 conn(0x7f21580b8320 0x7f21580cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:04.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.805+0000 7f21577fe700 1 --2- 172.21.15.37:0/1799291962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21580d1cd0 0x7f21581608e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2158067200 tx=0x7f214c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b462309a63657a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:04.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.805+0000 7f2156ffd700 1 -- 172.21.15.37:0/1799291962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c00b870 con 0x7f21580d1cd0 2023-07-12T02:04:04.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.805+0000 7f2156ffd700 1 -- 172.21.15.37:0/1799291962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c00b9d0 con 0x7f21580d1cd0 2023-07-12T02:04:04.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.805+0000 7f2156ffd700 1 -- 172.21.15.37:0/1799291962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c00bd60 con 0x7f21580d1cd0 2023-07-12T02:04:04.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.806+0000 7f215e5ff700 1 -- 172.21.15.37:0/1799291962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21580d1cd0 msgr2=0x7f21581608e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:04.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.806+0000 7f215e5ff700 1 --2- 172.21.15.37:0/1799291962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21580d1cd0 0x7f21581608e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2158067200 tx=0x7f214c009bd0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.806+0000 7f215e5ff700 1 -- 172.21.15.37:0/1799291962 shutdown_connections 2023-07-12T02:04:04.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.806+0000 7f215e5ff700 1 --2- 172.21.15.37:0/1799291962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21580b45b0 0x7f21580b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.806+0000 7f215e5ff700 1 --2- 172.21.15.37:0/1799291962 >> v2:172.21.15.196:3300/0 conn(0x7f21580b8320 0x7f21580cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.806+0000 7f215e5ff700 1 --2- 172.21.15.37:0/1799291962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21580d1cd0 0x7f21581608e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.806+0000 7f215e5ff700 1 -- 172.21.15.37:0/1799291962 >> 172.21.15.37:0/1799291962 conn(0x7f21580722b0 msgr2=0x7f21580cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:04.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.806+0000 7f215e5ff700 1 -- 172.21.15.37:0/1799291962 shutdown_connections 2023-07-12T02:04:04.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.806+0000 7f215e5ff700 1 -- 172.21.15.37:0/1799291962 wait complete. 2023-07-12T02:04:04.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.808+0000 7f215e5ff700 1 Processor -- start 2023-07-12T02:04:04.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.808+0000 7f215e5ff700 1 -- start start 2023-07-12T02:04:04.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.809+0000 7f215e5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21580b8320 0x7f215814d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:04.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.809+0000 7f215e5ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21580d1cd0 0x7f21580c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:04.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.809+0000 7f215e5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21580cc8c0 0x7f21580ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:04.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.809+0000 7f215e5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215814d8d0 con 0x7f21580cc8c0 2023-07-12T02:04:04.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.809+0000 7f215e5ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215815e4a0 con 0x7f21580d1cd0 2023-07-12T02:04:04.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.809+0000 7f215e5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215815e740 con 0x7f21580b8320 2023-07-12T02:04:04.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.809+0000 7f215cb9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21580cc8c0 0x7f21580ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:04.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.809+0000 7f215cb9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21580cc8c0 0x7f21580ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45400/0 (socket says 172.21.15.37:45400) 2023-07-12T02:04:04.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.809+0000 7f215cb9c700 1 -- 172.21.15.37:0/2868745343 learned_addr learned my addr 172.21.15.37:0/2868745343 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:04.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.809+0000 7f2157fff700 1 --2- 172.21.15.37:0/2868745343 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21580b8320 0x7f215814d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:04.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.809+0000 7f21577fe700 1 --2- 172.21.15.37:0/2868745343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21580d1cd0 0x7f21580c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.809+0000 7f215cb9c700 1 -- 172.21.15.37:0/2868745343 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21580b8320 msgr2=0x7f215814d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.809+0000 7f215cb9c700 1 --2- 172.21.15.37:0/2868745343 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21580b8320 0x7f215814d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.809+0000 7f215cb9c700 1 -- 172.21.15.37:0/2868745343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21580d1cd0 msgr2=0x7f21580c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.809+0000 7f215cb9c700 1 --2- 172.21.15.37:0/2868745343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21580d1cd0 0x7f21580c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.809+0000 7f215cb9c700 1 -- 172.21.15.37:0/2868745343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c009550 con 0x7f21580cc8c0 2023-07-12T02:04:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.810+0000 7f215cb9c700 1 --2- 172.21.15.37:0/2868745343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21580cc8c0 0x7f21580ca5a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2150007d20 tx=0x7f215000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:04.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.810+0000 7f2154ff9700 1 -- 172.21.15.37:0/2868745343 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215000ede0 con 0x7f21580cc8c0 2023-07-12T02:04:04.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.810+0000 7f2154ff9700 1 -- 172.21.15.37:0/2868745343 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2150007e70 con 0x7f21580cc8c0 2023-07-12T02:04:04.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.810+0000 7f2154ff9700 1 -- 172.21.15.37:0/2868745343 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2150014640 con 0x7f21580cc8c0 2023-07-12T02:04:04.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.810+0000 7f215e5ff700 1 -- 172.21.15.37:0/2868745343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215815ea20 con 0x7f21580cc8c0 2023-07-12T02:04:04.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.810+0000 7f215e5ff700 1 -- 172.21.15.37:0/2868745343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21580b63b0 con 0x7f21580cc8c0 2023-07-12T02:04:04.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.811+0000 7f215e5ff700 1 -- 172.21.15.37:0/2868745343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21580b65a0 con 0x7f21580cc8c0 2023-07-12T02:04:04.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.812+0000 7f2154ff9700 1 -- 172.21.15.37:0/2868745343 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f21500147a0 con 0x7f21580cc8c0 2023-07-12T02:04:04.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.813+0000 7f2154ff9700 1 --2- 172.21.15.37:0/2868745343 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f214406ace0 0x7f214406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:04.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.813+0000 7f2154ff9700 1 -- 172.21.15.37:0/2868745343 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2150089cf0 con 0x7f21580cc8c0 2023-07-12T02:04:04.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.814+0000 7f2157fff700 1 --2- 172.21.15.37:0/2868745343 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f214406ace0 0x7f214406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:04.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.814+0000 7f2157fff700 1 --2- 172.21.15.37:0/2868745343 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f214406ace0 0x7f214406d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f21480099d0 tx=0x7f2148008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:04.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:04.817+0000 7f2154ff9700 1 -- 172.21.15.37:0/2868745343 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f215008e070 con 0x7f21580cc8c0 2023-07-12T02:04:05.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.072+0000 7f215e5ff700 1 -- 172.21.15.37:0/2868745343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f215804ea60 con 0x7f21580cc8c0 2023-07-12T02:04:05.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.073+0000 7f2154ff9700 1 -- 172.21.15.37:0/2868745343 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f2150054b40 con 0x7f21580cc8c0 2023-07-12T02:04:05.076 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:05.077 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/2496042538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":2496042538},{"type":"v1","addr":"172.21.15.196:6836","nonce":2496042538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2193116262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":2193116262},{"type":"v1","addr":"172.21.15.196:6837","nonce":2193116262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3195008737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3195008737},{"type":"v1","addr":"172.21.15.37:6834","nonce":3195008737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:03:57.647919+0000","modified":"2023-07-12T02:04:02.702370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/4264740807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4264740807},{"type":"v1","addr":"172.21.15.37:6835","nonce":4264740807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-12T02:04:05.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.075+0000 7f215e5ff700 1 -- 172.21.15.37:0/2868745343 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f214406ace0 msgr2=0x7f214406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:05.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.075+0000 7f215e5ff700 1 --2- 172.21.15.37:0/2868745343 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f214406ace0 0x7f214406d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f21480099d0 tx=0x7f2148008040 comp rx=0 tx=0).stop 2023-07-12T02:04:05.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.075+0000 7f215e5ff700 1 -- 172.21.15.37:0/2868745343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21580cc8c0 msgr2=0x7f21580ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:05.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.075+0000 7f215e5ff700 1 --2- 172.21.15.37:0/2868745343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21580cc8c0 0x7f21580ca5a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2150007d20 tx=0x7f215000e3c0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.075+0000 7f215e5ff700 1 -- 172.21.15.37:0/2868745343 shutdown_connections 2023-07-12T02:04:05.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.075+0000 7f215e5ff700 1 --2- 172.21.15.37:0/2868745343 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f214406ace0 0x7f214406d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.075+0000 7f215e5ff700 1 --2- 172.21.15.37:0/2868745343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21580cc8c0 0x7f21580ca5a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.075+0000 7f215e5ff700 1 --2- 172.21.15.37:0/2868745343 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21580b8320 0x7f215814d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.075+0000 7f215e5ff700 1 --2- 172.21.15.37:0/2868745343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21580d1cd0 0x7f21580c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.075+0000 7f215e5ff700 1 -- 172.21.15.37:0/2868745343 >> 172.21.15.37:0/2868745343 conn(0x7f21580b45b0 msgr2=0x7f21581606b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:05.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.075+0000 7f215e5ff700 1 -- 172.21.15.37:0/2868745343 shutdown_connections 2023-07-12T02:04:05.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.075+0000 7f215e5ff700 1 -- 172.21.15.37:0/2868745343 wait complete. 2023-07-12T02:04:05.081 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-07-12T02:04:05.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:04:05.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.295+0000 7f418a5ff700 1 Processor -- start 2023-07-12T02:04:05.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.295+0000 7f418a5ff700 1 -- start start 2023-07-12T02:04:05.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.296+0000 7f418a5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f418415c460 0x7f41840b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:05.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.296+0000 7f418a5ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f41840d2640 0x7f41840cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:05.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.296+0000 7f418a5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41840cf720 0x7f41840cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:05.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.296+0000 7f418a5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41840cedd0 con 0x7f41840cf720 2023-07-12T02:04:05.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.296+0000 7f418a5ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41840d1790 con 0x7f41840d2640 2023-07-12T02:04:05.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.296+0000 7f418a5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41840cd950 con 0x7f418415c460 2023-07-12T02:04:05.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.297+0000 7f4188b9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41840cf720 0x7f41840cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:05.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.297+0000 7f4188b9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41840cf720 0x7f41840cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45402/0 (socket says 172.21.15.37:45402) 2023-07-12T02:04:05.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.297+0000 7f4188b9c700 1 -- 172.21.15.37:0/1678556545 learned_addr learned my addr 172.21.15.37:0/1678556545 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:05.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.297+0000 7f4188b9c700 1 -- 172.21.15.37:0/1678556545 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f418415c460 msgr2=0x7f41840b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.297+0000 7f4188b9c700 1 --2- 172.21.15.37:0/1678556545 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f418415c460 0x7f41840b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.297+0000 7f4188b9c700 1 -- 172.21.15.37:0/1678556545 >> v2:172.21.15.196:3300/0 conn(0x7f41840d2640 msgr2=0x7f41840cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.297+0000 7f41837fe700 1 --2- 172.21.15.37:0/1678556545 >> v2:172.21.15.196:3300/0 conn(0x7f41840d2640 0x7f41840cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.297+0000 7f4188b9c700 1 --2- 172.21.15.37:0/1678556545 >> v2:172.21.15.196:3300/0 conn(0x7f41840d2640 0x7f41840cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.297+0000 7f4188b9c700 1 -- 172.21.15.37:0/1678556545 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41840d14b0 con 0x7f41840cf720 2023-07-12T02:04:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.297+0000 7f41837fe700 1 --2- 172.21.15.37:0/1678556545 >> v2:172.21.15.196:3300/0 conn(0x7f41840d2640 0x7f41840cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.297+0000 7f4188b9c700 1 --2- 172.21.15.37:0/1678556545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41840cf720 0x7f41840cfbc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f41840d3c50 tx=0x7f417c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42fd5e2104a45f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.298+0000 7f4182ffd700 1 -- 172.21.15.37:0/1678556545 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c00e070 con 0x7f41840cf720 2023-07-12T02:04:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.298+0000 7f4182ffd700 1 -- 172.21.15.37:0/1678556545 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c00b9c0 con 0x7f41840cf720 2023-07-12T02:04:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.298+0000 7f4182ffd700 1 -- 172.21.15.37:0/1678556545 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c00bd70 con 0x7f41840cf720 2023-07-12T02:04:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.298+0000 7f418a5ff700 1 -- 172.21.15.37:0/1678556545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41840cf720 msgr2=0x7f41840cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.298+0000 7f418a5ff700 1 --2- 172.21.15.37:0/1678556545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41840cf720 0x7f41840cfbc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f41840d3c50 tx=0x7f417c00b330 comp rx=0 tx=0).stop 2023-07-12T02:04:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.298+0000 7f418a5ff700 1 -- 172.21.15.37:0/1678556545 shutdown_connections 2023-07-12T02:04:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.298+0000 7f418a5ff700 1 --2- 172.21.15.37:0/1678556545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41840cf720 0x7f41840cfbc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.298+0000 7f418a5ff700 1 --2- 172.21.15.37:0/1678556545 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f418415c460 0x7f41840b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.298+0000 7f418a5ff700 1 --2- 172.21.15.37:0/1678556545 >> v2:172.21.15.196:3300/0 conn(0x7f41840d2640 0x7f41840cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.298+0000 7f418a5ff700 1 -- 172.21.15.37:0/1678556545 >> 172.21.15.37:0/1678556545 conn(0x7f4184071660 msgr2=0x7f4184071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.298+0000 7f418a5ff700 1 -- 172.21.15.37:0/1678556545 shutdown_connections 2023-07-12T02:04:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.298+0000 7f418a5ff700 1 -- 172.21.15.37:0/1678556545 wait complete. 2023-07-12T02:04:05.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.300+0000 7f418a5ff700 1 Processor -- start 2023-07-12T02:04:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.300+0000 7f418a5ff700 1 -- start start 2023-07-12T02:04:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.301+0000 7f418a5ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f41840cf720 0x7f418414a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.301+0000 7f418a5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41840d2640 0x7f41841470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.301+0000 7f418a5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418415c460 0x7f41840c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.301+0000 7f418a5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4184158820 con 0x7f418415c460 2023-07-12T02:04:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.301+0000 7f418a5ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418414a990 con 0x7f41840cf720 2023-07-12T02:04:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.301+0000 7f418a5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41840ca1c0 con 0x7f41840d2640 2023-07-12T02:04:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.302+0000 7f4188b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418415c460 0x7f41840c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.302+0000 7f4188b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418415c460 0x7f41840c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45410/0 (socket says 172.21.15.37:45410) 2023-07-12T02:04:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.302+0000 7f4188b9c700 1 -- 172.21.15.37:0/2411972209 learned_addr learned my addr 172.21.15.37:0/2411972209 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.302+0000 7f4183fff700 1 --2- 172.21.15.37:0/2411972209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f41840cf720 0x7f418414a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.302+0000 7f41837fe700 1 --2- 172.21.15.37:0/2411972209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41840d2640 0x7f41841470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.302+0000 7f4188b9c700 1 -- 172.21.15.37:0/2411972209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41840d2640 msgr2=0x7f41841470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.302+0000 7f4188b9c700 1 --2- 172.21.15.37:0/2411972209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41840d2640 0x7f41841470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.302+0000 7f4188b9c700 1 -- 172.21.15.37:0/2411972209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f41840cf720 msgr2=0x7f418414a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.302+0000 7f4188b9c700 1 --2- 172.21.15.37:0/2411972209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f41840cf720 0x7f418414a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.302+0000 7f4188b9c700 1 -- 172.21.15.37:0/2411972209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c009b30 con 0x7f418415c460 2023-07-12T02:04:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.302+0000 7f4188b9c700 1 --2- 172.21.15.37:0/2411972209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418415c460 0x7f41840c8880 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b370 tx=0x7f417c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.303+0000 7f4180ff9700 1 -- 172.21.15.37:0/2411972209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c004310 con 0x7f418415c460 2023-07-12T02:04:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.303+0000 7f4180ff9700 1 -- 172.21.15.37:0/2411972209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c004470 con 0x7f418415c460 2023-07-12T02:04:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.303+0000 7f418a5ff700 1 -- 172.21.15.37:0/2411972209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41840ca4a0 con 0x7f418415c460 2023-07-12T02:04:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.303+0000 7f4180ff9700 1 -- 172.21.15.37:0/2411972209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c004820 con 0x7f418415c460 2023-07-12T02:04:05.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.303+0000 7f418a5ff700 1 -- 172.21.15.37:0/2411972209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41840caa60 con 0x7f418415c460 2023-07-12T02:04:05.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.304+0000 7f418a5ff700 1 -- 172.21.15.37:0/2411972209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418404ea60 con 0x7f418415c460 2023-07-12T02:04:05.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.305+0000 7f4180ff9700 1 -- 172.21.15.37:0/2411972209 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f417c01b430 con 0x7f418415c460 2023-07-12T02:04:05.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.305+0000 7f4180ff9700 1 --2- 172.21.15.37:0/2411972209 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f417006ace0 0x7f417006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:05.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.306+0000 7f4180ff9700 1 -- 172.21.15.37:0/2411972209 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f417c08a9d0 con 0x7f418415c460 2023-07-12T02:04:05.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.306+0000 7f4183fff700 1 --2- 172.21.15.37:0/2411972209 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f417006ace0 0x7f417006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:05.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.307+0000 7f4183fff700 1 --2- 172.21.15.37:0/2411972209 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f417006ace0 0x7f417006d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4174009970 tx=0x7f4174009110 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.310+0000 7f4180ff9700 1 -- 172.21.15.37:0/2411972209 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f417c055780 con 0x7f418415c460 2023-07-12T02:04:05.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.519+0000 7f418a5ff700 1 -- 172.21.15.37:0/2411972209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41840ccf40 con 0x7f418415c460 2023-07-12T02:04:05.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.520+0000 7f4180ff9700 1 -- 172.21.15.37:0/2411972209 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f417c058da0 con 0x7f418415c460 2023-07-12T02:04:05.524 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:05.524 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:02.702198+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:04:05.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.523+0000 7f418a5ff700 1 -- 172.21.15.37:0/2411972209 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f417006ace0 msgr2=0x7f417006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:05.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.523+0000 7f418a5ff700 1 --2- 172.21.15.37:0/2411972209 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f417006ace0 0x7f417006d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4174009970 tx=0x7f4174009110 comp rx=0 tx=0).stop 2023-07-12T02:04:05.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.523+0000 7f418a5ff700 1 -- 172.21.15.37:0/2411972209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418415c460 msgr2=0x7f41840c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:05.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.523+0000 7f418a5ff700 1 --2- 172.21.15.37:0/2411972209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418415c460 0x7f41840c8880 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b370 tx=0x7f417c004ad0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.523+0000 7f418a5ff700 1 -- 172.21.15.37:0/2411972209 shutdown_connections 2023-07-12T02:04:05.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.523+0000 7f418a5ff700 1 --2- 172.21.15.37:0/2411972209 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f417006ace0 0x7f417006d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.523+0000 7f418a5ff700 1 --2- 172.21.15.37:0/2411972209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418415c460 0x7f41840c8880 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.523+0000 7f418a5ff700 1 --2- 172.21.15.37:0/2411972209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f41840cf720 0x7f418414a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.523+0000 7f418a5ff700 1 --2- 172.21.15.37:0/2411972209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41840d2640 0x7f41841470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.523+0000 7f418a5ff700 1 -- 172.21.15.37:0/2411972209 >> 172.21.15.37:0/2411972209 conn(0x7f4184071660 msgr2=0x7f418406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.523+0000 7f418a5ff700 1 -- 172.21.15.37:0/2411972209 shutdown_connections 2023-07-12T02:04:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:05.523+0000 7f418a5ff700 1 -- 172.21.15.37:0/2411972209 wait complete. 2023-07-12T02:04:05.948 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-12T02:03:57.647919+0000', 'modified': '2023-07-12T02:04:02.702370+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/4264740807', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 4264740807}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 4264740807}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-07-12T02:04:05.949 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-12T02:04:05.949 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-12T02:04:06.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.152+0000 7f73633ff700 1 Processor -- start 2023-07-12T02:04:06.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.152+0000 7f73633ff700 1 -- start start 2023-07-12T02:04:06.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.154+0000 7f73633ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f735c0d2640 0x7f735c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.154+0000 7f73633ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f735c0d1790 con 0x7f735c0cf8f0 2023-07-12T02:04:06.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.154+0000 7f73633ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f735c0cd950 con 0x7f735c15c460 2023-07-12T02:04:06.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.154+0000 7f73633ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f735c0cedd0 con 0x7f735c0d2640 2023-07-12T02:04:06.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.154+0000 7f736119b700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f735c15c460 0x7f735c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:55826/0 (socket says 172.21.15.37:55826) 2023-07-12T02:04:06.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.154+0000 7f736119b700 1 -- 172.21.15.37:0/494824775 learned_addr learned my addr 172.21.15.37:0/494824775 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:06.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.154+0000 7f736099a700 1 --2- 172.21.15.37:0/494824775 >> v2:172.21.15.37:3300/0 conn(0x7f735c0d2640 0x7f735c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.154+0000 7f736099a700 1 -- 172.21.15.37:0/494824775 >> v1:172.21.15.196:6789/0 conn(0x7f735c15c460 legacy=0x7f735c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:06.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.154+0000 7f736099a700 1 -- 172.21.15.37:0/494824775 >> v1:172.21.15.37:6789/0 conn(0x7f735c0cf8f0 legacy=0x7f735c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:06.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.154+0000 7f736099a700 1 -- 172.21.15.37:0/494824775 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c0d14b0 con 0x7f735c0d2640 2023-07-12T02:04:06.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.155+0000 7f736099a700 1 --2- 172.21.15.37:0/494824775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f735c0d2640 0x7f735c0b59d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f734c009840 tx=0x7f734c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7b546eebe0756 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:06.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.155+0000 7f7353fff700 1 -- 172.21.15.37:0/494824775 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c011830 con 0x7f735c0d2640 2023-07-12T02:04:06.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.155+0000 7f7353fff700 1 -- 172.21.15.37:0/494824775 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734c011990 con 0x7f735c0d2640 2023-07-12T02:04:06.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.155+0000 7f7353fff700 1 -- 172.21.15.37:0/494824775 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c011d20 con 0x7f735c0d2640 2023-07-12T02:04:06.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.156+0000 7f73633ff700 1 -- 172.21.15.37:0/494824775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f735c0d2640 msgr2=0x7f735c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.156+0000 7f73633ff700 1 --2- 172.21.15.37:0/494824775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f735c0d2640 0x7f735c0b59d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f734c009840 tx=0x7f734c009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.156+0000 7f73633ff700 1 -- 172.21.15.37:0/494824775 shutdown_connections 2023-07-12T02:04:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.156+0000 7f73633ff700 1 --2- 172.21.15.37:0/494824775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f735c0d2640 0x7f735c0b59d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.156+0000 7f73633ff700 1 -- 172.21.15.37:0/494824775 >> 172.21.15.37:0/494824775 conn(0x7f735c071660 msgr2=0x7f735c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.156+0000 7f73633ff700 1 -- 172.21.15.37:0/494824775 shutdown_connections 2023-07-12T02:04:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.156+0000 7f73633ff700 1 -- 172.21.15.37:0/494824775 wait complete. 2023-07-12T02:04:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.158+0000 7f73633ff700 1 Processor -- start 2023-07-12T02:04:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.159+0000 7f73633ff700 1 -- start start 2023-07-12T02:04:06.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.160+0000 7f73633ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f735c0cf8f0 0x7f735c15a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.160+0000 7f73633ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f735c0d2640 0x7f735c1f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.160+0000 7f73633ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f735c15c460 0x7f735c0c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.160+0000 7f73633ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c1e60b0 con 0x7f735c0cf8f0 2023-07-12T02:04:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.160+0000 7f73633ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c1e6390 con 0x7f735c15c460 2023-07-12T02:04:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.160+0000 7f73633ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735c1f5980 con 0x7f735c0d2640 2023-07-12T02:04:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.160+0000 7f736119b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f735c0cf8f0 0x7f735c15a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.160+0000 7f736119b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f735c0cf8f0 0x7f735c15a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45428/0 (socket says 172.21.15.37:45428) 2023-07-12T02:04:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.160+0000 7f736119b700 1 -- 172.21.15.37:0/4220847582 learned_addr learned my addr 172.21.15.37:0/4220847582 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.160+0000 7f736099a700 1 --2- 172.21.15.37:0/4220847582 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f735c0d2640 0x7f735c1f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.160+0000 7f736199c700 1 --2- 172.21.15.37:0/4220847582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f735c15c460 0x7f735c0c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.161+0000 7f736119b700 1 -- 172.21.15.37:0/4220847582 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f735c0d2640 msgr2=0x7f735c1f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.161+0000 7f736119b700 1 --2- 172.21.15.37:0/4220847582 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f735c0d2640 0x7f735c1f6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.161+0000 7f736119b700 1 -- 172.21.15.37:0/4220847582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f735c15c460 msgr2=0x7f735c0c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.161+0000 7f736119b700 1 --2- 172.21.15.37:0/4220847582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f735c15c460 0x7f735c0c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.161+0000 7f736119b700 1 -- 172.21.15.37:0/4220847582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c0094a0 con 0x7f735c0cf8f0 2023-07-12T02:04:06.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.161+0000 7f736199c700 1 --2- 172.21.15.37:0/4220847582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f735c15c460 0x7f735c0c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:06.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.161+0000 7f736119b700 1 --2- 172.21.15.37:0/4220847582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f735c0cf8f0 0x7f735c15a190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f735800c520 tx=0x7f735800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:06.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.161+0000 7f7351ffb700 1 -- 172.21.15.37:0/4220847582 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358005d70 con 0x7f735c0cf8f0 2023-07-12T02:04:06.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.161+0000 7f7351ffb700 1 -- 172.21.15.37:0/4220847582 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73580070d0 con 0x7f735c0cf8f0 2023-07-12T02:04:06.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.161+0000 7f7351ffb700 1 -- 172.21.15.37:0/4220847582 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358007440 con 0x7f735c0cf8f0 2023-07-12T02:04:06.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.161+0000 7f73633ff700 1 -- 172.21.15.37:0/4220847582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735c1f5c60 con 0x7f735c0cf8f0 2023-07-12T02:04:06.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.161+0000 7f73633ff700 1 -- 172.21.15.37:0/4220847582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735c1e6670 con 0x7f735c0cf8f0 2023-07-12T02:04:06.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.165+0000 7f7351ffb700 1 -- 172.21.15.37:0/4220847582 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f73580075a0 con 0x7f735c0cf8f0 2023-07-12T02:04:06.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.166+0000 7f7351ffb700 1 --2- 172.21.15.37:0/4220847582 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f734006ace0 0x7f734006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.166+0000 7f7351ffb700 1 -- 172.21.15.37:0/4220847582 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7358088a50 con 0x7f735c0cf8f0 2023-07-12T02:04:06.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.166+0000 7f736099a700 1 --2- 172.21.15.37:0/4220847582 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f734006ace0 0x7f734006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.167+0000 7f736099a700 1 --2- 172.21.15.37:0/4220847582 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f734006ace0 0x7f734006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f734c0090b0 tx=0x7f734c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:06.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.167+0000 7f7376d02b80 1 Processor -- start 2023-07-12T02:04:06.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.167+0000 7f7376d02b80 1 -- start start 2023-07-12T02:04:06.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.168+0000 7f7376d02b80 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 0x562de9023130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.168+0000 7f7376d02b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de90281a0 0x562de9046a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.168+0000 7f7376d02b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de8ffdb60 0x562de9000120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.168+0000 7f7376d02b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de8f74ea0 con 0x562de90281a0 2023-07-12T02:04:06.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.168+0000 7f7376d02b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de8ee8600 con 0x562de8ffdb60 2023-07-12T02:04:06.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.168+0000 7f7376d02b80 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x562de8f57910 con 0x562de9022d60 2023-07-12T02:04:06.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.169+0000 7f736099a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de90281a0 0x562de9046a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.169+0000 7f736119b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 0x562de9023130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.169+0000 7f736099a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de90281a0 0x562de9046a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45436/0 (socket says 172.21.15.37:45436) 2023-07-12T02:04:06.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.169+0000 7f736099a700 1 -- 172.21.15.37:0/1478841019 learned_addr learned my addr 172.21.15.37:0/1478841019 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:06.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.169+0000 7f736199c700 1 --2- 172.21.15.37:0/1478841019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de8ffdb60 0x562de9000120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.169+0000 7f736119b700 1 -- 172.21.15.37:0/1478841019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de8ffdb60 msgr2=0x562de9000120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:06.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.169+0000 7f736119b700 1 --2- 172.21.15.37:0/1478841019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de8ffdb60 0x562de9000120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.169+0000 7f736119b700 1 -- 172.21.15.37:0/1478841019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de90281a0 msgr2=0x562de9046a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:06.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.169+0000 7f736119b700 1 --2- 172.21.15.37:0/1478841019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de90281a0 0x562de9046a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.169+0000 7f736119b700 1 -- 172.21.15.37:0/1478841019 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562de8d44790 con 0x562de9022d60 2023-07-12T02:04:06.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.169+0000 7f736119b700 1 --2- 172.21.15.37:0/1478841019 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 0x562de9023130 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7358086b90 tx=0x7f7358057240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abe5423d812d5bca server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:06.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.170+0000 7f733effd700 1 -- 172.21.15.37:0/1478841019 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735805f8b0 con 0x562de9022d60 2023-07-12T02:04:06.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.170+0000 7f733effd700 1 -- 172.21.15.37:0/1478841019 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73580559b0 con 0x562de9022d60 2023-07-12T02:04:06.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.170+0000 7f733effd700 1 -- 172.21.15.37:0/1478841019 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735805b2f0 con 0x562de9022d60 2023-07-12T02:04:06.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.170+0000 7f7376d02b80 1 -- 172.21.15.37:0/1478841019 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 msgr2=0x562de9023130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:06.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.170+0000 7f7376d02b80 1 --2- 172.21.15.37:0/1478841019 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 0x562de9023130 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7358086b90 tx=0x7f7358057240 comp rx=0 tx=0).stop 2023-07-12T02:04:06.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.170+0000 7f7376d02b80 1 -- 172.21.15.37:0/1478841019 shutdown_connections 2023-07-12T02:04:06.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.170+0000 7f7376d02b80 1 --2- 172.21.15.37:0/1478841019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de8ffdb60 0x562de9000120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.170+0000 7f7376d02b80 1 --2- 172.21.15.37:0/1478841019 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 0x562de9023130 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.170+0000 7f7376d02b80 1 --2- 172.21.15.37:0/1478841019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de90281a0 0x562de9046a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.170+0000 7f7376d02b80 1 -- 172.21.15.37:0/1478841019 >> 172.21.15.37:0/1478841019 conn(0x562de8ff5320 msgr2=0x562de90455c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:06.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.170+0000 7f7376d02b80 1 -- 172.21.15.37:0/1478841019 shutdown_connections 2023-07-12T02:04:06.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.171+0000 7f7376d02b80 1 -- 172.21.15.37:0/1478841019 wait complete. 2023-07-12T02:04:06.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.171+0000 7f7376d02b80 1 -- start start 2023-07-12T02:04:06.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.171+0000 7f7376d02b80 1 Processor -- start 2023-07-12T02:04:06.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.172+0000 7f7376d02b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de8ffdb60 0x562de901e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.172+0000 7f7376d02b80 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 0x562de903e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.172+0000 7f7376d02b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de90281a0 0x562de9048260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.172+0000 7f7376d02b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de8f50be0 con 0x562de8ffdb60 2023-07-12T02:04:06.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f7376d02b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de8f0e5b0 con 0x562de90281a0 2023-07-12T02:04:06.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f7376d02b80 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x562de8ef4910 con 0x562de9022d60 2023-07-12T02:04:06.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f7376d02b80 10 client.0 _ll_register_callbacks cb 0x562de8f0cb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-12T02:04:06.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f736119b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de8ffdb60 0x562de901e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f736119b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de8ffdb60 0x562de901e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45444/0 (socket says 172.21.15.37:45444) 2023-07-12T02:04:06.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f736119b700 1 -- 172.21.15.37:0/746226946 learned_addr learned my addr 172.21.15.37:0/746226946 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:06.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f736099a700 1 --2- 172.21.15.37:0/746226946 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 0x562de903e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f736119b700 1 -- 172.21.15.37:0/746226946 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 msgr2=0x562de903e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:06.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f736199c700 1 --2- 172.21.15.37:0/746226946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de90281a0 0x562de9048260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f736119b700 1 --2- 172.21.15.37:0/746226946 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 0x562de903e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f736119b700 1 -- 172.21.15.37:0/746226946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de90281a0 msgr2=0x562de9048260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:06.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f736119b700 1 --2- 172.21.15.37:0/746226946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de90281a0 0x562de9048260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f736119b700 1 -- 172.21.15.37:0/746226946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735c1e6670 con 0x562de8ffdb60 2023-07-12T02:04:06.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f736099a700 1 --2- 172.21.15.37:0/746226946 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 0x562de903e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:06.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f736199c700 1 --2- 172.21.15.37:0/746226946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de90281a0 0x562de9048260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:06.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f736119b700 1 --2- 172.21.15.37:0/746226946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de8ffdb60 0x562de901e150 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f73580575a0 tx=0x7f735800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b3e533964c4f78 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:06.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f7337fff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-12T02:04:06.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f7337fff700 1 -- 172.21.15.37:0/746226946 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735805f8b0 con 0x562de8ffdb60 2023-07-12T02:04:06.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f7337fff700 1 -- 172.21.15.37:0/746226946 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f735805d110 con 0x562de8ffdb60 2023-07-12T02:04:06.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.173+0000 7f7376d02b80 1 -- 172.21.15.37:0/746226946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562de8ff2930 con 0x562de8ffdb60 2023-07-12T02:04:06.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.174+0000 7f7337fff700 1 -- 172.21.15.37:0/746226946 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f735805d2d0 con 0x562de8ffdb60 2023-07-12T02:04:06.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.174+0000 7f7376d02b80 10 client.4446 fetch_fsmap learned FSMap version 7 2023-07-12T02:04:06.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.174+0000 7f7376d02b80 1 -- 172.21.15.37:0/746226946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562de8e310a0 con 0x562de8ffdb60 2023-07-12T02:04:06.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.174+0000 7f7337fff700 1 -- 172.21.15.37:0/746226946 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562de8ff2930 con 0x562de8ffdb60 2023-07-12T02:04:06.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.174+0000 7f7337fff700 1 -- 172.21.15.37:0/746226946 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f7358053400 con 0x562de8ffdb60 2023-07-12T02:04:06.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.174+0000 7f7376d02b80 10 client.4446 fetch_fsmap finished waiting for FSMap version 7 2023-07-12T02:04:06.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.174+0000 7f7376d02b80 10 client.4446 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-12T02:04:06.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.174+0000 7f7376d02b80 20 client.4446 populate_metadata read hostname 'smithi037' 2023-07-12T02:04:06.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.174+0000 7f7376d02b80 1 --2- 172.21.15.37:0/746226946 >> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] conn(0x562de9058000 0x562de90583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.174+0000 7f7376d02b80 4 client.4446 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-12T02:04:06.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.174+0000 7f7376d02b80 1 -- 172.21.15.37:0/746226946 --> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562de8fcf0e0 con 0x562de9058000 2023-07-12T02:04:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.174+0000 7f736099a700 1 --2- 172.21.15.37:0/746226946 >> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] conn(0x562de9058000 0x562de90583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.175+0000 7f736099a700 1 --2- 172.21.15.37:0/746226946 >> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] conn(0x562de9058000 0x562de90583d0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c085918680173a59 server_cookie=3eb76a7afc827c2f in_seq=0 out_seq=0 2023-07-12T02:04:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.175+0000 7f7337fff700 10 client.4446 ms_handle_connect on v2:172.21.15.37:6833/4264740807 2023-07-12T02:04:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.176+0000 7f7337fff700 1 -- 172.21.15.37:0/746226946 <== mds.0 v2:172.21.15.37:6833/4264740807 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562de8fcf0e0 con 0x562de9058000 2023-07-12T02:04:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.176+0000 7f7337fff700 10 client.4446 handle_command_reply: tid=0 2023-07-12T02:04:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.176+0000 7f7376d02b80 1 client.4446 shutdown 2023-07-12T02:04:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.176+0000 7f7376d02b80 1 -- 172.21.15.37:0/746226946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de8ffdb60 msgr2=0x562de901e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.176+0000 7f7376d02b80 1 --2- 172.21.15.37:0/746226946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de8ffdb60 0x562de901e150 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f73580575a0 tx=0x7f735800ce60 comp rx=0 tx=0).stop 2023-07-12T02:04:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.176+0000 7f7376d02b80 1 -- 172.21.15.37:0/746226946 shutdown_connections 2023-07-12T02:04:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.176+0000 7f7376d02b80 1 --2- 172.21.15.37:0/746226946 >> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] conn(0x562de9058000 0x562de90583d0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.176+0000 7f7376d02b80 1 --2- 172.21.15.37:0/746226946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de8ffdb60 0x562de901e150 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.176+0000 7f7376d02b80 1 --2- 172.21.15.37:0/746226946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de90281a0 0x562de9048260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.176+0000 7f7337fff700 0 client.4446 ms_handle_reset on v2:172.21.15.37:6833/4264740807 2023-07-12T02:04:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.176+0000 7f7376d02b80 1 --2- 172.21.15.37:0/746226946 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 0x562de903e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.176+0000 7f7376d02b80 1 -- 172.21.15.37:0/746226946 >> 172.21.15.37:0/746226946 conn(0x562de8ff5320 msgr2=0x562de9020ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.176+0000 7f7376d02b80 1 -- 172.21.15.37:0/746226946 shutdown_connections 2023-07-12T02:04:06.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.176+0000 7f7376d02b80 1 -- 172.21.15.37:0/746226946 wait complete. 2023-07-12T02:04:06.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.176+0000 7f7376d02b80 20 client.4446 trim_cache size 0 max 16384 2023-07-12T02:04:06.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.198+0000 7f7376d02b80 1 Processor -- start 2023-07-12T02:04:06.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.198+0000 7f7376d02b80 1 -- start start 2023-07-12T02:04:06.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.198+0000 7f7376d02b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de8ffdb60 0x562de905e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.198+0000 7f7376d02b80 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 0x562de901ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.199+0000 7f7376d02b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de90281a0 0x562de90204b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.199+0000 7f7376d02b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de8d45390 con 0x562de8ffdb60 2023-07-12T02:04:06.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.199+0000 7f7376d02b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de9001b80 con 0x562de90281a0 2023-07-12T02:04:06.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.199+0000 7f7376d02b80 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x562de9046050 con 0x562de9022d60 2023-07-12T02:04:06.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.199+0000 7f736119b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de8ffdb60 0x562de905e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.199+0000 7f736119b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de8ffdb60 0x562de905e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45456/0 (socket says 172.21.15.37:45456) 2023-07-12T02:04:06.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.199+0000 7f736119b700 1 -- 172.21.15.37:0/305681881 learned_addr learned my addr 172.21.15.37:0/305681881 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:06.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.199+0000 7f736199c700 1 --2- 172.21.15.37:0/305681881 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de90281a0 0x562de90204b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.199+0000 7f736099a700 1 --2- 172.21.15.37:0/305681881 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 0x562de901ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.199+0000 7f736119b700 1 -- 172.21.15.37:0/305681881 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 msgr2=0x562de901ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:06.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.199+0000 7f736119b700 1 --2- 172.21.15.37:0/305681881 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 0x562de901ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.199+0000 7f736119b700 1 -- 172.21.15.37:0/305681881 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de90281a0 msgr2=0x562de90204b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:06.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.199+0000 7f736119b700 1 --2- 172.21.15.37:0/305681881 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de90281a0 0x562de90204b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.199+0000 7f736119b700 1 -- 172.21.15.37:0/305681881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562de8ffa3b0 con 0x562de8ffdb60 2023-07-12T02:04:06.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.199+0000 7f736199c700 1 --2- 172.21.15.37:0/305681881 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de90281a0 0x562de90204b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:06.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.199+0000 7f736119b700 1 --2- 172.21.15.37:0/305681881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de8ffdb60 0x562de905e5b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7358056f00 tx=0x7f7358082070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a96700b4b0c247 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:06.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.200+0000 7f733f7fe700 1 -- 172.21.15.37:0/305681881 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735805f8b0 con 0x562de8ffdb60 2023-07-12T02:04:06.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.200+0000 7f733f7fe700 1 -- 172.21.15.37:0/305681881 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7358053400 con 0x562de8ffdb60 2023-07-12T02:04:06.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.200+0000 7f733f7fe700 1 -- 172.21.15.37:0/305681881 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358053570 con 0x562de8ffdb60 2023-07-12T02:04:06.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.200+0000 7f7376d02b80 1 -- 172.21.15.37:0/305681881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de8ffdb60 msgr2=0x562de905e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:06.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.200+0000 7f7376d02b80 1 --2- 172.21.15.37:0/305681881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de8ffdb60 0x562de905e5b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7358056f00 tx=0x7f7358082070 comp rx=0 tx=0).stop 2023-07-12T02:04:06.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.200+0000 7f7376d02b80 1 -- 172.21.15.37:0/305681881 shutdown_connections 2023-07-12T02:04:06.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.200+0000 7f7376d02b80 1 --2- 172.21.15.37:0/305681881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de8ffdb60 0x562de905e5b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.200+0000 7f7376d02b80 1 --2- 172.21.15.37:0/305681881 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de90281a0 0x562de90204b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.200+0000 7f7376d02b80 1 --2- 172.21.15.37:0/305681881 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de9022d60 0x562de901ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.200+0000 7f7376d02b80 1 -- 172.21.15.37:0/305681881 >> 172.21.15.37:0/305681881 conn(0x562de8ff5320 msgr2=0x562de902a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:06.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.200+0000 7f7376d02b80 1 -- 172.21.15.37:0/305681881 shutdown_connections 2023-07-12T02:04:06.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.200+0000 7f7376d02b80 1 -- 172.21.15.37:0/305681881 wait complete. 2023-07-12T02:04:06.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.201+0000 7f7376d02b80 1 -- start start 2023-07-12T02:04:06.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.201+0000 7f7376d02b80 1 Processor -- start 2023-07-12T02:04:06.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.202+0000 7f7376d02b80 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de8ffdb60 0x562de902e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.202+0000 7f7376d02b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9022d60 0x562de901ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.202+0000 7f7376d02b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de90281a0 0x562de90204b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.202+0000 7f7376d02b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de902e870 con 0x562de90281a0 2023-07-12T02:04:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.202+0000 7f7376d02b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de9094fa0 con 0x562de9022d60 2023-07-12T02:04:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.202+0000 7f7376d02b80 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x562de9053b30 con 0x562de8ffdb60 2023-07-12T02:04:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.202+0000 7f7376d02b80 10 client.0 _ll_register_callbacks cb 0x7f734c011750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-12T02:04:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.203+0000 7f736119b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de8ffdb60 0x562de902e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.203+0000 7f736119b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de8ffdb60 0x562de902e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:33502/0 (socket says 172.21.15.37:33502) 2023-07-12T02:04:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.203+0000 7f736119b700 1 -- 172.21.15.37:0/2967266016 learned_addr learned my addr 172.21.15.37:0/2967266016 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.203+0000 7f736199c700 1 --2- 172.21.15.37:0/2967266016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de90281a0 0x562de90204b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.203+0000 7f736099a700 1 --2- 172.21.15.37:0/2967266016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9022d60 0x562de901ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.203+0000 7f736119b700 1 -- 172.21.15.37:0/2967266016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9022d60 msgr2=0x562de901ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.203+0000 7f736119b700 1 --2- 172.21.15.37:0/2967266016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9022d60 0x562de901ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.203+0000 7f736119b700 1 -- 172.21.15.37:0/2967266016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de90281a0 msgr2=0x562de90204b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.203+0000 7f736119b700 1 --2- 172.21.15.37:0/2967266016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de90281a0 0x562de90204b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.203+0000 7f736119b700 1 -- 172.21.15.37:0/2967266016 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562de8e310a0 con 0x562de8ffdb60 2023-07-12T02:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.203+0000 7f736119b700 1 --2- 172.21.15.37:0/2967266016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de8ffdb60 0x562de902e330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7358057310 tx=0x7f7358001280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=def0d3ea2e11b675 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.203+0000 7f7337fff700 10 client.0 ms_handle_connect on v2:172.21.15.196:3301/0 2023-07-12T02:04:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.204+0000 7f7337fff700 1 -- 172.21.15.37:0/2967266016 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358053570 con 0x562de8ffdb60 2023-07-12T02:04:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.204+0000 7f7337fff700 1 -- 172.21.15.37:0/2967266016 <== mon.2 v2:172.21.15.196:3301/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f735807f020 con 0x562de8ffdb60 2023-07-12T02:04:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.204+0000 7f7376d02b80 1 -- 172.21.15.37:0/2967266016 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f73580559b0 con 0x562de8ffdb60 2023-07-12T02:04:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.204+0000 7f7337fff700 1 -- 172.21.15.37:0/2967266016 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7358053950 con 0x562de8ffdb60 2023-07-12T02:04:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.204+0000 7f7376d02b80 10 client.4346 fetch_fsmap learned FSMap version 7 2023-07-12T02:04:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.204+0000 7f7376d02b80 1 -- 172.21.15.37:0/2967266016 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562de8f16b10 con 0x562de8ffdb60 2023-07-12T02:04:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.204+0000 7f7337fff700 1 -- 172.21.15.37:0/2967266016 <== mon.2 v2:172.21.15.196:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73580559b0 con 0x562de8ffdb60 2023-07-12T02:04:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.204+0000 7f7337fff700 1 -- 172.21.15.37:0/2967266016 <== mon.2 v2:172.21.15.196:3301/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f735805fb00 con 0x562de8ffdb60 2023-07-12T02:04:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.204+0000 7f7376d02b80 10 client.4346 fetch_fsmap finished waiting for FSMap version 7 2023-07-12T02:04:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.204+0000 7f7376d02b80 10 client.4346 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-12T02:04:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.204+0000 7f7376d02b80 20 client.4346 populate_metadata read hostname 'smithi037' 2023-07-12T02:04:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.204+0000 7f7376d02b80 1 --2- 172.21.15.37:0/2967266016 >> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] conn(0x562de901c340 0x562de901c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.204+0000 7f7376d02b80 4 client.4346 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-07-12T02:04:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.204+0000 7f7376d02b80 1 -- 172.21.15.37:0/2967266016 --> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562de8f49d20 con 0x562de901c340 2023-07-12T02:04:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.205+0000 7f736099a700 1 --2- 172.21.15.37:0/2967266016 >> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] conn(0x562de901c340 0x562de901c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.205+0000 7f7337fff700 10 client.4346 ms_handle_connect on v2:172.21.15.37:6833/4264740807 2023-07-12T02:04:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.205+0000 7f736099a700 1 --2- 172.21.15.37:0/2967266016 >> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] conn(0x562de901c340 0x562de901c710 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9507c07d0bbfff8b server_cookie=b30c21def6d9ac4f in_seq=0 out_seq=0 2023-07-12T02:04:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.205+0000 7f7337fff700 1 -- 172.21.15.37:0/2967266016 <== mds.0 v2:172.21.15.37:6833/4264740807 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x562de8f49d20 con 0x562de901c340 2023-07-12T02:04:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.205+0000 7f7337fff700 10 client.4346 handle_command_reply: tid=0 2023-07-12T02:04:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.205+0000 7f7376d02b80 1 client.4346 shutdown 2023-07-12T02:04:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.206+0000 7f7376d02b80 1 -- 172.21.15.37:0/2967266016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de8ffdb60 msgr2=0x562de902e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.206+0000 7f7376d02b80 1 --2- 172.21.15.37:0/2967266016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de8ffdb60 0x562de902e330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7358057310 tx=0x7f7358001280 comp rx=0 tx=0).stop 2023-07-12T02:04:06.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.206+0000 7f7376d02b80 1 -- 172.21.15.37:0/2967266016 shutdown_connections 2023-07-12T02:04:06.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.206+0000 7f7376d02b80 1 --2- 172.21.15.37:0/2967266016 >> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] conn(0x562de901c340 0x562de901c710 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.206+0000 7f7376d02b80 1 --2- 172.21.15.37:0/2967266016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562de90281a0 0x562de90204b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.206+0000 7f7376d02b80 1 --2- 172.21.15.37:0/2967266016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562de8ffdb60 0x562de902e330 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.206+0000 7f7376d02b80 1 --2- 172.21.15.37:0/2967266016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9022d60 0x562de901ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.206+0000 7f7337fff700 0 client.4346 ms_handle_reset on v2:172.21.15.37:6833/4264740807 2023-07-12T02:04:06.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.206+0000 7f7376d02b80 1 -- 172.21.15.37:0/2967266016 >> 172.21.15.37:0/2967266016 conn(0x562de8ff5320 msgr2=0x562de902a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:06.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.206+0000 7f7376d02b80 1 -- 172.21.15.37:0/2967266016 shutdown_connections 2023-07-12T02:04:06.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.206+0000 7f7376d02b80 1 -- 172.21.15.37:0/2967266016 wait complete. 2023-07-12T02:04:06.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.206+0000 7f7376d02b80 20 client.4346 trim_cache size 0 max 16384 2023-07-12T02:04:06.217 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-12T02:04:06.217 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "e0d485b9-796c-494c-84d4-d32d9c18c85f", 2023-07-12T02:04:06.217 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-12T02:04:06.217 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4291, 2023-07-12T02:04:06.218 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-12T02:04:06.218 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-12T02:04:06.218 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-12T02:04:06.218 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 8.0781171549999993, 2023-07-12T02:04:06.218 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 7, 2023-07-12T02:04:06.218 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 27, 2023-07-12T02:04:06.218 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 26, 2023-07-12T02:04:06.218 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 14.114886987 2023-07-12T02:04:06.219 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-12T02:04:06.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.206+0000 7f73633ff700 1 -- 172.21.15.37:0/4220847582 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f734006ace0 msgr2=0x7f734006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:06.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.206+0000 7f73633ff700 1 --2- 172.21.15.37:0/4220847582 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f734006ace0 0x7f734006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f734c0090b0 tx=0x7f734c008030 comp rx=0 tx=0).stop 2023-07-12T02:04:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.207+0000 7f73633ff700 1 -- 172.21.15.37:0/4220847582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f735c0cf8f0 msgr2=0x7f735c15a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.207+0000 7f73633ff700 1 --2- 172.21.15.37:0/4220847582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f735c0cf8f0 0x7f735c15a190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f735800c520 tx=0x7f735800c830 comp rx=0 tx=0).stop 2023-07-12T02:04:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.207+0000 7f73633ff700 1 -- 172.21.15.37:0/4220847582 shutdown_connections 2023-07-12T02:04:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.207+0000 7f73633ff700 1 --2- 172.21.15.37:0/4220847582 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f734006ace0 0x7f734006d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.207+0000 7f73633ff700 1 --2- 172.21.15.37:0/4220847582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f735c0cf8f0 0x7f735c15a190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.207+0000 7f73633ff700 1 --2- 172.21.15.37:0/4220847582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f735c15c460 0x7f735c0c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.207+0000 7f73633ff700 1 --2- 172.21.15.37:0/4220847582 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f735c0d2640 0x7f735c1f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.207+0000 7f73633ff700 1 -- 172.21.15.37:0/4220847582 >> 172.21.15.37:0/4220847582 conn(0x7f735c071660 msgr2=0x7f735c0b77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.207+0000 7f73633ff700 1 -- 172.21.15.37:0/4220847582 shutdown_connections 2023-07-12T02:04:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.207+0000 7f73633ff700 1 -- 172.21.15.37:0/4220847582 wait complete. 2023-07-12T02:04:06.227 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-12T02:04:06.228 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-12T02:04:06.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-12T02:04:06.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.425+0000 7efd24fff700 1 Processor -- start 2023-07-12T02:04:06.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.426+0000 7efd24fff700 1 -- start start 2023-07-12T02:04:06.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.427+0000 7efd24fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd2015c460 0x7efd200b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.427+0000 7efd24fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7efd200d2640 0x7efd200cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.427+0000 7efd24fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efd200cf720 0x7efd200cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.427+0000 7efd24fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd200cedd0 con 0x7efd200cf720 2023-07-12T02:04:06.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.427+0000 7efd24fff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd200d1790 con 0x7efd200d2640 2023-07-12T02:04:06.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.427+0000 7efd24fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd200cd950 con 0x7efd2015c460 2023-07-12T02:04:06.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.427+0000 7efd1ed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efd200cf720 0x7efd200cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.427+0000 7efd1ed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efd200cf720 0x7efd200cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45468/0 (socket says 172.21.15.37:45468) 2023-07-12T02:04:06.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.427+0000 7efd1ed9d700 1 -- 172.21.15.37:0/3770387468 learned_addr learned my addr 172.21.15.37:0/3770387468 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:06.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.427+0000 7efd1e59c700 1 --2- 172.21.15.37:0/3770387468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd2015c460 0x7efd200b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.427+0000 7efd17fff700 1 --2- 172.21.15.37:0/3770387468 >> v2:172.21.15.196:3300/0 conn(0x7efd200d2640 0x7efd200cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.427+0000 7efd1ed9d700 1 -- 172.21.15.37:0/3770387468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd2015c460 msgr2=0x7efd200b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:06.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.427+0000 7efd1ed9d700 1 --2- 172.21.15.37:0/3770387468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd2015c460 0x7efd200b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.427+0000 7efd1ed9d700 1 -- 172.21.15.37:0/3770387468 >> v2:172.21.15.196:3300/0 conn(0x7efd200d2640 msgr2=0x7efd200cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:06.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.427+0000 7efd1ed9d700 1 --2- 172.21.15.37:0/3770387468 >> v2:172.21.15.196:3300/0 conn(0x7efd200d2640 0x7efd200cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.427+0000 7efd1ed9d700 1 -- 172.21.15.37:0/3770387468 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd200d14b0 con 0x7efd200cf720 2023-07-12T02:04:06.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.428+0000 7efd1ed9d700 1 --2- 172.21.15.37:0/3770387468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd200cf720 0x7efd200cfbc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efd200d3c50 tx=0x7efd1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc55526199d4c4b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:06.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.428+0000 7efd1dd9b700 1 -- 172.21.15.37:0/3770387468 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1800e070 con 0x7efd200cf720 2023-07-12T02:04:06.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.428+0000 7efd1dd9b700 1 -- 172.21.15.37:0/3770387468 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1800b9c0 con 0x7efd200cf720 2023-07-12T02:04:06.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.428+0000 7efd1dd9b700 1 -- 172.21.15.37:0/3770387468 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1800bd70 con 0x7efd200cf720 2023-07-12T02:04:06.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.428+0000 7efd24fff700 1 -- 172.21.15.37:0/3770387468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd200cf720 msgr2=0x7efd200cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:06.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.428+0000 7efd24fff700 1 --2- 172.21.15.37:0/3770387468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd200cf720 0x7efd200cfbc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efd200d3c50 tx=0x7efd1800b330 comp rx=0 tx=0).stop 2023-07-12T02:04:06.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.429+0000 7efd24fff700 1 -- 172.21.15.37:0/3770387468 shutdown_connections 2023-07-12T02:04:06.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.429+0000 7efd24fff700 1 --2- 172.21.15.37:0/3770387468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd200cf720 0x7efd200cfbc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.429+0000 7efd24fff700 1 --2- 172.21.15.37:0/3770387468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd2015c460 0x7efd200b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.429+0000 7efd24fff700 1 --2- 172.21.15.37:0/3770387468 >> v2:172.21.15.196:3300/0 conn(0x7efd200d2640 0x7efd200cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.429+0000 7efd24fff700 1 -- 172.21.15.37:0/3770387468 >> 172.21.15.37:0/3770387468 conn(0x7efd20071660 msgr2=0x7efd20071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:06.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.429+0000 7efd24fff700 1 -- 172.21.15.37:0/3770387468 shutdown_connections 2023-07-12T02:04:06.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.429+0000 7efd24fff700 1 -- 172.21.15.37:0/3770387468 wait complete. 2023-07-12T02:04:06.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.431+0000 7efd24fff700 1 Processor -- start 2023-07-12T02:04:06.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.431+0000 7efd24fff700 1 -- start start 2023-07-12T02:04:06.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.432+0000 7efd24fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd200cf720 0x7efd201f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.432+0000 7efd24fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd200d2640 0x7efd20157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.432+0000 7efd24fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd2015c460 0x7efd200c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.432+0000 7efd24fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd200cc1e0 con 0x7efd200d2640 2023-07-12T02:04:06.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.432+0000 7efd24fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd201f2bb0 con 0x7efd2015c460 2023-07-12T02:04:06.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.432+0000 7efd24fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd200cb5d0 con 0x7efd200cf720 2023-07-12T02:04:06.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.432+0000 7efd17fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd200d2640 0x7efd20157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.432+0000 7efd17fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd200d2640 0x7efd20157ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45484/0 (socket says 172.21.15.37:45484) 2023-07-12T02:04:06.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.432+0000 7efd17fff700 1 -- 172.21.15.37:0/1150695284 learned_addr learned my addr 172.21.15.37:0/1150695284 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:06.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.432+0000 7efd1e59c700 1 --2- 172.21.15.37:0/1150695284 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd200cf720 0x7efd201f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.432+0000 7efd1ed9d700 1 --2- 172.21.15.37:0/1150695284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd2015c460 0x7efd200c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.432+0000 7efd17fff700 1 -- 172.21.15.37:0/1150695284 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd200cf720 msgr2=0x7efd201f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:06.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.432+0000 7efd17fff700 1 --2- 172.21.15.37:0/1150695284 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd200cf720 0x7efd201f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.432+0000 7efd17fff700 1 -- 172.21.15.37:0/1150695284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd2015c460 msgr2=0x7efd200c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:06.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.432+0000 7efd17fff700 1 --2- 172.21.15.37:0/1150695284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd2015c460 0x7efd200c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.432+0000 7efd17fff700 1 -- 172.21.15.37:0/1150695284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd18009b30 con 0x7efd200d2640 2023-07-12T02:04:06.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.433+0000 7efd17fff700 1 --2- 172.21.15.37:0/1150695284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd200d2640 0x7efd20157ed0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efd0800d800 tx=0x7efd0800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:06.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.433+0000 7efd16ffd700 1 -- 172.21.15.37:0/1150695284 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd080125f0 con 0x7efd200d2640 2023-07-12T02:04:06.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.433+0000 7efd16ffd700 1 -- 172.21.15.37:0/1150695284 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd08012750 con 0x7efd200d2640 2023-07-12T02:04:06.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.433+0000 7efd16ffd700 1 -- 172.21.15.37:0/1150695284 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd08012ae0 con 0x7efd200d2640 2023-07-12T02:04:06.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.433+0000 7efd24fff700 1 -- 172.21.15.37:0/1150695284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd200cb8b0 con 0x7efd200d2640 2023-07-12T02:04:06.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.433+0000 7efd24fff700 1 -- 172.21.15.37:0/1150695284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd200cbe70 con 0x7efd200d2640 2023-07-12T02:04:06.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.434+0000 7efd24fff700 1 -- 172.21.15.37:0/1150695284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2004ea60 con 0x7efd200d2640 2023-07-12T02:04:06.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.435+0000 7efd16ffd700 1 -- 172.21.15.37:0/1150695284 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd08012c40 con 0x7efd200d2640 2023-07-12T02:04:06.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.436+0000 7efd16ffd700 1 --2- 172.21.15.37:0/1150695284 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efd0006ace0 0x7efd0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:06.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.436+0000 7efd16ffd700 1 -- 172.21.15.37:0/1150695284 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efd08089ba0 con 0x7efd200d2640 2023-07-12T02:04:06.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.436+0000 7efd1e59c700 1 --2- 172.21.15.37:0/1150695284 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efd0006ace0 0x7efd0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:06.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.437+0000 7efd1e59c700 1 --2- 172.21.15.37:0/1150695284 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efd0006ace0 0x7efd0006d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd201e7ff0 tx=0x7efd10008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:06.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.440+0000 7efd16ffd700 1 -- 172.21.15.37:0/1150695284 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7efd080548c0 con 0x7efd200d2640 2023-07-12T02:04:06.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.695+0000 7efd24fff700 1 -- 172.21.15.37:0/1150695284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efd200b4fa0 con 0x7efd200d2640 2023-07-12T02:04:06.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.696+0000 7efd16ffd700 1 -- 172.21.15.37:0/1150695284 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7efd08057ee0 con 0x7efd200d2640 2023-07-12T02:04:06.700 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-12T02:04:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.698+0000 7efd24fff700 1 -- 172.21.15.37:0/1150695284 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efd0006ace0 msgr2=0x7efd0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.698+0000 7efd24fff700 1 --2- 172.21.15.37:0/1150695284 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efd0006ace0 0x7efd0006d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd201e7ff0 tx=0x7efd10008040 comp rx=0 tx=0).stop 2023-07-12T02:04:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.698+0000 7efd24fff700 1 -- 172.21.15.37:0/1150695284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd200d2640 msgr2=0x7efd20157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.698+0000 7efd24fff700 1 --2- 172.21.15.37:0/1150695284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd200d2640 0x7efd20157ed0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efd0800d800 tx=0x7efd0800dbc0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.698+0000 7efd24fff700 1 -- 172.21.15.37:0/1150695284 shutdown_connections 2023-07-12T02:04:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.698+0000 7efd24fff700 1 --2- 172.21.15.37:0/1150695284 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efd0006ace0 0x7efd0006d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.698+0000 7efd24fff700 1 --2- 172.21.15.37:0/1150695284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd2015c460 0x7efd200c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.698+0000 7efd24fff700 1 --2- 172.21.15.37:0/1150695284 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd200cf720 0x7efd201f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.698+0000 7efd24fff700 1 --2- 172.21.15.37:0/1150695284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd200d2640 0x7efd20157ed0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.698+0000 7efd24fff700 1 -- 172.21.15.37:0/1150695284 >> 172.21.15.37:0/1150695284 conn(0x7efd20071660 msgr2=0x7efd20071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.698+0000 7efd24fff700 1 -- 172.21.15.37:0/1150695284 shutdown_connections 2023-07-12T02:04:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:06.698+0000 7efd24fff700 1 -- 172.21.15.37:0/1150695284 wait complete. 2023-07-12T02:04:06.719 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-12T02:04:06.720 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-12T02:04:06.720 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-12T02:04:06.720 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-07-12T02:04:06.720 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-12T02:04:06.721 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-12T02:04:06.721 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-12T02:04:06.721 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-12T02:04:06.721 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-07-12T02:04:06.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:06.722 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-12T02:04:06.768 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-12T02:04:06.768 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-12T02:04:06.769 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-12T02:04:06.769 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:06.769 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-12T02:04:06.769 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:06.769 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:04:06.769 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:06.769 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-12T02:04:06.770 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:04:06.770 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:06.770 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-12T02:04:06.770 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-12T02:04:06.770 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:06.770 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-12T02:04:06.770 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-12T02:04:06.770 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41734sec preferred_lft 41734sec 2023-07-12T02:04:06.771 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-12T02:04:06.771 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:06.771 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:04:06.771 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:06.771 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-12T02:04:06.772 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-12T02:04:06.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:06.773 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-12T02:04:06.773 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-12T02:04:06.773 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2023-07-12T02:04:06.774 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2023-07-12T02:04:06.774 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2023-07-12T02:04:06.774 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-12T02:04:06.774 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-12T02:04:07.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:07.189 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-12T02:04:07.299 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-12T02:04:07.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:07.302 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-12T02:04:07.378 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-12T02:04:07.378 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-12T02:04:07.379 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-12T02:04:07.379 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-12T02:04:07.379 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-12T02:04:07.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:07.380 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-12T02:04:07.381 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-12T02:04:07.381 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-12T02:04:07.381 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-12T02:04:07.381 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-12T02:04:07.382 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-12T02:04:08.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:08.050 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-12T02:04:08.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:08.097 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-07-12T02:04:08.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:08.183 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-12T02:04:08.183 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-12T02:04:08.183 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-12T02:04:08.183 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-07-12T02:04:08.184 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-12T02:04:08.328 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-07-12T02:04:08.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:08.329 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-12T02:04:08.330 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-12T02:04:08.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-07-12T02:04:08.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-12T02:04:08.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-07-12T02:04:08.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-07-12T02:04:08.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-07-12T02:04:08.331 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-12T02:04:08.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:08.602 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-12T02:04:08.602 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-12T02:04:08.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-12T02:04:08.603 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2023-07-12T02:04:08.603 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-12T02:04:08.782 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-07-12T02:04:08.782 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-12T02:04:08.782 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-07-12T02:04:08.828 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-07-12T02:04:08.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-12T02:04:08.829 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-07-12T02:04:08.912 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-12T02:04:09.022 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-12T02:04:09.022 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-12T02:04:09.091 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-12T02:04:09.093 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-12T02:04:09.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:09.094 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-12T02:04:09.139 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-12T02:04:09.140 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-07-12T02:04:09.144 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-12T02:04:09.219 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-12T02:04:09.219 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-12T02:04:09.264 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:04:09.269 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:04:09.294 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-12T02:04:09.296 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-12T02:04:09.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:09.297 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-12T02:04:09.323 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:2023-07-12T02:04:09.320+0000 7fb31f6285c0 -1 init, newargv = 0x5619bd9dd3e0 newargc=15 2023-07-12T02:04:09.324 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[119410]: starting ceph client 2023-07-12T02:04:09.335 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[119410]: starting fuse 2023-07-12T02:04:09.374 INFO:teuthology.orchestra.run.smithi037.stdout:42 2023-07-12T02:04:09.375 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-07-12T02:04:09.375 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-12T02:04:09.376 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-07-12T02:04:09.376 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-07-12T02:04:09.376 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-07-12T02:04:09.377 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-07-12T02:04:09.377 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-12T02:04:09.377 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-07-12T02:04:09.377 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-07-12T02:04:09.378 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-07-12T02:04:09.378 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-07-12T02:04:09.378 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-12T02:04:09.378 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-07-12T02:04:09.379 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-07-12T02:04:09.379 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-07-12T02:04:09.379 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-07-12T02:04:09.380 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-12T02:04:09.380 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-07-12T02:04:09.380 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-12T02:04:09.380 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-12T02:04:09.381 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-12T02:04:09.381 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-07-12T02:04:09.381 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-07-12T02:04:09.382 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-07-12T02:04:09.382 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-12T02:04:09.382 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-12T02:04:09.382 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.admin")) 2023-07-12T02:04:09.383 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-07-12T02:04:09.560 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.admin.119410.asok 2023-07-12T02:04:09.737 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.119410.asok 2023-07-12T02:04:09.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:09.738 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.119410.asok status 2023-07-12T02:04:09.968 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-12T02:04:09.968 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-07-12T02:04:09.968 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "b5891ed62e7aba6227aed8ab09a4dd0853a1caf2", 2023-07-12T02:04:09.968 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev)", 2023-07-12T02:04:09.969 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "admin", 2023-07-12T02:04:09.969 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-07-12T02:04:09.969 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-07-12T02:04:09.969 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "119410", 2023-07-12T02:04:09.969 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-07-12T02:04:09.969 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:04:09.969 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-07-12T02:04:09.970 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-07-12T02:04:09.970 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4444, 2023-07-12T02:04:09.970 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-07-12T02:04:09.970 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-07-12T02:04:09.970 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-07-12T02:04:09.970 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 4444 2023-07-12T02:04:09.970 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:04:09.971 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-12T02:04:09.971 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-12T02:04:09.971 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2023-07-12T02:04:09.971 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2109159729 2023-07-12T02:04:09.971 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:04:09.971 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:04:09.971 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-12T02:04:09.972 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-12T02:04:09.972 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2023-07-12T02:04:09.972 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2109159729 2023-07-12T02:04:09.972 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:04:09.972 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.4444 172.21.15.37:0/2109159729", 2023-07-12T02:04:09.972 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "172.21.15.37:0/2109159729", 2023-07-12T02:04:09.972 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-07-12T02:04:09.973 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 7, 2023-07-12T02:04:09.973 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 27, 2023-07-12T02:04:09.973 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-07-12T02:04:09.973 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-07-12T02:04:09.973 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-07-12T02:04:09.973 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-12T02:04:09.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:09.983 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-07-12T02:04:09.983 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-07-12T02:04:10.029 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-07-12T02:04:10.030 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-07-12T02:04:10.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:10.030 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-07-12T02:04:10.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:10.101 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-07-12T02:04:10.221 INFO:teuthology.orchestra.run.smithi037.stdout:# file: . 2023-07-12T02:04:10.222 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-07-12T02:04:10.222 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:10.223 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:04:10.223 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:04:10.268 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:04:10.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.504+0000 7fc3c35ff700 1 Processor -- start 2023-07-12T02:04:10.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.505+0000 7fc3c35ff700 1 -- start start 2023-07-12T02:04:10.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.506+0000 7fc3c35ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3bc0d2640 0x7fc3bc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.506+0000 7fc3c35ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3bc0d1790 con 0x7fc3bc15c460 2023-07-12T02:04:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.506+0000 7fc3c35ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3bc0cd950 con 0x7fc3bc0cf8f0 2023-07-12T02:04:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.506+0000 7fc3c35ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0cedd0 con 0x7fc3bc0d2640 2023-07-12T02:04:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.506+0000 7fc3c139b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc3bc15c460 0x7fc3bc0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53322/0 (socket says 172.21.15.37:53322) 2023-07-12T02:04:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.506+0000 7fc3c139b700 1 -- 172.21.15.37:0/3896641991 learned_addr learned my addr 172.21.15.37:0/3896641991 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:10.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.506+0000 7fc3c0b9a700 1 --2- 172.21.15.37:0/3896641991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3bc0d2640 0x7fc3bc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:10.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.507+0000 7fc3b3fff700 1 -- 172.21.15.37:0/3896641991 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266465878 0 0) 0x7fc3bc0d1790 con 0x7fc3bc15c460 2023-07-12T02:04:10.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.507+0000 7fc3b3fff700 1 -- 172.21.15.37:0/3896641991 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3a80035b0 con 0x7fc3bc15c460 2023-07-12T02:04:10.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.507+0000 7fc3b3fff700 1 -- 172.21.15.37:0/3896641991 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546860628 0 0) 0x7fc3bc0cd950 con 0x7fc3bc0cf8f0 2023-07-12T02:04:10.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.507+0000 7fc3b3fff700 1 -- 172.21.15.37:0/3896641991 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3bc0d1790 con 0x7fc3bc0cf8f0 2023-07-12T02:04:10.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.507+0000 7fc3c0b9a700 1 -- 172.21.15.37:0/3896641991 >> v1:172.21.15.196:6789/0 conn(0x7fc3bc0cf8f0 legacy=0x7fc3bc15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:10.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.507+0000 7fc3c0b9a700 1 -- 172.21.15.37:0/3896641991 >> v1:172.21.15.37:6789/0 conn(0x7fc3bc15c460 legacy=0x7fc3bc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:10.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.507+0000 7fc3b3fff700 1 -- 172.21.15.37:0/3896641991 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 327357762 0 0) 0x7fc3a80035b0 con 0x7fc3bc15c460 2023-07-12T02:04:10.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.507+0000 7fc3c0b9a700 1 -- 172.21.15.37:0/3896641991 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc0d14b0 con 0x7fc3bc0d2640 2023-07-12T02:04:10.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.507+0000 7fc3c0b9a700 1 --2- 172.21.15.37:0/3896641991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3bc0d2640 0x7fc3bc0b59d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009870 tx=0x7fc3ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51ff45f9d49a82f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:10.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.507+0000 7fc3b3fff700 1 -- 172.21.15.37:0/3896641991 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8001670 con 0x7fc3bc0d2640 2023-07-12T02:04:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.508+0000 7fc3b3fff700 1 -- 172.21.15.37:0/3896641991 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ac004030 con 0x7fc3bc0d2640 2023-07-12T02:04:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.508+0000 7fc3b3fff700 1 -- 172.21.15.37:0/3896641991 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac0043c0 con 0x7fc3bc0d2640 2023-07-12T02:04:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.508+0000 7fc3c35ff700 1 -- 172.21.15.37:0/3896641991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3bc0d2640 msgr2=0x7fc3bc0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.508+0000 7fc3c35ff700 1 --2- 172.21.15.37:0/3896641991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3bc0d2640 0x7fc3bc0b59d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009870 tx=0x7fc3ac009b80 comp rx=0 tx=0).stop 2023-07-12T02:04:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.508+0000 7fc3c35ff700 1 -- 172.21.15.37:0/3896641991 shutdown_connections 2023-07-12T02:04:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.508+0000 7fc3c35ff700 1 --2- 172.21.15.37:0/3896641991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3bc0d2640 0x7fc3bc0b59d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.508+0000 7fc3c35ff700 1 -- 172.21.15.37:0/3896641991 >> 172.21.15.37:0/3896641991 conn(0x7fc3bc071660 msgr2=0x7fc3bc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:10.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.508+0000 7fc3c35ff700 1 -- 172.21.15.37:0/3896641991 shutdown_connections 2023-07-12T02:04:10.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.508+0000 7fc3c35ff700 1 -- 172.21.15.37:0/3896641991 wait complete. 2023-07-12T02:04:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.510+0000 7fc3c35ff700 1 Processor -- start 2023-07-12T02:04:10.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.510+0000 7fc3c35ff700 1 -- start start 2023-07-12T02:04:10.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.511+0000 7fc3c35ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3bc0cf8f0 0x7fc3bc145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:10.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.511+0000 7fc3c35ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3bc0d2640 0x7fc3bc0c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:10.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.511+0000 7fc3c35ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc15c460 0x7fc3bc0cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:10.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.511+0000 7fc3c35ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc1431d0 con 0x7fc3bc15c460 2023-07-12T02:04:10.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.511+0000 7fc3c35ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc1e5c40 con 0x7fc3bc0cf8f0 2023-07-12T02:04:10.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.511+0000 7fc3c35ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc142ba0 con 0x7fc3bc0d2640 2023-07-12T02:04:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.511+0000 7fc3c1b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc15c460 0x7fc3bc0cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.512+0000 7fc3c0b9a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3bc0d2640 0x7fc3bc0c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.512+0000 7fc3c139b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3bc0cf8f0 0x7fc3bc145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.512+0000 7fc3c1b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc15c460 0x7fc3bc0cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45500/0 (socket says 172.21.15.37:45500) 2023-07-12T02:04:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.512+0000 7fc3c1b9c700 1 -- 172.21.15.37:0/3911501451 learned_addr learned my addr 172.21.15.37:0/3911501451 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.512+0000 7fc3c1b9c700 1 -- 172.21.15.37:0/3911501451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3bc0d2640 msgr2=0x7fc3bc0c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.512+0000 7fc3c1b9c700 1 --2- 172.21.15.37:0/3911501451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3bc0d2640 0x7fc3bc0c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:10.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.512+0000 7fc3c1b9c700 1 -- 172.21.15.37:0/3911501451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3bc0cf8f0 msgr2=0x7fc3bc145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:10.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.512+0000 7fc3c1b9c700 1 --2- 172.21.15.37:0/3911501451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3bc0cf8f0 0x7fc3bc145600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:10.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.512+0000 7fc3c1b9c700 1 -- 172.21.15.37:0/3911501451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac0094a0 con 0x7fc3bc15c460 2023-07-12T02:04:10.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.512+0000 7fc3c1b9c700 1 --2- 172.21.15.37:0/3911501451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc15c460 0x7fc3bc0cadd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400cbc0 tx=0x7fc3b400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:10.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.512+0000 7fc3b1ffb700 1 -- 172.21.15.37:0/3911501451 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4003c00 con 0x7fc3bc15c460 2023-07-12T02:04:10.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.513+0000 7fc3b1ffb700 1 -- 172.21.15.37:0/3911501451 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b4003d60 con 0x7fc3bc15c460 2023-07-12T02:04:10.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.513+0000 7fc3c35ff700 1 -- 172.21.15.37:0/3911501451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3bc145b40 con 0x7fc3bc15c460 2023-07-12T02:04:10.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.513+0000 7fc3b1ffb700 1 -- 172.21.15.37:0/3911501451 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b400aaa0 con 0x7fc3bc15c460 2023-07-12T02:04:10.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.513+0000 7fc3c35ff700 1 -- 172.21.15.37:0/3911501451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc1e6130 con 0x7fc3bc15c460 2023-07-12T02:04:10.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.514+0000 7fc3c35ff700 1 -- 172.21.15.37:0/3911501451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc066a00 con 0x7fc3bc15c460 2023-07-12T02:04:10.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.515+0000 7fc3b1ffb700 1 -- 172.21.15.37:0/3911501451 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc3b400ac00 con 0x7fc3bc15c460 2023-07-12T02:04:10.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.516+0000 7fc3b1ffb700 1 --2- 172.21.15.37:0/3911501451 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc3a006ace0 0x7fc3a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:10.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.516+0000 7fc3b1ffb700 1 -- 172.21.15.37:0/3911501451 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc3b4089740 con 0x7fc3bc15c460 2023-07-12T02:04:10.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.516+0000 7fc3c139b700 1 --2- 172.21.15.37:0/3911501451 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc3a006ace0 0x7fc3a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:10.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.517+0000 7fc3c139b700 1 --2- 172.21.15.37:0/3911501451 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc3a006ace0 0x7fc3a006d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8001380 tx=0x7fc3b8000f10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.520+0000 7fc3b1ffb700 1 -- 172.21.15.37:0/3911501451 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc3bc066a00 con 0x7fc3bc15c460 2023-07-12T02:04:10.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.728+0000 7fc3c35ff700 1 -- 172.21.15.37:0/3911501451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3bc143310 con 0x7fc3bc15c460 2023-07-12T02:04:10.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.730+0000 7fc3b1ffb700 1 -- 172.21.15.37:0/3911501451 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7fc3bc143310 con 0x7fc3bc15c460 2023-07-12T02:04:10.734 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:10.734 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:02.702198+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:04:10.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.732+0000 7fc3c35ff700 1 -- 172.21.15.37:0/3911501451 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc3a006ace0 msgr2=0x7fc3a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:10.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.732+0000 7fc3c35ff700 1 --2- 172.21.15.37:0/3911501451 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc3a006ace0 0x7fc3a006d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8001380 tx=0x7fc3b8000f10 comp rx=0 tx=0).stop 2023-07-12T02:04:10.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.732+0000 7fc3c35ff700 1 -- 172.21.15.37:0/3911501451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc15c460 msgr2=0x7fc3bc0cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:10.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.732+0000 7fc3c35ff700 1 --2- 172.21.15.37:0/3911501451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc15c460 0x7fc3bc0cadd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400cbc0 tx=0x7fc3b400ced0 comp rx=0 tx=0).stop 2023-07-12T02:04:10.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.732+0000 7fc3c35ff700 1 -- 172.21.15.37:0/3911501451 shutdown_connections 2023-07-12T02:04:10.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.732+0000 7fc3c35ff700 1 --2- 172.21.15.37:0/3911501451 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc3a006ace0 0x7fc3a006d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:10.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.732+0000 7fc3c35ff700 1 --2- 172.21.15.37:0/3911501451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc15c460 0x7fc3bc0cadd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:10.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.732+0000 7fc3c35ff700 1 --2- 172.21.15.37:0/3911501451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3bc0cf8f0 0x7fc3bc145600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:10.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.732+0000 7fc3c35ff700 1 --2- 172.21.15.37:0/3911501451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc3bc0d2640 0x7fc3bc0c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:10.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.732+0000 7fc3c35ff700 1 -- 172.21.15.37:0/3911501451 >> 172.21.15.37:0/3911501451 conn(0x7fc3bc071660 msgr2=0x7fc3bc0cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:10.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.732+0000 7fc3c35ff700 1 -- 172.21.15.37:0/3911501451 shutdown_connections 2023-07-12T02:04:10.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.732+0000 7fc3c35ff700 1 -- 172.21.15.37:0/3911501451 wait complete. 2023-07-12T02:04:10.754 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:03:56.039938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:03:56.612707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-12T02:04:00.200885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-12T02:04:10.755 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:04:10.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.955+0000 7f6f895ff700 1 Processor -- start 2023-07-12T02:04:10.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.955+0000 7f6f895ff700 1 -- start start 2023-07-12T02:04:10.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.956+0000 7f6f895ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6f840b8430 0x7f6f840cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.956+0000 7f6f895ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f840d3730 0x7f6f840cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.956+0000 7f6f895ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f840d0b20 con 0x7f6f840cfa90 2023-07-12T02:04:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.956+0000 7f6f895ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f840b8800 con 0x7f6f840b8430 2023-07-12T02:04:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.956+0000 7f6f895ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840cfeb0 con 0x7f6f840d3730 2023-07-12T02:04:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.956+0000 7f6f82ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6f840b8430 0x7f6f840cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:10.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.956+0000 7f6f837fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6f840cfa90 0x7f6f8415feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53338/0 (socket says 172.21.15.37:53338) 2023-07-12T02:04:10.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.956+0000 7f6f837fe700 1 -- 172.21.15.37:0/4114018322 learned_addr learned my addr 172.21.15.37:0/4114018322 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:10.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.956+0000 7f6f827fc700 1 --2- 172.21.15.37:0/4114018322 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f840d3730 0x7f6f840cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:10.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.957+0000 7f6f82ffd700 1 -- 172.21.15.37:0/4114018322 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f840d3730 msgr2=0x7f6f840cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:10.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.957+0000 7f6f82ffd700 1 --2- 172.21.15.37:0/4114018322 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f840d3730 0x7f6f840cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:10.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.957+0000 7f6f82ffd700 1 -- 172.21.15.37:0/4114018322 >> v1:172.21.15.37:6789/0 conn(0x7f6f840cfa90 legacy=0x7f6f8415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.957+0000 7f6f82ffd700 1 -- 172.21.15.37:0/4114018322 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f840b4ee0 con 0x7f6f840b8430 2023-07-12T02:04:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.957+0000 7f6f81ffb700 1 -- 172.21.15.37:0/4114018322 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213261460 0 0) 0x7f6f840d0b20 con 0x7f6f840cfa90 2023-07-12T02:04:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.957+0000 7f6f82ffd700 1 --2- 172.21.15.37:0/4114018322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f840b8430 0x7f6f840cd320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f74009d90 tx=0x7f6f7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5068d76ae5e8a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.957+0000 7f6f81ffb700 1 -- 172.21.15.37:0/4114018322 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7400e070 con 0x7f6f840b8430 2023-07-12T02:04:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.957+0000 7f6f81ffb700 1 -- 172.21.15.37:0/4114018322 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7400bb20 con 0x7f6f840b8430 2023-07-12T02:04:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.957+0000 7f6f81ffb700 1 -- 172.21.15.37:0/4114018322 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74012430 con 0x7f6f840b8430 2023-07-12T02:04:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.958+0000 7f6f895ff700 1 -- 172.21.15.37:0/4114018322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f840b8430 msgr2=0x7f6f840cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.958+0000 7f6f895ff700 1 --2- 172.21.15.37:0/4114018322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f840b8430 0x7f6f840cd320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f74009d90 tx=0x7f6f7400b330 comp rx=0 tx=0).stop 2023-07-12T02:04:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.958+0000 7f6f895ff700 1 -- 172.21.15.37:0/4114018322 shutdown_connections 2023-07-12T02:04:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.958+0000 7f6f895ff700 1 --2- 172.21.15.37:0/4114018322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f840b8430 0x7f6f840cd320 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.958+0000 7f6f895ff700 1 --2- 172.21.15.37:0/4114018322 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f840d3730 0x7f6f840cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.958+0000 7f6f895ff700 1 -- 172.21.15.37:0/4114018322 >> 172.21.15.37:0/4114018322 conn(0x7f6f8406b3f0 msgr2=0x7f6f8406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.958+0000 7f6f895ff700 1 -- 172.21.15.37:0/4114018322 shutdown_connections 2023-07-12T02:04:10.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.958+0000 7f6f895ff700 1 -- 172.21.15.37:0/4114018322 wait complete. 2023-07-12T02:04:10.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.960+0000 7f6f895ff700 1 Processor -- start 2023-07-12T02:04:10.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.960+0000 7f6f895ff700 1 -- start start 2023-07-12T02:04:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.961+0000 7f6f895ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f840b8430 0x7f6f840c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.961+0000 7f6f895ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f840cfa90 0x7f6f840cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.961+0000 7f6f895ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f840d3730 0x7f6f8414f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.961+0000 7f6f895ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840cb1e0 con 0x7f6f840b8430 2023-07-12T02:04:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.961+0000 7f6f895ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840cb4c0 con 0x7f6f840d3730 2023-07-12T02:04:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.961+0000 7f6f895ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840cb7a0 con 0x7f6f840cfa90 2023-07-12T02:04:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.961+0000 7f6f82ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f840b8430 0x7f6f840c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:10.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.961+0000 7f6f82ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f840b8430 0x7f6f840c8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45506/0 (socket says 172.21.15.37:45506) 2023-07-12T02:04:10.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.961+0000 7f6f82ffd700 1 -- 172.21.15.37:0/905900302 learned_addr learned my addr 172.21.15.37:0/905900302 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:10.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.961+0000 7f6f827fc700 1 --2- 172.21.15.37:0/905900302 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f840cfa90 0x7f6f840cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:10.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.961+0000 7f6f837fe700 1 --2- 172.21.15.37:0/905900302 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f840d3730 0x7f6f8414f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:10.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.962+0000 7f6f82ffd700 1 -- 172.21.15.37:0/905900302 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f840cfa90 msgr2=0x7f6f840cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:10.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.962+0000 7f6f82ffd700 1 --2- 172.21.15.37:0/905900302 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f840cfa90 0x7f6f840cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:10.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.962+0000 7f6f82ffd700 1 -- 172.21.15.37:0/905900302 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f840d3730 msgr2=0x7f6f8414f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:10.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.962+0000 7f6f82ffd700 1 --2- 172.21.15.37:0/905900302 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f840d3730 0x7f6f8414f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:10.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.962+0000 7f6f82ffd700 1 -- 172.21.15.37:0/905900302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f74009a70 con 0x7f6f840b8430 2023-07-12T02:04:10.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.962+0000 7f6f82ffd700 1 --2- 172.21.15.37:0/905900302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f840b8430 0x7f6f840c8f90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6f74014040 tx=0x7f6f74004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:10.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.962+0000 7f6f6b7fe700 1 -- 172.21.15.37:0/905900302 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74012430 con 0x7f6f840b8430 2023-07-12T02:04:10.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.962+0000 7f6f6b7fe700 1 -- 172.21.15.37:0/905900302 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f74020070 con 0x7f6f840b8430 2023-07-12T02:04:10.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.962+0000 7f6f6b7fe700 1 -- 172.21.15.37:0/905900302 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74004280 con 0x7f6f840b8430 2023-07-12T02:04:10.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.962+0000 7f6f895ff700 1 -- 172.21.15.37:0/905900302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f840cba80 con 0x7f6f840b8430 2023-07-12T02:04:10.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.962+0000 7f6f895ff700 1 -- 172.21.15.37:0/905900302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f840c94d0 con 0x7f6f840b8430 2023-07-12T02:04:10.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.963+0000 7f6f895ff700 1 -- 172.21.15.37:0/905900302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8404ea60 con 0x7f6f840b8430 2023-07-12T02:04:10.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.964+0000 7f6f6b7fe700 1 -- 172.21.15.37:0/905900302 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f740043e0 con 0x7f6f840b8430 2023-07-12T02:04:10.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.965+0000 7f6f6b7fe700 1 --2- 172.21.15.37:0/905900302 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6f7006ace0 0x7f6f7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:10.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.965+0000 7f6f6b7fe700 1 -- 172.21.15.37:0/905900302 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6f74022070 con 0x7f6f840b8430 2023-07-12T02:04:10.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.965+0000 7f6f827fc700 1 --2- 172.21.15.37:0/905900302 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6f7006ace0 0x7f6f7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:10.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.966+0000 7f6f827fc700 1 --2- 172.21.15.37:0/905900302 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6f7006ace0 0x7f6f7006d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6f841f5070 tx=0x7f6f78009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:10.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:10.970+0000 7f6f6b7fe700 1 -- 172.21.15.37:0/905900302 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6f74056180 con 0x7f6f840b8430 2023-07-12T02:04:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.174+0000 7f6f895ff700 1 -- 172.21.15.37:0/905900302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f8406b860 con 0x7f6f840b8430 2023-07-12T02:04:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.175+0000 7f6f6b7fe700 1 -- 172.21.15.37:0/905900302 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f740597a0 con 0x7f6f840b8430 2023-07-12T02:04:11.179 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:04:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.177+0000 7f6f895ff700 1 -- 172.21.15.37:0/905900302 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6f7006ace0 msgr2=0x7f6f7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.177+0000 7f6f895ff700 1 --2- 172.21.15.37:0/905900302 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6f7006ace0 0x7f6f7006d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6f841f5070 tx=0x7f6f78009210 comp rx=0 tx=0).stop 2023-07-12T02:04:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.177+0000 7f6f895ff700 1 -- 172.21.15.37:0/905900302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f840b8430 msgr2=0x7f6f840c8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.177+0000 7f6f895ff700 1 --2- 172.21.15.37:0/905900302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f840b8430 0x7f6f840c8f90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6f74014040 tx=0x7f6f74004ad0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.177+0000 7f6f895ff700 1 -- 172.21.15.37:0/905900302 shutdown_connections 2023-07-12T02:04:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.177+0000 7f6f895ff700 1 --2- 172.21.15.37:0/905900302 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6f7006ace0 0x7f6f7006d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.177+0000 7f6f895ff700 1 --2- 172.21.15.37:0/905900302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f840b8430 0x7f6f840c8f90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.177+0000 7f6f895ff700 1 --2- 172.21.15.37:0/905900302 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f840d3730 0x7f6f8414f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.177+0000 7f6f895ff700 1 --2- 172.21.15.37:0/905900302 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f840cfa90 0x7f6f840cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.178+0000 7f6f895ff700 1 -- 172.21.15.37:0/905900302 >> 172.21.15.37:0/905900302 conn(0x7f6f8406b3f0 msgr2=0x7f6f840b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.178+0000 7f6f895ff700 1 -- 172.21.15.37:0/905900302 shutdown_connections 2023-07-12T02:04:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.178+0000 7f6f895ff700 1 -- 172.21.15.37:0/905900302 wait complete. 2023-07-12T02:04:11.199 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:04:11.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.400+0000 7f6d751ff700 1 Processor -- start 2023-07-12T02:04:11.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.401+0000 7f6d751ff700 1 -- start start 2023-07-12T02:04:11.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.402+0000 7f6d751ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d700b8430 0x7f6d700cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:11.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.402+0000 7f6d751ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d700d0b20 con 0x7f6d700d3730 2023-07-12T02:04:11.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.402+0000 7f6d751ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d700b4ee0 con 0x7f6d700cfc60 2023-07-12T02:04:11.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.402+0000 7f6d751ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d700b8800 con 0x7f6d700b8430 2023-07-12T02:04:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.402+0000 7f6d6e59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6d700d3730 0x7f6d700cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53354/0 (socket says 172.21.15.37:53354) 2023-07-12T02:04:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.402+0000 7f6d6e59c700 1 -- 172.21.15.37:0/3151435981 learned_addr learned my addr 172.21.15.37:0/3151435981 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.402+0000 7f6d6ed9d700 1 --2- 172.21.15.37:0/3151435981 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d700b8430 0x7f6d700cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.403+0000 7f6d6dd9b700 1 -- 172.21.15.37:0/3151435981 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005366444 0 0) 0x7f6d700d0b20 con 0x7f6d700d3730 2023-07-12T02:04:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.403+0000 7f6d6dd9b700 1 -- 172.21.15.37:0/3151435981 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d580035b0 con 0x7f6d700d3730 2023-07-12T02:04:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.403+0000 7f6d6dd9b700 1 -- 172.21.15.37:0/3151435981 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931263544 0 0) 0x7f6d700b4ee0 con 0x7f6d700cfc60 2023-07-12T02:04:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.403+0000 7f6d6ed9d700 1 -- 172.21.15.37:0/3151435981 >> v1:172.21.15.196:6789/0 conn(0x7f6d700cfc60 legacy=0x7f6d700d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.403+0000 7f6d6ed9d700 1 -- 172.21.15.37:0/3151435981 >> v1:172.21.15.37:6789/0 conn(0x7f6d700d3730 legacy=0x7f6d700cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.403+0000 7f6d6ed9d700 1 -- 172.21.15.37:0/3151435981 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d700b51c0 con 0x7f6d700b8430 2023-07-12T02:04:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.403+0000 7f6d6ed9d700 1 --2- 172.21.15.37:0/3151435981 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d700b8430 0x7f6d700cd320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d60009870 tx=0x7f6d60009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71b611a389a980a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.403+0000 7f6d6dd9b700 1 -- 172.21.15.37:0/3151435981 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60011830 con 0x7f6d700b8430 2023-07-12T02:04:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.403+0000 7f6d6dd9b700 1 -- 172.21.15.37:0/3151435981 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d60011990 con 0x7f6d700b8430 2023-07-12T02:04:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.403+0000 7f6d6dd9b700 1 -- 172.21.15.37:0/3151435981 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60011d20 con 0x7f6d700b8430 2023-07-12T02:04:11.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.404+0000 7f6d751ff700 1 -- 172.21.15.37:0/3151435981 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d700b8430 msgr2=0x7f6d700cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:11.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.404+0000 7f6d751ff700 1 --2- 172.21.15.37:0/3151435981 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d700b8430 0x7f6d700cd320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d60009870 tx=0x7f6d60009b80 comp rx=0 tx=0).stop 2023-07-12T02:04:11.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.404+0000 7f6d751ff700 1 -- 172.21.15.37:0/3151435981 shutdown_connections 2023-07-12T02:04:11.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.404+0000 7f6d751ff700 1 --2- 172.21.15.37:0/3151435981 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d700b8430 0x7f6d700cd320 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.404+0000 7f6d751ff700 1 -- 172.21.15.37:0/3151435981 >> 172.21.15.37:0/3151435981 conn(0x7f6d7006b3f0 msgr2=0x7f6d7006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.404+0000 7f6d751ff700 1 -- 172.21.15.37:0/3151435981 shutdown_connections 2023-07-12T02:04:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.404+0000 7f6d751ff700 1 -- 172.21.15.37:0/3151435981 wait complete. 2023-07-12T02:04:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.406+0000 7f6d751ff700 1 Processor -- start 2023-07-12T02:04:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.406+0000 7f6d751ff700 1 -- start start 2023-07-12T02:04:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.407+0000 7f6d751ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d700b8430 0x7f6d701f1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.407+0000 7f6d751ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d700cfc60 0x7f6d70159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.407+0000 7f6d751ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d700d3730 0x7f6d700c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.407+0000 7f6d751ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d700cb1f0 con 0x7f6d700b8430 2023-07-12T02:04:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.407+0000 7f6d751ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d700cb4d0 con 0x7f6d700cfc60 2023-07-12T02:04:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.407+0000 7f6d751ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d700cb7b0 con 0x7f6d700d3730 2023-07-12T02:04:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.407+0000 7f6d6ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d700b8430 0x7f6d701f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.407+0000 7f6d6ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d700b8430 0x7f6d701f1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45520/0 (socket says 172.21.15.37:45520) 2023-07-12T02:04:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.407+0000 7f6d6ed9d700 1 -- 172.21.15.37:0/1049834034 learned_addr learned my addr 172.21.15.37:0/1049834034 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.407+0000 7f6d6e59c700 1 --2- 172.21.15.37:0/1049834034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d700cfc60 0x7f6d70159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.407+0000 7f6d6f59e700 1 --2- 172.21.15.37:0/1049834034 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d700d3730 0x7f6d700c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.408+0000 7f6d6ed9d700 1 -- 172.21.15.37:0/1049834034 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d700d3730 msgr2=0x7f6d700c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.408+0000 7f6d6ed9d700 1 --2- 172.21.15.37:0/1049834034 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d700d3730 0x7f6d700c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.408+0000 7f6d6ed9d700 1 -- 172.21.15.37:0/1049834034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d700cfc60 msgr2=0x7f6d70159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.408+0000 7f6d6ed9d700 1 --2- 172.21.15.37:0/1049834034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d700cfc60 0x7f6d70159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.408+0000 7f6d6ed9d700 1 -- 172.21.15.37:0/1049834034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d600094a0 con 0x7f6d700b8430 2023-07-12T02:04:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.408+0000 7f6d6ed9d700 1 --2- 172.21.15.37:0/1049834034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d700b8430 0x7f6d701f1750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d600090b0 tx=0x7f6d60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.408+0000 7f6d577fe700 1 -- 172.21.15.37:0/1049834034 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6001a7e0 con 0x7f6d700b8430 2023-07-12T02:04:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.408+0000 7f6d577fe700 1 -- 172.21.15.37:0/1049834034 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6001a940 con 0x7f6d700b8430 2023-07-12T02:04:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.408+0000 7f6d577fe700 1 -- 172.21.15.37:0/1049834034 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6001acd0 con 0x7f6d700b8430 2023-07-12T02:04:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.408+0000 7f6d751ff700 1 -- 172.21.15.37:0/1049834034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d700cba90 con 0x7f6d700b8430 2023-07-12T02:04:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.408+0000 7f6d751ff700 1 -- 172.21.15.37:0/1049834034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d7015a360 con 0x7f6d700b8430 2023-07-12T02:04:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.409+0000 7f6d751ff700 1 -- 172.21.15.37:0/1049834034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d7004ea60 con 0x7f6d700b8430 2023-07-12T02:04:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.410+0000 7f6d577fe700 1 -- 172.21.15.37:0/1049834034 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6d60022070 con 0x7f6d700b8430 2023-07-12T02:04:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.412+0000 7f6d577fe700 1 --2- 172.21.15.37:0/1049834034 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6d5c06ace0 0x7f6d5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.412+0000 7f6d577fe700 1 -- 172.21.15.37:0/1049834034 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6d6008a460 con 0x7f6d700b8430 2023-07-12T02:04:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.412+0000 7f6d6e59c700 1 --2- 172.21.15.37:0/1049834034 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6d5c06ace0 0x7f6d5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.413+0000 7f6d6e59c700 1 --2- 172.21.15.37:0/1049834034 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6d5c06ace0 0x7f6d5c06d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6d7015ee50 tx=0x7f6d64009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:11.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.416+0000 7f6d577fe700 1 -- 172.21.15.37:0/1049834034 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6d600553d0 con 0x7f6d700b8430 2023-07-12T02:04:11.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.622+0000 7f6d751ff700 1 -- 172.21.15.37:0/1049834034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6d700cb330 con 0x7f6d700b8430 2023-07-12T02:04:11.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.623+0000 7f6d577fe700 1 -- 172.21.15.37:0/1049834034 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6d700cb330 con 0x7f6d700b8430 2023-07-12T02:04:11.627 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:04:11.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.625+0000 7f6d751ff700 1 -- 172.21.15.37:0/1049834034 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6d5c06ace0 msgr2=0x7f6d5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:11.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.625+0000 7f6d751ff700 1 --2- 172.21.15.37:0/1049834034 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6d5c06ace0 0x7f6d5c06d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6d7015ee50 tx=0x7f6d64009040 comp rx=0 tx=0).stop 2023-07-12T02:04:11.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.625+0000 7f6d751ff700 1 -- 172.21.15.37:0/1049834034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d700b8430 msgr2=0x7f6d701f1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:11.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.625+0000 7f6d751ff700 1 --2- 172.21.15.37:0/1049834034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d700b8430 0x7f6d701f1750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d600090b0 tx=0x7f6d60004750 comp rx=0 tx=0).stop 2023-07-12T02:04:11.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.625+0000 7f6d751ff700 1 -- 172.21.15.37:0/1049834034 shutdown_connections 2023-07-12T02:04:11.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.625+0000 7f6d751ff700 1 --2- 172.21.15.37:0/1049834034 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6d5c06ace0 0x7f6d5c06d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.625+0000 7f6d751ff700 1 --2- 172.21.15.37:0/1049834034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d700b8430 0x7f6d701f1750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.625+0000 7f6d751ff700 1 --2- 172.21.15.37:0/1049834034 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d700d3730 0x7f6d700c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.625+0000 7f6d751ff700 1 --2- 172.21.15.37:0/1049834034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d700cfc60 0x7f6d70159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.625+0000 7f6d751ff700 1 -- 172.21.15.37:0/1049834034 >> 172.21.15.37:0/1049834034 conn(0x7f6d7006b3f0 msgr2=0x7f6d700cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:11.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.626+0000 7f6d751ff700 1 -- 172.21.15.37:0/1049834034 shutdown_connections 2023-07-12T02:04:11.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.626+0000 7f6d751ff700 1 -- 172.21.15.37:0/1049834034 wait complete. 2023-07-12T02:04:11.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:04:11.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.847+0000 7fb08a5ff700 1 Processor -- start 2023-07-12T02:04:11.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.847+0000 7fb08a5ff700 1 -- start start 2023-07-12T02:04:11.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.848+0000 7fb08a5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0840d3730 0x7fb0840cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:11.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.848+0000 7fb08a5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0840cfa90 0x7fb0840d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:11.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.848+0000 7fb08a5ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0840d0b20 con 0x7fb0840b8430 2023-07-12T02:04:11.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.848+0000 7fb08a5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0840cda30 con 0x7fb0840cfa90 2023-07-12T02:04:11.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.848+0000 7fb08a5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840b8800 con 0x7fb0840d3730 2023-07-12T02:04:11.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.848+0000 7fb083fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb0840b8430 0x7fb0840cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53366/0 (socket says 172.21.15.37:53366) 2023-07-12T02:04:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.848+0000 7fb083fff700 1 -- 172.21.15.37:0/1658304913 learned_addr learned my addr 172.21.15.37:0/1658304913 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.848+0000 7fb0837fe700 1 --2- 172.21.15.37:0/1658304913 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0840d3730 0x7fb0840cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.848+0000 7fb088b9c700 1 --2- 172.21.15.37:0/1658304913 >> v2:172.21.15.37:3300/0 conn(0x7fb0840cfa90 0x7fb0840d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.849+0000 7fb082ffd700 1 -- 172.21.15.37:0/1658304913 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286126895 0 0) 0x7fb0840d0b20 con 0x7fb0840b8430 2023-07-12T02:04:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.849+0000 7fb082ffd700 1 -- 172.21.15.37:0/1658304913 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb06c0035b0 con 0x7fb0840b8430 2023-07-12T02:04:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.849+0000 7fb088b9c700 1 -- 172.21.15.37:0/1658304913 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0840d3730 msgr2=0x7fb0840cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.849+0000 7fb088b9c700 1 --2- 172.21.15.37:0/1658304913 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0840d3730 0x7fb0840cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.849+0000 7fb088b9c700 1 -- 172.21.15.37:0/1658304913 >> v1:172.21.15.37:6789/0 conn(0x7fb0840b8430 legacy=0x7fb0840cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.849+0000 7fb088b9c700 1 -- 172.21.15.37:0/1658304913 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0840cfeb0 con 0x7fb0840cfa90 2023-07-12T02:04:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.849+0000 7fb0837fe700 1 --2- 172.21.15.37:0/1658304913 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0840d3730 0x7fb0840cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:04:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.849+0000 7fb088b9c700 1 --2- 172.21.15.37:0/1658304913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0840cfa90 0x7fb0840d0fb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009d90 tx=0x7fb07c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb719f15f346301 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.849+0000 7fb082ffd700 1 -- 172.21.15.37:0/1658304913 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c00e070 con 0x7fb0840cfa90 2023-07-12T02:04:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.850+0000 7fb082ffd700 1 -- 172.21.15.37:0/1658304913 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c00bb20 con 0x7fb0840cfa90 2023-07-12T02:04:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.850+0000 7fb082ffd700 1 -- 172.21.15.37:0/1658304913 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c00be90 con 0x7fb0840cfa90 2023-07-12T02:04:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.850+0000 7fb08a5ff700 1 -- 172.21.15.37:0/1658304913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0840cfa90 msgr2=0x7fb0840d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.850+0000 7fb08a5ff700 1 --2- 172.21.15.37:0/1658304913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0840cfa90 0x7fb0840d0fb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009d90 tx=0x7fb07c00b330 comp rx=0 tx=0).stop 2023-07-12T02:04:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.850+0000 7fb08a5ff700 1 -- 172.21.15.37:0/1658304913 shutdown_connections 2023-07-12T02:04:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.850+0000 7fb08a5ff700 1 --2- 172.21.15.37:0/1658304913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0840cfa90 0x7fb0840d0fb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.850+0000 7fb08a5ff700 1 --2- 172.21.15.37:0/1658304913 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0840d3730 0x7fb0840cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.850+0000 7fb08a5ff700 1 -- 172.21.15.37:0/1658304913 >> 172.21.15.37:0/1658304913 conn(0x7fb08406b3f0 msgr2=0x7fb08406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.850+0000 7fb08a5ff700 1 -- 172.21.15.37:0/1658304913 shutdown_connections 2023-07-12T02:04:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.850+0000 7fb08a5ff700 1 -- 172.21.15.37:0/1658304913 wait complete. 2023-07-12T02:04:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.852+0000 7fb08a5ff700 1 Processor -- start 2023-07-12T02:04:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.852+0000 7fb08a5ff700 1 -- start start 2023-07-12T02:04:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.853+0000 7fb08a5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0840b8430 0x7fb08415d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.853+0000 7fb08a5ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0840cfa90 0x7fb08415a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.853+0000 7fb08a5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0840d3730 0x7fb08415a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.853+0000 7fb08a5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c9c10 con 0x7fb0840b8430 2023-07-12T02:04:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.853+0000 7fb08a5ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c9ef0 con 0x7fb0840cfa90 2023-07-12T02:04:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.853+0000 7fb08a5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840ca1d0 con 0x7fb0840d3730 2023-07-12T02:04:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.853+0000 7fb083fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0840b8430 0x7fb08415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.853+0000 7fb083fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0840b8430 0x7fb08415d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45552/0 (socket says 172.21.15.37:45552) 2023-07-12T02:04:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.853+0000 7fb083fff700 1 -- 172.21.15.37:0/3379625808 learned_addr learned my addr 172.21.15.37:0/3379625808 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:11.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.853+0000 7fb0837fe700 1 --2- 172.21.15.37:0/3379625808 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0840cfa90 0x7fb08415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:11.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.853+0000 7fb088b9c700 1 --2- 172.21.15.37:0/3379625808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0840d3730 0x7fb08415a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:11.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.854+0000 7fb083fff700 1 -- 172.21.15.37:0/3379625808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0840d3730 msgr2=0x7fb08415a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:11.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.854+0000 7fb083fff700 1 --2- 172.21.15.37:0/3379625808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0840d3730 0x7fb08415a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.854+0000 7fb083fff700 1 -- 172.21.15.37:0/3379625808 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0840cfa90 msgr2=0x7fb08415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:11.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.854+0000 7fb083fff700 1 --2- 172.21.15.37:0/3379625808 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0840cfa90 0x7fb08415a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:11.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.854+0000 7fb083fff700 1 -- 172.21.15.37:0/3379625808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0780094a0 con 0x7fb0840b8430 2023-07-12T02:04:11.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.854+0000 7fb083fff700 1 --2- 172.21.15.37:0/3379625808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0840b8430 0x7fb08415d340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb07400c4d0 tx=0x7fb07400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:11.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.854+0000 7fb080ff9700 1 -- 172.21.15.37:0/3379625808 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074005d70 con 0x7fb0840b8430 2023-07-12T02:04:11.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.854+0000 7fb080ff9700 1 -- 172.21.15.37:0/3379625808 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0740070d0 con 0x7fb0840b8430 2023-07-12T02:04:11.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.854+0000 7fb080ff9700 1 -- 172.21.15.37:0/3379625808 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074007440 con 0x7fb0840b8430 2023-07-12T02:04:11.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.854+0000 7fb08a5ff700 1 -- 172.21.15.37:0/3379625808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c009a70 con 0x7fb0840b8430 2023-07-12T02:04:11.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.854+0000 7fb08a5ff700 1 -- 172.21.15.37:0/3379625808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0840ca790 con 0x7fb0840b8430 2023-07-12T02:04:11.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.855+0000 7fb08a5ff700 1 -- 172.21.15.37:0/3379625808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08404ea60 con 0x7fb0840b8430 2023-07-12T02:04:11.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.856+0000 7fb080ff9700 1 -- 172.21.15.37:0/3379625808 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb0740075a0 con 0x7fb0840b8430 2023-07-12T02:04:11.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.857+0000 7fb080ff9700 1 --2- 172.21.15.37:0/3379625808 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb07006ace0 0x7fb07006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:11.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.857+0000 7fb080ff9700 1 -- 172.21.15.37:0/3379625808 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb074088b00 con 0x7fb0840b8430 2023-07-12T02:04:11.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.857+0000 7fb0837fe700 1 --2- 172.21.15.37:0/3379625808 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb07006ace0 0x7fb07006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:11.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.858+0000 7fb0837fe700 1 --2- 172.21.15.37:0/3379625808 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb07006ace0 0x7fb07006d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb0841f4eb0 tx=0x7fb078009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:11.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:11.861+0000 7fb080ff9700 1 -- 172.21.15.37:0/3379625808 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb07408ae60 con 0x7fb0840b8430 2023-07-12T02:04:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.068+0000 7fb08a5ff700 1 -- 172.21.15.37:0/3379625808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb08415ec90 con 0x7fb0840b8430 2023-07-12T02:04:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.069+0000 7fb080ff9700 1 -- 172.21.15.37:0/3379625808 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb0740538d0 con 0x7fb0840b8430 2023-07-12T02:04:12.072 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:04:12.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.071+0000 7fb08a5ff700 1 -- 172.21.15.37:0/3379625808 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb07006ace0 msgr2=0x7fb07006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:12.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.071+0000 7fb08a5ff700 1 --2- 172.21.15.37:0/3379625808 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb07006ace0 0x7fb07006d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb0841f4eb0 tx=0x7fb078009210 comp rx=0 tx=0).stop 2023-07-12T02:04:12.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.071+0000 7fb08a5ff700 1 -- 172.21.15.37:0/3379625808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0840b8430 msgr2=0x7fb08415d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.071+0000 7fb08a5ff700 1 --2- 172.21.15.37:0/3379625808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0840b8430 0x7fb08415d340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb07400c4d0 tx=0x7fb07400c7e0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.071+0000 7fb08a5ff700 1 -- 172.21.15.37:0/3379625808 shutdown_connections 2023-07-12T02:04:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.071+0000 7fb08a5ff700 1 --2- 172.21.15.37:0/3379625808 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb07006ace0 0x7fb07006d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.071+0000 7fb08a5ff700 1 --2- 172.21.15.37:0/3379625808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0840b8430 0x7fb08415d340 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.071+0000 7fb08a5ff700 1 --2- 172.21.15.37:0/3379625808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0840d3730 0x7fb08415a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.071+0000 7fb08a5ff700 1 --2- 172.21.15.37:0/3379625808 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0840cfa90 0x7fb08415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.071+0000 7fb08a5ff700 1 -- 172.21.15.37:0/3379625808 >> 172.21.15.37:0/3379625808 conn(0x7fb08406b3f0 msgr2=0x7fb08415beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:12.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.071+0000 7fb08a5ff700 1 -- 172.21.15.37:0/3379625808 shutdown_connections 2023-07-12T02:04:12.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.071+0000 7fb08a5ff700 1 -- 172.21.15.37:0/3379625808 wait complete. 2023-07-12T02:04:12.092 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:04:12.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.293+0000 7ff0d5dff700 1 Processor -- start 2023-07-12T02:04:12.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.293+0000 7ff0d5dff700 1 -- start start 2023-07-12T02:04:12.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.294+0000 7ff0d5dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0d006bda0 0x7ff0d00d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:12.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.294+0000 7ff0d5dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0d006c210 0x7ff0d00d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:12.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.294+0000 7ff0d5dff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d00d1490 con 0x7ff0d00b4590 2023-07-12T02:04:12.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.294+0000 7ff0d5dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d006b390 con 0x7ff0d006c210 2023-07-12T02:04:12.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.294+0000 7ff0d5dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d015d3d0 con 0x7ff0d006bda0 2023-07-12T02:04:12.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.295+0000 7ff0cffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0d006c210 0x7ff0d00d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:12.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.295+0000 7ff0cffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0d006c210 0x7ff0d00d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40472/0 (socket says 172.21.15.37:40472) 2023-07-12T02:04:12.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.295+0000 7ff0cffff700 1 -- 172.21.15.37:0/633659534 learned_addr learned my addr 172.21.15.37:0/633659534 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:12.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.295+0000 7ff0ceffd700 1 --2- 172.21.15.37:0/633659534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0d006bda0 0x7ff0d00d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:12.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.295+0000 7ff0cffff700 1 -- 172.21.15.37:0/633659534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0d006bda0 msgr2=0x7ff0d00d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:12.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.295+0000 7ff0cffff700 1 --2- 172.21.15.37:0/633659534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0d006bda0 0x7ff0d00d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.295+0000 7ff0cffff700 1 -- 172.21.15.37:0/633659534 >> v1:172.21.15.196:6789/0 conn(0x7ff0d00b4590 legacy=0x7ff0d00b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:12.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.295+0000 7ff0cffff700 1 -- 172.21.15.37:0/633659534 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d015d6b0 con 0x7ff0d006c210 2023-07-12T02:04:12.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.295+0000 7ff0cffff700 1 --2- 172.21.15.37:0/633659534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d006c210 0x7ff0d00d0f50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009e50 tx=0x7ff0c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0d800e0471a041 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:12.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.296+0000 7ff0ce7fc700 1 -- 172.21.15.37:0/633659534 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800e070 con 0x7ff0d006c210 2023-07-12T02:04:12.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.296+0000 7ff0ce7fc700 1 -- 172.21.15.37:0/633659534 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c800b910 con 0x7ff0d006c210 2023-07-12T02:04:12.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.296+0000 7ff0ce7fc700 1 -- 172.21.15.37:0/633659534 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800bcc0 con 0x7ff0d006c210 2023-07-12T02:04:12.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.296+0000 7ff0d5dff700 1 -- 172.21.15.37:0/633659534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d006c210 msgr2=0x7ff0d00d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:12.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.296+0000 7ff0d5dff700 1 --2- 172.21.15.37:0/633659534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d006c210 0x7ff0d00d0f50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009e50 tx=0x7ff0c800b330 comp rx=0 tx=0).stop 2023-07-12T02:04:12.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.296+0000 7ff0d5dff700 1 -- 172.21.15.37:0/633659534 shutdown_connections 2023-07-12T02:04:12.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.296+0000 7ff0d5dff700 1 --2- 172.21.15.37:0/633659534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d006c210 0x7ff0d00d0f50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.296+0000 7ff0d5dff700 1 --2- 172.21.15.37:0/633659534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0d006bda0 0x7ff0d00d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.296+0000 7ff0d5dff700 1 -- 172.21.15.37:0/633659534 >> 172.21.15.37:0/633659534 conn(0x7ff0d00cf590 msgr2=0x7ff0d00cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:12.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.296+0000 7ff0d5dff700 1 -- 172.21.15.37:0/633659534 shutdown_connections 2023-07-12T02:04:12.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.296+0000 7ff0d5dff700 1 -- 172.21.15.37:0/633659534 wait complete. 2023-07-12T02:04:12.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.298+0000 7ff0d5dff700 1 Processor -- start 2023-07-12T02:04:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.298+0000 7ff0d5dff700 1 -- start start 2023-07-12T02:04:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.299+0000 7ff0d5dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0d006bda0 0x7ff0d00c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.299+0000 7ff0d5dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0d006c210 0x7ff0d0155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.299+0000 7ff0d5dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d00b4590 0x7ff0d01e2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.299+0000 7ff0d5dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00c9090 con 0x7ff0d00b4590 2023-07-12T02:04:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.299+0000 7ff0d5dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d01556a0 con 0x7ff0d006c210 2023-07-12T02:04:12.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.299+0000 7ff0d5dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00c7ab0 con 0x7ff0d006bda0 2023-07-12T02:04:12.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.299+0000 7ff0cffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d00b4590 0x7ff0d01e2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:12.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.299+0000 7ff0cffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d00b4590 0x7ff0d01e2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40474/0 (socket says 172.21.15.37:40474) 2023-07-12T02:04:12.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.299+0000 7ff0cffff700 1 -- 172.21.15.37:0/1753189941 learned_addr learned my addr 172.21.15.37:0/1753189941 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:12.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.299+0000 7ff0ceffd700 1 --2- 172.21.15.37:0/1753189941 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0d006c210 0x7ff0d0155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:12.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.299+0000 7ff0cf7fe700 1 --2- 172.21.15.37:0/1753189941 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0d006bda0 0x7ff0d00c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:12.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.300+0000 7ff0cffff700 1 -- 172.21.15.37:0/1753189941 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0d006bda0 msgr2=0x7ff0d00c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.300+0000 7ff0cffff700 1 --2- 172.21.15.37:0/1753189941 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0d006bda0 0x7ff0d00c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.300+0000 7ff0cffff700 1 -- 172.21.15.37:0/1753189941 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0d006c210 msgr2=0x7ff0d0155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.300+0000 7ff0cffff700 1 --2- 172.21.15.37:0/1753189941 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0d006c210 0x7ff0d0155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.300+0000 7ff0cffff700 1 -- 172.21.15.37:0/1753189941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c8009b30 con 0x7ff0d00b4590 2023-07-12T02:04:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.300+0000 7ff0cffff700 1 --2- 172.21.15.37:0/1753189941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d00b4590 0x7ff0d01e2730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff0d008b6b0 tx=0x7ff0c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.300+0000 7ff0b7fff700 1 -- 172.21.15.37:0/1753189941 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c80047c0 con 0x7ff0d00b4590 2023-07-12T02:04:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.300+0000 7ff0b7fff700 1 -- 172.21.15.37:0/1753189941 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c80099b0 con 0x7ff0d00b4590 2023-07-12T02:04:12.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.300+0000 7ff0d5dff700 1 -- 172.21.15.37:0/1753189941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d00c7d90 con 0x7ff0d00b4590 2023-07-12T02:04:12.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.300+0000 7ff0b7fff700 1 -- 172.21.15.37:0/1753189941 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c801c680 con 0x7ff0d00b4590 2023-07-12T02:04:12.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.300+0000 7ff0d5dff700 1 -- 172.21.15.37:0/1753189941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d00c8350 con 0x7ff0d00b4590 2023-07-12T02:04:12.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.301+0000 7ff0d5dff700 1 -- 172.21.15.37:0/1753189941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d004ea60 con 0x7ff0d00b4590 2023-07-12T02:04:12.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.302+0000 7ff0b7fff700 1 -- 172.21.15.37:0/1753189941 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff0c801c7e0 con 0x7ff0d00b4590 2023-07-12T02:04:12.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.303+0000 7ff0b7fff700 1 --2- 172.21.15.37:0/1753189941 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff0bc06ace0 0x7ff0bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:12.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.303+0000 7ff0b7fff700 1 -- 172.21.15.37:0/1753189941 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff0c808b080 con 0x7ff0d00b4590 2023-07-12T02:04:12.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.304+0000 7ff0cf7fe700 1 --2- 172.21.15.37:0/1753189941 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff0bc06ace0 0x7ff0bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:12.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.305+0000 7ff0cf7fe700 1 --2- 172.21.15.37:0/1753189941 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff0bc06ace0 0x7ff0bc06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0007fd0 tx=0x7ff0c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.308+0000 7ff0b7fff700 1 -- 172.21.15.37:0/1753189941 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff0c8055da0 con 0x7ff0d00b4590 2023-07-12T02:04:12.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.516+0000 7ff0d5dff700 1 -- 172.21.15.37:0/1753189941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff0d00b5350 con 0x7ff0d00b4590 2023-07-12T02:04:12.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.516+0000 7ff0b7fff700 1 -- 172.21.15.37:0/1753189941 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff0c80593c0 con 0x7ff0d00b4590 2023-07-12T02:04:12.520 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-12T02:04:12.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.518+0000 7ff0d5dff700 1 -- 172.21.15.37:0/1753189941 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff0bc06ace0 msgr2=0x7ff0bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:12.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.518+0000 7ff0d5dff700 1 --2- 172.21.15.37:0/1753189941 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff0bc06ace0 0x7ff0bc06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0007fd0 tx=0x7ff0c0009040 comp rx=0 tx=0).stop 2023-07-12T02:04:12.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.518+0000 7ff0d5dff700 1 -- 172.21.15.37:0/1753189941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d00b4590 msgr2=0x7ff0d01e2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:12.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.518+0000 7ff0d5dff700 1 --2- 172.21.15.37:0/1753189941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d00b4590 0x7ff0d01e2730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff0d008b6b0 tx=0x7ff0c8004ad0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.519+0000 7ff0d5dff700 1 -- 172.21.15.37:0/1753189941 shutdown_connections 2023-07-12T02:04:12.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.519+0000 7ff0d5dff700 1 --2- 172.21.15.37:0/1753189941 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff0bc06ace0 0x7ff0bc06d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.519+0000 7ff0d5dff700 1 --2- 172.21.15.37:0/1753189941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d00b4590 0x7ff0d01e2730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.519+0000 7ff0d5dff700 1 --2- 172.21.15.37:0/1753189941 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0d006bda0 0x7ff0d00c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.519+0000 7ff0d5dff700 1 --2- 172.21.15.37:0/1753189941 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0d006c210 0x7ff0d0155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.519+0000 7ff0d5dff700 1 -- 172.21.15.37:0/1753189941 >> 172.21.15.37:0/1753189941 conn(0x7ff0d00cf590 msgr2=0x7ff0d00d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:12.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.519+0000 7ff0d5dff700 1 -- 172.21.15.37:0/1753189941 shutdown_connections 2023-07-12T02:04:12.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.519+0000 7ff0d5dff700 1 -- 172.21.15.37:0/1753189941 wait complete. 2023-07-12T02:04:12.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-12T02:04:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.739+0000 7f8b7a5ff700 1 Processor -- start 2023-07-12T02:04:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.740+0000 7f8b7a5ff700 1 -- start start 2023-07-12T02:04:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.741+0000 7f8b7a5ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8b740b8430 0x7f8b740cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.741+0000 7f8b7a5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b740cfc60 0x7f8b740d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.741+0000 7f8b7a5ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b740d0b20 con 0x7f8b740d3730 2023-07-12T02:04:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.741+0000 7f8b7a5ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b740b8800 con 0x7f8b740b8430 2023-07-12T02:04:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.741+0000 7f8b7a5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b740b4ee0 con 0x7f8b740cfc60 2023-07-12T02:04:12.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.741+0000 7f8b78b9c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b740cfc60 0x7f8b740d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.741+0000 7f8b73fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8b740b8430 0x7f8b740cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.741+0000 7f8b78b9c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b740cfc60 0x7f8b740d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:43074/0 (socket says 172.21.15.37:43074) 2023-07-12T02:04:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.741+0000 7f8b73fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8b740b8430 0x7f8b740cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:47808/0 (socket says 172.21.15.37:47808) 2023-07-12T02:04:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.741+0000 7f8b78b9c700 1 -- 172.21.15.37:0/1678715465 learned_addr learned my addr 172.21.15.37:0/1678715465 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.742+0000 7f8b78b9c700 1 -- 172.21.15.37:0/1678715465 >> v2:172.21.15.196:3300/0 conn(0x7f8b740b8430 msgr2=0x7f8b740cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.742+0000 7f8b78b9c700 1 --2- 172.21.15.37:0/1678715465 >> v2:172.21.15.196:3300/0 conn(0x7f8b740b8430 0x7f8b740cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.742+0000 7f8b78b9c700 1 -- 172.21.15.37:0/1678715465 >> v1:172.21.15.196:6789/0 conn(0x7f8b740d3730 legacy=0x7f8b740cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.742+0000 7f8b78b9c700 1 -- 172.21.15.37:0/1678715465 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b740b51c0 con 0x7f8b740cfc60 2023-07-12T02:04:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.742+0000 7f8b78b9c700 1 --2- 172.21.15.37:0/1678715465 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b740cfc60 0x7f8b740d0fb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c009e50 tx=0x7f8b6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a202c868417156c server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.742+0000 7f8b72ffd700 1 -- 172.21.15.37:0/1678715465 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c00e070 con 0x7f8b740cfc60 2023-07-12T02:04:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.742+0000 7f8b72ffd700 1 -- 172.21.15.37:0/1678715465 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c00b910 con 0x7f8b740cfc60 2023-07-12T02:04:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.742+0000 7f8b72ffd700 1 -- 172.21.15.37:0/1678715465 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c00bcc0 con 0x7f8b740cfc60 2023-07-12T02:04:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.743+0000 7f8b7a5ff700 1 -- 172.21.15.37:0/1678715465 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b740cfc60 msgr2=0x7f8b740d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.743+0000 7f8b7a5ff700 1 --2- 172.21.15.37:0/1678715465 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b740cfc60 0x7f8b740d0fb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c009e50 tx=0x7f8b6c00b330 comp rx=0 tx=0).stop 2023-07-12T02:04:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.743+0000 7f8b7a5ff700 1 -- 172.21.15.37:0/1678715465 shutdown_connections 2023-07-12T02:04:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.743+0000 7f8b7a5ff700 1 --2- 172.21.15.37:0/1678715465 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b740cfc60 0x7f8b740d0fb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.743+0000 7f8b7a5ff700 1 --2- 172.21.15.37:0/1678715465 >> v2:172.21.15.196:3300/0 conn(0x7f8b740b8430 0x7f8b740cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.743+0000 7f8b7a5ff700 1 -- 172.21.15.37:0/1678715465 >> 172.21.15.37:0/1678715465 conn(0x7f8b7406b3f0 msgr2=0x7f8b7406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.743+0000 7f8b7a5ff700 1 -- 172.21.15.37:0/1678715465 shutdown_connections 2023-07-12T02:04:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.743+0000 7f8b7a5ff700 1 -- 172.21.15.37:0/1678715465 wait complete. 2023-07-12T02:04:12.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.745+0000 7f8b7a5ff700 1 Processor -- start 2023-07-12T02:04:12.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.745+0000 7f8b7a5ff700 1 -- start start 2023-07-12T02:04:12.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.746+0000 7f8b7a5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b740b8430 0x7f8b741579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:12.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.746+0000 7f8b7a5ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b740cfc60 0x7f8b740cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:12.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.746+0000 7f8b7a5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b740d3730 0x7f8b740cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:12.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.746+0000 7f8b7a5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7415ecd0 con 0x7f8b740b8430 2023-07-12T02:04:12.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.746+0000 7f8b7a5ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b74157ef0 con 0x7f8b740cfc60 2023-07-12T02:04:12.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.746+0000 7f8b7a5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b740caad0 con 0x7f8b740d3730 2023-07-12T02:04:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.746+0000 7f8b73fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b740b8430 0x7f8b741579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.746+0000 7f8b73fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b740b8430 0x7f8b741579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40476/0 (socket says 172.21.15.37:40476) 2023-07-12T02:04:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.746+0000 7f8b73fff700 1 -- 172.21.15.37:0/1011529644 learned_addr learned my addr 172.21.15.37:0/1011529644 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.746+0000 7f8b78b9c700 1 --2- 172.21.15.37:0/1011529644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b740d3730 0x7f8b740cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.746+0000 7f8b737fe700 1 --2- 172.21.15.37:0/1011529644 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b740cfc60 0x7f8b740cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.747+0000 7f8b73fff700 1 -- 172.21.15.37:0/1011529644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b740d3730 msgr2=0x7f8b740cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.747+0000 7f8b73fff700 1 --2- 172.21.15.37:0/1011529644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b740d3730 0x7f8b740cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.747+0000 7f8b73fff700 1 -- 172.21.15.37:0/1011529644 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b740cfc60 msgr2=0x7f8b740cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:12.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.747+0000 7f8b73fff700 1 --2- 172.21.15.37:0/1011529644 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b740cfc60 0x7f8b740cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.747+0000 7f8b73fff700 1 -- 172.21.15.37:0/1011529644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c009b30 con 0x7f8b740b8430 2023-07-12T02:04:12.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.747+0000 7f8b73fff700 1 --2- 172.21.15.37:0/1011529644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b740b8430 0x7f8b741579b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400e870 tx=0x7f8b6400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:12.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.747+0000 7f8b70ff9700 1 -- 172.21.15.37:0/1011529644 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64009590 con 0x7f8b740b8430 2023-07-12T02:04:12.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.747+0000 7f8b70ff9700 1 -- 172.21.15.37:0/1011529644 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b64013680 con 0x7f8b740b8430 2023-07-12T02:04:12.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.747+0000 7f8b70ff9700 1 -- 172.21.15.37:0/1011529644 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b640139f0 con 0x7f8b740b8430 2023-07-12T02:04:12.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.747+0000 7f8b7a5ff700 1 -- 172.21.15.37:0/1011529644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b740cadb0 con 0x7f8b740b8430 2023-07-12T02:04:12.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.748+0000 7f8b7a5ff700 1 -- 172.21.15.37:0/1011529644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b740cb370 con 0x7f8b740b8430 2023-07-12T02:04:12.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.749+0000 7f8b7a5ff700 1 -- 172.21.15.37:0/1011529644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7404ea60 con 0x7f8b740b8430 2023-07-12T02:04:12.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.750+0000 7f8b70ff9700 1 -- 172.21.15.37:0/1011529644 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b64013b50 con 0x7f8b740b8430 2023-07-12T02:04:12.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.750+0000 7f8b70ff9700 1 --2- 172.21.15.37:0/1011529644 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b6006ace0 0x7f8b6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:12.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.751+0000 7f8b70ff9700 1 -- 172.21.15.37:0/1011529644 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8b64089610 con 0x7f8b740b8430 2023-07-12T02:04:12.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.751+0000 7f8b737fe700 1 --2- 172.21.15.37:0/1011529644 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b6006ace0 0x7f8b6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:12.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.752+0000 7f8b737fe700 1 --2- 172.21.15.37:0/1011529644 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b6006ace0 0x7f8b6006d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8b740b6760 tx=0x7f8b68009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:12.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.755+0000 7f8b70ff9700 1 -- 172.21.15.37:0/1011529644 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8b64057dc0 con 0x7f8b740b8430 2023-07-12T02:04:12.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.961+0000 7f8b7a5ff700 1 -- 172.21.15.37:0/1011529644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8b740b5470 con 0x7f8b740b8430 2023-07-12T02:04:12.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.962+0000 7f8b70ff9700 1 -- 172.21.15.37:0/1011529644 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8b64057950 con 0x7f8b740b8430 2023-07-12T02:04:12.966 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:04:12.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.964+0000 7f8b7a5ff700 1 -- 172.21.15.37:0/1011529644 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b6006ace0 msgr2=0x7f8b6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:12.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.964+0000 7f8b7a5ff700 1 --2- 172.21.15.37:0/1011529644 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b6006ace0 0x7f8b6006d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8b740b6760 tx=0x7f8b68009040 comp rx=0 tx=0).stop 2023-07-12T02:04:12.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.964+0000 7f8b7a5ff700 1 -- 172.21.15.37:0/1011529644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b740b8430 msgr2=0x7f8b741579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:12.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.964+0000 7f8b7a5ff700 1 --2- 172.21.15.37:0/1011529644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b740b8430 0x7f8b741579b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400e870 tx=0x7f8b6400eb80 comp rx=0 tx=0).stop 2023-07-12T02:04:12.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.964+0000 7f8b7a5ff700 1 -- 172.21.15.37:0/1011529644 shutdown_connections 2023-07-12T02:04:12.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.964+0000 7f8b7a5ff700 1 --2- 172.21.15.37:0/1011529644 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b6006ace0 0x7f8b6006d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.964+0000 7f8b7a5ff700 1 --2- 172.21.15.37:0/1011529644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b740b8430 0x7f8b741579b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.964+0000 7f8b7a5ff700 1 --2- 172.21.15.37:0/1011529644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b740d3730 0x7f8b740cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.964+0000 7f8b7a5ff700 1 --2- 172.21.15.37:0/1011529644 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b740cfc60 0x7f8b740cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:12.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.964+0000 7f8b7a5ff700 1 -- 172.21.15.37:0/1011529644 >> 172.21.15.37:0/1011529644 conn(0x7f8b7406b3f0 msgr2=0x7f8b740d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:12.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.964+0000 7f8b7a5ff700 1 -- 172.21.15.37:0/1011529644 shutdown_connections 2023-07-12T02:04:12.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:12.965+0000 7f8b7a5ff700 1 -- 172.21.15.37:0/1011529644 wait complete. 2023-07-12T02:04:12.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-12T02:04:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.186+0000 7f0066fff700 1 Processor -- start 2023-07-12T02:04:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.186+0000 7f0066fff700 1 -- start start 2023-07-12T02:04:13.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.187+0000 7f0066fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f006015c460 0x7f00600b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:13.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.187+0000 7f0066fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f00600d2640 0x7f00600cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:13.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.188+0000 7f0066fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00600d1790 con 0x7f00600cf720 2023-07-12T02:04:13.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.188+0000 7f0066fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00600cedd0 con 0x7f00600d2640 2023-07-12T02:04:13.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.188+0000 7f0066fff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00600cd950 con 0x7f006015c460 2023-07-12T02:04:13.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.188+0000 7f006559c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f00600cf720 0x7f00600d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59008/0 (socket says 172.21.15.37:59008) 2023-07-12T02:04:13.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.188+0000 7f005ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f00600d2640 0x7f00600cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:13.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.188+0000 7f006559c700 1 -- 172.21.15.37:0/2325490609 learned_addr learned my addr 172.21.15.37:0/2325490609 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:13.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.188+0000 7f0064d9b700 1 --2- 172.21.15.37:0/2325490609 >> v2:172.21.15.196:3300/0 conn(0x7f006015c460 0x7f00600b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:13.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.188+0000 7f005f7fe700 1 -- 172.21.15.37:0/2325490609 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391880171 0 0) 0x7f00600d1790 con 0x7f00600cf720 2023-07-12T02:04:13.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.188+0000 7f005ffff700 1 -- 172.21.15.37:0/2325490609 >> v2:172.21.15.196:3300/0 conn(0x7f006015c460 msgr2=0x7f00600b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:13.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.188+0000 7f005ffff700 1 --2- 172.21.15.37:0/2325490609 >> v2:172.21.15.196:3300/0 conn(0x7f006015c460 0x7f00600b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:13.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.188+0000 7f005ffff700 1 -- 172.21.15.37:0/2325490609 >> v1:172.21.15.37:6789/0 conn(0x7f00600cf720 legacy=0x7f00600d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:13.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.188+0000 7f005ffff700 1 -- 172.21.15.37:0/2325490609 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00600d14b0 con 0x7f00600d2640 2023-07-12T02:04:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.189+0000 7f005ffff700 1 --2- 172.21.15.37:0/2325490609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00600d2640 0x7f00600cf1e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f00600b4f00 tx=0x7f004c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d358deed11c720c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.189+0000 7f005f7fe700 1 -- 172.21.15.37:0/2325490609 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c011830 con 0x7f00600d2640 2023-07-12T02:04:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.189+0000 7f005f7fe700 1 -- 172.21.15.37:0/2325490609 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c011990 con 0x7f00600d2640 2023-07-12T02:04:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.189+0000 7f005f7fe700 1 -- 172.21.15.37:0/2325490609 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c011d20 con 0x7f00600d2640 2023-07-12T02:04:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.189+0000 7f0066fff700 1 -- 172.21.15.37:0/2325490609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00600d2640 msgr2=0x7f00600cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.189+0000 7f0066fff700 1 --2- 172.21.15.37:0/2325490609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00600d2640 0x7f00600cf1e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f00600b4f00 tx=0x7f004c009b20 comp rx=0 tx=0).stop 2023-07-12T02:04:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.190+0000 7f0066fff700 1 -- 172.21.15.37:0/2325490609 shutdown_connections 2023-07-12T02:04:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.190+0000 7f0066fff700 1 --2- 172.21.15.37:0/2325490609 >> v2:172.21.15.196:3300/0 conn(0x7f006015c460 0x7f00600b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.190+0000 7f0066fff700 1 --2- 172.21.15.37:0/2325490609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00600d2640 0x7f00600cf1e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.190+0000 7f0066fff700 1 -- 172.21.15.37:0/2325490609 >> 172.21.15.37:0/2325490609 conn(0x7f0060071660 msgr2=0x7f0060071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.190+0000 7f0066fff700 1 -- 172.21.15.37:0/2325490609 shutdown_connections 2023-07-12T02:04:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.190+0000 7f0066fff700 1 -- 172.21.15.37:0/2325490609 wait complete. 2023-07-12T02:04:13.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.191+0000 7f0066fff700 1 Processor -- start 2023-07-12T02:04:13.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.192+0000 7f0066fff700 1 -- start start 2023-07-12T02:04:13.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.192+0000 7f0066fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00600cf720 0x7f00601f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:13.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.192+0000 7f0066fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00600d2640 0x7f00600cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:13.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.192+0000 7f0066fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f006015c460 0x7f0060156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:13.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.193+0000 7f0066fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00600cab10 con 0x7f006015c460 2023-07-12T02:04:13.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.193+0000 7f0066fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00600cce60 con 0x7f00600d2640 2023-07-12T02:04:13.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.193+0000 7f0066fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00600ca240 con 0x7f00600cf720 2023-07-12T02:04:13.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.193+0000 7f006559c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f006015c460 0x7f0060156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:13.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.193+0000 7f006559c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f006015c460 0x7f0060156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40500/0 (socket says 172.21.15.37:40500) 2023-07-12T02:04:13.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.193+0000 7f006559c700 1 -- 172.21.15.37:0/781165211 learned_addr learned my addr 172.21.15.37:0/781165211 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:13.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.193+0000 7f0064d9b700 1 --2- 172.21.15.37:0/781165211 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00600cf720 0x7f00601f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:13.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.193+0000 7f006559c700 1 -- 172.21.15.37:0/781165211 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00600cf720 msgr2=0x7f00601f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:13.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.193+0000 7f006559c700 1 --2- 172.21.15.37:0/781165211 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00600cf720 0x7f00601f4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:13.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.193+0000 7f006559c700 1 -- 172.21.15.37:0/781165211 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00600d2640 msgr2=0x7f00600cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:13.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.193+0000 7f006559c700 1 --2- 172.21.15.37:0/781165211 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00600d2640 0x7f00600cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:13.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.193+0000 7f006559c700 1 -- 172.21.15.37:0/781165211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c0094a0 con 0x7f006015c460 2023-07-12T02:04:13.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.193+0000 7f006559c700 1 --2- 172.21.15.37:0/781165211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f006015c460 0x7f0060156b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f005800cba0 tx=0x7f005800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:13.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.194+0000 7f005d7fa700 1 -- 172.21.15.37:0/781165211 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005800ab80 con 0x7f006015c460 2023-07-12T02:04:13.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.194+0000 7f005d7fa700 1 -- 172.21.15.37:0/781165211 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005800ad00 con 0x7f006015c460 2023-07-12T02:04:13.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.194+0000 7f0066fff700 1 -- 172.21.15.37:0/781165211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00600ccb80 con 0x7f006015c460 2023-07-12T02:04:13.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.194+0000 7f005d7fa700 1 -- 172.21.15.37:0/781165211 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058007310 con 0x7f006015c460 2023-07-12T02:04:13.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.194+0000 7f0066fff700 1 -- 172.21.15.37:0/781165211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00600ca730 con 0x7f006015c460 2023-07-12T02:04:13.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.195+0000 7f0066fff700 1 -- 172.21.15.37:0/781165211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006004ea60 con 0x7f006015c460 2023-07-12T02:04:13.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.196+0000 7f005d7fa700 1 -- 172.21.15.37:0/781165211 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0058007470 con 0x7f006015c460 2023-07-12T02:04:13.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.197+0000 7f005d7fa700 1 --2- 172.21.15.37:0/781165211 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f004406ace0 0x7f004406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:13.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.197+0000 7f005d7fa700 1 -- 172.21.15.37:0/781165211 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0058089240 con 0x7f006015c460 2023-07-12T02:04:13.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.198+0000 7f0064d9b700 1 --2- 172.21.15.37:0/781165211 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f004406ace0 0x7f004406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.198+0000 7f0064d9b700 1 --2- 172.21.15.37:0/781165211 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f004406ace0 0x7f004406d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0060160740 tx=0x7f0054008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:13.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.201+0000 7f005d7fa700 1 -- 172.21.15.37:0/781165211 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0058053ff0 con 0x7f006015c460 2023-07-12T02:04:13.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.424+0000 7f0066fff700 1 -- 172.21.15.37:0/781165211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f00600b4fa0 con 0x7f006015c460 2023-07-12T02:04:13.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.424+0000 7f005d7fa700 1 -- 172.21.15.37:0/781165211 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0058057610 con 0x7f006015c460 2023-07-12T02:04:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.426+0000 7f0066fff700 1 -- 172.21.15.37:0/781165211 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f004406ace0 msgr2=0x7f004406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.426+0000 7f0066fff700 1 --2- 172.21.15.37:0/781165211 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f004406ace0 0x7f004406d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0060160740 tx=0x7f0054008040 comp rx=0 tx=0).stop 2023-07-12T02:04:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.426+0000 7f0066fff700 1 -- 172.21.15.37:0/781165211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f006015c460 msgr2=0x7f0060156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:13.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.426+0000 7f0066fff700 1 --2- 172.21.15.37:0/781165211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f006015c460 0x7f0060156b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f005800cba0 tx=0x7f005800cf60 comp rx=0 tx=0).stop 2023-07-12T02:04:13.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.426+0000 7f0066fff700 1 -- 172.21.15.37:0/781165211 shutdown_connections 2023-07-12T02:04:13.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.426+0000 7f0066fff700 1 --2- 172.21.15.37:0/781165211 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f004406ace0 0x7f004406d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:13.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.426+0000 7f0066fff700 1 --2- 172.21.15.37:0/781165211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f006015c460 0x7f0060156b10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:13.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.426+0000 7f0066fff700 1 --2- 172.21.15.37:0/781165211 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00600cf720 0x7f00601f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:13.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.426+0000 7f0066fff700 1 --2- 172.21.15.37:0/781165211 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00600d2640 0x7f00600cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:13.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.426+0000 7f0066fff700 1 -- 172.21.15.37:0/781165211 >> 172.21.15.37:0/781165211 conn(0x7f0060071660 msgr2=0x7f00600d1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.426+0000 7f0066fff700 1 -- 172.21.15.37:0/781165211 shutdown_connections 2023-07-12T02:04:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.427+0000 7f0066fff700 1 -- 172.21.15.37:0/781165211 wait complete. 2023-07-12T02:04:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-12T02:04:13.447 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:04:13.448 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:04:13.493 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:04:13.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.730+0000 7fd3ad5ff700 1 Processor -- start 2023-07-12T02:04:13.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.730+0000 7fd3ad5ff700 1 -- start start 2023-07-12T02:04:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.732+0000 7fd3ad5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3a80b8320 0x7fd3a80cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.732+0000 7fd3ad5ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a80cf3b0 con 0x7fd3a80b4cc0 2023-07-12T02:04:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.732+0000 7fd3ad5ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a80b86f0 con 0x7fd3a80d1cd0 2023-07-12T02:04:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.732+0000 7fd3ad5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a80cf0d0 con 0x7fd3a80b8320 2023-07-12T02:04:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.732+0000 7fd3a77fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd3a80b4cc0 0x7fd3a80d0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59018/0 (socket says 172.21.15.37:59018) 2023-07-12T02:04:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.732+0000 7fd3a77fe700 1 -- 172.21.15.37:0/3736367129 learned_addr learned my addr 172.21.15.37:0/3736367129 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.732+0000 7fd3a6ffd700 1 --2- 172.21.15.37:0/3736367129 >> v2:172.21.15.37:3300/0 conn(0x7fd3a80b8320 0x7fd3a80cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:13.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.732+0000 7fd3a5ffb700 1 -- 172.21.15.37:0/3736367129 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895531946 0 0) 0x7fd3a80cf3b0 con 0x7fd3a80b4cc0 2023-07-12T02:04:13.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.733+0000 7fd3a5ffb700 1 -- 172.21.15.37:0/3736367129 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3900035b0 con 0x7fd3a80b4cc0 2023-07-12T02:04:13.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.733+0000 7fd3a6ffd700 1 -- 172.21.15.37:0/3736367129 >> v1:172.21.15.196:6789/0 conn(0x7fd3a80d1cd0 legacy=0x7fd3a80b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:13.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.733+0000 7fd3a5ffb700 1 -- 172.21.15.37:0/3736367129 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378141898 0 0) 0x7fd3a80b86f0 con 0x7fd3a80d1cd0 2023-07-12T02:04:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.733+0000 7fd3a6ffd700 1 -- 172.21.15.37:0/3736367129 >> v1:172.21.15.37:6789/0 conn(0x7fd3a80b4cc0 legacy=0x7fd3a80d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.733+0000 7fd3a6ffd700 1 -- 172.21.15.37:0/3736367129 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a80d22c0 con 0x7fd3a80b8320 2023-07-12T02:04:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.733+0000 7fd3a6ffd700 1 --2- 172.21.15.37:0/3736367129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a80b8320 0x7fd3a80cd4f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd398009840 tx=0x7fd398009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499bb74ff5d5531 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.733+0000 7fd3a5ffb700 1 -- 172.21.15.37:0/3736367129 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd398011830 con 0x7fd3a80b8320 2023-07-12T02:04:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.733+0000 7fd3a5ffb700 1 -- 172.21.15.37:0/3736367129 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd398011990 con 0x7fd3a80b8320 2023-07-12T02:04:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.733+0000 7fd3a5ffb700 1 -- 172.21.15.37:0/3736367129 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd398011d20 con 0x7fd3a80b8320 2023-07-12T02:04:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.734+0000 7fd3ad5ff700 1 -- 172.21.15.37:0/3736367129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a80b8320 msgr2=0x7fd3a80cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.734+0000 7fd3ad5ff700 1 --2- 172.21.15.37:0/3736367129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a80b8320 0x7fd3a80cd4f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd398009840 tx=0x7fd398009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.734+0000 7fd3ad5ff700 1 -- 172.21.15.37:0/3736367129 shutdown_connections 2023-07-12T02:04:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.734+0000 7fd3ad5ff700 1 --2- 172.21.15.37:0/3736367129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a80b8320 0x7fd3a80cd4f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.734+0000 7fd3ad5ff700 1 -- 172.21.15.37:0/3736367129 >> 172.21.15.37:0/3736367129 conn(0x7fd3a80722b0 msgr2=0x7fd3a80cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.734+0000 7fd3ad5ff700 1 -- 172.21.15.37:0/3736367129 shutdown_connections 2023-07-12T02:04:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.734+0000 7fd3ad5ff700 1 -- 172.21.15.37:0/3736367129 wait complete. 2023-07-12T02:04:13.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.736+0000 7fd3ad5ff700 1 Processor -- start 2023-07-12T02:04:13.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.736+0000 7fd3ad5ff700 1 -- start start 2023-07-12T02:04:13.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3ad5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a80b8320 0x7fd3a815f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:13.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3ad5ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3a80d1cd0 0x7fd3a80c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:13.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3ad5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3a815d9e0 0x7fd3a8150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:13.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3ad5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a815ebb0 con 0x7fd3a80b8320 2023-07-12T02:04:13.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3ad5ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a815dfa0 con 0x7fd3a80d1cd0 2023-07-12T02:04:13.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3ad5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a815e280 con 0x7fd3a815d9e0 2023-07-12T02:04:13.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3a6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a80b8320 0x7fd3a815f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:13.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3a6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a80b8320 0x7fd3a815f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40528/0 (socket says 172.21.15.37:40528) 2023-07-12T02:04:13.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3a6ffd700 1 -- 172.21.15.37:0/552528488 learned_addr learned my addr 172.21.15.37:0/552528488 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:13.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3a67fc700 1 --2- 172.21.15.37:0/552528488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3a80d1cd0 0x7fd3a80c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:13.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3a77fe700 1 --2- 172.21.15.37:0/552528488 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3a815d9e0 0x7fd3a8150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:13.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3a6ffd700 1 -- 172.21.15.37:0/552528488 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3a815d9e0 msgr2=0x7fd3a8150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:13.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3a6ffd700 1 --2- 172.21.15.37:0/552528488 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3a815d9e0 0x7fd3a8150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:13.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3a6ffd700 1 -- 172.21.15.37:0/552528488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3a80d1cd0 msgr2=0x7fd3a80c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:13.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3a6ffd700 1 --2- 172.21.15.37:0/552528488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3a80d1cd0 0x7fd3a80c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:13.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3a6ffd700 1 -- 172.21.15.37:0/552528488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3980094a0 con 0x7fd3a80b8320 2023-07-12T02:04:13.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.737+0000 7fd3a67fc700 1 --2- 172.21.15.37:0/552528488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3a80d1cd0 0x7fd3a80c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:13.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.738+0000 7fd3a6ffd700 1 --2- 172.21.15.37:0/552528488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a80b8320 0x7fd3a815f040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd3980090b0 tx=0x7fd398004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:13.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.738+0000 7fd38f7fe700 1 -- 172.21.15.37:0/552528488 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39801a910 con 0x7fd3a80b8320 2023-07-12T02:04:13.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.738+0000 7fd38f7fe700 1 -- 172.21.15.37:0/552528488 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39801aa70 con 0x7fd3a80b8320 2023-07-12T02:04:13.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.738+0000 7fd38f7fe700 1 -- 172.21.15.37:0/552528488 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39801ade0 con 0x7fd3a80b8320 2023-07-12T02:04:13.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.738+0000 7fd3ad5ff700 1 -- 172.21.15.37:0/552528488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a815e560 con 0x7fd3a80b8320 2023-07-12T02:04:13.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.738+0000 7fd3ad5ff700 1 -- 172.21.15.37:0/552528488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a80c8ff0 con 0x7fd3a80b8320 2023-07-12T02:04:13.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.739+0000 7fd3ad5ff700 1 -- 172.21.15.37:0/552528488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a804ea60 con 0x7fd3a80b8320 2023-07-12T02:04:13.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.740+0000 7fd38f7fe700 1 -- 172.21.15.37:0/552528488 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd398022070 con 0x7fd3a80b8320 2023-07-12T02:04:13.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.741+0000 7fd38f7fe700 1 --2- 172.21.15.37:0/552528488 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd39406ace0 0x7fd39406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:13.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.741+0000 7fd38f7fe700 1 -- 172.21.15.37:0/552528488 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd39808a580 con 0x7fd3a80b8320 2023-07-12T02:04:13.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.741+0000 7fd3a67fc700 1 --2- 172.21.15.37:0/552528488 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd39406ace0 0x7fd39406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:13.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.742+0000 7fd3a67fc700 1 --2- 172.21.15.37:0/552528488 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd39406ace0 0x7fd39406d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80b4690 tx=0x7fd39c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:13.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.745+0000 7fd38f7fe700 1 -- 172.21.15.37:0/552528488 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd3980553e0 con 0x7fd3a80b8320 2023-07-12T02:04:13.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.953+0000 7fd3ad5ff700 1 -- 172.21.15.37:0/552528488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3a80b8930 con 0x7fd3a80b8320 2023-07-12T02:04:13.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.954+0000 7fd38f7fe700 1 -- 172.21.15.37:0/552528488 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7fd398015090 con 0x7fd3a80b8320 2023-07-12T02:04:13.958 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:13.959 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:02.702198+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:04:13.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.957+0000 7fd3ad5ff700 1 -- 172.21.15.37:0/552528488 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd39406ace0 msgr2=0x7fd39406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:13.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.957+0000 7fd3ad5ff700 1 --2- 172.21.15.37:0/552528488 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd39406ace0 0x7fd39406d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80b4690 tx=0x7fd39c009040 comp rx=0 tx=0).stop 2023-07-12T02:04:13.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.957+0000 7fd3ad5ff700 1 -- 172.21.15.37:0/552528488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a80b8320 msgr2=0x7fd3a815f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:13.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.957+0000 7fd3ad5ff700 1 --2- 172.21.15.37:0/552528488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a80b8320 0x7fd3a815f040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd3980090b0 tx=0x7fd398004750 comp rx=0 tx=0).stop 2023-07-12T02:04:13.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.957+0000 7fd3ad5ff700 1 -- 172.21.15.37:0/552528488 shutdown_connections 2023-07-12T02:04:13.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.957+0000 7fd3ad5ff700 1 --2- 172.21.15.37:0/552528488 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd39406ace0 0x7fd39406d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:13.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.957+0000 7fd3ad5ff700 1 --2- 172.21.15.37:0/552528488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a80b8320 0x7fd3a815f040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:13.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.957+0000 7fd3ad5ff700 1 --2- 172.21.15.37:0/552528488 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3a815d9e0 0x7fd3a8150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:13.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.957+0000 7fd3ad5ff700 1 --2- 172.21.15.37:0/552528488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3a80d1cd0 0x7fd3a80c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:13.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.957+0000 7fd3ad5ff700 1 -- 172.21.15.37:0/552528488 >> 172.21.15.37:0/552528488 conn(0x7fd3a80b4cc0 msgr2=0x7fd3a80d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:13.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.957+0000 7fd3ad5ff700 1 -- 172.21.15.37:0/552528488 shutdown_connections 2023-07-12T02:04:13.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:13.957+0000 7fd3ad5ff700 1 -- 172.21.15.37:0/552528488 wait complete. 2023-07-12T02:04:13.979 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:03:56.039938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:03:56.612707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-12T02:04:00.200885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-12T02:04:13.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:04:14.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.182+0000 7f5b88bff700 1 Processor -- start 2023-07-12T02:04:14.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.182+0000 7f5b88bff700 1 -- start start 2023-07-12T02:04:14.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b88bff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5b8415c3e0 0x7f5b840b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:14.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b88bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5b840ccd30 0x7f5b840af150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:14.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b88bff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5b8415fec0 0x7f5b84160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:14.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b88bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b84160880 con 0x7f5b840ccd30 2023-07-12T02:04:14.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b88bff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b840b0440 con 0x7f5b8415fec0 2023-07-12T02:04:14.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b88bff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b840cd1a0 con 0x7f5b8415c3e0 2023-07-12T02:04:14.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b81d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5b840ccd30 0x7f5b840af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:14.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b81d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5b840ccd30 0x7f5b840af150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40544/0 (socket says 172.21.15.37:40544) 2023-07-12T02:04:14.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b81d9b700 1 -- 172.21.15.37:0/3093165310 learned_addr learned my addr 172.21.15.37:0/3093165310 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b8259c700 1 --2- 172.21.15.37:0/3093165310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5b8415c3e0 0x7f5b840b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b82d9d700 1 --2- 172.21.15.37:0/3093165310 >> v2:172.21.15.196:3300/0 conn(0x7f5b8415fec0 0x7f5b84160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:14.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b81d9b700 1 -- 172.21.15.37:0/3093165310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5b8415c3e0 msgr2=0x7f5b840b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:14.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b81d9b700 1 --2- 172.21.15.37:0/3093165310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5b8415c3e0 0x7f5b840b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b81d9b700 1 -- 172.21.15.37:0/3093165310 >> v2:172.21.15.196:3300/0 conn(0x7f5b8415fec0 msgr2=0x7f5b84160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:14.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b81d9b700 1 --2- 172.21.15.37:0/3093165310 >> v2:172.21.15.196:3300/0 conn(0x7f5b8415fec0 0x7f5b84160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b81d9b700 1 -- 172.21.15.37:0/3093165310 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8415c7b0 con 0x7f5b840ccd30 2023-07-12T02:04:14.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.184+0000 7f5b82d9d700 1 --2- 172.21.15.37:0/3093165310 >> v2:172.21.15.196:3300/0 conn(0x7f5b8415fec0 0x7f5b84160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:14.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.185+0000 7f5b81d9b700 1 --2- 172.21.15.37:0/3093165310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840ccd30 0x7f5b840af150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5b840b58e0 tx=0x7f5b78009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7709449826c99fee server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:14.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.185+0000 7f5b8159a700 1 -- 172.21.15.37:0/3093165310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7800b870 con 0x7f5b840ccd30 2023-07-12T02:04:14.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.185+0000 7f5b8159a700 1 -- 172.21.15.37:0/3093165310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7800b9d0 con 0x7f5b840ccd30 2023-07-12T02:04:14.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.185+0000 7f5b8159a700 1 -- 172.21.15.37:0/3093165310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7800bd60 con 0x7f5b840ccd30 2023-07-12T02:04:14.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.185+0000 7f5b88bff700 1 -- 172.21.15.37:0/3093165310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840ccd30 msgr2=0x7f5b840af150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:14.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.185+0000 7f5b88bff700 1 --2- 172.21.15.37:0/3093165310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840ccd30 0x7f5b840af150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5b840b58e0 tx=0x7f5b78009bd0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.186+0000 7f5b88bff700 1 -- 172.21.15.37:0/3093165310 shutdown_connections 2023-07-12T02:04:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.186+0000 7f5b88bff700 1 --2- 172.21.15.37:0/3093165310 >> v2:172.21.15.196:3300/0 conn(0x7f5b8415fec0 0x7f5b84160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.186+0000 7f5b88bff700 1 --2- 172.21.15.37:0/3093165310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5b8415c3e0 0x7f5b840b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.186+0000 7f5b88bff700 1 --2- 172.21.15.37:0/3093165310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840ccd30 0x7f5b840af150 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.186+0000 7f5b88bff700 1 -- 172.21.15.37:0/3093165310 >> 172.21.15.37:0/3093165310 conn(0x7f5b8406b960 msgr2=0x7f5b84098a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.186+0000 7f5b88bff700 1 -- 172.21.15.37:0/3093165310 shutdown_connections 2023-07-12T02:04:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.186+0000 7f5b88bff700 1 -- 172.21.15.37:0/3093165310 wait complete. 2023-07-12T02:04:14.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.187+0000 7f5b88bff700 1 Processor -- start 2023-07-12T02:04:14.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.188+0000 7f5b88bff700 1 -- start start 2023-07-12T02:04:14.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.188+0000 7f5b88bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840ccd30 0x7f5b840c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:14.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.188+0000 7f5b88bff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5b8415c3e0 0x7f5b840ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:14.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.188+0000 7f5b88bff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b8415fec0 0x7f5b840aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:14.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.188+0000 7f5b88bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b840c85a0 con 0x7f5b840ccd30 2023-07-12T02:04:14.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.188+0000 7f5b88bff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b840c9840 con 0x7f5b8415fec0 2023-07-12T02:04:14.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.188+0000 7f5b88bff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b841f27b0 con 0x7f5b8415c3e0 2023-07-12T02:04:14.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.189+0000 7f5b8259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840ccd30 0x7f5b840c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:14.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.189+0000 7f5b8259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840ccd30 0x7f5b840c9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40548/0 (socket says 172.21.15.37:40548) 2023-07-12T02:04:14.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.189+0000 7f5b8259c700 1 -- 172.21.15.37:0/3002684374 learned_addr learned my addr 172.21.15.37:0/3002684374 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.189+0000 7f5b82d9d700 1 --2- 172.21.15.37:0/3002684374 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b8415fec0 0x7f5b840aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.189+0000 7f5b81d9b700 1 --2- 172.21.15.37:0/3002684374 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5b8415c3e0 0x7f5b840ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.189+0000 7f5b8259c700 1 -- 172.21.15.37:0/3002684374 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5b8415c3e0 msgr2=0x7f5b840ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.189+0000 7f5b8259c700 1 --2- 172.21.15.37:0/3002684374 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5b8415c3e0 0x7f5b840ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.189+0000 7f5b8259c700 1 -- 172.21.15.37:0/3002684374 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b8415fec0 msgr2=0x7f5b840aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.189+0000 7f5b8259c700 1 --2- 172.21.15.37:0/3002684374 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b8415fec0 0x7f5b840aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.189+0000 7f5b8259c700 1 -- 172.21.15.37:0/3002684374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b78009550 con 0x7f5b840ccd30 2023-07-12T02:04:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.189+0000 7f5b82d9d700 1 --2- 172.21.15.37:0/3002684374 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b8415fec0 0x7f5b840aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.189+0000 7f5b8259c700 1 --2- 172.21.15.37:0/3002684374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840ccd30 0x7f5b840c9300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400e7e0 tx=0x7f5b7400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.190+0000 7f5b72ffd700 1 -- 172.21.15.37:0/3002684374 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7400c070 con 0x7f5b840ccd30 2023-07-12T02:04:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.190+0000 7f5b72ffd700 1 -- 172.21.15.37:0/3002684374 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b74013610 con 0x7f5b840ccd30 2023-07-12T02:04:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.190+0000 7f5b88bff700 1 -- 172.21.15.37:0/3002684374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b840c8820 con 0x7f5b840ccd30 2023-07-12T02:04:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.190+0000 7f5b72ffd700 1 -- 172.21.15.37:0/3002684374 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b740139a0 con 0x7f5b840ccd30 2023-07-12T02:04:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.190+0000 7f5b88bff700 1 -- 172.21.15.37:0/3002684374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b840c8de0 con 0x7f5b840ccd30 2023-07-12T02:04:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.191+0000 7f5b88bff700 1 -- 172.21.15.37:0/3002684374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b840c8fa0 con 0x7f5b840ccd30 2023-07-12T02:04:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.192+0000 7f5b72ffd700 1 -- 172.21.15.37:0/3002684374 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5b74013b00 con 0x7f5b840ccd30 2023-07-12T02:04:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.193+0000 7f5b72ffd700 1 --2- 172.21.15.37:0/3002684374 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5b6406ace0 0x7f5b6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.193+0000 7f5b72ffd700 1 -- 172.21.15.37:0/3002684374 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5b740895a0 con 0x7f5b840ccd30 2023-07-12T02:04:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.193+0000 7f5b81d9b700 1 --2- 172.21.15.37:0/3002684374 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5b6406ace0 0x7f5b6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.194+0000 7f5b81d9b700 1 --2- 172.21.15.37:0/3002684374 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5b6406ace0 0x7f5b6406d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5b78000c00 tx=0x7f5b78008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.197+0000 7f5b72ffd700 1 -- 172.21.15.37:0/3002684374 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5b740542c0 con 0x7f5b840ccd30 2023-07-12T02:04:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.404+0000 7f5b88bff700 1 -- 172.21.15.37:0/3002684374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b840cd650 con 0x7f5b840ccd30 2023-07-12T02:04:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.405+0000 7f5b72ffd700 1 -- 172.21.15.37:0/3002684374 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b740578e0 con 0x7f5b840ccd30 2023-07-12T02:04:14.408 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:04:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.407+0000 7f5b88bff700 1 -- 172.21.15.37:0/3002684374 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5b6406ace0 msgr2=0x7f5b6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.407+0000 7f5b88bff700 1 --2- 172.21.15.37:0/3002684374 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5b6406ace0 0x7f5b6406d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5b78000c00 tx=0x7f5b78008030 comp rx=0 tx=0).stop 2023-07-12T02:04:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.407+0000 7f5b88bff700 1 -- 172.21.15.37:0/3002684374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840ccd30 msgr2=0x7f5b840c9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.407+0000 7f5b88bff700 1 --2- 172.21.15.37:0/3002684374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840ccd30 0x7f5b840c9300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400e7e0 tx=0x7f5b7400eaf0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.407+0000 7f5b88bff700 1 -- 172.21.15.37:0/3002684374 shutdown_connections 2023-07-12T02:04:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.407+0000 7f5b88bff700 1 --2- 172.21.15.37:0/3002684374 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5b6406ace0 0x7f5b6406d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.407+0000 7f5b88bff700 1 --2- 172.21.15.37:0/3002684374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840ccd30 0x7f5b840c9300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.407+0000 7f5b88bff700 1 --2- 172.21.15.37:0/3002684374 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b8415fec0 0x7f5b840aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.407+0000 7f5b88bff700 1 --2- 172.21.15.37:0/3002684374 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5b8415c3e0 0x7f5b840ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.407+0000 7f5b88bff700 1 -- 172.21.15.37:0/3002684374 >> 172.21.15.37:0/3002684374 conn(0x7f5b8406b960 msgr2=0x7f5b840adcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:14.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.407+0000 7f5b88bff700 1 -- 172.21.15.37:0/3002684374 shutdown_connections 2023-07-12T02:04:14.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.407+0000 7f5b88bff700 1 -- 172.21.15.37:0/3002684374 wait complete. 2023-07-12T02:04:14.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:04:14.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.627+0000 7efeddbff700 1 Processor -- start 2023-07-12T02:04:14.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.628+0000 7efeddbff700 1 -- start start 2023-07-12T02:04:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.629+0000 7efeddbff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efed80b8430 0x7efed80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.629+0000 7efeddbff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7efed80d3730 0x7efed80cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.629+0000 7efeddbff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efed80cfa90 0x7efed815feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.629+0000 7efeddbff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed80b8800 con 0x7efed80b8430 2023-07-12T02:04:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.629+0000 7efeddbff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed80d0b20 con 0x7efed80d3730 2023-07-12T02:04:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.629+0000 7efeddbff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed80cfeb0 con 0x7efed80cfa90 2023-07-12T02:04:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.629+0000 7efed77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efed80b8430 0x7efed80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.629+0000 7efed77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efed80b8430 0x7efed80cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40562/0 (socket says 172.21.15.37:40562) 2023-07-12T02:04:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.629+0000 7efed77fe700 1 -- 172.21.15.37:0/2366337164 learned_addr learned my addr 172.21.15.37:0/2366337164 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.629+0000 7efed7fff700 1 --2- 172.21.15.37:0/2366337164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efed80cfa90 0x7efed815feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.629+0000 7efed6ffd700 1 --2- 172.21.15.37:0/2366337164 >> v2:172.21.15.196:3300/0 conn(0x7efed80d3730 0x7efed80cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.630+0000 7efed77fe700 1 -- 172.21.15.37:0/2366337164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efed80cfa90 msgr2=0x7efed815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.630+0000 7efed77fe700 1 --2- 172.21.15.37:0/2366337164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efed80cfa90 0x7efed815feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.630+0000 7efed77fe700 1 -- 172.21.15.37:0/2366337164 >> v2:172.21.15.196:3300/0 conn(0x7efed80d3730 msgr2=0x7efed80cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.630+0000 7efed77fe700 1 --2- 172.21.15.37:0/2366337164 >> v2:172.21.15.196:3300/0 conn(0x7efed80d3730 0x7efed80cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.630+0000 7efed77fe700 1 -- 172.21.15.37:0/2366337164 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed80b4ee0 con 0x7efed80b8430 2023-07-12T02:04:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.630+0000 7efed77fe700 1 --2- 172.21.15.37:0/2366337164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed80b8430 0x7efed80cd320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efed8160f50 tx=0x7efec8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8b2924e2483093 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.630+0000 7efed67fc700 1 -- 172.21.15.37:0/2366337164 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8011830 con 0x7efed80b8430 2023-07-12T02:04:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.630+0000 7efed67fc700 1 -- 172.21.15.37:0/2366337164 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec8011990 con 0x7efed80b8430 2023-07-12T02:04:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.630+0000 7efed67fc700 1 -- 172.21.15.37:0/2366337164 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8011d20 con 0x7efed80b8430 2023-07-12T02:04:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.631+0000 7efeddbff700 1 -- 172.21.15.37:0/2366337164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed80b8430 msgr2=0x7efed80cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.631+0000 7efeddbff700 1 --2- 172.21.15.37:0/2366337164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed80b8430 0x7efed80cd320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efed8160f50 tx=0x7efec8009bd0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.631+0000 7efeddbff700 1 -- 172.21.15.37:0/2366337164 shutdown_connections 2023-07-12T02:04:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.631+0000 7efeddbff700 1 --2- 172.21.15.37:0/2366337164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed80b8430 0x7efed80cd320 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.631+0000 7efeddbff700 1 --2- 172.21.15.37:0/2366337164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efed80cfa90 0x7efed815feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.631+0000 7efeddbff700 1 --2- 172.21.15.37:0/2366337164 >> v2:172.21.15.196:3300/0 conn(0x7efed80d3730 0x7efed80cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.631+0000 7efeddbff700 1 -- 172.21.15.37:0/2366337164 >> 172.21.15.37:0/2366337164 conn(0x7efed806b3f0 msgr2=0x7efed806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.631+0000 7efeddbff700 1 -- 172.21.15.37:0/2366337164 shutdown_connections 2023-07-12T02:04:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.631+0000 7efeddbff700 1 -- 172.21.15.37:0/2366337164 wait complete. 2023-07-12T02:04:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.633+0000 7efeddbff700 1 Processor -- start 2023-07-12T02:04:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.633+0000 7efeddbff700 1 -- start start 2023-07-12T02:04:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.634+0000 7efeddbff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efed80b8430 0x7efed815df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.634+0000 7efeddbff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efed80cfa90 0x7efed80c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.634+0000 7efeddbff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed80d3730 0x7efed814ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.634+0000 7efeddbff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed815cea0 con 0x7efed80d3730 2023-07-12T02:04:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.634+0000 7efeddbff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed815d180 con 0x7efed80b8430 2023-07-12T02:04:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.634+0000 7efeddbff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed815d460 con 0x7efed80cfa90 2023-07-12T02:04:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.634+0000 7efed7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed80d3730 0x7efed814ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.634+0000 7efed7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed80d3730 0x7efed814ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40578/0 (socket says 172.21.15.37:40578) 2023-07-12T02:04:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.634+0000 7efed7fff700 1 -- 172.21.15.37:0/3586830196 learned_addr learned my addr 172.21.15.37:0/3586830196 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.634+0000 7efed6ffd700 1 --2- 172.21.15.37:0/3586830196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efed80cfa90 0x7efed80c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.634+0000 7efed77fe700 1 --2- 172.21.15.37:0/3586830196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efed80b8430 0x7efed815df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.634+0000 7efed7fff700 1 -- 172.21.15.37:0/3586830196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efed80cfa90 msgr2=0x7efed80c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.634+0000 7efed7fff700 1 --2- 172.21.15.37:0/3586830196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efed80cfa90 0x7efed80c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.634+0000 7efed7fff700 1 -- 172.21.15.37:0/3586830196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efed80b8430 msgr2=0x7efed815df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.634+0000 7efed7fff700 1 --2- 172.21.15.37:0/3586830196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efed80b8430 0x7efed815df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.635+0000 7efed7fff700 1 -- 172.21.15.37:0/3586830196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec8009550 con 0x7efed80d3730 2023-07-12T02:04:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.635+0000 7efed6ffd700 1 --2- 172.21.15.37:0/3586830196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efed80cfa90 0x7efed80c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.635+0000 7efed7fff700 1 --2- 172.21.15.37:0/3586830196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed80d3730 0x7efed814ae30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efed000efc0 tx=0x7efed000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.635+0000 7efebffff700 1 -- 172.21.15.37:0/3586830196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed000cb80 con 0x7efed80d3730 2023-07-12T02:04:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.635+0000 7efebffff700 1 -- 172.21.15.37:0/3586830196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed000f040 con 0x7efed80d3730 2023-07-12T02:04:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.635+0000 7efeddbff700 1 -- 172.21.15.37:0/3586830196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed815d740 con 0x7efed80d3730 2023-07-12T02:04:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.635+0000 7efebffff700 1 -- 172.21.15.37:0/3586830196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0014480 con 0x7efed80d3730 2023-07-12T02:04:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.635+0000 7efeddbff700 1 -- 172.21.15.37:0/3586830196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed80c7710 con 0x7efed80d3730 2023-07-12T02:04:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.636+0000 7efeddbff700 1 -- 172.21.15.37:0/3586830196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed815dc60 con 0x7efed80d3730 2023-07-12T02:04:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.637+0000 7efebffff700 1 -- 172.21.15.37:0/3586830196 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efed00145e0 con 0x7efed80d3730 2023-07-12T02:04:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.638+0000 7efebffff700 1 --2- 172.21.15.37:0/3586830196 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efec406ace0 0x7efec406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.638+0000 7efebffff700 1 -- 172.21.15.37:0/3586830196 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efed008a030 con 0x7efed80d3730 2023-07-12T02:04:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.639+0000 7efed77fe700 1 --2- 172.21.15.37:0/3586830196 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efec406ace0 0x7efec406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:14.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.639+0000 7efed77fe700 1 --2- 172.21.15.37:0/3586830196 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efec406ace0 0x7efec406d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efec8014040 tx=0x7efec8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:14.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.643+0000 7efebffff700 1 -- 172.21.15.37:0/3586830196 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7efed00bc380 con 0x7efed80d3730 2023-07-12T02:04:14.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.848+0000 7efeddbff700 1 -- 172.21.15.37:0/3586830196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efed804ea60 con 0x7efed80d3730 2023-07-12T02:04:14.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.848+0000 7efebffff700 1 -- 172.21.15.37:0/3586830196 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7efed0018020 con 0x7efed80d3730 2023-07-12T02:04:14.852 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:04:14.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.850+0000 7efeddbff700 1 -- 172.21.15.37:0/3586830196 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efec406ace0 msgr2=0x7efec406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:14.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.850+0000 7efeddbff700 1 --2- 172.21.15.37:0/3586830196 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efec406ace0 0x7efec406d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efec8014040 tx=0x7efec8008030 comp rx=0 tx=0).stop 2023-07-12T02:04:14.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.850+0000 7efeddbff700 1 -- 172.21.15.37:0/3586830196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed80d3730 msgr2=0x7efed814ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:14.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.850+0000 7efeddbff700 1 --2- 172.21.15.37:0/3586830196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed80d3730 0x7efed814ae30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efed000efc0 tx=0x7efed000c0c0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.850+0000 7efeddbff700 1 -- 172.21.15.37:0/3586830196 shutdown_connections 2023-07-12T02:04:14.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.851+0000 7efeddbff700 1 --2- 172.21.15.37:0/3586830196 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efec406ace0 0x7efec406d190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.851+0000 7efeddbff700 1 --2- 172.21.15.37:0/3586830196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed80d3730 0x7efed814ae30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.851+0000 7efeddbff700 1 --2- 172.21.15.37:0/3586830196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efed80b8430 0x7efed815df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.851+0000 7efeddbff700 1 --2- 172.21.15.37:0/3586830196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efed80cfa90 0x7efed80c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:14.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.851+0000 7efeddbff700 1 -- 172.21.15.37:0/3586830196 >> 172.21.15.37:0/3586830196 conn(0x7efed806b3f0 msgr2=0x7efed80cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:14.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.851+0000 7efeddbff700 1 -- 172.21.15.37:0/3586830196 shutdown_connections 2023-07-12T02:04:14.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:14.851+0000 7efeddbff700 1 -- 172.21.15.37:0/3586830196 wait complete. 2023-07-12T02:04:14.872 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:04:15.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.074+0000 7ff02edff700 1 Processor -- start 2023-07-12T02:04:15.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.074+0000 7ff02edff700 1 -- start start 2023-07-12T02:04:15.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.075+0000 7ff02edff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0280b8430 0x7ff0280cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.075+0000 7ff02edff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0280cfc60 0x7ff0280d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.075+0000 7ff02edff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0280d0b20 con 0x7ff0280d3730 2023-07-12T02:04:15.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.075+0000 7ff02edff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0280b8800 con 0x7ff0280cfc60 2023-07-12T02:04:15.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.075+0000 7ff02edff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280b4ee0 con 0x7ff0280b8430 2023-07-12T02:04:15.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.076+0000 7ff02d39c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0280cfc60 0x7ff0280d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.076+0000 7ff02d39c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0280cfc60 0x7ff0280d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40588/0 (socket says 172.21.15.37:40588) 2023-07-12T02:04:15.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.076+0000 7ff02d39c700 1 -- 172.21.15.37:0/2561993990 learned_addr learned my addr 172.21.15.37:0/2561993990 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:15.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.076+0000 7ff02cb9b700 1 --2- 172.21.15.37:0/2561993990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0280b8430 0x7ff0280cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.076+0000 7ff02d39c700 1 -- 172.21.15.37:0/2561993990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0280b8430 msgr2=0x7ff0280cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:15.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.076+0000 7ff02d39c700 1 --2- 172.21.15.37:0/2561993990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0280b8430 0x7ff0280cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.076+0000 7ff02d39c700 1 -- 172.21.15.37:0/2561993990 >> v1:172.21.15.196:6789/0 conn(0x7ff0280d3730 legacy=0x7ff0280cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:15.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.076+0000 7ff02d39c700 1 -- 172.21.15.37:0/2561993990 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0280b51c0 con 0x7ff0280cfc60 2023-07-12T02:04:15.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.076+0000 7ff02cb9b700 1 --2- 172.21.15.37:0/2561993990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0280b8430 0x7ff0280cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:15.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.076+0000 7ff02d39c700 1 --2- 172.21.15.37:0/2561993990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0280cfc60 0x7ff0280d0fb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff020009e50 tx=0x7ff02000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a382cc043237ba11 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:15.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.076+0000 7ff0277fe700 1 -- 172.21.15.37:0/2561993990 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02000e070 con 0x7ff0280cfc60 2023-07-12T02:04:15.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.077+0000 7ff0277fe700 1 -- 172.21.15.37:0/2561993990 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02000b9c0 con 0x7ff0280cfc60 2023-07-12T02:04:15.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.077+0000 7ff0277fe700 1 -- 172.21.15.37:0/2561993990 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02000bd70 con 0x7ff0280cfc60 2023-07-12T02:04:15.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.077+0000 7ff02edff700 1 -- 172.21.15.37:0/2561993990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0280cfc60 msgr2=0x7ff0280d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:15.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.077+0000 7ff02edff700 1 --2- 172.21.15.37:0/2561993990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0280cfc60 0x7ff0280d0fb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff020009e50 tx=0x7ff02000b330 comp rx=0 tx=0).stop 2023-07-12T02:04:15.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.077+0000 7ff02edff700 1 -- 172.21.15.37:0/2561993990 shutdown_connections 2023-07-12T02:04:15.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.077+0000 7ff02edff700 1 --2- 172.21.15.37:0/2561993990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0280b8430 0x7ff0280cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.077+0000 7ff02edff700 1 --2- 172.21.15.37:0/2561993990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0280cfc60 0x7ff0280d0fb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.077+0000 7ff02edff700 1 -- 172.21.15.37:0/2561993990 >> 172.21.15.37:0/2561993990 conn(0x7ff02806b3f0 msgr2=0x7ff02806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:15.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.077+0000 7ff02edff700 1 -- 172.21.15.37:0/2561993990 shutdown_connections 2023-07-12T02:04:15.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.077+0000 7ff02edff700 1 -- 172.21.15.37:0/2561993990 wait complete. 2023-07-12T02:04:15.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.080+0000 7ff02edff700 1 Processor -- start 2023-07-12T02:04:15.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.080+0000 7ff02edff700 1 -- start start 2023-07-12T02:04:15.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.081+0000 7ff02edff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0280b8430 0x7ff0280ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.081+0000 7ff02edff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0280cfc60 0x7ff0280c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.081+0000 7ff02edff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0280d3730 0x7ff02815ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.081+0000 7ff02edff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280c7140 con 0x7ff0280b8430 2023-07-12T02:04:15.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.081+0000 7ff02edff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280ca150 con 0x7ff0280cfc60 2023-07-12T02:04:15.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.081+0000 7ff02edff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280ca360 con 0x7ff0280d3730 2023-07-12T02:04:15.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.081+0000 7ff02cb9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0280b8430 0x7ff0280ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.081+0000 7ff02cb9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0280b8430 0x7ff0280ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40598/0 (socket says 172.21.15.37:40598) 2023-07-12T02:04:15.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.081+0000 7ff02cb9b700 1 -- 172.21.15.37:0/1593554855 learned_addr learned my addr 172.21.15.37:0/1593554855 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:15.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.081+0000 7ff027fff700 1 --2- 172.21.15.37:0/1593554855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0280cfc60 0x7ff0280c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.082+0000 7ff02d39c700 1 --2- 172.21.15.37:0/1593554855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0280d3730 0x7ff02815ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.082+0000 7ff02cb9b700 1 -- 172.21.15.37:0/1593554855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0280d3730 msgr2=0x7ff02815ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:15.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.082+0000 7ff02cb9b700 1 --2- 172.21.15.37:0/1593554855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0280d3730 0x7ff02815ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.082+0000 7ff02cb9b700 1 -- 172.21.15.37:0/1593554855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0280cfc60 msgr2=0x7ff0280c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:15.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.082+0000 7ff02cb9b700 1 --2- 172.21.15.37:0/1593554855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0280cfc60 0x7ff0280c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.082+0000 7ff02cb9b700 1 -- 172.21.15.37:0/1593554855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff020009b30 con 0x7ff0280b8430 2023-07-12T02:04:15.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.082+0000 7ff02cb9b700 1 --2- 172.21.15.37:0/1593554855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0280b8430 0x7ff0280ccab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00e840 tx=0x7ff01c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:15.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.082+0000 7ff0257fa700 1 -- 172.21.15.37:0/1593554855 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c013610 con 0x7ff0280b8430 2023-07-12T02:04:15.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.082+0000 7ff0257fa700 1 -- 172.21.15.37:0/1593554855 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c013770 con 0x7ff0280b8430 2023-07-12T02:04:15.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.082+0000 7ff02edff700 1 -- 172.21.15.37:0/1593554855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0280c67a0 con 0x7ff0280b8430 2023-07-12T02:04:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.082+0000 7ff0257fa700 1 -- 172.21.15.37:0/1593554855 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c013b20 con 0x7ff0280b8430 2023-07-12T02:04:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.083+0000 7ff02edff700 1 -- 172.21.15.37:0/1593554855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0280c6d60 con 0x7ff0280b8430 2023-07-12T02:04:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.084+0000 7ff02edff700 1 -- 172.21.15.37:0/1593554855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0280c73b0 con 0x7ff0280b8430 2023-07-12T02:04:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.085+0000 7ff0257fa700 1 -- 172.21.15.37:0/1593554855 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff01c013c80 con 0x7ff0280b8430 2023-07-12T02:04:15.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.086+0000 7ff0257fa700 1 --2- 172.21.15.37:0/1593554855 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff00c06ace0 0x7ff00c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.087+0000 7ff0257fa700 1 -- 172.21.15.37:0/1593554855 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff01c0892e0 con 0x7ff0280b8430 2023-07-12T02:04:15.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.087+0000 7ff027fff700 1 --2- 172.21.15.37:0/1593554855 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff00c06ace0 0x7ff00c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.088+0000 7ff027fff700 1 --2- 172.21.15.37:0/1593554855 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff00c06ace0 0x7ff00c06d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff02815f6a0 tx=0x7ff014009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:15.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.091+0000 7ff0257fa700 1 -- 172.21.15.37:0/1593554855 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff01c057b20 con 0x7ff0280b8430 2023-07-12T02:04:15.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.296+0000 7ff02edff700 1 -- 172.21.15.37:0/1593554855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff02804ea60 con 0x7ff0280b8430 2023-07-12T02:04:15.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.296+0000 7ff0257fa700 1 -- 172.21.15.37:0/1593554855 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff01c0576b0 con 0x7ff0280b8430 2023-07-12T02:04:15.300 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:04:15.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.299+0000 7ff02edff700 1 -- 172.21.15.37:0/1593554855 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff00c06ace0 msgr2=0x7ff00c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:15.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.299+0000 7ff02edff700 1 --2- 172.21.15.37:0/1593554855 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff00c06ace0 0x7ff00c06d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff02815f6a0 tx=0x7ff014009040 comp rx=0 tx=0).stop 2023-07-12T02:04:15.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.299+0000 7ff02edff700 1 -- 172.21.15.37:0/1593554855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0280b8430 msgr2=0x7ff0280ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:15.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.299+0000 7ff02edff700 1 --2- 172.21.15.37:0/1593554855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0280b8430 0x7ff0280ccab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00e840 tx=0x7ff01c00eb50 comp rx=0 tx=0).stop 2023-07-12T02:04:15.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.299+0000 7ff02edff700 1 -- 172.21.15.37:0/1593554855 shutdown_connections 2023-07-12T02:04:15.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.299+0000 7ff02edff700 1 --2- 172.21.15.37:0/1593554855 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff00c06ace0 0x7ff00c06d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.299+0000 7ff02edff700 1 --2- 172.21.15.37:0/1593554855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0280b8430 0x7ff0280ccab0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.299+0000 7ff02edff700 1 --2- 172.21.15.37:0/1593554855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff0280d3730 0x7ff02815ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.299+0000 7ff02edff700 1 --2- 172.21.15.37:0/1593554855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff0280cfc60 0x7ff0280c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.299+0000 7ff02edff700 1 -- 172.21.15.37:0/1593554855 >> 172.21.15.37:0/1593554855 conn(0x7ff02806b3f0 msgr2=0x7ff0280b69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:15.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.299+0000 7ff02edff700 1 -- 172.21.15.37:0/1593554855 shutdown_connections 2023-07-12T02:04:15.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.299+0000 7ff02edff700 1 -- 172.21.15.37:0/1593554855 wait complete. 2023-07-12T02:04:15.320 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:04:15.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.521+0000 7f832a7ff700 1 Processor -- start 2023-07-12T02:04:15.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.521+0000 7f832a7ff700 1 -- start start 2023-07-12T02:04:15.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.522+0000 7f832a7ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f83240b8430 0x7f83240cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.522+0000 7f832a7ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f83240d3730 0x7f83240cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.522+0000 7f832a7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83240d0b20 con 0x7f83240cfa90 2023-07-12T02:04:15.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.522+0000 7f832a7ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83240b8800 con 0x7f83240b8430 2023-07-12T02:04:15.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.522+0000 7f832a7ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83240cfe90 con 0x7f83240d3730 2023-07-12T02:04:15.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.522+0000 7f8328d9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f83240cfa90 0x7f832415feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59026/0 (socket says 172.21.15.37:59026) 2023-07-12T02:04:15.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.522+0000 7f8328d9c700 1 -- 172.21.15.37:0/83790860 learned_addr learned my addr 172.21.15.37:0/83790860 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:15.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.523+0000 7f8323fff700 1 --2- 172.21.15.37:0/83790860 >> v2:172.21.15.37:3300/0 conn(0x7f83240b8430 0x7f83240cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.523+0000 7f83237fe700 1 --2- 172.21.15.37:0/83790860 >> v2:172.21.15.196:3300/0 conn(0x7f83240d3730 0x7f83240cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.523+0000 7f8322ffd700 1 -- 172.21.15.37:0/83790860 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965173944 0 0) 0x7f83240d0b20 con 0x7f83240cfa90 2023-07-12T02:04:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.523+0000 7f8322ffd700 1 -- 172.21.15.37:0/83790860 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f830c0035b0 con 0x7f83240cfa90 2023-07-12T02:04:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.523+0000 7f8323fff700 1 -- 172.21.15.37:0/83790860 >> v2:172.21.15.196:3300/0 conn(0x7f83240d3730 msgr2=0x7f83240cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.523+0000 7f8323fff700 1 --2- 172.21.15.37:0/83790860 >> v2:172.21.15.196:3300/0 conn(0x7f83240d3730 0x7f83240cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.523+0000 7f8323fff700 1 -- 172.21.15.37:0/83790860 >> v1:172.21.15.37:6789/0 conn(0x7f83240cfa90 legacy=0x7f832415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.523+0000 7f8323fff700 1 -- 172.21.15.37:0/83790860 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83240b4ee0 con 0x7f83240b8430 2023-07-12T02:04:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.523+0000 7f8323fff700 1 --2- 172.21.15.37:0/83790860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83240b8430 0x7f83240cd320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8324160f50 tx=0x7f8314009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f44d5890366525 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:15.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.524+0000 7f8322ffd700 1 -- 172.21.15.37:0/83790860 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314011830 con 0x7f83240b8430 2023-07-12T02:04:15.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.524+0000 7f8322ffd700 1 -- 172.21.15.37:0/83790860 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8314011990 con 0x7f83240b8430 2023-07-12T02:04:15.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.524+0000 7f8322ffd700 1 -- 172.21.15.37:0/83790860 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314011d20 con 0x7f83240b8430 2023-07-12T02:04:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.524+0000 7f832a7ff700 1 -- 172.21.15.37:0/83790860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83240b8430 msgr2=0x7f83240cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.524+0000 7f832a7ff700 1 --2- 172.21.15.37:0/83790860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83240b8430 0x7f83240cd320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8324160f50 tx=0x7f8314009b20 comp rx=0 tx=0).stop 2023-07-12T02:04:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.524+0000 7f832a7ff700 1 -- 172.21.15.37:0/83790860 shutdown_connections 2023-07-12T02:04:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.524+0000 7f832a7ff700 1 --2- 172.21.15.37:0/83790860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83240b8430 0x7f83240cd320 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.524+0000 7f832a7ff700 1 --2- 172.21.15.37:0/83790860 >> v2:172.21.15.196:3300/0 conn(0x7f83240d3730 0x7f83240cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.524+0000 7f832a7ff700 1 -- 172.21.15.37:0/83790860 >> 172.21.15.37:0/83790860 conn(0x7f832406b3f0 msgr2=0x7f832406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.524+0000 7f832a7ff700 1 -- 172.21.15.37:0/83790860 shutdown_connections 2023-07-12T02:04:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.524+0000 7f832a7ff700 1 -- 172.21.15.37:0/83790860 wait complete. 2023-07-12T02:04:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.526+0000 7f832a7ff700 1 Processor -- start 2023-07-12T02:04:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.526+0000 7f832a7ff700 1 -- start start 2023-07-12T02:04:15.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.527+0000 7f832a7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83240b8430 0x7f83241f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.527+0000 7f832a7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83240cfa90 0x7f83241f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.527+0000 7f832a7ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83240d3730 0x7f83241ef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.527+0000 7f832a7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83240d1a20 con 0x7f83240b8430 2023-07-12T02:04:15.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.527+0000 7f832a7ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83241f3190 con 0x7f83240d3730 2023-07-12T02:04:15.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.527+0000 7f832a7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83241f33c0 con 0x7f83240cfa90 2023-07-12T02:04:15.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.527+0000 7f8323fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83240b8430 0x7f83241f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.528+0000 7f8323fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83240b8430 0x7f83241f1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40606/0 (socket says 172.21.15.37:40606) 2023-07-12T02:04:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.528+0000 7f8323fff700 1 -- 172.21.15.37:0/2012311065 learned_addr learned my addr 172.21.15.37:0/2012311065 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.528+0000 7f8328d9c700 1 --2- 172.21.15.37:0/2012311065 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83240d3730 0x7f83241ef6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.528+0000 7f83237fe700 1 --2- 172.21.15.37:0/2012311065 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83240cfa90 0x7f83241f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.528+0000 7f8323fff700 1 -- 172.21.15.37:0/2012311065 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83240cfa90 msgr2=0x7f83241f2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.528+0000 7f8323fff700 1 --2- 172.21.15.37:0/2012311065 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83240cfa90 0x7f83241f2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.528+0000 7f8323fff700 1 -- 172.21.15.37:0/2012311065 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83240d3730 msgr2=0x7f83241ef6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.528+0000 7f8323fff700 1 --2- 172.21.15.37:0/2012311065 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83240d3730 0x7f83241ef6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.528+0000 7f8323fff700 1 -- 172.21.15.37:0/2012311065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83140094a0 con 0x7f83240b8430 2023-07-12T02:04:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.528+0000 7f8323fff700 1 --2- 172.21.15.37:0/2012311065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83240b8430 0x7f83241f1a60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8314000c00 tx=0x7f8314004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.528+0000 7f8320ff9700 1 -- 172.21.15.37:0/2012311065 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314004590 con 0x7f83240b8430 2023-07-12T02:04:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.529+0000 7f8320ff9700 1 -- 172.21.15.37:0/2012311065 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831401e070 con 0x7f83240b8430 2023-07-12T02:04:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.529+0000 7f8320ff9700 1 -- 172.21.15.37:0/2012311065 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83140038e0 con 0x7f83240b8430 2023-07-12T02:04:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.529+0000 7f832a7ff700 1 -- 172.21.15.37:0/2012311065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83241f36a0 con 0x7f83240b8430 2023-07-12T02:04:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.529+0000 7f832a7ff700 1 -- 172.21.15.37:0/2012311065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83241f3c60 con 0x7f83240b8430 2023-07-12T02:04:15.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.530+0000 7f832a7ff700 1 -- 172.21.15.37:0/2012311065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83240b21c0 con 0x7f83240b8430 2023-07-12T02:04:15.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.530+0000 7f8320ff9700 1 -- 172.21.15.37:0/2012311065 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8314003a40 con 0x7f83240b8430 2023-07-12T02:04:15.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.531+0000 7f8320ff9700 1 --2- 172.21.15.37:0/2012311065 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f831006ace0 0x7f831006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.531+0000 7f8320ff9700 1 -- 172.21.15.37:0/2012311065 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f831408a620 con 0x7f83240b8430 2023-07-12T02:04:15.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.532+0000 7f83237fe700 1 --2- 172.21.15.37:0/2012311065 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f831006ace0 0x7f831006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.532+0000 7f83237fe700 1 --2- 172.21.15.37:0/2012311065 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f831006ace0 0x7f831006d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f83240cdbb0 tx=0x7f8318009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:15.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.536+0000 7f8320ff9700 1 -- 172.21.15.37:0/2012311065 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8314055350 con 0x7f83240b8430 2023-07-12T02:04:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.742+0000 7f832a7ff700 1 -- 172.21.15.37:0/2012311065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f832404ea60 con 0x7f83240b8430 2023-07-12T02:04:15.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.743+0000 7f8320ff9700 1 -- 172.21.15.37:0/2012311065 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8314058970 con 0x7f83240b8430 2023-07-12T02:04:15.746 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-12T02:04:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.745+0000 7f832a7ff700 1 -- 172.21.15.37:0/2012311065 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f831006ace0 msgr2=0x7f831006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.745+0000 7f832a7ff700 1 --2- 172.21.15.37:0/2012311065 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f831006ace0 0x7f831006d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f83240cdbb0 tx=0x7f8318009210 comp rx=0 tx=0).stop 2023-07-12T02:04:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.745+0000 7f832a7ff700 1 -- 172.21.15.37:0/2012311065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83240b8430 msgr2=0x7f83241f1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.745+0000 7f832a7ff700 1 --2- 172.21.15.37:0/2012311065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83240b8430 0x7f83241f1a60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8314000c00 tx=0x7f8314004750 comp rx=0 tx=0).stop 2023-07-12T02:04:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.745+0000 7f832a7ff700 1 -- 172.21.15.37:0/2012311065 shutdown_connections 2023-07-12T02:04:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.745+0000 7f832a7ff700 1 --2- 172.21.15.37:0/2012311065 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f831006ace0 0x7f831006d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.745+0000 7f832a7ff700 1 --2- 172.21.15.37:0/2012311065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83240b8430 0x7f83241f1a60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.745+0000 7f832a7ff700 1 --2- 172.21.15.37:0/2012311065 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83240d3730 0x7f83241ef6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.745+0000 7f832a7ff700 1 --2- 172.21.15.37:0/2012311065 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83240cfa90 0x7f83241f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.745+0000 7f832a7ff700 1 -- 172.21.15.37:0/2012311065 >> 172.21.15.37:0/2012311065 conn(0x7f832406b3f0 msgr2=0x7f832406b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:15.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.745+0000 7f832a7ff700 1 -- 172.21.15.37:0/2012311065 shutdown_connections 2023-07-12T02:04:15.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.745+0000 7f832a7ff700 1 -- 172.21.15.37:0/2012311065 wait complete. 2023-07-12T02:04:15.766 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-12T02:04:15.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.967+0000 7fd3ca3ff700 1 Processor -- start 2023-07-12T02:04:15.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.967+0000 7fd3ca3ff700 1 -- start start 2023-07-12T02:04:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.968+0000 7fd3ca3ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd3c40d3730 0x7fd3c40cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.968+0000 7fd3ca3ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3c40cfa90 0x7fd3c40d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.968+0000 7fd3ca3ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c40d0b20 con 0x7fd3c40b8430 2023-07-12T02:04:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.968+0000 7fd3ca3ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c40cda30 con 0x7fd3c40cfa90 2023-07-12T02:04:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.968+0000 7fd3ca3ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c40b8800 con 0x7fd3c40d3730 2023-07-12T02:04:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.968+0000 7fd3c3fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd3c40b8430 0x7fd3c40cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59036/0 (socket says 172.21.15.37:59036) 2023-07-12T02:04:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.968+0000 7fd3c3fff700 1 -- 172.21.15.37:0/874577501 learned_addr learned my addr 172.21.15.37:0/874577501 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.968+0000 7fd3c899c700 1 --2- 172.21.15.37:0/874577501 >> v2:172.21.15.37:3300/0 conn(0x7fd3c40cfa90 0x7fd3c40d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.968+0000 7fd3c37fe700 1 --2- 172.21.15.37:0/874577501 >> v2:172.21.15.196:3300/0 conn(0x7fd3c40d3730 0x7fd3c40cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.969+0000 7fd3c899c700 1 -- 172.21.15.37:0/874577501 >> v2:172.21.15.196:3300/0 conn(0x7fd3c40d3730 msgr2=0x7fd3c40cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:15.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.969+0000 7fd3c899c700 1 --2- 172.21.15.37:0/874577501 >> v2:172.21.15.196:3300/0 conn(0x7fd3c40d3730 0x7fd3c40cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.969+0000 7fd3c899c700 1 -- 172.21.15.37:0/874577501 >> v1:172.21.15.37:6789/0 conn(0x7fd3c40b8430 legacy=0x7fd3c40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:15.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.969+0000 7fd3c899c700 1 -- 172.21.15.37:0/874577501 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c40cfe90 con 0x7fd3c40cfa90 2023-07-12T02:04:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.969+0000 7fd3c899c700 1 --2- 172.21.15.37:0/874577501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c40cfa90 0x7fd3c40d0fb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4160f50 tx=0x7fd3bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf315c7186ce4af server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.969+0000 7fd3c2ffd700 1 -- 172.21.15.37:0/874577501 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00e070 con 0x7fd3c40cfa90 2023-07-12T02:04:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.969+0000 7fd3c2ffd700 1 -- 172.21.15.37:0/874577501 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc00bb20 con 0x7fd3c40cfa90 2023-07-12T02:04:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.969+0000 7fd3c2ffd700 1 -- 172.21.15.37:0/874577501 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc012430 con 0x7fd3c40cfa90 2023-07-12T02:04:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.970+0000 7fd3ca3ff700 1 -- 172.21.15.37:0/874577501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c40cfa90 msgr2=0x7fd3c40d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.970+0000 7fd3ca3ff700 1 --2- 172.21.15.37:0/874577501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c40cfa90 0x7fd3c40d0fb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4160f50 tx=0x7fd3bc00b330 comp rx=0 tx=0).stop 2023-07-12T02:04:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.970+0000 7fd3ca3ff700 1 -- 172.21.15.37:0/874577501 shutdown_connections 2023-07-12T02:04:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.970+0000 7fd3ca3ff700 1 --2- 172.21.15.37:0/874577501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c40cfa90 0x7fd3c40d0fb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.970+0000 7fd3ca3ff700 1 --2- 172.21.15.37:0/874577501 >> v2:172.21.15.196:3300/0 conn(0x7fd3c40d3730 0x7fd3c40cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.970+0000 7fd3ca3ff700 1 -- 172.21.15.37:0/874577501 >> 172.21.15.37:0/874577501 conn(0x7fd3c406b3f0 msgr2=0x7fd3c406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.970+0000 7fd3ca3ff700 1 -- 172.21.15.37:0/874577501 shutdown_connections 2023-07-12T02:04:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.970+0000 7fd3ca3ff700 1 -- 172.21.15.37:0/874577501 wait complete. 2023-07-12T02:04:15.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.972+0000 7fd3ca3ff700 1 Processor -- start 2023-07-12T02:04:15.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.972+0000 7fd3ca3ff700 1 -- start start 2023-07-12T02:04:15.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.973+0000 7fd3ca3ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3c40b8430 0x7fd3c415c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.973+0000 7fd3ca3ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3c40cfa90 0x7fd3c414e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.973+0000 7fd3ca3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c40d3730 0x7fd3c415f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.973+0000 7fd3ca3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c415f850 con 0x7fd3c40d3730 2023-07-12T02:04:15.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.973+0000 7fd3ca3ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c415cf10 con 0x7fd3c40b8430 2023-07-12T02:04:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.973+0000 7fd3ca3ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c415d1f0 con 0x7fd3c40cfa90 2023-07-12T02:04:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.973+0000 7fd3c899c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c40d3730 0x7fd3c415f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.973+0000 7fd3c899c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c40d3730 0x7fd3c415f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40620/0 (socket says 172.21.15.37:40620) 2023-07-12T02:04:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.973+0000 7fd3c899c700 1 -- 172.21.15.37:0/1871701164 learned_addr learned my addr 172.21.15.37:0/1871701164 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.973+0000 7fd3c3fff700 1 --2- 172.21.15.37:0/1871701164 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3c40b8430 0x7fd3c415c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.973+0000 7fd3c37fe700 1 --2- 172.21.15.37:0/1871701164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3c40cfa90 0x7fd3c414e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.973+0000 7fd3c899c700 1 -- 172.21.15.37:0/1871701164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3c40cfa90 msgr2=0x7fd3c414e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.973+0000 7fd3c899c700 1 --2- 172.21.15.37:0/1871701164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3c40cfa90 0x7fd3c414e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.973+0000 7fd3c899c700 1 -- 172.21.15.37:0/1871701164 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3c40b8430 msgr2=0x7fd3c415c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:15.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.973+0000 7fd3c899c700 1 --2- 172.21.15.37:0/1871701164 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3c40b8430 0x7fd3c415c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:15.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.973+0000 7fd3c899c700 1 -- 172.21.15.37:0/1871701164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc009a70 con 0x7fd3c40d3730 2023-07-12T02:04:15.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.974+0000 7fd3c899c700 1 --2- 172.21.15.37:0/1871701164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c40d3730 0x7fd3c415f310 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc014040 tx=0x7fd3bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:15.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.974+0000 7fd3c0ff9700 1 -- 172.21.15.37:0/1871701164 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc012430 con 0x7fd3c40d3730 2023-07-12T02:04:15.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.974+0000 7fd3c0ff9700 1 -- 172.21.15.37:0/1871701164 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc020070 con 0x7fd3c40d3730 2023-07-12T02:04:15.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.974+0000 7fd3c0ff9700 1 -- 172.21.15.37:0/1871701164 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc004280 con 0x7fd3c40d3730 2023-07-12T02:04:15.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.974+0000 7fd3ca3ff700 1 -- 172.21.15.37:0/1871701164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c415d4d0 con 0x7fd3c40d3730 2023-07-12T02:04:15.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.974+0000 7fd3ca3ff700 1 -- 172.21.15.37:0/1871701164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c415da90 con 0x7fd3c40d3730 2023-07-12T02:04:15.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.975+0000 7fd3ca3ff700 1 -- 172.21.15.37:0/1871701164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c415dca0 con 0x7fd3c40d3730 2023-07-12T02:04:15.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.976+0000 7fd3c0ff9700 1 -- 172.21.15.37:0/1871701164 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd3bc0043e0 con 0x7fd3c40d3730 2023-07-12T02:04:15.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.977+0000 7fd3c0ff9700 1 --2- 172.21.15.37:0/1871701164 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd3b006ace0 0x7fd3b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:15.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.977+0000 7fd3c0ff9700 1 -- 172.21.15.37:0/1871701164 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd3bc022070 con 0x7fd3c40d3730 2023-07-12T02:04:15.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.977+0000 7fd3c3fff700 1 --2- 172.21.15.37:0/1871701164 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd3b006ace0 0x7fd3b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:15.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.978+0000 7fd3c3fff700 1 --2- 172.21.15.37:0/1871701164 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd3b006ace0 0x7fd3b006d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4005910 tx=0x7fd3b4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:15.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:15.981+0000 7fd3c0ff9700 1 -- 172.21.15.37:0/1871701164 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd3bc0562a0 con 0x7fd3c40d3730 2023-07-12T02:04:16.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.189+0000 7fd3ca3ff700 1 -- 172.21.15.37:0/1871701164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd3c404ea60 con 0x7fd3c40d3730 2023-07-12T02:04:16.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.190+0000 7fd3c0ff9700 1 -- 172.21.15.37:0/1871701164 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd3bc02c020 con 0x7fd3c40d3730 2023-07-12T02:04:16.193 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:04:16.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.192+0000 7fd3ca3ff700 1 -- 172.21.15.37:0/1871701164 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd3b006ace0 msgr2=0x7fd3b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:16.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.192+0000 7fd3ca3ff700 1 --2- 172.21.15.37:0/1871701164 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd3b006ace0 0x7fd3b006d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4005910 tx=0x7fd3b4009040 comp rx=0 tx=0).stop 2023-07-12T02:04:16.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.192+0000 7fd3ca3ff700 1 -- 172.21.15.37:0/1871701164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c40d3730 msgr2=0x7fd3c415f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:16.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.192+0000 7fd3ca3ff700 1 --2- 172.21.15.37:0/1871701164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c40d3730 0x7fd3c415f310 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc014040 tx=0x7fd3bc004ad0 comp rx=0 tx=0).stop 2023-07-12T02:04:16.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.192+0000 7fd3ca3ff700 1 -- 172.21.15.37:0/1871701164 shutdown_connections 2023-07-12T02:04:16.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.192+0000 7fd3ca3ff700 1 --2- 172.21.15.37:0/1871701164 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd3b006ace0 0x7fd3b006d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:16.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.192+0000 7fd3ca3ff700 1 --2- 172.21.15.37:0/1871701164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c40d3730 0x7fd3c415f310 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:16.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.192+0000 7fd3ca3ff700 1 --2- 172.21.15.37:0/1871701164 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3c40b8430 0x7fd3c415c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:16.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.192+0000 7fd3ca3ff700 1 --2- 172.21.15.37:0/1871701164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3c40cfa90 0x7fd3c414e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:16.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.192+0000 7fd3ca3ff700 1 -- 172.21.15.37:0/1871701164 >> 172.21.15.37:0/1871701164 conn(0x7fd3c406b3f0 msgr2=0x7fd3c415bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:16.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.192+0000 7fd3ca3ff700 1 -- 172.21.15.37:0/1871701164 shutdown_connections 2023-07-12T02:04:16.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.192+0000 7fd3ca3ff700 1 -- 172.21.15.37:0/1871701164 wait complete. 2023-07-12T02:04:16.213 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-12T02:04:16.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.412+0000 7fc45f1ff700 1 Processor -- start 2023-07-12T02:04:16.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.412+0000 7fc45f1ff700 1 -- start start 2023-07-12T02:04:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.413+0000 7fc45f1ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4580b59d0 0x7fc4581671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.413+0000 7fc45f1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4580d1790 con 0x7fc4580d2640 2023-07-12T02:04:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.413+0000 7fc45f1ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4580cd950 con 0x7fc45815c460 2023-07-12T02:04:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.413+0000 7fc45f1ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4580b5e10 con 0x7fc4580b59d0 2023-07-12T02:04:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.413+0000 7fc44ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc4580d2640 0x7fc4580cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59052/0 (socket says 172.21.15.37:59052) 2023-07-12T02:04:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.413+0000 7fc44ffff700 1 -- 172.21.15.37:0/2857256111 learned_addr learned my addr 172.21.15.37:0/2857256111 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:16.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.414+0000 7fc45d79c700 1 --2- 172.21.15.37:0/2857256111 >> v2:172.21.15.37:3300/0 conn(0x7fc4580b59d0 0x7fc4581671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:16.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.414+0000 7fc44f7fe700 1 -- 172.21.15.37:0/2857256111 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764110500 0 0) 0x7fc4580d1790 con 0x7fc4580d2640 2023-07-12T02:04:16.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.414+0000 7fc44f7fe700 1 -- 172.21.15.37:0/2857256111 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4400035b0 con 0x7fc4580d2640 2023-07-12T02:04:16.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.414+0000 7fc44f7fe700 1 -- 172.21.15.37:0/2857256111 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119940815 0 0) 0x7fc4580cd950 con 0x7fc45815c460 2023-07-12T02:04:16.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.414+0000 7fc44f7fe700 1 -- 172.21.15.37:0/2857256111 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4580d1790 con 0x7fc45815c460 2023-07-12T02:04:16.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.414+0000 7fc45d79c700 1 -- 172.21.15.37:0/2857256111 >> v1:172.21.15.196:6789/0 conn(0x7fc45815c460 legacy=0x7fc4580cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.414+0000 7fc45d79c700 1 -- 172.21.15.37:0/2857256111 >> v1:172.21.15.37:6789/0 conn(0x7fc4580d2640 legacy=0x7fc4580cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.414+0000 7fc45d79c700 1 -- 172.21.15.37:0/2857256111 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4580d14b0 con 0x7fc4580b59d0 2023-07-12T02:04:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.414+0000 7fc45d79c700 1 --2- 172.21.15.37:0/2857256111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4580b59d0 0x7fc4581671b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc450009840 tx=0x7fc450009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d462cc72f3315c96 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.415+0000 7fc44f7fe700 1 -- 172.21.15.37:0/2857256111 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450011830 con 0x7fc4580b59d0 2023-07-12T02:04:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.415+0000 7fc44f7fe700 1 -- 172.21.15.37:0/2857256111 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc450011990 con 0x7fc4580b59d0 2023-07-12T02:04:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.415+0000 7fc44f7fe700 1 -- 172.21.15.37:0/2857256111 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450011d20 con 0x7fc4580b59d0 2023-07-12T02:04:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.415+0000 7fc45f1ff700 1 -- 172.21.15.37:0/2857256111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4580b59d0 msgr2=0x7fc4581671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.415+0000 7fc45f1ff700 1 --2- 172.21.15.37:0/2857256111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4580b59d0 0x7fc4581671b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc450009840 tx=0x7fc450009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.415+0000 7fc45f1ff700 1 -- 172.21.15.37:0/2857256111 shutdown_connections 2023-07-12T02:04:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.415+0000 7fc45f1ff700 1 --2- 172.21.15.37:0/2857256111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4580b59d0 0x7fc4581671b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.415+0000 7fc45f1ff700 1 -- 172.21.15.37:0/2857256111 >> 172.21.15.37:0/2857256111 conn(0x7fc458071660 msgr2=0x7fc458071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.415+0000 7fc45f1ff700 1 -- 172.21.15.37:0/2857256111 shutdown_connections 2023-07-12T02:04:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.415+0000 7fc45f1ff700 1 -- 172.21.15.37:0/2857256111 wait complete. 2023-07-12T02:04:16.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.417+0000 7fc45f1ff700 1 Processor -- start 2023-07-12T02:04:16.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.417+0000 7fc45f1ff700 1 -- start start 2023-07-12T02:04:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.418+0000 7fc45f1ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4580b59d0 0x7fc45814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.418+0000 7fc45f1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4580d2640 0x7fc458160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.418+0000 7fc45f1ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc45815c460 0x7fc458160890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.418+0000 7fc45f1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45815cfb0 con 0x7fc4580d2640 2023-07-12T02:04:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.418+0000 7fc45f1ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45815f800 con 0x7fc45815c460 2023-07-12T02:04:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.418+0000 7fc45f1ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45815f520 con 0x7fc4580b59d0 2023-07-12T02:04:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.419+0000 7fc44ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4580d2640 0x7fc458160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.419+0000 7fc44ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4580d2640 0x7fc458160350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40638/0 (socket says 172.21.15.37:40638) 2023-07-12T02:04:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.419+0000 7fc44ffff700 1 -- 172.21.15.37:0/121645008 learned_addr learned my addr 172.21.15.37:0/121645008 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.419+0000 7fc45cf9b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4580b59d0 0x7fc45814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.419+0000 7fc45d79c700 1 --2- 172.21.15.37:0/121645008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc45815c460 0x7fc458160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.419+0000 7fc44ffff700 1 -- 172.21.15.37:0/121645008 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4580b59d0 msgr2=0x7fc45814ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.419+0000 7fc44ffff700 1 --2- 172.21.15.37:0/121645008 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4580b59d0 0x7fc45814ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.419+0000 7fc44ffff700 1 -- 172.21.15.37:0/121645008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc45815c460 msgr2=0x7fc458160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:16.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.419+0000 7fc44ffff700 1 --2- 172.21.15.37:0/121645008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc45815c460 0x7fc458160890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:16.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.419+0000 7fc44ffff700 1 -- 172.21.15.37:0/121645008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4500094a0 con 0x7fc4580d2640 2023-07-12T02:04:16.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.419+0000 7fc44ffff700 1 --2- 172.21.15.37:0/121645008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4580d2640 0x7fc458160350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc44800c700 tx=0x7fc44800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.419+0000 7fc44d7fa700 1 -- 172.21.15.37:0/121645008 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448005d70 con 0x7fc4580d2640 2023-07-12T02:04:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.419+0000 7fc44d7fa700 1 -- 172.21.15.37:0/121645008 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4480070d0 con 0x7fc4580d2640 2023-07-12T02:04:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.419+0000 7fc44d7fa700 1 -- 172.21.15.37:0/121645008 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448007440 con 0x7fc4580d2640 2023-07-12T02:04:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.419+0000 7fc45f1ff700 1 -- 172.21.15.37:0/121645008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45815c960 con 0x7fc4580d2640 2023-07-12T02:04:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.420+0000 7fc45f1ff700 1 -- 172.21.15.37:0/121645008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4581504c0 con 0x7fc4580d2640 2023-07-12T02:04:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.421+0000 7fc45f1ff700 1 -- 172.21.15.37:0/121645008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45815d120 con 0x7fc4580d2640 2023-07-12T02:04:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.421+0000 7fc44d7fa700 1 -- 172.21.15.37:0/121645008 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc4480075a0 con 0x7fc4580d2640 2023-07-12T02:04:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.422+0000 7fc44d7fa700 1 --2- 172.21.15.37:0/121645008 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc44406ace0 0x7fc44406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.422+0000 7fc44d7fa700 1 -- 172.21.15.37:0/121645008 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc448088a80 con 0x7fc4580d2640 2023-07-12T02:04:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.423+0000 7fc45cf9b700 1 --2- 172.21.15.37:0/121645008 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc44406ace0 0x7fc44406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.423+0000 7fc45cf9b700 1 --2- 172.21.15.37:0/121645008 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc44406ace0 0x7fc44406d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc454001560 tx=0x7fc454009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:16.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.427+0000 7fc44d7fa700 1 -- 172.21.15.37:0/121645008 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc4480538e0 con 0x7fc4580d2640 2023-07-12T02:04:16.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.652+0000 7fc45f1ff700 1 -- 172.21.15.37:0/121645008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc45804ea60 con 0x7fc4580d2640 2023-07-12T02:04:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.652+0000 7fc44d7fa700 1 -- 172.21.15.37:0/121645008 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc448017020 con 0x7fc4580d2640 2023-07-12T02:04:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.654+0000 7fc45f1ff700 1 -- 172.21.15.37:0/121645008 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc44406ace0 msgr2=0x7fc44406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.654+0000 7fc45f1ff700 1 --2- 172.21.15.37:0/121645008 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc44406ace0 0x7fc44406d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc454001560 tx=0x7fc454009040 comp rx=0 tx=0).stop 2023-07-12T02:04:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.654+0000 7fc45f1ff700 1 -- 172.21.15.37:0/121645008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4580d2640 msgr2=0x7fc458160350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.654+0000 7fc45f1ff700 1 --2- 172.21.15.37:0/121645008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4580d2640 0x7fc458160350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc44800c700 tx=0x7fc44800ca10 comp rx=0 tx=0).stop 2023-07-12T02:04:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.654+0000 7fc45f1ff700 1 -- 172.21.15.37:0/121645008 shutdown_connections 2023-07-12T02:04:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.654+0000 7fc45f1ff700 1 --2- 172.21.15.37:0/121645008 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc44406ace0 0x7fc44406d190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.654+0000 7fc45f1ff700 1 --2- 172.21.15.37:0/121645008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc45815c460 0x7fc458160890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.654+0000 7fc45f1ff700 1 --2- 172.21.15.37:0/121645008 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4580b59d0 0x7fc45814ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.654+0000 7fc45f1ff700 1 --2- 172.21.15.37:0/121645008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4580d2640 0x7fc458160350 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.654+0000 7fc45f1ff700 1 -- 172.21.15.37:0/121645008 >> 172.21.15.37:0/121645008 conn(0x7fc458071660 msgr2=0x7fc4580d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.655+0000 7fc45f1ff700 1 -- 172.21.15.37:0/121645008 shutdown_connections 2023-07-12T02:04:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:16.655+0000 7fc45f1ff700 1 -- 172.21.15.37:0/121645008 wait complete. 2023-07-12T02:04:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-12T02:04:16.676 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-07-12T02:04:16.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:16.677 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-07-12T02:04:16.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[119410]: fuse finished with error 0 and tester_r 0 2023-07-12T02:04:16.746 INFO:teuthology.orchestra.run:waiting for 300 2023-07-12T02:04:22.848 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-12T02:04:22.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:22.849 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-07-12T02:04:22.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:04:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.114+0000 7f9d45bff700 1 Processor -- start 2023-07-12T02:04:23.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.114+0000 7f9d45bff700 1 -- start start 2023-07-12T02:04:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.115+0000 7f9d45bff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9d400d2640 0x7f9d400b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.115+0000 7f9d45bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d400d1790 con 0x7f9d4015c460 2023-07-12T02:04:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.115+0000 7f9d45bff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d400cd950 con 0x7f9d400cf8f0 2023-07-12T02:04:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.115+0000 7f9d45bff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d400cedd0 con 0x7f9d400d2640 2023-07-12T02:04:23.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.116+0000 7f9d3f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9d4015c460 0x7f9d400cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48472/0 (socket says 172.21.15.37:48472) 2023-07-12T02:04:23.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.116+0000 7f9d3f7fe700 1 -- 172.21.15.37:0/2355415390 learned_addr learned my addr 172.21.15.37:0/2355415390 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:23.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.116+0000 7f9d3e7fc700 1 -- 172.21.15.37:0/2355415390 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952825967 0 0) 0x7f9d400d1790 con 0x7f9d4015c460 2023-07-12T02:04:23.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.116+0000 7f9d3effd700 1 --2- 172.21.15.37:0/2355415390 >> v2:172.21.15.196:3300/0 conn(0x7f9d400d2640 0x7f9d400b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:23.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.116+0000 7f9d3e7fc700 1 -- 172.21.15.37:0/2355415390 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d280035b0 con 0x7f9d4015c460 2023-07-12T02:04:23.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.116+0000 7f9d3e7fc700 1 -- 172.21.15.37:0/2355415390 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3584533907 0 0) 0x7f9d280035b0 con 0x7f9d4015c460 2023-07-12T02:04:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.116+0000 7f9d3e7fc700 1 -- 172.21.15.37:0/2355415390 >> v2:172.21.15.196:3300/0 conn(0x7f9d400d2640 msgr2=0x7f9d400b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.116+0000 7f9d3e7fc700 1 --2- 172.21.15.37:0/2355415390 >> v2:172.21.15.196:3300/0 conn(0x7f9d400d2640 0x7f9d400b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.116+0000 7f9d3e7fc700 1 -- 172.21.15.37:0/2355415390 >> v1:172.21.15.196:6789/0 conn(0x7f9d400cf8f0 legacy=0x7f9d4015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.116+0000 7f9d3e7fc700 1 -- 172.21.15.37:0/2355415390 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d400d14b0 con 0x7f9d4015c460 2023-07-12T02:04:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.116+0000 7f9d3e7fc700 1 -- 172.21.15.37:0/2355415390 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7f9d30001670 con 0x7f9d4015c460 2023-07-12T02:04:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.116+0000 7f9d3e7fc700 1 -- 172.21.15.37:0/2355415390 >> v1:172.21.15.37:6789/0 conn(0x7f9d4015c460 legacy=0x7f9d400cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.116+0000 7f9d3e7fc700 1 --2- 172.21.15.37:0/2355415390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d28003a00 0x7f9d28003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.117+0000 7f9d3e7fc700 1 --2- 172.21.15.37:0/2355415390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d28004850 0x7f9d28004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.117+0000 7f9d3e7fc700 1 --2- 172.21.15.37:0/2355415390 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d28005250 0x7f9d2800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.117+0000 7f9d3e7fc700 1 -- 172.21.15.37:0/2355415390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d400cedd0 con 0x7f9d28004850 2023-07-12T02:04:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.117+0000 7f9d3e7fc700 1 -- 172.21.15.37:0/2355415390 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2800c190 con 0x7f9d28005250 2023-07-12T02:04:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.117+0000 7f9d3e7fc700 1 -- 172.21.15.37:0/2355415390 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2800c350 con 0x7f9d28003a00 2023-07-12T02:04:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.117+0000 7f9d3effd700 1 --2- 172.21.15.37:0/2355415390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d28004850 0x7f9d28004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.117+0000 7f9d3ffff700 1 --2- 172.21.15.37:0/2355415390 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d28005250 0x7f9d2800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.117+0000 7f9d3f7fe700 1 --2- 172.21.15.37:0/2355415390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d28003a00 0x7f9d28003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:23.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.117+0000 7f9d3effd700 1 -- 172.21.15.37:0/2355415390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d28003a00 msgr2=0x7f9d28003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:23.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.117+0000 7f9d3effd700 1 --2- 172.21.15.37:0/2355415390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d28003a00 0x7f9d28003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.117+0000 7f9d3effd700 1 -- 172.21.15.37:0/2355415390 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d28005250 msgr2=0x7f9d2800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:23.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.117+0000 7f9d3effd700 1 --2- 172.21.15.37:0/2355415390 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d28005250 0x7f9d2800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.117+0000 7f9d3effd700 1 -- 172.21.15.37:0/2355415390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d280035b0 con 0x7f9d28004850 2023-07-12T02:04:23.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.117+0000 7f9d3ffff700 1 -- 172.21.15.37:0/2355415390 reap_dead start 2023-07-12T02:04:23.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.117+0000 7f9d3f7fe700 1 --2- 172.21.15.37:0/2355415390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d28003a00 0x7f9d28003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:23.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.117+0000 7f9d3effd700 1 --2- 172.21.15.37:0/2355415390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d28004850 0x7f9d28004cc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9d280047d0 tx=0x7f9d28005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b44c3ae9224d19 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:23.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.118+0000 7f9d3e7fc700 1 -- 172.21.15.37:0/2355415390 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400e6c0 con 0x7f9d28004850 2023-07-12T02:04:23.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.118+0000 7f9d3e7fc700 1 -- 172.21.15.37:0/2355415390 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3400e820 con 0x7f9d28004850 2023-07-12T02:04:23.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.118+0000 7f9d3e7fc700 1 -- 172.21.15.37:0/2355415390 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400ebd0 con 0x7f9d28004850 2023-07-12T02:04:23.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.118+0000 7f9d45bff700 1 -- 172.21.15.37:0/2355415390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d28004850 msgr2=0x7f9d28004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:23.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.118+0000 7f9d45bff700 1 --2- 172.21.15.37:0/2355415390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d28004850 0x7f9d28004cc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9d280047d0 tx=0x7f9d28005880 comp rx=0 tx=0).stop 2023-07-12T02:04:23.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.118+0000 7f9d45bff700 1 -- 172.21.15.37:0/2355415390 shutdown_connections 2023-07-12T02:04:23.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.118+0000 7f9d45bff700 1 --2- 172.21.15.37:0/2355415390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d28004850 0x7f9d28004cc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.118+0000 7f9d45bff700 1 -- 172.21.15.37:0/2355415390 >> 172.21.15.37:0/2355415390 conn(0x7f9d40071660 msgr2=0x7f9d40071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:23.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.118+0000 7f9d45bff700 1 -- 172.21.15.37:0/2355415390 shutdown_connections 2023-07-12T02:04:23.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.118+0000 7f9d45bff700 1 -- 172.21.15.37:0/2355415390 wait complete. 2023-07-12T02:04:23.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.120+0000 7f9d45bff700 1 Processor -- start 2023-07-12T02:04:23.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.120+0000 7f9d45bff700 1 -- start start 2023-07-12T02:04:23.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.121+0000 7f9d45bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d28004850 0x7f9d401f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:23.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.121+0000 7f9d45bff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d40158060 0x7f9d401f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:23.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.121+0000 7f9d45bff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d400cc210 0x7f9d400b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:23.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.121+0000 7f9d45bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d40158950 con 0x7f9d28004850 2023-07-12T02:04:23.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.121+0000 7f9d45bff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4015ab90 con 0x7f9d400cc210 2023-07-12T02:04:23.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.121+0000 7f9d45bff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4015a5a0 con 0x7f9d40158060 2023-07-12T02:04:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.122+0000 7f9d3f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d28004850 0x7f9d401f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.122+0000 7f9d3f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d28004850 0x7f9d401f23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48938/0 (socket says 172.21.15.37:48938) 2023-07-12T02:04:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.122+0000 7f9d3f7fe700 1 -- 172.21.15.37:0/183857535 learned_addr learned my addr 172.21.15.37:0/183857535 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.122+0000 7f9d3ffff700 1 --2- 172.21.15.37:0/183857535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d400cc210 0x7f9d400b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.122+0000 7f9d3effd700 1 --2- 172.21.15.37:0/183857535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d40158060 0x7f9d401f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.122+0000 7f9d3f7fe700 1 -- 172.21.15.37:0/183857535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d40158060 msgr2=0x7f9d401f2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.122+0000 7f9d3f7fe700 1 --2- 172.21.15.37:0/183857535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d40158060 0x7f9d401f2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.122+0000 7f9d3f7fe700 1 -- 172.21.15.37:0/183857535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d400cc210 msgr2=0x7f9d400b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.122+0000 7f9d3f7fe700 1 --2- 172.21.15.37:0/183857535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d400cc210 0x7f9d400b6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.122+0000 7f9d3f7fe700 1 -- 172.21.15.37:0/183857535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d401f28e0 con 0x7f9d28004850 2023-07-12T02:04:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.122+0000 7f9d3f7fe700 1 --2- 172.21.15.37:0/183857535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d28004850 0x7f9d401f23a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9d30001b00 tx=0x7f9d3000eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.122+0000 7f9d27fff700 1 -- 172.21.15.37:0/183857535 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30012590 con 0x7f9d28004850 2023-07-12T02:04:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.123+0000 7f9d45bff700 1 -- 172.21.15.37:0/183857535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d40159120 con 0x7f9d28004850 2023-07-12T02:04:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.123+0000 7f9d27fff700 1 -- 172.21.15.37:0/183857535 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d300126f0 con 0x7f9d28004850 2023-07-12T02:04:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.123+0000 7f9d27fff700 1 -- 172.21.15.37:0/183857535 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30012a60 con 0x7f9d28004850 2023-07-12T02:04:23.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.123+0000 7f9d45bff700 1 -- 172.21.15.37:0/183857535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d40158e40 con 0x7f9d28004850 2023-07-12T02:04:23.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.124+0000 7f9d45bff700 1 -- 172.21.15.37:0/183857535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4004ea60 con 0x7f9d28004850 2023-07-12T02:04:23.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.125+0000 7f9d27fff700 1 -- 172.21.15.37:0/183857535 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9d30012bc0 con 0x7f9d28004850 2023-07-12T02:04:23.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.125+0000 7f9d27fff700 1 --2- 172.21.15.37:0/183857535 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9d2c06ace0 0x7f9d2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:23.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.126+0000 7f9d27fff700 1 -- 172.21.15.37:0/183857535 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9d30089600 con 0x7f9d28004850 2023-07-12T02:04:23.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.126+0000 7f9d3effd700 1 --2- 172.21.15.37:0/183857535 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9d2c06ace0 0x7f9d2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:23.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.127+0000 7f9d3effd700 1 --2- 172.21.15.37:0/183857535 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9d2c06ace0 0x7f9d2c06d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9d34000c00 tx=0x7f9d3401e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:23.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.130+0000 7f9d27fff700 1 -- 172.21.15.37:0/183857535 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9d300542a0 con 0x7f9d28004850 2023-07-12T02:04:23.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.343+0000 7f9d45bff700 1 -- 172.21.15.37:0/183857535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d400b4fa0 con 0x7f9d28004850 2023-07-12T02:04:23.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.344+0000 7f9d27fff700 1 -- 172.21.15.37:0/183857535 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f9d300578c0 con 0x7f9d28004850 2023-07-12T02:04:23.348 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:23.348 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:02.702198+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:04:23.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.347+0000 7f9d45bff700 1 -- 172.21.15.37:0/183857535 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9d2c06ace0 msgr2=0x7f9d2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:23.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.347+0000 7f9d45bff700 1 --2- 172.21.15.37:0/183857535 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9d2c06ace0 0x7f9d2c06d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9d34000c00 tx=0x7f9d3401e040 comp rx=0 tx=0).stop 2023-07-12T02:04:23.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.347+0000 7f9d45bff700 1 -- 172.21.15.37:0/183857535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d28004850 msgr2=0x7f9d401f23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:23.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.347+0000 7f9d45bff700 1 --2- 172.21.15.37:0/183857535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d28004850 0x7f9d401f23a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9d30001b00 tx=0x7f9d3000eb10 comp rx=0 tx=0).stop 2023-07-12T02:04:23.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.347+0000 7f9d45bff700 1 -- 172.21.15.37:0/183857535 shutdown_connections 2023-07-12T02:04:23.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.347+0000 7f9d45bff700 1 --2- 172.21.15.37:0/183857535 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9d2c06ace0 0x7f9d2c06d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.347+0000 7f9d45bff700 1 --2- 172.21.15.37:0/183857535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d28004850 0x7f9d401f23a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.347+0000 7f9d45bff700 1 --2- 172.21.15.37:0/183857535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d400cc210 0x7f9d400b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.347+0000 7f9d45bff700 1 --2- 172.21.15.37:0/183857535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d40158060 0x7f9d401f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.347+0000 7f9d45bff700 1 -- 172.21.15.37:0/183857535 >> 172.21.15.37:0/183857535 conn(0x7f9d40071660 msgr2=0x7f9d400cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:23.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.347+0000 7f9d45bff700 1 -- 172.21.15.37:0/183857535 shutdown_connections 2023-07-12T02:04:23.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.347+0000 7f9d45bff700 1 -- 172.21.15.37:0/183857535 wait complete. 2023-07-12T02:04:23.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:04:23.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.566+0000 7f0789fff700 1 Processor -- start 2023-07-12T02:04:23.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.566+0000 7f0789fff700 1 -- start start 2023-07-12T02:04:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.568+0000 7f0789fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f078415c460 0x7f07840b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.568+0000 7f0789fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07840cf8f0 0x7f078415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.568+0000 7f0789fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07840d1790 con 0x7f07840d2640 2023-07-12T02:04:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.568+0000 7f0789fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07840cedd0 con 0x7f078415c460 2023-07-12T02:04:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.568+0000 7f0789fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07840cd950 con 0x7f07840cf8f0 2023-07-12T02:04:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.568+0000 7f07837fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f078415c460 0x7f07840b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.568+0000 7f0782ffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f07840d2640 0x7f07840cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48480/0 (socket says 172.21.15.37:48480) 2023-07-12T02:04:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.568+0000 7f0782ffd700 1 -- 172.21.15.37:0/2742260411 learned_addr learned my addr 172.21.15.37:0/2742260411 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.568+0000 7f0783fff700 1 --2- 172.21.15.37:0/2742260411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07840cf8f0 0x7f078415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.568+0000 7f07837fe700 1 -- 172.21.15.37:0/2742260411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07840cf8f0 msgr2=0x7f078415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.568+0000 7f07837fe700 1 --2- 172.21.15.37:0/2742260411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07840cf8f0 0x7f078415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.568+0000 7f07837fe700 1 -- 172.21.15.37:0/2742260411 >> v1:172.21.15.37:6789/0 conn(0x7f07840d2640 legacy=0x7f07840cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.568+0000 7f07837fe700 1 -- 172.21.15.37:0/2742260411 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07840d14b0 con 0x7f078415c460 2023-07-12T02:04:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.568+0000 7f07827fc700 1 -- 172.21.15.37:0/2742260411 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984094224 0 0) 0x7f07840d1790 con 0x7f07840d2640 2023-07-12T02:04:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.569+0000 7f07837fe700 1 --2- 172.21.15.37:0/2742260411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078415c460 0x7f07840b59d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0774009840 tx=0x7f0774009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c418038af8c9a1d server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.569+0000 7f07827fc700 1 -- 172.21.15.37:0/2742260411 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774011830 con 0x7f078415c460 2023-07-12T02:04:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.569+0000 7f07827fc700 1 -- 172.21.15.37:0/2742260411 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0774011990 con 0x7f078415c460 2023-07-12T02:04:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.569+0000 7f07827fc700 1 -- 172.21.15.37:0/2742260411 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774011d20 con 0x7f078415c460 2023-07-12T02:04:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.569+0000 7f0789fff700 1 -- 172.21.15.37:0/2742260411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078415c460 msgr2=0x7f07840b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.569+0000 7f0789fff700 1 --2- 172.21.15.37:0/2742260411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078415c460 0x7f07840b59d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0774009840 tx=0x7f0774009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.570+0000 7f0789fff700 1 -- 172.21.15.37:0/2742260411 shutdown_connections 2023-07-12T02:04:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.570+0000 7f0789fff700 1 --2- 172.21.15.37:0/2742260411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07840cf8f0 0x7f078415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.570+0000 7f0789fff700 1 --2- 172.21.15.37:0/2742260411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078415c460 0x7f07840b59d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.570+0000 7f0789fff700 1 -- 172.21.15.37:0/2742260411 >> 172.21.15.37:0/2742260411 conn(0x7f0784071660 msgr2=0x7f0784071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:23.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.570+0000 7f0789fff700 1 -- 172.21.15.37:0/2742260411 shutdown_connections 2023-07-12T02:04:23.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.570+0000 7f0789fff700 1 -- 172.21.15.37:0/2742260411 wait complete. 2023-07-12T02:04:23.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.571+0000 7f0789fff700 1 Processor -- start 2023-07-12T02:04:23.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.571+0000 7f0789fff700 1 -- start start 2023-07-12T02:04:23.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.572+0000 7f0789fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07840cf8f0 0x7f07840cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:23.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.572+0000 7f0789fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07840d2640 0x7f07841579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:23.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.572+0000 7f0789fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078415c460 0x7f0784157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:23.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.572+0000 7f0789fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0784158450 con 0x7f078415c460 2023-07-12T02:04:23.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.572+0000 7f0789fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07840c7fb0 con 0x7f07840d2640 2023-07-12T02:04:23.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.572+0000 7f0789fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07840c9cf0 con 0x7f07840cf8f0 2023-07-12T02:04:23.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.573+0000 7f0783fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078415c460 0x7f0784157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:23.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.573+0000 7f0783fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078415c460 0x7f0784157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48960/0 (socket says 172.21.15.37:48960) 2023-07-12T02:04:23.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.573+0000 7f0783fff700 1 -- 172.21.15.37:0/2092697952 learned_addr learned my addr 172.21.15.37:0/2092697952 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:23.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.573+0000 7f0782ffd700 1 --2- 172.21.15.37:0/2092697952 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07840d2640 0x7f07841579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:23.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.573+0000 7f07837fe700 1 --2- 172.21.15.37:0/2092697952 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07840cf8f0 0x7f07840cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:23.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.573+0000 7f0783fff700 1 -- 172.21.15.37:0/2092697952 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07840cf8f0 msgr2=0x7f07840cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:23.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.573+0000 7f0783fff700 1 --2- 172.21.15.37:0/2092697952 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07840cf8f0 0x7f07840cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.573+0000 7f0783fff700 1 -- 172.21.15.37:0/2092697952 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07840d2640 msgr2=0x7f07841579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:23.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.573+0000 7f0783fff700 1 --2- 172.21.15.37:0/2092697952 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07840d2640 0x7f07841579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.573+0000 7f0783fff700 1 -- 172.21.15.37:0/2092697952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07740094a0 con 0x7f078415c460 2023-07-12T02:04:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.573+0000 7f0783fff700 1 --2- 172.21.15.37:0/2092697952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078415c460 0x7f0784157f10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f077c007e60 tx=0x7f077c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.574+0000 7f076bfff700 1 -- 172.21.15.37:0/2092697952 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c00ede0 con 0x7f078415c460 2023-07-12T02:04:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.574+0000 7f076bfff700 1 -- 172.21.15.37:0/2092697952 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c014420 con 0x7f078415c460 2023-07-12T02:04:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.574+0000 7f076bfff700 1 -- 172.21.15.37:0/2092697952 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c0147d0 con 0x7f078415c460 2023-07-12T02:04:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.574+0000 7f0789fff700 1 -- 172.21.15.37:0/2092697952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07840c9fd0 con 0x7f078415c460 2023-07-12T02:04:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.574+0000 7f0789fff700 1 -- 172.21.15.37:0/2092697952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07840ca590 con 0x7f078415c460 2023-07-12T02:04:23.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.575+0000 7f0789fff700 1 -- 172.21.15.37:0/2092697952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07840ca720 con 0x7f078415c460 2023-07-12T02:04:23.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.576+0000 7f076bfff700 1 -- 172.21.15.37:0/2092697952 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f077c014930 con 0x7f078415c460 2023-07-12T02:04:23.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.577+0000 7f076bfff700 1 --2- 172.21.15.37:0/2092697952 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f077006ace0 0x7f077006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:23.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.577+0000 7f076bfff700 1 -- 172.21.15.37:0/2092697952 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f077c089ff0 con 0x7f078415c460 2023-07-12T02:04:23.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.577+0000 7f07837fe700 1 --2- 172.21.15.37:0/2092697952 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f077006ace0 0x7f077006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:23.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.578+0000 7f07837fe700 1 --2- 172.21.15.37:0/2092697952 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f077006ace0 0x7f077006d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f07740090b0 tx=0x7f077401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.581+0000 7f076bfff700 1 -- 172.21.15.37:0/2092697952 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f077c054dc0 con 0x7f078415c460 2023-07-12T02:04:23.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.788+0000 7f0789fff700 1 -- 172.21.15.37:0/2092697952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f078404ea60 con 0x7f078415c460 2023-07-12T02:04:23.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.790+0000 7f076bfff700 1 -- 172.21.15.37:0/2092697952 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f077c0583e0 con 0x7f078415c460 2023-07-12T02:04:23.794 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:23.794 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:02.702198+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:04:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.792+0000 7f0789fff700 1 -- 172.21.15.37:0/2092697952 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f077006ace0 msgr2=0x7f077006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.792+0000 7f0789fff700 1 --2- 172.21.15.37:0/2092697952 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f077006ace0 0x7f077006d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f07740090b0 tx=0x7f077401c040 comp rx=0 tx=0).stop 2023-07-12T02:04:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.792+0000 7f0789fff700 1 -- 172.21.15.37:0/2092697952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078415c460 msgr2=0x7f0784157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.792+0000 7f0789fff700 1 --2- 172.21.15.37:0/2092697952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078415c460 0x7f0784157f10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f077c007e60 tx=0x7f077c00e3c0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.792+0000 7f0789fff700 1 -- 172.21.15.37:0/2092697952 shutdown_connections 2023-07-12T02:04:23.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.792+0000 7f0789fff700 1 --2- 172.21.15.37:0/2092697952 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f077006ace0 0x7f077006d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.792+0000 7f0789fff700 1 --2- 172.21.15.37:0/2092697952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078415c460 0x7f0784157f10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.792+0000 7f0789fff700 1 --2- 172.21.15.37:0/2092697952 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07840cf8f0 0x7f07840cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.792+0000 7f0789fff700 1 --2- 172.21.15.37:0/2092697952 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07840d2640 0x7f07841579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:23.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.792+0000 7f0789fff700 1 -- 172.21.15.37:0/2092697952 >> 172.21.15.37:0/2092697952 conn(0x7f0784071660 msgr2=0x7f078415c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:23.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.792+0000 7f0789fff700 1 -- 172.21.15.37:0/2092697952 shutdown_connections 2023-07-12T02:04:23.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:23.792+0000 7f0789fff700 1 -- 172.21.15.37:0/2092697952 wait complete. 2023-07-12T02:04:23.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-12T02:04:24.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.015+0000 7fb278fff700 1 Processor -- start 2023-07-12T02:04:24.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.015+0000 7fb278fff700 1 -- start start 2023-07-12T02:04:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.016+0000 7fb278fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb2740d3730 0x7fb2740cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.016+0000 7fb278fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb2740cfa90 0x7fb2740d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.016+0000 7fb278fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2740d0b20 con 0x7fb2740b8430 2023-07-12T02:04:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.016+0000 7fb278fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2740cda30 con 0x7fb2740cfa90 2023-07-12T02:04:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.016+0000 7fb278fff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2740b8800 con 0x7fb2740d3730 2023-07-12T02:04:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.017+0000 7fb27259c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb2740b8430 0x7fb2740cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48484/0 (socket says 172.21.15.37:48484) 2023-07-12T02:04:24.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.017+0000 7fb27259c700 1 -- 172.21.15.37:0/1533483446 learned_addr learned my addr 172.21.15.37:0/1533483446 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:24.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.017+0000 7fb272d9d700 1 --2- 172.21.15.37:0/1533483446 >> v2:172.21.15.37:3300/0 conn(0x7fb2740cfa90 0x7fb2740d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:24.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.017+0000 7fb271d9b700 1 --2- 172.21.15.37:0/1533483446 >> v2:172.21.15.196:3300/0 conn(0x7fb2740d3730 0x7fb2740cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:24.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.017+0000 7fb27159a700 1 -- 172.21.15.37:0/1533483446 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34723359 0 0) 0x7fb2740d0b20 con 0x7fb2740b8430 2023-07-12T02:04:24.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.017+0000 7fb27159a700 1 -- 172.21.15.37:0/1533483446 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb25c0035b0 con 0x7fb2740b8430 2023-07-12T02:04:24.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.017+0000 7fb272d9d700 1 -- 172.21.15.37:0/1533483446 >> v2:172.21.15.196:3300/0 conn(0x7fb2740d3730 msgr2=0x7fb2740cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:24.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.017+0000 7fb272d9d700 1 --2- 172.21.15.37:0/1533483446 >> v2:172.21.15.196:3300/0 conn(0x7fb2740d3730 0x7fb2740cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:24.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.017+0000 7fb272d9d700 1 -- 172.21.15.37:0/1533483446 >> v1:172.21.15.37:6789/0 conn(0x7fb2740b8430 legacy=0x7fb2740cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:24.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.017+0000 7fb272d9d700 1 -- 172.21.15.37:0/1533483446 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2740cfe90 con 0x7fb2740cfa90 2023-07-12T02:04:24.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.017+0000 7fb272d9d700 1 --2- 172.21.15.37:0/1533483446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2740cfa90 0x7fb2740d0fb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb274160f50 tx=0x7fb26c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60df6be454cc8784 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:24.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.018+0000 7fb27159a700 1 -- 172.21.15.37:0/1533483446 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c00e070 con 0x7fb2740cfa90 2023-07-12T02:04:24.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.018+0000 7fb27159a700 1 -- 172.21.15.37:0/1533483446 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c00bb20 con 0x7fb2740cfa90 2023-07-12T02:04:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.018+0000 7fb27159a700 1 -- 172.21.15.37:0/1533483446 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c012430 con 0x7fb2740cfa90 2023-07-12T02:04:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.018+0000 7fb278fff700 1 -- 172.21.15.37:0/1533483446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2740cfa90 msgr2=0x7fb2740d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.018+0000 7fb278fff700 1 --2- 172.21.15.37:0/1533483446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2740cfa90 0x7fb2740d0fb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb274160f50 tx=0x7fb26c00b330 comp rx=0 tx=0).stop 2023-07-12T02:04:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.018+0000 7fb278fff700 1 -- 172.21.15.37:0/1533483446 shutdown_connections 2023-07-12T02:04:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.018+0000 7fb278fff700 1 --2- 172.21.15.37:0/1533483446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2740cfa90 0x7fb2740d0fb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.018+0000 7fb278fff700 1 --2- 172.21.15.37:0/1533483446 >> v2:172.21.15.196:3300/0 conn(0x7fb2740d3730 0x7fb2740cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.018+0000 7fb278fff700 1 -- 172.21.15.37:0/1533483446 >> 172.21.15.37:0/1533483446 conn(0x7fb27406b3f0 msgr2=0x7fb27406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.018+0000 7fb278fff700 1 -- 172.21.15.37:0/1533483446 shutdown_connections 2023-07-12T02:04:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.019+0000 7fb278fff700 1 -- 172.21.15.37:0/1533483446 wait complete. 2023-07-12T02:04:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.020+0000 7fb278fff700 1 Processor -- start 2023-07-12T02:04:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.020+0000 7fb278fff700 1 -- start start 2023-07-12T02:04:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.021+0000 7fb278fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2740b8430 0x7fb27414a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.021+0000 7fb278fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2740cfa90 0x7fb2740c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.021+0000 7fb278fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb2740d3730 0x7fb27415e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.021+0000 7fb278fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2740c6bb0 con 0x7fb2740cfa90 2023-07-12T02:04:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.021+0000 7fb278fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2740c6e50 con 0x7fb2740b8430 2023-07-12T02:04:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.021+0000 7fb278fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2740c7130 con 0x7fb2740d3730 2023-07-12T02:04:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.022+0000 7fb271d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2740cfa90 0x7fb2740c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.022+0000 7fb271d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2740cfa90 0x7fb2740c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48982/0 (socket says 172.21.15.37:48982) 2023-07-12T02:04:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.022+0000 7fb271d9b700 1 -- 172.21.15.37:0/3783754323 learned_addr learned my addr 172.21.15.37:0/3783754323 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.022+0000 7fb27259c700 1 --2- 172.21.15.37:0/3783754323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2740b8430 0x7fb27414a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.022+0000 7fb272d9d700 1 --2- 172.21.15.37:0/3783754323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb2740d3730 0x7fb27415e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.022+0000 7fb271d9b700 1 -- 172.21.15.37:0/3783754323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb2740d3730 msgr2=0x7fb27415e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.022+0000 7fb271d9b700 1 --2- 172.21.15.37:0/3783754323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb2740d3730 0x7fb27415e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.022+0000 7fb271d9b700 1 -- 172.21.15.37:0/3783754323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2740b8430 msgr2=0x7fb27414a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.022+0000 7fb271d9b700 1 --2- 172.21.15.37:0/3783754323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2740b8430 0x7fb27414a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.022+0000 7fb271d9b700 1 -- 172.21.15.37:0/3783754323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c009a70 con 0x7fb2740cfa90 2023-07-12T02:04:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.022+0000 7fb271d9b700 1 --2- 172.21.15.37:0/3783754323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2740cfa90 0x7fb2740c6670 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb26800e870 tx=0x7fb26800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.023+0000 7fb262ffd700 1 -- 172.21.15.37:0/3783754323 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268009590 con 0x7fb2740cfa90 2023-07-12T02:04:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.023+0000 7fb262ffd700 1 -- 172.21.15.37:0/3783754323 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb268013680 con 0x7fb2740cfa90 2023-07-12T02:04:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.023+0000 7fb278fff700 1 -- 172.21.15.37:0/3783754323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2740c7410 con 0x7fb2740cfa90 2023-07-12T02:04:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.023+0000 7fb262ffd700 1 -- 172.21.15.37:0/3783754323 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2680139f0 con 0x7fb2740cfa90 2023-07-12T02:04:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.023+0000 7fb278fff700 1 -- 172.21.15.37:0/3783754323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2740c79d0 con 0x7fb2740cfa90 2023-07-12T02:04:24.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.024+0000 7fb278fff700 1 -- 172.21.15.37:0/3783754323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2740c7d40 con 0x7fb2740cfa90 2023-07-12T02:04:24.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.025+0000 7fb262ffd700 1 -- 172.21.15.37:0/3783754323 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb268013b50 con 0x7fb2740cfa90 2023-07-12T02:04:24.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.026+0000 7fb262ffd700 1 --2- 172.21.15.37:0/3783754323 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb25406ace0 0x7fb25406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:24.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.026+0000 7fb262ffd700 1 -- 172.21.15.37:0/3783754323 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb268089710 con 0x7fb2740cfa90 2023-07-12T02:04:24.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.027+0000 7fb27259c700 1 --2- 172.21.15.37:0/3783754323 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb25406ace0 0x7fb25406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:24.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.027+0000 7fb27259c700 1 --2- 172.21.15.37:0/3783754323 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb25406ace0 0x7fb25406d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb264007fd0 tx=0x7fb264007dc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:24.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.031+0000 7fb262ffd700 1 -- 172.21.15.37:0/3783754323 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb268057ec0 con 0x7fb2740cfa90 2023-07-12T02:04:24.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.285+0000 7fb278fff700 1 -- 172.21.15.37:0/3783754323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb27404ea60 con 0x7fb2740cfa90 2023-07-12T02:04:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.939+0000 7fb262ffd700 1 -- 172.21.15.37:0/3783754323 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb268057a50 con 0x7fb2740cfa90 2023-07-12T02:04:24.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.942+0000 7fb278fff700 1 -- 172.21.15.37:0/3783754323 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb25406ace0 msgr2=0x7fb25406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:24.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.942+0000 7fb278fff700 1 --2- 172.21.15.37:0/3783754323 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb25406ace0 0x7fb25406d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb264007fd0 tx=0x7fb264007dc0 comp rx=0 tx=0).stop 2023-07-12T02:04:24.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.942+0000 7fb278fff700 1 -- 172.21.15.37:0/3783754323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2740cfa90 msgr2=0x7fb2740c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:24.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.942+0000 7fb278fff700 1 --2- 172.21.15.37:0/3783754323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2740cfa90 0x7fb2740c6670 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb26800e870 tx=0x7fb26800eb80 comp rx=0 tx=0).stop 2023-07-12T02:04:24.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.942+0000 7fb278fff700 1 -- 172.21.15.37:0/3783754323 shutdown_connections 2023-07-12T02:04:24.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.942+0000 7fb278fff700 1 --2- 172.21.15.37:0/3783754323 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb25406ace0 0x7fb25406d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:24.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.942+0000 7fb278fff700 1 --2- 172.21.15.37:0/3783754323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb2740d3730 0x7fb27415e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:24.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.942+0000 7fb278fff700 1 --2- 172.21.15.37:0/3783754323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2740b8430 0x7fb27414a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:24.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.942+0000 7fb278fff700 1 --2- 172.21.15.37:0/3783754323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2740cfa90 0x7fb2740c6670 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:24.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.942+0000 7fb278fff700 1 -- 172.21.15.37:0/3783754323 >> 172.21.15.37:0/3783754323 conn(0x7fb27406b3f0 msgr2=0x7fb2740d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:24.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.942+0000 7fb278fff700 1 -- 172.21.15.37:0/3783754323 shutdown_connections 2023-07-12T02:04:24.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:24.942+0000 7fb278fff700 1 -- 172.21.15.37:0/3783754323 wait complete. 2023-07-12T02:04:24.966 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-07-12T02:04:24.967 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-12T02:04:25.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.171+0000 7f1b0efff700 1 Processor -- start 2023-07-12T02:04:25.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.171+0000 7f1b0efff700 1 -- start start 2023-07-12T02:04:25.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.172+0000 7f1b0efff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b080b8430 0x7f1b080cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:25.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.172+0000 7f1b0efff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b080d3730 0x7f1b080cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:25.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.172+0000 7f1b0efff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b080d0b20 con 0x7f1b080cfa90 2023-07-12T02:04:25.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.172+0000 7f1b0efff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b080b8800 con 0x7f1b080d3730 2023-07-12T02:04:25.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.172+0000 7f1b0efff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080cfeb0 con 0x7f1b080b8430 2023-07-12T02:04:25.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.172+0000 7f1b07fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b080d3730 0x7f1b080cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:25.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.172+0000 7f1b0d59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1b080cfa90 0x7f1b0815feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48492/0 (socket says 172.21.15.37:48492) 2023-07-12T02:04:25.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.172+0000 7f1b0d59c700 1 -- 172.21.15.37:0/693681799 learned_addr learned my addr 172.21.15.37:0/693681799 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:25.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.173+0000 7f1b0cd9b700 1 --2- 172.21.15.37:0/693681799 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b080b8430 0x7f1b080cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:25.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.173+0000 7f1b07fff700 1 -- 172.21.15.37:0/693681799 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b080b8430 msgr2=0x7f1b080cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:25.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.173+0000 7f1b07fff700 1 --2- 172.21.15.37:0/693681799 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b080b8430 0x7f1b080cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:25.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.173+0000 7f1b07fff700 1 -- 172.21.15.37:0/693681799 >> v1:172.21.15.37:6789/0 conn(0x7f1b080cfa90 legacy=0x7f1b0815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:25.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.173+0000 7f1b07fff700 1 -- 172.21.15.37:0/693681799 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b080b4ee0 con 0x7f1b080d3730 2023-07-12T02:04:25.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.173+0000 7f1b07fff700 1 --2- 172.21.15.37:0/693681799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b080d3730 0x7f1b080cf550 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1af4009840 tx=0x7f1af4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368dc0664e6ecc63 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:25.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.173+0000 7f1b077fe700 1 -- 172.21.15.37:0/693681799 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4011830 con 0x7f1b080d3730 2023-07-12T02:04:25.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.173+0000 7f1b077fe700 1 -- 172.21.15.37:0/693681799 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af4011990 con 0x7f1b080d3730 2023-07-12T02:04:25.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.173+0000 7f1b077fe700 1 -- 172.21.15.37:0/693681799 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4011d20 con 0x7f1b080d3730 2023-07-12T02:04:25.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.174+0000 7f1b0efff700 1 -- 172.21.15.37:0/693681799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b080d3730 msgr2=0x7f1b080cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:25.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.174+0000 7f1b0efff700 1 --2- 172.21.15.37:0/693681799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b080d3730 0x7f1b080cf550 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1af4009840 tx=0x7f1af4009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:25.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.174+0000 7f1b0efff700 1 -- 172.21.15.37:0/693681799 shutdown_connections 2023-07-12T02:04:25.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.174+0000 7f1b0efff700 1 --2- 172.21.15.37:0/693681799 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b080b8430 0x7f1b080cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:25.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.174+0000 7f1b0efff700 1 --2- 172.21.15.37:0/693681799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b080d3730 0x7f1b080cf550 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:25.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.174+0000 7f1b0efff700 1 -- 172.21.15.37:0/693681799 >> 172.21.15.37:0/693681799 conn(0x7f1b0806b3f0 msgr2=0x7f1b0806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:25.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.174+0000 7f1b0efff700 1 -- 172.21.15.37:0/693681799 shutdown_connections 2023-07-12T02:04:25.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.174+0000 7f1b0efff700 1 -- 172.21.15.37:0/693681799 wait complete. 2023-07-12T02:04:25.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.176+0000 7f1b0efff700 1 Processor -- start 2023-07-12T02:04:25.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.176+0000 7f1b0efff700 1 -- start start 2023-07-12T02:04:25.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.177+0000 7f1b0efff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b080b8430 0x7f1b0814ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:25.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.177+0000 7f1b0efff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b080cfa90 0x7f1b080c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:25.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.177+0000 7f1b0efff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b080d3730 0x7f1b080c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:25.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.177+0000 7f1b0efff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080ca4f0 con 0x7f1b080b8430 2023-07-12T02:04:25.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.177+0000 7f1b0efff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080ca7d0 con 0x7f1b080d3730 2023-07-12T02:04:25.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.177+0000 7f1b0efff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080caab0 con 0x7f1b080cfa90 2023-07-12T02:04:25.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.177+0000 7f1b0cd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b080b8430 0x7f1b0814ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:25.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.177+0000 7f1b0cd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b080b8430 0x7f1b0814ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49002/0 (socket says 172.21.15.37:49002) 2023-07-12T02:04:25.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.177+0000 7f1b0cd9b700 1 -- 172.21.15.37:0/984606661 learned_addr learned my addr 172.21.15.37:0/984606661 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:25.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.177+0000 7f1b07fff700 1 --2- 172.21.15.37:0/984606661 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b080cfa90 0x7f1b080c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:25.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.177+0000 7f1b0d59c700 1 --2- 172.21.15.37:0/984606661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b080d3730 0x7f1b080c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:25.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.178+0000 7f1b0cd9b700 1 -- 172.21.15.37:0/984606661 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b080cfa90 msgr2=0x7f1b080c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:25.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.178+0000 7f1b0cd9b700 1 --2- 172.21.15.37:0/984606661 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b080cfa90 0x7f1b080c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:25.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.178+0000 7f1b0cd9b700 1 -- 172.21.15.37:0/984606661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b080d3730 msgr2=0x7f1b080c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:25.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.178+0000 7f1b0cd9b700 1 --2- 172.21.15.37:0/984606661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b080d3730 0x7f1b080c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:25.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.178+0000 7f1b0cd9b700 1 -- 172.21.15.37:0/984606661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af40094a0 con 0x7f1b080b8430 2023-07-12T02:04:25.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.178+0000 7f1b0cd9b700 1 --2- 172.21.15.37:0/984606661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b080b8430 0x7f1b0814ff90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00d800 tx=0x7f1afc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:25.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.178+0000 7f1b057fa700 1 -- 172.21.15.37:0/984606661 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc0125f0 con 0x7f1b080b8430 2023-07-12T02:04:25.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.178+0000 7f1b057fa700 1 -- 172.21.15.37:0/984606661 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1afc012750 con 0x7f1b080b8430 2023-07-12T02:04:25.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.178+0000 7f1b057fa700 1 -- 172.21.15.37:0/984606661 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc012b00 con 0x7f1b080b8430 2023-07-12T02:04:25.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.178+0000 7f1b0efff700 1 -- 172.21.15.37:0/984606661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b080cafd0 con 0x7f1b080b8430 2023-07-12T02:04:25.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.178+0000 7f1b0efff700 1 -- 172.21.15.37:0/984606661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b081504d0 con 0x7f1b080b8430 2023-07-12T02:04:25.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.179+0000 7f1b0efff700 1 -- 172.21.15.37:0/984606661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b080cb4f0 con 0x7f1b080b8430 2023-07-12T02:04:25.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.180+0000 7f1b057fa700 1 -- 172.21.15.37:0/984606661 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1afc012c60 con 0x7f1b080b8430 2023-07-12T02:04:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.181+0000 7f1b057fa700 1 --2- 172.21.15.37:0/984606661 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1aec06ace0 0x7f1aec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.182+0000 7f1b057fa700 1 -- 172.21.15.37:0/984606661 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1afc089760 con 0x7f1b080b8430 2023-07-12T02:04:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.182+0000 7f1b07fff700 1 --2- 172.21.15.37:0/984606661 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1aec06ace0 0x7f1aec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.183+0000 7f1b07fff700 1 --2- 172.21.15.37:0/984606661 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1aec06ace0 0x7f1aec06d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1af4009b90 tx=0x7f1af401d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:25.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.186+0000 7f1b057fa700 1 -- 172.21.15.37:0/984606661 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1afc054520 con 0x7f1b080b8430 2023-07-12T02:04:25.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.437+0000 7f1b0efff700 1 -- 172.21.15.37:0/984606661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1b0804ea60 con 0x7f1b080b8430 2023-07-12T02:04:25.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.944+0000 7f1b057fa700 1 -- 172.21.15.37:0/984606661 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1afc057b40 con 0x7f1b080b8430 2023-07-12T02:04:25.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.947+0000 7f1b0efff700 1 -- 172.21.15.37:0/984606661 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1aec06ace0 msgr2=0x7f1aec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:25.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.947+0000 7f1b0efff700 1 --2- 172.21.15.37:0/984606661 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1aec06ace0 0x7f1aec06d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1af4009b90 tx=0x7f1af401d040 comp rx=0 tx=0).stop 2023-07-12T02:04:25.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.947+0000 7f1b0efff700 1 -- 172.21.15.37:0/984606661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b080b8430 msgr2=0x7f1b0814ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:25.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.947+0000 7f1b0efff700 1 --2- 172.21.15.37:0/984606661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b080b8430 0x7f1b0814ff90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00d800 tx=0x7f1afc00db10 comp rx=0 tx=0).stop 2023-07-12T02:04:25.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.947+0000 7f1b0efff700 1 -- 172.21.15.37:0/984606661 shutdown_connections 2023-07-12T02:04:25.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.947+0000 7f1b0efff700 1 --2- 172.21.15.37:0/984606661 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1aec06ace0 0x7f1aec06d190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:25.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.947+0000 7f1b0efff700 1 --2- 172.21.15.37:0/984606661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b080b8430 0x7f1b0814ff90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:25.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.947+0000 7f1b0efff700 1 --2- 172.21.15.37:0/984606661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b080d3730 0x7f1b080c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:25.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.947+0000 7f1b0efff700 1 --2- 172.21.15.37:0/984606661 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b080cfa90 0x7f1b080c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:25.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.947+0000 7f1b0efff700 1 -- 172.21.15.37:0/984606661 >> 172.21.15.37:0/984606661 conn(0x7f1b0806b3f0 msgr2=0x7f1b080b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:25.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.947+0000 7f1b0efff700 1 -- 172.21.15.37:0/984606661 shutdown_connections 2023-07-12T02:04:25.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:25.947+0000 7f1b0efff700 1 -- 172.21.15.37:0/984606661 wait complete. 2023-07-12T02:04:25.970 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-12T02:04:25.971 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:04:26.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.170+0000 7f1064fff700 1 Processor -- start 2023-07-12T02:04:26.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.170+0000 7f1064fff700 1 -- start start 2023-07-12T02:04:26.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.172+0000 7f1064fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10600d2640 0x7f10600b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:26.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.172+0000 7f1064fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f10600cf8f0 0x7f106015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:26.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.172+0000 7f1064fff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10600d1790 con 0x7f106015c460 2023-07-12T02:04:26.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.172+0000 7f1064fff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10600cedd0 con 0x7f10600cf8f0 2023-07-12T02:04:26.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.172+0000 7f1064fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10600cd950 con 0x7f10600d2640 2023-07-12T02:04:26.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.172+0000 7f1057fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10600d2640 0x7f10600b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:26.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.172+0000 7f105ed9d700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f10600cf8f0 0x7f106015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:26.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.172+0000 7f105e59c700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f106015c460 0x7f10600cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:56256/0 (socket says 172.21.15.37:56256) 2023-07-12T02:04:26.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.172+0000 7f105e59c700 1 -- 172.21.15.37:0/42009766 learned_addr learned my addr 172.21.15.37:0/42009766 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:26.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.173+0000 7f1057fff700 1 -- 172.21.15.37:0/42009766 >> v2:172.21.15.196:3300/0 conn(0x7f10600cf8f0 msgr2=0x7f106015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:26.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.173+0000 7f1057fff700 1 --2- 172.21.15.37:0/42009766 >> v2:172.21.15.196:3300/0 conn(0x7f10600cf8f0 0x7f106015fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.173+0000 7f1057fff700 1 -- 172.21.15.37:0/42009766 >> v1:172.21.15.196:6789/0 conn(0x7f106015c460 legacy=0x7f10600cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:26.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.173+0000 7f1057fff700 1 -- 172.21.15.37:0/42009766 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10600d14b0 con 0x7f10600d2640 2023-07-12T02:04:26.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.173+0000 7f105ed9d700 1 --2- 172.21.15.37:0/42009766 >> v2:172.21.15.196:3300/0 conn(0x7f10600cf8f0 0x7f106015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:04:26.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.173+0000 7f105dd9b700 1 -- 172.21.15.37:0/42009766 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276852793 0 0) 0x7f10600d1790 con 0x7f106015c460 2023-07-12T02:04:26.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.173+0000 7f1057fff700 1 --2- 172.21.15.37:0/42009766 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10600d2640 0x7f10600b59d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1048009840 tx=0x7f1048009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a0030a35cf2788e server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:26.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.173+0000 7f105dd9b700 1 -- 172.21.15.37:0/42009766 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048011830 con 0x7f10600d2640 2023-07-12T02:04:26.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.173+0000 7f105dd9b700 1 -- 172.21.15.37:0/42009766 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1048011990 con 0x7f10600d2640 2023-07-12T02:04:26.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.173+0000 7f105dd9b700 1 -- 172.21.15.37:0/42009766 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048011d20 con 0x7f10600d2640 2023-07-12T02:04:26.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.174+0000 7f1064fff700 1 -- 172.21.15.37:0/42009766 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10600d2640 msgr2=0x7f10600b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.174+0000 7f1064fff700 1 --2- 172.21.15.37:0/42009766 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10600d2640 0x7f10600b59d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1048009840 tx=0x7f1048009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.174+0000 7f1064fff700 1 -- 172.21.15.37:0/42009766 shutdown_connections 2023-07-12T02:04:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.174+0000 7f1064fff700 1 --2- 172.21.15.37:0/42009766 >> v2:172.21.15.196:3300/0 conn(0x7f10600cf8f0 0x7f106015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.174+0000 7f1064fff700 1 --2- 172.21.15.37:0/42009766 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10600d2640 0x7f10600b59d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.174+0000 7f1064fff700 1 -- 172.21.15.37:0/42009766 >> 172.21.15.37:0/42009766 conn(0x7f1060071660 msgr2=0x7f1060071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.174+0000 7f1064fff700 1 -- 172.21.15.37:0/42009766 shutdown_connections 2023-07-12T02:04:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.174+0000 7f1064fff700 1 -- 172.21.15.37:0/42009766 wait complete. 2023-07-12T02:04:26.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.176+0000 7f1064fff700 1 Processor -- start 2023-07-12T02:04:26.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.176+0000 7f1064fff700 1 -- start start 2023-07-12T02:04:26.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.177+0000 7f1064fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10600cf8f0 0x7f10601f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:26.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.177+0000 7f1064fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10600d2640 0x7f106013a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:26.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.177+0000 7f1064fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f106015c460 0x7f106015eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:26.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.177+0000 7f1064fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c6a70 con 0x7f10600d2640 2023-07-12T02:04:26.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.177+0000 7f1064fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c85c0 con 0x7f10600cf8f0 2023-07-12T02:04:26.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.177+0000 7f1064fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10601f61a0 con 0x7f106015c460 2023-07-12T02:04:26.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.177+0000 7f1057fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10600d2640 0x7f106013a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:26.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.177+0000 7f1057fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10600d2640 0x7f106013a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49004/0 (socket says 172.21.15.37:49004) 2023-07-12T02:04:26.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.177+0000 7f1057fff700 1 -- 172.21.15.37:0/2663171835 learned_addr learned my addr 172.21.15.37:0/2663171835 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:26.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.177+0000 7f105e59c700 1 --2- 172.21.15.37:0/2663171835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10600cf8f0 0x7f10601f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:26.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.178+0000 7f105ed9d700 1 --2- 172.21.15.37:0/2663171835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f106015c460 0x7f106015eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.178+0000 7f1057fff700 1 -- 172.21.15.37:0/2663171835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f106015c460 msgr2=0x7f106015eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.178+0000 7f1057fff700 1 --2- 172.21.15.37:0/2663171835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f106015c460 0x7f106015eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.178+0000 7f1057fff700 1 -- 172.21.15.37:0/2663171835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10600cf8f0 msgr2=0x7f10601f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.178+0000 7f1057fff700 1 --2- 172.21.15.37:0/2663171835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10600cf8f0 0x7f10601f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.178+0000 7f1057fff700 1 -- 172.21.15.37:0/2663171835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058009a70 con 0x7f10600d2640 2023-07-12T02:04:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.178+0000 7f1057fff700 1 --2- 172.21.15.37:0/2663171835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10600d2640 0x7f106013a5b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1048009b90 tx=0x7f1048004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.178+0000 7f1056ffd700 1 -- 172.21.15.37:0/2663171835 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10480038a0 con 0x7f10600d2640 2023-07-12T02:04:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.178+0000 7f1056ffd700 1 -- 172.21.15.37:0/2663171835 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104801e070 con 0x7f10600d2640 2023-07-12T02:04:26.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.178+0000 7f1056ffd700 1 -- 172.21.15.37:0/2663171835 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048003c00 con 0x7f10600d2640 2023-07-12T02:04:26.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.178+0000 7f1064fff700 1 -- 172.21.15.37:0/2663171835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10480094a0 con 0x7f10600d2640 2023-07-12T02:04:26.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.178+0000 7f1064fff700 1 -- 172.21.15.37:0/2663171835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10601f5be0 con 0x7f10600d2640 2023-07-12T02:04:26.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.179+0000 7f1064fff700 1 -- 172.21.15.37:0/2663171835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106004ea60 con 0x7f10600d2640 2023-07-12T02:04:26.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.180+0000 7f1056ffd700 1 -- 172.21.15.37:0/2663171835 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f104802d450 con 0x7f10600d2640 2023-07-12T02:04:26.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.181+0000 7f1056ffd700 1 --2- 172.21.15.37:0/2663171835 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f104006ace0 0x7f104006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:26.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.181+0000 7f1056ffd700 1 -- 172.21.15.37:0/2663171835 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f104808a800 con 0x7f10600d2640 2023-07-12T02:04:26.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.181+0000 7f105e59c700 1 --2- 172.21.15.37:0/2663171835 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f104006ace0 0x7f104006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:26.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.182+0000 7f105e59c700 1 --2- 172.21.15.37:0/2663171835 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f104006ace0 0x7f104006d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1050000f60 tx=0x7f1050007be0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:26.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.185+0000 7f1056ffd700 1 -- 172.21.15.37:0/2663171835 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f10480555b0 con 0x7f10600d2640 2023-07-12T02:04:26.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.441+0000 7f1064fff700 1 -- 172.21.15.37:0/2663171835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10600c6450 con 0x7f10600d2640 2023-07-12T02:04:26.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.441+0000 7f1056ffd700 1 -- 172.21.15.37:0/2663171835 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f1048058bd0 con 0x7f10600d2640 2023-07-12T02:04:26.445 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:26.445 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/2496042538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":2496042538},{"type":"v1","addr":"172.21.15.196:6836","nonce":2496042538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2193116262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":2193116262},{"type":"v1","addr":"172.21.15.196:6837","nonce":2193116262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3195008737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3195008737},{"type":"v1","addr":"172.21.15.37:6834","nonce":3195008737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:03:57.647919+0000","modified":"2023-07-12T02:04:25.438552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/4264740807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4264740807},{"type":"v1","addr":"172.21.15.37:6835","nonce":4264740807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-12T02:04:26.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.444+0000 7f1064fff700 1 -- 172.21.15.37:0/2663171835 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f104006ace0 msgr2=0x7f104006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:26.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.444+0000 7f1064fff700 1 --2- 172.21.15.37:0/2663171835 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f104006ace0 0x7f104006d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1050000f60 tx=0x7f1050007be0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.444+0000 7f1064fff700 1 -- 172.21.15.37:0/2663171835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10600d2640 msgr2=0x7f106013a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:26.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.444+0000 7f1064fff700 1 --2- 172.21.15.37:0/2663171835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10600d2640 0x7f106013a5b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1048009b90 tx=0x7f1048004750 comp rx=0 tx=0).stop 2023-07-12T02:04:26.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.444+0000 7f1064fff700 1 -- 172.21.15.37:0/2663171835 shutdown_connections 2023-07-12T02:04:26.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.444+0000 7f1064fff700 1 --2- 172.21.15.37:0/2663171835 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f104006ace0 0x7f104006d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.444+0000 7f1064fff700 1 --2- 172.21.15.37:0/2663171835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f106015c460 0x7f106015eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.444+0000 7f1064fff700 1 --2- 172.21.15.37:0/2663171835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10600cf8f0 0x7f10601f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.444+0000 7f1064fff700 1 --2- 172.21.15.37:0/2663171835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10600d2640 0x7f106013a5b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.444+0000 7f1064fff700 1 -- 172.21.15.37:0/2663171835 >> 172.21.15.37:0/2663171835 conn(0x7f1060071660 msgr2=0x7f1060156d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.444+0000 7f1064fff700 1 -- 172.21.15.37:0/2663171835 shutdown_connections 2023-07-12T02:04:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.444+0000 7f1064fff700 1 -- 172.21.15.37:0/2663171835 wait complete. 2023-07-12T02:04:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2023-07-12T02:04:26.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:04:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.663+0000 7f284cfff700 1 Processor -- start 2023-07-12T02:04:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.663+0000 7f284cfff700 1 -- start start 2023-07-12T02:04:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.664+0000 7f284cfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f28480b8320 0x7f28480cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.664+0000 7f284cfff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28480d1cd0 0x7f28481608e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.664+0000 7f284cfff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28480cf3b0 con 0x7f28480b45b0 2023-07-12T02:04:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.664+0000 7f284cfff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2848160e20 con 0x7f28480b8320 2023-07-12T02:04:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.664+0000 7f284cfff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28480b86f0 con 0x7f28480d1cd0 2023-07-12T02:04:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.664+0000 7f2846d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f28480b45b0 0x7f28480d0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48504/0 (socket says 172.21.15.37:48504) 2023-07-12T02:04:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.664+0000 7f2846d9d700 1 -- 172.21.15.37:0/2606762664 learned_addr learned my addr 172.21.15.37:0/2606762664 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.664+0000 7f284659c700 1 --2- 172.21.15.37:0/2606762664 >> v2:172.21.15.37:3300/0 conn(0x7f28480b8320 0x7f28480cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.665+0000 7f2845d9b700 1 --2- 172.21.15.37:0/2606762664 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28480d1cd0 0x7f28481608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.665+0000 7f284659c700 1 -- 172.21.15.37:0/2606762664 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28480d1cd0 msgr2=0x7f28481608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.665+0000 7f284659c700 1 --2- 172.21.15.37:0/2606762664 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28480d1cd0 0x7f28481608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.665+0000 7f284659c700 1 -- 172.21.15.37:0/2606762664 >> v1:172.21.15.37:6789/0 conn(0x7f28480b45b0 legacy=0x7f28480d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.665+0000 7f284659c700 1 -- 172.21.15.37:0/2606762664 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28480cf0d0 con 0x7f28480b8320 2023-07-12T02:04:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.665+0000 7f284559a700 1 -- 172.21.15.37:0/2606762664 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606275990 0 0) 0x7f28480cf3b0 con 0x7f28480b45b0 2023-07-12T02:04:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.665+0000 7f284659c700 1 --2- 172.21.15.37:0/2606762664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28480b8320 0x7f28480cd4f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2838009840 tx=0x7f2838009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08df3b0acbf8b67 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.665+0000 7f284559a700 1 -- 172.21.15.37:0/2606762664 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838011830 con 0x7f28480b8320 2023-07-12T02:04:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.666+0000 7f284559a700 1 -- 172.21.15.37:0/2606762664 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2838011990 con 0x7f28480b8320 2023-07-12T02:04:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.666+0000 7f284559a700 1 -- 172.21.15.37:0/2606762664 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838011d20 con 0x7f28480b8320 2023-07-12T02:04:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.666+0000 7f284cfff700 1 -- 172.21.15.37:0/2606762664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28480b8320 msgr2=0x7f28480cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.666+0000 7f284cfff700 1 --2- 172.21.15.37:0/2606762664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28480b8320 0x7f28480cd4f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2838009840 tx=0x7f2838009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.666+0000 7f284cfff700 1 -- 172.21.15.37:0/2606762664 shutdown_connections 2023-07-12T02:04:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.666+0000 7f284cfff700 1 --2- 172.21.15.37:0/2606762664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28480b8320 0x7f28480cd4f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.666+0000 7f284cfff700 1 --2- 172.21.15.37:0/2606762664 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28480d1cd0 0x7f28481608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.666+0000 7f284cfff700 1 -- 172.21.15.37:0/2606762664 >> 172.21.15.37:0/2606762664 conn(0x7f28480722b0 msgr2=0x7f28480cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.666+0000 7f284cfff700 1 -- 172.21.15.37:0/2606762664 shutdown_connections 2023-07-12T02:04:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.666+0000 7f284cfff700 1 -- 172.21.15.37:0/2606762664 wait complete. 2023-07-12T02:04:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.668+0000 7f284cfff700 1 Processor -- start 2023-07-12T02:04:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.668+0000 7f284cfff700 1 -- start start 2023-07-12T02:04:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.669+0000 7f284cfff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28480b8320 0x7f28480c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.669+0000 7f284cfff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28480d1cd0 0x7f284815df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.669+0000 7f284cfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28481e6c00 0x7f28480b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.669+0000 7f284cfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284815e470 con 0x7f28481e6c00 2023-07-12T02:04:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.669+0000 7f284cfff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284815e740 con 0x7f28480b8320 2023-07-12T02:04:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.669+0000 7f284cfff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28481e5e40 con 0x7f28480d1cd0 2023-07-12T02:04:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.669+0000 7f2846d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28481e6c00 0x7f28480b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.669+0000 7f2846d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28481e6c00 0x7f28480b2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49022/0 (socket says 172.21.15.37:49022) 2023-07-12T02:04:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.669+0000 7f2846d9d700 1 -- 172.21.15.37:0/2279875850 learned_addr learned my addr 172.21.15.37:0/2279875850 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.669+0000 7f2845d9b700 1 --2- 172.21.15.37:0/2279875850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28480d1cd0 0x7f284815df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.670+0000 7f284659c700 1 --2- 172.21.15.37:0/2279875850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28480b8320 0x7f28480c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.670+0000 7f2846d9d700 1 -- 172.21.15.37:0/2279875850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28480d1cd0 msgr2=0x7f284815df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.670+0000 7f2846d9d700 1 --2- 172.21.15.37:0/2279875850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28480d1cd0 0x7f284815df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.670+0000 7f2846d9d700 1 -- 172.21.15.37:0/2279875850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28480b8320 msgr2=0x7f28480c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.670+0000 7f2846d9d700 1 --2- 172.21.15.37:0/2279875850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28480b8320 0x7f28480c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.670+0000 7f2846d9d700 1 -- 172.21.15.37:0/2279875850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28380094a0 con 0x7f28481e6c00 2023-07-12T02:04:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.670+0000 7f2846d9d700 1 --2- 172.21.15.37:0/2279875850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28481e6c00 0x7f28480b2ad0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2840002230 tx=0x7f284000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.670+0000 7f2836ffd700 1 -- 172.21.15.37:0/2279875850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000aac0 con 0x7f28481e6c00 2023-07-12T02:04:26.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.670+0000 7f2836ffd700 1 -- 172.21.15.37:0/2279875850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284000ac40 con 0x7f28481e6c00 2023-07-12T02:04:26.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.670+0000 7f284cfff700 1 -- 172.21.15.37:0/2279875850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28481e6120 con 0x7f28481e6c00 2023-07-12T02:04:26.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.670+0000 7f2836ffd700 1 -- 172.21.15.37:0/2279875850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28400070d0 con 0x7f28481e6c00 2023-07-12T02:04:26.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.670+0000 7f284cfff700 1 -- 172.21.15.37:0/2279875850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28481e66e0 con 0x7f28481e6c00 2023-07-12T02:04:26.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.671+0000 7f284cfff700 1 -- 172.21.15.37:0/2279875850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28481e68d0 con 0x7f28481e6c00 2023-07-12T02:04:26.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.672+0000 7f2836ffd700 1 -- 172.21.15.37:0/2279875850 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2840007250 con 0x7f28481e6c00 2023-07-12T02:04:26.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.673+0000 7f2836ffd700 1 --2- 172.21.15.37:0/2279875850 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f282806ace0 0x7f282806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:26.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.673+0000 7f2836ffd700 1 -- 172.21.15.37:0/2279875850 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2840089270 con 0x7f28481e6c00 2023-07-12T02:04:26.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.674+0000 7f284659c700 1 --2- 172.21.15.37:0/2279875850 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f282806ace0 0x7f282806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:26.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.674+0000 7f284659c700 1 --2- 172.21.15.37:0/2279875850 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f282806ace0 0x7f282806d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f28380090b0 tx=0x7f2838008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.678+0000 7f2836ffd700 1 -- 172.21.15.37:0/2279875850 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2840053f90 con 0x7f28481e6c00 2023-07-12T02:04:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.883+0000 7f284cfff700 1 -- 172.21.15.37:0/2279875850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f284804ea60 con 0x7f28481e6c00 2023-07-12T02:04:26.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.885+0000 7f2836ffd700 1 -- 172.21.15.37:0/2279875850 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f28400575b0 con 0x7f28481e6c00 2023-07-12T02:04:26.888 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:26.889 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:02.702198+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:04:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.887+0000 7f284cfff700 1 -- 172.21.15.37:0/2279875850 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f282806ace0 msgr2=0x7f282806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.887+0000 7f284cfff700 1 --2- 172.21.15.37:0/2279875850 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f282806ace0 0x7f282806d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f28380090b0 tx=0x7f2838008030 comp rx=0 tx=0).stop 2023-07-12T02:04:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.887+0000 7f284cfff700 1 -- 172.21.15.37:0/2279875850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28481e6c00 msgr2=0x7f28480b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.887+0000 7f284cfff700 1 --2- 172.21.15.37:0/2279875850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28481e6c00 0x7f28480b2ad0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2840002230 tx=0x7f284000cf50 comp rx=0 tx=0).stop 2023-07-12T02:04:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.887+0000 7f284cfff700 1 -- 172.21.15.37:0/2279875850 shutdown_connections 2023-07-12T02:04:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.887+0000 7f284cfff700 1 --2- 172.21.15.37:0/2279875850 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f282806ace0 0x7f282806d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.887+0000 7f284cfff700 1 --2- 172.21.15.37:0/2279875850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28481e6c00 0x7f28480b2ad0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.887+0000 7f284cfff700 1 --2- 172.21.15.37:0/2279875850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28480b8320 0x7f28480c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.887+0000 7f284cfff700 1 --2- 172.21.15.37:0/2279875850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28480d1cd0 0x7f284815df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.887+0000 7f284cfff700 1 -- 172.21.15.37:0/2279875850 >> 172.21.15.37:0/2279875850 conn(0x7f28480b45b0 msgr2=0x7f28480b76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.887+0000 7f284cfff700 1 -- 172.21.15.37:0/2279875850 shutdown_connections 2023-07-12T02:04:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:26.887+0000 7f284cfff700 1 -- 172.21.15.37:0/2279875850 wait complete. 2023-07-12T02:04:26.908 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-12T02:04:26.909 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-12T02:04:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.106+0000 7f69417ff700 1 Processor -- start 2023-07-12T02:04:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.106+0000 7f69417ff700 1 -- start start 2023-07-12T02:04:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.107+0000 7f69417ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f693c15c460 0x7f693c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.108+0000 7f69417ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693c0d1790 con 0x7f693c0d2640 2023-07-12T02:04:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.108+0000 7f69417ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693c0cd950 con 0x7f693c0cf8f0 2023-07-12T02:04:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.108+0000 7f69417ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693c0cedd0 con 0x7f693c15c460 2023-07-12T02:04:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.108+0000 7f6933fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f693c0d2640 0x7f693c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48516/0 (socket says 172.21.15.37:48516) 2023-07-12T02:04:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.108+0000 7f6933fff700 1 -- 172.21.15.37:0/1670492523 learned_addr learned my addr 172.21.15.37:0/1670492523 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.108+0000 7f693affd700 1 --2- 172.21.15.37:0/1670492523 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f693c15c460 0x7f693c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.108+0000 7f693a7fc700 1 -- 172.21.15.37:0/1670492523 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791999987 0 0) 0x7f693c0d1790 con 0x7f693c0d2640 2023-07-12T02:04:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.108+0000 7f693a7fc700 1 -- 172.21.15.37:0/1670492523 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69280035b0 con 0x7f693c0d2640 2023-07-12T02:04:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.109+0000 7f693a7fc700 1 -- 172.21.15.37:0/1670492523 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760884223 0 0) 0x7f693c0cd950 con 0x7f693c0cf8f0 2023-07-12T02:04:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.109+0000 7f693a7fc700 1 -- 172.21.15.37:0/1670492523 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f693c0d1790 con 0x7f693c0cf8f0 2023-07-12T02:04:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.109+0000 7f693a7fc700 1 -- 172.21.15.37:0/1670492523 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 289627201 0 0) 0x7f69280035b0 con 0x7f693c0d2640 2023-07-12T02:04:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.109+0000 7f693affd700 1 -- 172.21.15.37:0/1670492523 >> v1:172.21.15.196:6789/0 conn(0x7f693c0cf8f0 legacy=0x7f693c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.109+0000 7f693affd700 1 -- 172.21.15.37:0/1670492523 >> v1:172.21.15.37:6789/0 conn(0x7f693c0d2640 legacy=0x7f693c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.109+0000 7f693affd700 1 -- 172.21.15.37:0/1670492523 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c0d14b0 con 0x7f693c15c460 2023-07-12T02:04:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.109+0000 7f693affd700 1 --2- 172.21.15.37:0/1670492523 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f693c15c460 0x7f693c0b59d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f692c009870 tx=0x7f692c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fec65049208dff9 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.109+0000 7f693a7fc700 1 -- 172.21.15.37:0/1670492523 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924001670 con 0x7f693c15c460 2023-07-12T02:04:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.109+0000 7f693a7fc700 1 -- 172.21.15.37:0/1670492523 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692c004030 con 0x7f693c15c460 2023-07-12T02:04:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.109+0000 7f693a7fc700 1 -- 172.21.15.37:0/1670492523 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c0043c0 con 0x7f693c15c460 2023-07-12T02:04:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.110+0000 7f69417ff700 1 -- 172.21.15.37:0/1670492523 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f693c15c460 msgr2=0x7f693c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.110+0000 7f69417ff700 1 --2- 172.21.15.37:0/1670492523 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f693c15c460 0x7f693c0b59d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f692c009870 tx=0x7f692c009b80 comp rx=0 tx=0).stop 2023-07-12T02:04:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.110+0000 7f69417ff700 1 -- 172.21.15.37:0/1670492523 shutdown_connections 2023-07-12T02:04:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.110+0000 7f69417ff700 1 --2- 172.21.15.37:0/1670492523 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f693c15c460 0x7f693c0b59d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.110+0000 7f69417ff700 1 -- 172.21.15.37:0/1670492523 >> 172.21.15.37:0/1670492523 conn(0x7f693c071660 msgr2=0x7f693c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.110+0000 7f69417ff700 1 -- 172.21.15.37:0/1670492523 shutdown_connections 2023-07-12T02:04:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.110+0000 7f69417ff700 1 -- 172.21.15.37:0/1670492523 wait complete. 2023-07-12T02:04:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.112+0000 7f69417ff700 1 Processor -- start 2023-07-12T02:04:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.112+0000 7f69417ff700 1 -- start start 2023-07-12T02:04:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.113+0000 7f69417ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f693c0cf8f0 0x7f693c1e66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.113+0000 7f69417ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f693c0d2640 0x7f693c15b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.113+0000 7f69417ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f693c15c460 0x7f693c1457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.113+0000 7f69417ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c0cce60 con 0x7f693c15c460 2023-07-12T02:04:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.113+0000 7f69417ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c0cbbd0 con 0x7f693c0cf8f0 2023-07-12T02:04:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.113+0000 7f69417ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693c15bcc0 con 0x7f693c0d2640 2023-07-12T02:04:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.113+0000 7f693b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f693c15c460 0x7f693c1457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.113+0000 7f693b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f693c15c460 0x7f693c1457c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49038/0 (socket says 172.21.15.37:49038) 2023-07-12T02:04:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.113+0000 7f693b7fe700 1 -- 172.21.15.37:0/3338474462 learned_addr learned my addr 172.21.15.37:0/3338474462 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.113+0000 7f6933fff700 1 --2- 172.21.15.37:0/3338474462 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f693c0d2640 0x7f693c15b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.113+0000 7f693affd700 1 --2- 172.21.15.37:0/3338474462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f693c0cf8f0 0x7f693c1e66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.113+0000 7f693b7fe700 1 -- 172.21.15.37:0/3338474462 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f693c0d2640 msgr2=0x7f693c15b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.113+0000 7f693b7fe700 1 --2- 172.21.15.37:0/3338474462 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f693c0d2640 0x7f693c15b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.113+0000 7f693b7fe700 1 -- 172.21.15.37:0/3338474462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f693c0cf8f0 msgr2=0x7f693c1e66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.114+0000 7f693b7fe700 1 --2- 172.21.15.37:0/3338474462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f693c0cf8f0 0x7f693c1e66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.114+0000 7f693b7fe700 1 -- 172.21.15.37:0/3338474462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c0094a0 con 0x7f693c15c460 2023-07-12T02:04:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.114+0000 7f693b7fe700 1 --2- 172.21.15.37:0/3338474462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f693c15c460 0x7f693c1457c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f693400cbc0 tx=0x7f693400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.114+0000 7f69337fe700 1 -- 172.21.15.37:0/3338474462 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6934003c00 con 0x7f693c15c460 2023-07-12T02:04:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.114+0000 7f69337fe700 1 -- 172.21.15.37:0/3338474462 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6934003d60 con 0x7f693c15c460 2023-07-12T02:04:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.114+0000 7f69337fe700 1 -- 172.21.15.37:0/3338474462 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693400aaa0 con 0x7f693c15c460 2023-07-12T02:04:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.114+0000 7f69417ff700 1 -- 172.21.15.37:0/3338474462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693c0cbe00 con 0x7f693c15c460 2023-07-12T02:04:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.114+0000 7f69417ff700 1 -- 172.21.15.37:0/3338474462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693c0cc380 con 0x7f693c15c460 2023-07-12T02:04:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.115+0000 7f69417ff700 1 -- 172.21.15.37:0/3338474462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693c04ea60 con 0x7f693c15c460 2023-07-12T02:04:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.116+0000 7f69337fe700 1 -- 172.21.15.37:0/3338474462 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f693400ac00 con 0x7f693c15c460 2023-07-12T02:04:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.117+0000 7f69337fe700 1 --2- 172.21.15.37:0/3338474462 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f691c06ace0 0x7f691c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:27.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.117+0000 7f69337fe700 1 -- 172.21.15.37:0/3338474462 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6934089780 con 0x7f693c15c460 2023-07-12T02:04:27.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.117+0000 7f693affd700 1 --2- 172.21.15.37:0/3338474462 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f691c06ace0 0x7f691c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:27.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.118+0000 7f693affd700 1 --2- 172.21.15.37:0/3338474462 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f691c06ace0 0x7f691c06d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f692c0090b0 tx=0x7f692c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:27.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.121+0000 7f69337fe700 1 -- 172.21.15.37:0/3338474462 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f69340544a0 con 0x7f693c15c460 2023-07-12T02:04:27.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.327+0000 7f69417ff700 1 -- 172.21.15.37:0/3338474462 --> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f693c0cd5e0 con 0x7f691c06ace0 2023-07-12T02:04:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.341+0000 7f69337fe700 1 -- 172.21.15.37:0/3338474462 <== mgr.4099 v2:172.21.15.196:6832/3490435896 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367376 (secure 0 0 0) 0x7f692c0042a0 con 0x7f691c06ace0 2023-07-12T02:04:27.350 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.346+0000 7f69417ff700 1 -- 172.21.15.37:0/3338474462 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f691c06ace0 msgr2=0x7f691c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.346+0000 7f69417ff700 1 --2- 172.21.15.37:0/3338474462 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f691c06ace0 0x7f691c06d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f692c0090b0 tx=0x7f692c008030 comp rx=0 tx=0).stop 2023-07-12T02:04:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.346+0000 7f69417ff700 1 -- 172.21.15.37:0/3338474462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f693c15c460 msgr2=0x7f693c1457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.346+0000 7f69417ff700 1 --2- 172.21.15.37:0/3338474462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f693c15c460 0x7f693c1457c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f693400cbc0 tx=0x7f693400ced0 comp rx=0 tx=0).stop 2023-07-12T02:04:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.346+0000 7f69417ff700 1 -- 172.21.15.37:0/3338474462 shutdown_connections 2023-07-12T02:04:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.346+0000 7f69417ff700 1 --2- 172.21.15.37:0/3338474462 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f691c06ace0 0x7f691c06d190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.346+0000 7f69417ff700 1 --2- 172.21.15.37:0/3338474462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f693c15c460 0x7f693c1457c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.346+0000 7f69417ff700 1 --2- 172.21.15.37:0/3338474462 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f693c0cf8f0 0x7f693c1e66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.346+0000 7f69417ff700 1 --2- 172.21.15.37:0/3338474462 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f693c0d2640 0x7f693c15b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.346+0000 7f69417ff700 1 -- 172.21.15.37:0/3338474462 >> 172.21.15.37:0/3338474462 conn(0x7f693c071660 msgr2=0x7f693c0d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.346+0000 7f69417ff700 1 -- 172.21.15.37:0/3338474462 shutdown_connections 2023-07-12T02:04:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.346+0000 7f69417ff700 1 -- 172.21.15.37:0/3338474462 wait complete. 2023-07-12T02:04:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-12T02:04:27.368 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-07-12T02:04:25.351471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219684,"kb_used_data":3492,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755036,"statfs":{"total":773094113280,"available":772869156864,"internally_reserved":0,"allocated":3575808,"data_stored":2148109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003837"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173964+0000","last_change":"2023-07-12T02:03:58.150799+0000","last_active":"2023-07-12T02:04:03.173964+0000","last_peered":"2023-07-12T02:04:03.173964+0000","last_clean":"2023-07-12T02:04:03.173964+0000","last_became_active":"2023-07-12T02:03:58.150302+0000","last_became_peered":"2023-07-12T02:03:58.150302+0000","last_unstale":"2023-07-12T02:04:03.173964+0000","last_undegraded":"2023-07-12T02:04:03.173964+0000","last_fullsized":"2023-07-12T02:04:03.173964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:34:50.094079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707297+0000","last_change":"2023-07-12T02:03:58.167958+0000","last_active":"2023-07-12T02:04:03.707297+0000","last_peered":"2023-07-12T02:04:03.707297+0000","last_clean":"2023-07-12T02:04:03.707297+0000","last_became_active":"2023-07-12T02:03:58.167409+0000","last_became_peered":"2023-07-12T02:03:58.167409+0000","last_unstale":"2023-07-12T02:04:03.707297+0000","last_undegraded":"2023-07-12T02:04:03.707297+0000","last_fullsized":"2023-07-12T02:04:03.707297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:15:21.392894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174114+0000","last_change":"2023-07-12T02:03:58.158253+0000","last_active":"2023-07-12T02:04:03.174114+0000","last_peered":"2023-07-12T02:04:03.174114+0000","last_clean":"2023-07-12T02:04:03.174114+0000","last_became_active":"2023-07-12T02:03:58.158005+0000","last_became_peered":"2023-07-12T02:03:58.158005+0000","last_unstale":"2023-07-12T02:04:03.174114+0000","last_undegraded":"2023-07-12T02:04:03.174114+0000","last_fullsized":"2023-07-12T02:04:03.174114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:07:16.216455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707579+0000","last_change":"2023-07-12T02:03:58.155943+0000","last_active":"2023-07-12T02:04:03.707579+0000","last_peered":"2023-07-12T02:04:03.707579+0000","last_clean":"2023-07-12T02:04:03.707579+0000","last_became_active":"2023-07-12T02:03:58.155672+0000","last_became_peered":"2023-07-12T02:03:58.155672+0000","last_unstale":"2023-07-12T02:04:03.707579+0000","last_undegraded":"2023-07-12T02:04:03.707579+0000","last_fullsized":"2023-07-12T02:04:03.707579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:59:41.793818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172594+0000","last_change":"2023-07-12T02:03:58.163745+0000","last_active":"2023-07-12T02:04:03.172594+0000","last_peered":"2023-07-12T02:04:03.172594+0000","last_clean":"2023-07-12T02:04:03.172594+0000","last_became_active":"2023-07-12T02:03:58.163198+0000","last_became_peered":"2023-07-12T02:03:58.163198+0000","last_unstale":"2023-07-12T02:04:03.172594+0000","last_undegraded":"2023-07-12T02:04:03.172594+0000","last_fullsized":"2023-07-12T02:04:03.172594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:29.024675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173684+0000","last_change":"2023-07-12T02:03:58.160380+0000","last_active":"2023-07-12T02:04:03.173684+0000","last_peered":"2023-07-12T02:04:03.173684+0000","last_clean":"2023-07-12T02:04:03.173684+0000","last_became_active":"2023-07-12T02:03:58.160102+0000","last_became_peered":"2023-07-12T02:03:58.160102+0000","last_unstale":"2023-07-12T02:04:03.173684+0000","last_undegraded":"2023-07-12T02:04:03.173684+0000","last_fullsized":"2023-07-12T02:04:03.173684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:08:29.661400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589781+0000","last_change":"2023-07-12T02:03:58.153608+0000","last_active":"2023-07-12T02:04:03.589781+0000","last_peered":"2023-07-12T02:04:03.589781+0000","last_clean":"2023-07-12T02:04:03.589781+0000","last_became_active":"2023-07-12T02:03:58.153320+0000","last_became_peered":"2023-07-12T02:03:58.153320+0000","last_unstale":"2023-07-12T02:04:03.589781+0000","last_undegraded":"2023-07-12T02:04:03.589781+0000","last_fullsized":"2023-07-12T02:04:03.589781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:37.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706388+0000","last_change":"2023-07-12T02:03:58.157485+0000","last_active":"2023-07-12T02:04:03.706388+0000","last_peered":"2023-07-12T02:04:03.706388+0000","last_clean":"2023-07-12T02:04:03.706388+0000","last_became_active":"2023-07-12T02:03:58.157195+0000","last_became_peered":"2023-07-12T02:03:58.157195+0000","last_unstale":"2023-07-12T02:04:03.706388+0000","last_undegraded":"2023-07-12T02:04:03.706388+0000","last_fullsized":"2023-07-12T02:04:03.706388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:52.656557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171917+0000","last_change":"2023-07-12T02:03:58.162632+0000","last_active":"2023-07-12T02:04:03.171917+0000","last_peered":"2023-07-12T02:04:03.171917+0000","last_clean":"2023-07-12T02:04:03.171917+0000","last_became_active":"2023-07-12T02:03:58.162344+0000","last_became_peered":"2023-07-12T02:03:58.162344+0000","last_unstale":"2023-07-12T02:04:03.171917+0000","last_undegraded":"2023-07-12T02:04:03.171917+0000","last_fullsized":"2023-07-12T02:04:03.171917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:39.957211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707756+0000","last_change":"2023-07-12T02:03:58.165129+0000","last_active":"2023-07-12T02:04:03.707756+0000","last_peered":"2023-07-12T02:04:03.707756+0000","last_clean":"2023-07-12T02:04:03.707756+0000","last_became_active":"2023-07-12T02:03:58.164826+0000","last_became_peered":"2023-07-12T02:03:58.164826+0000","last_unstale":"2023-07-12T02:04:03.707756+0000","last_undegraded":"2023-07-12T02:04:03.707756+0000","last_fullsized":"2023-07-12T02:04:03.707756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:30:44.777286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174276+0000","last_change":"2023-07-12T02:03:58.167779+0000","last_active":"2023-07-12T02:04:03.174276+0000","last_peered":"2023-07-12T02:04:03.174276+0000","last_clean":"2023-07-12T02:04:03.174276+0000","last_became_active":"2023-07-12T02:03:58.167405+0000","last_became_peered":"2023-07-12T02:03:58.167405+0000","last_unstale":"2023-07-12T02:04:03.174276+0000","last_undegraded":"2023-07-12T02:04:03.174276+0000","last_fullsized":"2023-07-12T02:04:03.174276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:05:20.293113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173473+0000","last_change":"2023-07-12T02:03:58.140088+0000","last_active":"2023-07-12T02:04:03.173473+0000","last_peered":"2023-07-12T02:04:03.173473+0000","last_clean":"2023-07-12T02:04:03.173473+0000","last_became_active":"2023-07-12T02:03:58.139727+0000","last_became_peered":"2023-07-12T02:03:58.139727+0000","last_unstale":"2023-07-12T02:04:03.173473+0000","last_undegraded":"2023-07-12T02:04:03.173473+0000","last_fullsized":"2023-07-12T02:04:03.173473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:50.799195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173642+0000","last_change":"2023-07-12T02:03:58.152355+0000","last_active":"2023-07-12T02:04:03.173642+0000","last_peered":"2023-07-12T02:04:03.173642+0000","last_clean":"2023-07-12T02:04:03.173642+0000","last_became_active":"2023-07-12T02:03:58.151997+0000","last_became_peered":"2023-07-12T02:03:58.151997+0000","last_unstale":"2023-07-12T02:04:03.173642+0000","last_undegraded":"2023-07-12T02:04:03.173642+0000","last_fullsized":"2023-07-12T02:04:03.173642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:50:47.044125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706694+0000","last_change":"2023-07-12T02:03:58.155958+0000","last_active":"2023-07-12T02:04:03.706694+0000","last_peered":"2023-07-12T02:04:03.706694+0000","last_clean":"2023-07-12T02:04:03.706694+0000","last_became_active":"2023-07-12T02:03:58.155646+0000","last_became_peered":"2023-07-12T02:03:58.155646+0000","last_unstale":"2023-07-12T02:04:03.706694+0000","last_undegraded":"2023-07-12T02:04:03.706694+0000","last_fullsized":"2023-07-12T02:04:03.706694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:04:36.999164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589619+0000","last_change":"2023-07-12T02:03:58.162352+0000","last_active":"2023-07-12T02:04:03.589619+0000","last_peered":"2023-07-12T02:04:03.589619+0000","last_clean":"2023-07-12T02:04:03.589619+0000","last_became_active":"2023-07-12T02:03:58.162011+0000","last_became_peered":"2023-07-12T02:03:58.162011+0000","last_unstale":"2023-07-12T02:04:03.589619+0000","last_undegraded":"2023-07-12T02:04:03.589619+0000","last_fullsized":"2023-07-12T02:04:03.589619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:04:36.999164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173236+0000","last_change":"2023-07-12T02:03:58.162838+0000","last_active":"2023-07-12T02:04:03.173236+0000","last_peered":"2023-07-12T02:04:03.173236+0000","last_clean":"2023-07-12T02:04:03.173236+0000","last_became_active":"2023-07-12T02:03:58.162528+0000","last_became_peered":"2023-07-12T02:03:58.162528+0000","last_unstale":"2023-07-12T02:04:03.173236+0000","last_undegraded":"2023-07-12T02:04:03.173236+0000","last_fullsized":"2023-07-12T02:04:03.173236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:42:38.629324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172071+0000","last_change":"2023-07-12T02:03:58.162549+0000","last_active":"2023-07-12T02:04:03.172071+0000","last_peered":"2023-07-12T02:04:03.172071+0000","last_clean":"2023-07-12T02:04:03.172071+0000","last_became_active":"2023-07-12T02:03:58.161983+0000","last_became_peered":"2023-07-12T02:03:58.161983+0000","last_unstale":"2023-07-12T02:04:03.172071+0000","last_undegraded":"2023-07-12T02:04:03.172071+0000","last_fullsized":"2023-07-12T02:04:03.172071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:37.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174066+0000","last_change":"2023-07-12T02:03:58.140088+0000","last_active":"2023-07-12T02:04:03.174066+0000","last_peered":"2023-07-12T02:04:03.174066+0000","last_clean":"2023-07-12T02:04:03.174066+0000","last_became_active":"2023-07-12T02:03:58.139825+0000","last_became_peered":"2023-07-12T02:03:58.139825+0000","last_unstale":"2023-07-12T02:04:03.174066+0000","last_undegraded":"2023-07-12T02:04:03.174066+0000","last_fullsized":"2023-07-12T02:04:03.174066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:22:57.380427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173781+0000","last_change":"2023-07-12T02:03:58.149388+0000","last_active":"2023-07-12T02:04:03.173781+0000","last_peered":"2023-07-12T02:04:03.173781+0000","last_clean":"2023-07-12T02:04:03.173781+0000","last_became_active":"2023-07-12T02:03:58.149009+0000","last_became_peered":"2023-07-12T02:03:58.149009+0000","last_unstale":"2023-07-12T02:04:03.173781+0000","last_undegraded":"2023-07-12T02:04:03.173781+0000","last_fullsized":"2023-07-12T02:04:03.173781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:18:25.150845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173690+0000","last_change":"2023-07-12T02:03:58.144677+0000","last_active":"2023-07-12T02:04:03.173690+0000","last_peered":"2023-07-12T02:04:03.173690+0000","last_clean":"2023-07-12T02:04:03.173690+0000","last_became_active":"2023-07-12T02:03:58.144365+0000","last_became_peered":"2023-07-12T02:03:58.144365+0000","last_unstale":"2023-07-12T02:04:03.173690+0000","last_undegraded":"2023-07-12T02:04:03.173690+0000","last_fullsized":"2023-07-12T02:04:03.173690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:46:02.333414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590198+0000","last_change":"2023-07-12T02:03:58.156054+0000","last_active":"2023-07-12T02:04:03.590198+0000","last_peered":"2023-07-12T02:04:03.590198+0000","last_clean":"2023-07-12T02:04:03.590198+0000","last_became_active":"2023-07-12T02:03:58.155755+0000","last_became_peered":"2023-07-12T02:03:58.155755+0000","last_unstale":"2023-07-12T02:04:03.590198+0000","last_undegraded":"2023-07-12T02:04:03.590198+0000","last_fullsized":"2023-07-12T02:04:03.590198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:37:27.430690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171482+0000","last_change":"2023-07-12T02:03:58.169838+0000","last_active":"2023-07-12T02:04:03.171482+0000","last_peered":"2023-07-12T02:04:03.171482+0000","last_clean":"2023-07-12T02:04:03.171482+0000","last_became_active":"2023-07-12T02:03:58.169574+0000","last_became_peered":"2023-07-12T02:03:58.169574+0000","last_unstale":"2023-07-12T02:04:03.171482+0000","last_undegraded":"2023-07-12T02:04:03.171482+0000","last_fullsized":"2023-07-12T02:04:03.171482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:03:49.584323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706395+0000","last_change":"2023-07-12T02:03:58.158643+0000","last_active":"2023-07-12T02:04:03.706395+0000","last_peered":"2023-07-12T02:04:03.706395+0000","last_clean":"2023-07-12T02:04:03.706395+0000","last_became_active":"2023-07-12T02:03:58.158228+0000","last_became_peered":"2023-07-12T02:03:58.158228+0000","last_unstale":"2023-07-12T02:04:03.706395+0000","last_undegraded":"2023-07-12T02:04:03.706395+0000","last_fullsized":"2023-07-12T02:04:03.706395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:15:21.392894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589781+0000","last_change":"2023-07-12T02:03:58.155246+0000","last_active":"2023-07-12T02:04:03.589781+0000","last_peered":"2023-07-12T02:04:03.589781+0000","last_clean":"2023-07-12T02:04:03.589781+0000","last_became_active":"2023-07-12T02:03:58.154842+0000","last_became_peered":"2023-07-12T02:03:58.154842+0000","last_unstale":"2023-07-12T02:04:03.589781+0000","last_undegraded":"2023-07-12T02:04:03.589781+0000","last_fullsized":"2023-07-12T02:04:03.589781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:52.156977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706732+0000","last_change":"2023-07-12T02:03:58.167506+0000","last_active":"2023-07-12T02:04:03.706732+0000","last_peered":"2023-07-12T02:04:03.706732+0000","last_clean":"2023-07-12T02:04:03.706732+0000","last_became_active":"2023-07-12T02:03:58.166701+0000","last_became_peered":"2023-07-12T02:03:58.166701+0000","last_unstale":"2023-07-12T02:04:03.706732+0000","last_undegraded":"2023-07-12T02:04:03.706732+0000","last_fullsized":"2023-07-12T02:04:03.706732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:03:49.584323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706759+0000","last_change":"2023-07-12T02:03:58.164411+0000","last_active":"2023-07-12T02:04:03.706759+0000","last_peered":"2023-07-12T02:04:03.706759+0000","last_clean":"2023-07-12T02:04:03.706759+0000","last_became_active":"2023-07-12T02:03:58.164136+0000","last_became_peered":"2023-07-12T02:03:58.164136+0000","last_unstale":"2023-07-12T02:04:03.706759+0000","last_undegraded":"2023-07-12T02:04:03.706759+0000","last_fullsized":"2023-07-12T02:04:03.706759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:40:41.452100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707500+0000","last_change":"2023-07-12T02:03:58.158327+0000","last_active":"2023-07-12T02:04:03.707500+0000","last_peered":"2023-07-12T02:04:03.707500+0000","last_clean":"2023-07-12T02:04:03.707500+0000","last_became_active":"2023-07-12T02:03:58.158038+0000","last_became_peered":"2023-07-12T02:03:58.158038+0000","last_unstale":"2023-07-12T02:04:03.707500+0000","last_undegraded":"2023-07-12T02:04:03.707500+0000","last_fullsized":"2023-07-12T02:04:03.707500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:37:27.430690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174072+0000","last_change":"2023-07-12T02:04:02.205882+0000","last_active":"2023-07-12T02:04:03.174072+0000","last_peered":"2023-07-12T02:04:03.174072+0000","last_clean":"2023-07-12T02:04:03.174072+0000","last_became_active":"2023-07-12T02:04:02.205422+0000","last_became_peered":"2023-07-12T02:04:02.205422+0000","last_unstale":"2023-07-12T02:04:03.174072+0000","last_undegraded":"2023-07-12T02:04:03.174072+0000","last_fullsized":"2023-07-12T02:04:03.174072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:00:06.567816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173559+0000","last_change":"2023-07-12T02:03:57.132659+0000","last_active":"2023-07-12T02:04:03.173559+0000","last_peered":"2023-07-12T02:04:03.173559+0000","last_clean":"2023-07-12T02:04:03.173559+0000","last_became_active":"2023-07-12T02:03:57.132296+0000","last_became_peered":"2023-07-12T02:03:57.132296+0000","last_unstale":"2023-07-12T02:04:03.173559+0000","last_undegraded":"2023-07-12T02:04:03.173559+0000","last_fullsized":"2023-07-12T02:04:03.173559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:13:18.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706776+0000","last_change":"2023-07-12T02:03:58.168189+0000","last_active":"2023-07-12T02:04:03.706776+0000","last_peered":"2023-07-12T02:04:03.706776+0000","last_clean":"2023-07-12T02:04:03.706776+0000","last_became_active":"2023-07-12T02:03:58.167837+0000","last_became_peered":"2023-07-12T02:03:58.167837+0000","last_unstale":"2023-07-12T02:04:03.706776+0000","last_undegraded":"2023-07-12T02:04:03.706776+0000","last_fullsized":"2023-07-12T02:04:03.706776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:37:27.430690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.708053+0000","last_change":"2023-07-12T02:04:02.192589+0000","last_active":"2023-07-12T02:04:03.708053+0000","last_peered":"2023-07-12T02:04:03.708053+0000","last_clean":"2023-07-12T02:04:03.708053+0000","last_became_active":"2023-07-12T02:04:02.192078+0000","last_became_peered":"2023-07-12T02:04:02.192078+0000","last_unstale":"2023-07-12T02:04:03.708053+0000","last_undegraded":"2023-07-12T02:04:03.708053+0000","last_fullsized":"2023-07-12T02:04:03.708053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:13:11.653857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706270+0000","last_change":"2023-07-12T02:03:57.137950+0000","last_active":"2023-07-12T02:04:03.706270+0000","last_peered":"2023-07-12T02:04:03.706270+0000","last_clean":"2023-07-12T02:04:03.706270+0000","last_became_active":"2023-07-12T02:03:57.137512+0000","last_became_peered":"2023-07-12T02:03:57.137512+0000","last_unstale":"2023-07-12T02:04:03.706270+0000","last_undegraded":"2023-07-12T02:04:03.706270+0000","last_fullsized":"2023-07-12T02:04:03.706270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:23:19.169613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172604+0000","last_change":"2023-07-12T02:03:58.161489+0000","last_active":"2023-07-12T02:04:03.172604+0000","last_peered":"2023-07-12T02:04:03.172604+0000","last_clean":"2023-07-12T02:04:03.172604+0000","last_became_active":"2023-07-12T02:03:58.161146+0000","last_became_peered":"2023-07-12T02:03:58.161146+0000","last_unstale":"2023-07-12T02:04:03.172604+0000","last_undegraded":"2023-07-12T02:04:03.172604+0000","last_fullsized":"2023-07-12T02:04:03.172604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:30:44.777286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172742+0000","last_change":"2023-07-12T02:04:02.199897+0000","last_active":"2023-07-12T02:04:03.172742+0000","last_peered":"2023-07-12T02:04:03.172742+0000","last_clean":"2023-07-12T02:04:03.172742+0000","last_became_active":"2023-07-12T02:04:02.198813+0000","last_became_peered":"2023-07-12T02:04:02.198813+0000","last_unstale":"2023-07-12T02:04:03.172742+0000","last_undegraded":"2023-07-12T02:04:03.172742+0000","last_fullsized":"2023-07-12T02:04:03.172742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:12.327958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706246+0000","last_change":"2023-07-12T02:03:57.150630+0000","last_active":"2023-07-12T02:04:03.706246+0000","last_peered":"2023-07-12T02:04:03.706246+0000","last_clean":"2023-07-12T02:04:03.706246+0000","last_became_active":"2023-07-12T02:03:57.150342+0000","last_became_peered":"2023-07-12T02:03:57.150342+0000","last_unstale":"2023-07-12T02:04:03.706246+0000","last_undegraded":"2023-07-12T02:04:03.706246+0000","last_fullsized":"2023-07-12T02:04:03.706246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:44:57.891756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.708148+0000","last_change":"2023-07-12T02:03:58.151183+0000","last_active":"2023-07-12T02:04:03.708148+0000","last_peered":"2023-07-12T02:04:03.708148+0000","last_clean":"2023-07-12T02:04:03.708148+0000","last_became_active":"2023-07-12T02:03:58.150257+0000","last_became_peered":"2023-07-12T02:03:58.150257+0000","last_unstale":"2023-07-12T02:04:03.708148+0000","last_undegraded":"2023-07-12T02:04:03.708148+0000","last_fullsized":"2023-07-12T02:04:03.708148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:59:55.615077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707354+0000","last_change":"2023-07-12T02:04:02.193315+0000","last_active":"2023-07-12T02:04:03.707354+0000","last_peered":"2023-07-12T02:04:03.707354+0000","last_clean":"2023-07-12T02:04:03.707354+0000","last_became_active":"2023-07-12T02:04:02.192915+0000","last_became_peered":"2023-07-12T02:04:02.192915+0000","last_unstale":"2023-07-12T02:04:03.707354+0000","last_undegraded":"2023-07-12T02:04:03.707354+0000","last_fullsized":"2023-07-12T02:04:03.707354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:48:36.242589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172114+0000","last_change":"2023-07-12T02:03:57.147980+0000","last_active":"2023-07-12T02:04:03.172114+0000","last_peered":"2023-07-12T02:04:03.172114+0000","last_clean":"2023-07-12T02:04:03.172114+0000","last_became_active":"2023-07-12T02:03:57.147701+0000","last_became_peered":"2023-07-12T02:03:57.147701+0000","last_unstale":"2023-07-12T02:04:03.172114+0000","last_undegraded":"2023-07-12T02:04:03.172114+0000","last_fullsized":"2023-07-12T02:04:03.172114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:20.831039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706124+0000","last_change":"2023-07-12T02:03:58.162466+0000","last_active":"2023-07-12T02:04:03.706124+0000","last_peered":"2023-07-12T02:04:03.706124+0000","last_clean":"2023-07-12T02:04:03.706124+0000","last_became_active":"2023-07-12T02:03:58.162232+0000","last_became_peered":"2023-07-12T02:03:58.162232+0000","last_unstale":"2023-07-12T02:04:03.706124+0000","last_undegraded":"2023-07-12T02:04:03.706124+0000","last_fullsized":"2023-07-12T02:04:03.706124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:52.156977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589544+0000","last_change":"2023-07-12T02:04:02.199601+0000","last_active":"2023-07-12T02:04:03.589544+0000","last_peered":"2023-07-12T02:04:03.589544+0000","last_clean":"2023-07-12T02:04:03.589544+0000","last_became_active":"2023-07-12T02:04:02.199218+0000","last_became_peered":"2023-07-12T02:04:02.199218+0000","last_unstale":"2023-07-12T02:04:03.589544+0000","last_undegraded":"2023-07-12T02:04:03.589544+0000","last_fullsized":"2023-07-12T02:04:03.589544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:56.700790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707513+0000","last_change":"2023-07-12T02:03:57.144471+0000","last_active":"2023-07-12T02:04:03.707513+0000","last_peered":"2023-07-12T02:04:03.707513+0000","last_clean":"2023-07-12T02:04:03.707513+0000","last_became_active":"2023-07-12T02:03:57.144183+0000","last_became_peered":"2023-07-12T02:03:57.144183+0000","last_unstale":"2023-07-12T02:04:03.707513+0000","last_undegraded":"2023-07-12T02:04:03.707513+0000","last_fullsized":"2023-07-12T02:04:03.707513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:28.017520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706261+0000","last_change":"2023-07-12T02:03:58.155253+0000","last_active":"2023-07-12T02:04:03.706261+0000","last_peered":"2023-07-12T02:04:03.706261+0000","last_clean":"2023-07-12T02:04:03.706261+0000","last_became_active":"2023-07-12T02:03:58.154981+0000","last_became_peered":"2023-07-12T02:03:58.154981+0000","last_unstale":"2023-07-12T02:04:03.706261+0000","last_undegraded":"2023-07-12T02:04:03.706261+0000","last_fullsized":"2023-07-12T02:04:03.706261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:05.243878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707342+0000","last_change":"2023-07-12T02:04:02.199311+0000","last_active":"2023-07-12T02:04:03.707342+0000","last_peered":"2023-07-12T02:04:03.707342+0000","last_clean":"2023-07-12T02:04:03.707342+0000","last_became_active":"2023-07-12T02:04:02.198883+0000","last_became_peered":"2023-07-12T02:04:02.198883+0000","last_unstale":"2023-07-12T02:04:03.707342+0000","last_undegraded":"2023-07-12T02:04:03.707342+0000","last_fullsized":"2023-07-12T02:04:03.707342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:19:55.666369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590314+0000","last_change":"2023-07-12T02:03:57.150937+0000","last_active":"2023-07-12T02:04:03.590314+0000","last_peered":"2023-07-12T02:04:03.590314+0000","last_clean":"2023-07-12T02:04:03.590314+0000","last_became_active":"2023-07-12T02:03:57.150617+0000","last_became_peered":"2023-07-12T02:03:57.150617+0000","last_unstale":"2023-07-12T02:04:03.590314+0000","last_undegraded":"2023-07-12T02:04:03.590314+0000","last_fullsized":"2023-07-12T02:04:03.590314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:07.276570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707832+0000","last_change":"2023-07-12T02:03:58.160889+0000","last_active":"2023-07-12T02:04:03.707832+0000","last_peered":"2023-07-12T02:04:03.707832+0000","last_clean":"2023-07-12T02:04:03.707832+0000","last_became_active":"2023-07-12T02:03:58.160594+0000","last_became_peered":"2023-07-12T02:03:58.160594+0000","last_unstale":"2023-07-12T02:04:03.707832+0000","last_undegraded":"2023-07-12T02:04:03.707832+0000","last_fullsized":"2023-07-12T02:04:03.707832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:05.243878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707549+0000","last_change":"2023-07-12T02:04:02.191342+0000","last_active":"2023-07-12T02:04:03.707549+0000","last_peered":"2023-07-12T02:04:03.707549+0000","last_clean":"2023-07-12T02:04:03.707549+0000","last_became_active":"2023-07-12T02:04:02.190277+0000","last_became_peered":"2023-07-12T02:04:02.190277+0000","last_unstale":"2023-07-12T02:04:03.707549+0000","last_undegraded":"2023-07-12T02:04:03.707549+0000","last_fullsized":"2023-07-12T02:04:03.707549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:56.201209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:16.744060+0000","last_change":"2023-07-12T02:03:57.141317+0000","last_active":"2023-07-12T02:04:16.744060+0000","last_peered":"2023-07-12T02:04:16.744060+0000","last_clean":"2023-07-12T02:04:16.744060+0000","last_became_active":"2023-07-12T02:03:57.140668+0000","last_became_peered":"2023-07-12T02:03:57.140668+0000","last_unstale":"2023-07-12T02:04:16.744060+0000","last_undegraded":"2023-07-12T02:04:16.744060+0000","last_fullsized":"2023-07-12T02:04:16.744060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:26:13.420313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173616+0000","last_change":"2023-07-12T02:03:58.147529+0000","last_active":"2023-07-12T02:04:03.173616+0000","last_peered":"2023-07-12T02:04:03.173616+0000","last_clean":"2023-07-12T02:04:03.173616+0000","last_became_active":"2023-07-12T02:03:58.147226+0000","last_became_peered":"2023-07-12T02:03:58.147226+0000","last_unstale":"2023-07-12T02:04:03.173616+0000","last_undegraded":"2023-07-12T02:04:03.173616+0000","last_fullsized":"2023-07-12T02:04:03.173616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:41:34.175917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707746+0000","last_change":"2023-07-12T02:04:02.199731+0000","last_active":"2023-07-12T02:04:03.707746+0000","last_peered":"2023-07-12T02:04:03.707746+0000","last_clean":"2023-07-12T02:04:03.707746+0000","last_became_active":"2023-07-12T02:04:02.199360+0000","last_became_peered":"2023-07-12T02:04:02.199360+0000","last_unstale":"2023-07-12T02:04:03.707746+0000","last_undegraded":"2023-07-12T02:04:03.707746+0000","last_fullsized":"2023-07-12T02:04:03.707746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:09:51.362187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590031+0000","last_change":"2023-07-12T02:03:57.146809+0000","last_active":"2023-07-12T02:04:03.590031+0000","last_peered":"2023-07-12T02:04:03.590031+0000","last_clean":"2023-07-12T02:04:03.590031+0000","last_became_active":"2023-07-12T02:03:57.146430+0000","last_became_peered":"2023-07-12T02:03:57.146430+0000","last_unstale":"2023-07-12T02:04:03.590031+0000","last_undegraded":"2023-07-12T02:04:03.590031+0000","last_fullsized":"2023-07-12T02:04:03.590031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:04.236723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707769+0000","last_change":"2023-07-12T02:03:58.152748+0000","last_active":"2023-07-12T02:04:03.707769+0000","last_peered":"2023-07-12T02:04:03.707769+0000","last_clean":"2023-07-12T02:04:03.707769+0000","last_became_active":"2023-07-12T02:03:58.152426+0000","last_became_peered":"2023-07-12T02:03:58.152426+0000","last_unstale":"2023-07-12T02:04:03.707769+0000","last_undegraded":"2023-07-12T02:04:03.707769+0000","last_fullsized":"2023-07-12T02:04:03.707769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:04:26.740269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707577+0000","last_change":"2023-07-12T02:04:02.192398+0000","last_active":"2023-07-12T02:04:03.707577+0000","last_peered":"2023-07-12T02:04:03.707577+0000","last_clean":"2023-07-12T02:04:03.707577+0000","last_became_active":"2023-07-12T02:04:02.191940+0000","last_became_peered":"2023-07-12T02:04:02.191940+0000","last_unstale":"2023-07-12T02:04:03.707577+0000","last_undegraded":"2023-07-12T02:04:03.707577+0000","last_fullsized":"2023-07-12T02:04:03.707577+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:22.171422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171647+0000","last_change":"2023-07-12T02:03:57.146620+0000","last_active":"2023-07-12T02:04:03.171647+0000","last_peered":"2023-07-12T02:04:03.171647+0000","last_clean":"2023-07-12T02:04:03.171647+0000","last_became_active":"2023-07-12T02:03:57.144751+0000","last_became_peered":"2023-07-12T02:03:57.144751+0000","last_unstale":"2023-07-12T02:04:03.171647+0000","last_undegraded":"2023-07-12T02:04:03.171647+0000","last_fullsized":"2023-07-12T02:04:03.171647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:40:40.444944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707376+0000","last_change":"2023-07-12T02:03:58.158785+0000","last_active":"2023-07-12T02:04:03.707376+0000","last_peered":"2023-07-12T02:04:03.707376+0000","last_clean":"2023-07-12T02:04:03.707376+0000","last_became_active":"2023-07-12T02:03:58.158476+0000","last_became_peered":"2023-07-12T02:03:58.158476+0000","last_unstale":"2023-07-12T02:04:03.707376+0000","last_undegraded":"2023-07-12T02:04:03.707376+0000","last_fullsized":"2023-07-12T02:04:03.707376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:58:17.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707289+0000","last_change":"2023-07-12T02:04:02.198903+0000","last_active":"2023-07-12T02:04:03.707289+0000","last_peered":"2023-07-12T02:04:03.707289+0000","last_clean":"2023-07-12T02:04:03.707289+0000","last_became_active":"2023-07-12T02:04:02.198445+0000","last_became_peered":"2023-07-12T02:04:02.198445+0000","last_unstale":"2023-07-12T02:04:03.707289+0000","last_undegraded":"2023-07-12T02:04:03.707289+0000","last_fullsized":"2023-07-12T02:04:03.707289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:09:51.362187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589697+0000","last_change":"2023-07-12T02:03:57.143073+0000","last_active":"2023-07-12T02:04:03.589697+0000","last_peered":"2023-07-12T02:04:03.589697+0000","last_clean":"2023-07-12T02:04:03.589697+0000","last_became_active":"2023-07-12T02:03:57.142805+0000","last_became_peered":"2023-07-12T02:03:57.142805+0000","last_unstale":"2023-07-12T02:04:03.589697+0000","last_undegraded":"2023-07-12T02:04:03.589697+0000","last_fullsized":"2023-07-12T02:04:03.589697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:38.950056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172309+0000","last_change":"2023-07-12T02:03:58.161612+0000","last_active":"2023-07-12T02:04:03.172309+0000","last_peered":"2023-07-12T02:04:03.172309+0000","last_clean":"2023-07-12T02:04:03.172309+0000","last_became_active":"2023-07-12T02:03:58.161329+0000","last_became_peered":"2023-07-12T02:03:58.161329+0000","last_unstale":"2023-07-12T02:04:03.172309+0000","last_undegraded":"2023-07-12T02:04:03.172309+0000","last_fullsized":"2023-07-12T02:04:03.172309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:58:17.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707911+0000","last_change":"2023-07-12T02:04:02.201466+0000","last_active":"2023-07-12T02:04:03.707911+0000","last_peered":"2023-07-12T02:04:03.707911+0000","last_clean":"2023-07-12T02:04:03.707911+0000","last_became_active":"2023-07-12T02:04:02.200829+0000","last_became_peered":"2023-07-12T02:04:02.200829+0000","last_unstale":"2023-07-12T02:04:03.707911+0000","last_undegraded":"2023-07-12T02:04:03.707911+0000","last_fullsized":"2023-07-12T02:04:03.707911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:38:34.209015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706866+0000","last_change":"2023-07-12T02:03:57.151484+0000","last_active":"2023-07-12T02:04:03.706866+0000","last_peered":"2023-07-12T02:04:03.706866+0000","last_clean":"2023-07-12T02:04:03.706866+0000","last_became_active":"2023-07-12T02:03:57.151265+0000","last_became_peered":"2023-07-12T02:03:57.151265+0000","last_unstale":"2023-07-12T02:04:03.706866+0000","last_undegraded":"2023-07-12T02:04:03.706866+0000","last_fullsized":"2023-07-12T02:04:03.706866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:20:54.377849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707483+0000","last_change":"2023-07-12T02:03:58.155235+0000","last_active":"2023-07-12T02:04:03.707483+0000","last_peered":"2023-07-12T02:04:03.707483+0000","last_clean":"2023-07-12T02:04:03.707483+0000","last_became_active":"2023-07-12T02:03:58.154930+0000","last_became_peered":"2023-07-12T02:03:58.154930+0000","last_unstale":"2023-07-12T02:04:03.707483+0000","last_undegraded":"2023-07-12T02:04:03.707483+0000","last_fullsized":"2023-07-12T02:04:03.707483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:49:27.944683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589908+0000","last_change":"2023-07-12T02:04:02.192401+0000","last_active":"2023-07-12T02:04:03.589908+0000","last_peered":"2023-07-12T02:04:03.589908+0000","last_clean":"2023-07-12T02:04:03.589908+0000","last_became_active":"2023-07-12T02:04:02.191970+0000","last_became_peered":"2023-07-12T02:04:02.191970+0000","last_unstale":"2023-07-12T02:04:03.589908+0000","last_undegraded":"2023-07-12T02:04:03.589908+0000","last_fullsized":"2023-07-12T02:04:03.589908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:45:02.943144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590605+0000","last_change":"2023-07-12T02:03:57.147171+0000","last_active":"2023-07-12T02:04:03.590605+0000","last_peered":"2023-07-12T02:04:03.590605+0000","last_clean":"2023-07-12T02:04:03.590605+0000","last_became_active":"2023-07-12T02:03:57.146834+0000","last_became_peered":"2023-07-12T02:03:57.146834+0000","last_unstale":"2023-07-12T02:04:03.590605+0000","last_undegraded":"2023-07-12T02:04:03.590605+0000","last_fullsized":"2023-07-12T02:04:03.590605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:19:50.614981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706300+0000","last_change":"2023-07-12T02:03:58.158172+0000","last_active":"2023-07-12T02:04:03.706300+0000","last_peered":"2023-07-12T02:04:03.706300+0000","last_clean":"2023-07-12T02:04:03.706300+0000","last_became_active":"2023-07-12T02:03:58.157899+0000","last_became_peered":"2023-07-12T02:03:58.157899+0000","last_unstale":"2023-07-12T02:04:03.706300+0000","last_undegraded":"2023-07-12T02:04:03.706300+0000","last_fullsized":"2023-07-12T02:04:03.706300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:40:41.452100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173071+0000","last_change":"2023-07-12T02:04:02.204856+0000","last_active":"2023-07-12T02:04:03.173071+0000","last_peered":"2023-07-12T02:04:03.173071+0000","last_clean":"2023-07-12T02:04:03.173071+0000","last_became_active":"2023-07-12T02:04:02.204417+0000","last_became_peered":"2023-07-12T02:04:02.204417+0000","last_unstale":"2023-07-12T02:04:03.173071+0000","last_undegraded":"2023-07-12T02:04:03.173071+0000","last_fullsized":"2023-07-12T02:04:03.173071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:48:27.384109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590285+0000","last_change":"2023-07-12T02:03:57.146813+0000","last_active":"2023-07-12T02:04:03.590285+0000","last_peered":"2023-07-12T02:04:03.590285+0000","last_clean":"2023-07-12T02:04:03.590285+0000","last_became_active":"2023-07-12T02:03:57.146386+0000","last_became_peered":"2023-07-12T02:03:57.146386+0000","last_unstale":"2023-07-12T02:04:03.590285+0000","last_undegraded":"2023-07-12T02:04:03.590285+0000","last_fullsized":"2023-07-12T02:04:03.590285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:28.017520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173036+0000","last_change":"2023-07-12T02:03:58.150492+0000","last_active":"2023-07-12T02:04:03.173036+0000","last_peered":"2023-07-12T02:04:03.173036+0000","last_clean":"2023-07-12T02:04:03.173036+0000","last_became_active":"2023-07-12T02:03:58.150197+0000","last_became_peered":"2023-07-12T02:03:58.150197+0000","last_unstale":"2023-07-12T02:04:03.173036+0000","last_undegraded":"2023-07-12T02:04:03.173036+0000","last_fullsized":"2023-07-12T02:04:03.173036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:58:53.219351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173480+0000","last_change":"2023-07-12T02:04:02.208486+0000","last_active":"2023-07-12T02:04:03.173480+0000","last_peered":"2023-07-12T02:04:03.173480+0000","last_clean":"2023-07-12T02:04:03.173480+0000","last_became_active":"2023-07-12T02:04:02.207988+0000","last_became_peered":"2023-07-12T02:04:02.207988+0000","last_unstale":"2023-07-12T02:04:03.173480+0000","last_undegraded":"2023-07-12T02:04:03.173480+0000","last_fullsized":"2023-07-12T02:04:03.173480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:35:12.462957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590458+0000","last_change":"2023-07-12T02:03:57.147092+0000","last_active":"2023-07-12T02:04:03.590458+0000","last_peered":"2023-07-12T02:04:03.590458+0000","last_clean":"2023-07-12T02:04:03.590458+0000","last_became_active":"2023-07-12T02:03:57.146801+0000","last_became_peered":"2023-07-12T02:03:57.146801+0000","last_unstale":"2023-07-12T02:04:03.590458+0000","last_undegraded":"2023-07-12T02:04:03.590458+0000","last_fullsized":"2023-07-12T02:04:03.590458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:09:46.310799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707708+0000","last_change":"2023-07-12T02:03:58.168581+0000","last_active":"2023-07-12T02:04:03.707708+0000","last_peered":"2023-07-12T02:04:03.707708+0000","last_clean":"2023-07-12T02:04:03.707708+0000","last_became_active":"2023-07-12T02:03:58.168315+0000","last_became_peered":"2023-07-12T02:03:58.168315+0000","last_unstale":"2023-07-12T02:04:03.707708+0000","last_undegraded":"2023-07-12T02:04:03.707708+0000","last_fullsized":"2023-07-12T02:04:03.707708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:58:16.528209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173461+0000","last_change":"2023-07-12T02:04:02.193052+0000","last_active":"2023-07-12T02:04:03.173461+0000","last_peered":"2023-07-12T02:04:03.173461+0000","last_clean":"2023-07-12T02:04:03.173461+0000","last_became_active":"2023-07-12T02:04:02.192566+0000","last_became_peered":"2023-07-12T02:04:02.192566+0000","last_unstale":"2023-07-12T02:04:03.173461+0000","last_undegraded":"2023-07-12T02:04:03.173461+0000","last_fullsized":"2023-07-12T02:04:03.173461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:14:44.922812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706990+0000","last_change":"2023-07-12T02:03:57.140828+0000","last_active":"2023-07-12T02:04:03.706990+0000","last_peered":"2023-07-12T02:04:03.706990+0000","last_clean":"2023-07-12T02:04:03.706990+0000","last_became_active":"2023-07-12T02:03:57.140464+0000","last_became_peered":"2023-07-12T02:03:57.140464+0000","last_unstale":"2023-07-12T02:04:03.706990+0000","last_undegraded":"2023-07-12T02:04:03.706990+0000","last_fullsized":"2023-07-12T02:04:03.706990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:20.831039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172247+0000","last_change":"2023-07-12T02:03:58.169131+0000","last_active":"2023-07-12T02:04:03.172247+0000","last_peered":"2023-07-12T02:04:03.172247+0000","last_clean":"2023-07-12T02:04:03.172247+0000","last_became_active":"2023-07-12T02:03:58.168799+0000","last_became_peered":"2023-07-12T02:03:58.168799+0000","last_unstale":"2023-07-12T02:04:03.172247+0000","last_undegraded":"2023-07-12T02:04:03.172247+0000","last_fullsized":"2023-07-12T02:04:03.172247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:44:58.898911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173850+0000","last_change":"2023-07-12T02:04:02.190747+0000","last_active":"2023-07-12T02:04:03.173850+0000","last_peered":"2023-07-12T02:04:03.173850+0000","last_clean":"2023-07-12T02:04:03.173850+0000","last_became_active":"2023-07-12T02:04:02.190302+0000","last_became_peered":"2023-07-12T02:04:02.190302+0000","last_unstale":"2023-07-12T02:04:03.173850+0000","last_undegraded":"2023-07-12T02:04:03.173850+0000","last_fullsized":"2023-07-12T02:04:03.173850+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:33:37.078500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706960+0000","last_change":"2023-07-12T02:03:57.146313+0000","last_active":"2023-07-12T02:04:03.706960+0000","last_peered":"2023-07-12T02:04:03.706960+0000","last_clean":"2023-07-12T02:04:03.706960+0000","last_became_active":"2023-07-12T02:03:57.146009+0000","last_became_peered":"2023-07-12T02:03:57.146009+0000","last_unstale":"2023-07-12T02:04:03.706960+0000","last_undegraded":"2023-07-12T02:04:03.706960+0000","last_fullsized":"2023-07-12T02:04:03.706960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:07.276570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173066+0000","last_change":"2023-07-12T02:03:58.152369+0000","last_active":"2023-07-12T02:04:03.173066+0000","last_peered":"2023-07-12T02:04:03.173066+0000","last_clean":"2023-07-12T02:04:03.173066+0000","last_became_active":"2023-07-12T02:03:58.152135+0000","last_became_peered":"2023-07-12T02:03:58.152135+0000","last_unstale":"2023-07-12T02:04:03.173066+0000","last_undegraded":"2023-07-12T02:04:03.173066+0000","last_fullsized":"2023-07-12T02:04:03.173066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:50:41.194014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706141+0000","last_change":"2023-07-12T02:04:02.197112+0000","last_active":"2023-07-12T02:04:03.706141+0000","last_peered":"2023-07-12T02:04:03.706141+0000","last_clean":"2023-07-12T02:04:03.706141+0000","last_became_active":"2023-07-12T02:04:02.196690+0000","last_became_peered":"2023-07-12T02:04:02.196690+0000","last_unstale":"2023-07-12T02:04:03.706141+0000","last_undegraded":"2023-07-12T02:04:03.706141+0000","last_fullsized":"2023-07-12T02:04:03.706141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:13:26.428845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707558+0000","last_change":"2023-07-12T02:03:57.142419+0000","last_active":"2023-07-12T02:04:03.707558+0000","last_peered":"2023-07-12T02:04:03.707558+0000","last_clean":"2023-07-12T02:04:03.707558+0000","last_became_active":"2023-07-12T02:03:57.142100+0000","last_became_peered":"2023-07-12T02:03:57.142100+0000","last_unstale":"2023-07-12T02:04:03.707558+0000","last_undegraded":"2023-07-12T02:04:03.707558+0000","last_fullsized":"2023-07-12T02:04:03.707558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:56:37.546908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173901+0000","last_change":"2023-07-12T02:03:58.139451+0000","last_active":"2023-07-12T02:04:03.173901+0000","last_peered":"2023-07-12T02:04:03.173901+0000","last_clean":"2023-07-12T02:04:03.173901+0000","last_became_active":"2023-07-12T02:03:58.139177+0000","last_became_peered":"2023-07-12T02:03:58.139177+0000","last_unstale":"2023-07-12T02:04:03.173901+0000","last_undegraded":"2023-07-12T02:04:03.173901+0000","last_fullsized":"2023-07-12T02:04:03.173901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:55:54.389650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707633+0000","last_change":"2023-07-12T02:04:02.195542+0000","last_active":"2023-07-12T02:04:03.707633+0000","last_peered":"2023-07-12T02:04:03.707633+0000","last_clean":"2023-07-12T02:04:03.707633+0000","last_became_active":"2023-07-12T02:04:02.195110+0000","last_became_peered":"2023-07-12T02:04:02.195110+0000","last_unstale":"2023-07-12T02:04:03.707633+0000","last_undegraded":"2023-07-12T02:04:03.707633+0000","last_fullsized":"2023-07-12T02:04:03.707633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:12.327958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172725+0000","last_change":"2023-07-12T02:03:57.139384+0000","last_active":"2023-07-12T02:04:03.172725+0000","last_peered":"2023-07-12T02:04:03.172725+0000","last_clean":"2023-07-12T02:04:03.172725+0000","last_became_active":"2023-07-12T02:03:57.139029+0000","last_became_peered":"2023-07-12T02:03:57.139029+0000","last_unstale":"2023-07-12T02:04:03.172725+0000","last_undegraded":"2023-07-12T02:04:03.172725+0000","last_fullsized":"2023-07-12T02:04:03.172725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:49:26.937527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174239+0000","last_change":"2023-07-12T02:03:58.147472+0000","last_active":"2023-07-12T02:04:03.174239+0000","last_peered":"2023-07-12T02:04:03.174239+0000","last_clean":"2023-07-12T02:04:03.174239+0000","last_became_active":"2023-07-12T02:03:58.147122+0000","last_became_peered":"2023-07-12T02:03:58.147122+0000","last_unstale":"2023-07-12T02:04:03.174239+0000","last_undegraded":"2023-07-12T02:04:03.174239+0000","last_fullsized":"2023-07-12T02:04:03.174239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:01:36.223649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174157+0000","last_change":"2023-07-12T02:04:02.198219+0000","last_active":"2023-07-12T02:04:03.174157+0000","last_peered":"2023-07-12T02:04:03.174157+0000","last_clean":"2023-07-12T02:04:03.174157+0000","last_became_active":"2023-07-12T02:04:02.197795+0000","last_became_peered":"2023-07-12T02:04:02.197795+0000","last_unstale":"2023-07-12T02:04:03.174157+0000","last_undegraded":"2023-07-12T02:04:03.174157+0000","last_fullsized":"2023-07-12T02:04:03.174157+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:34:25.707588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706092+0000","last_change":"2023-07-12T02:03:57.135818+0000","last_active":"2023-07-12T02:04:03.706092+0000","last_peered":"2023-07-12T02:04:03.706092+0000","last_clean":"2023-07-12T02:04:03.706092+0000","last_became_active":"2023-07-12T02:03:57.135457+0000","last_became_peered":"2023-07-12T02:03:57.135457+0000","last_unstale":"2023-07-12T02:04:03.706092+0000","last_undegraded":"2023-07-12T02:04:03.706092+0000","last_fullsized":"2023-07-12T02:04:03.706092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:20.831039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706991+0000","last_change":"2023-07-12T02:03:58.167298+0000","last_active":"2023-07-12T02:04:03.706991+0000","last_peered":"2023-07-12T02:04:03.706991+0000","last_clean":"2023-07-12T02:04:03.706991+0000","last_became_active":"2023-07-12T02:03:58.166301+0000","last_became_peered":"2023-07-12T02:03:58.166301+0000","last_unstale":"2023-07-12T02:04:03.706991+0000","last_undegraded":"2023-07-12T02:04:03.706991+0000","last_fullsized":"2023-07-12T02:04:03.706991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:37.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171935+0000","last_change":"2023-07-12T02:04:02.200517+0000","last_active":"2023-07-12T02:04:03.171935+0000","last_peered":"2023-07-12T02:04:03.171935+0000","last_clean":"2023-07-12T02:04:03.171935+0000","last_became_active":"2023-07-12T02:04:02.200076+0000","last_became_peered":"2023-07-12T02:04:02.200076+0000","last_unstale":"2023-07-12T02:04:03.171935+0000","last_undegraded":"2023-07-12T02:04:03.171935+0000","last_fullsized":"2023-07-12T02:04:03.171935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:15:25.437127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706448+0000","last_change":"2023-07-12T02:03:52.304302+0000","last_active":"2023-07-12T02:04:03.706448+0000","last_peered":"2023-07-12T02:04:03.706448+0000","last_clean":"2023-07-12T02:04:03.706448+0000","last_became_active":"2023-07-12T02:03:52.303905+0000","last_became_peered":"2023-07-12T02:03:52.303905+0000","last_unstale":"2023-07-12T02:04:03.706448+0000","last_undegraded":"2023-07-12T02:04:03.706448+0000","last_fullsized":"2023-07-12T02:04:03.706448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:06.990537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707239+0000","last_change":"2023-07-12T02:03:57.141396+0000","last_active":"2023-07-12T02:04:03.707239+0000","last_peered":"2023-07-12T02:04:03.707239+0000","last_clean":"2023-07-12T02:04:03.707239+0000","last_became_active":"2023-07-12T02:03:57.141107+0000","last_became_peered":"2023-07-12T02:03:57.141107+0000","last_unstale":"2023-07-12T02:04:03.707239+0000","last_undegraded":"2023-07-12T02:04:03.707239+0000","last_fullsized":"2023-07-12T02:04:03.707239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:04.236723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707745+0000","last_change":"2023-07-12T02:03:58.159883+0000","last_active":"2023-07-12T02:04:03.707745+0000","last_peered":"2023-07-12T02:04:03.707745+0000","last_clean":"2023-07-12T02:04:03.707745+0000","last_became_active":"2023-07-12T02:03:58.159572+0000","last_became_peered":"2023-07-12T02:03:58.159572+0000","last_unstale":"2023-07-12T02:04:03.707745+0000","last_undegraded":"2023-07-12T02:04:03.707745+0000","last_fullsized":"2023-07-12T02:04:03.707745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:44:58.898911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171927+0000","last_change":"2023-07-12T02:04:02.205064+0000","last_active":"2023-07-12T02:04:03.171927+0000","last_peered":"2023-07-12T02:04:03.171927+0000","last_clean":"2023-07-12T02:04:03.171927+0000","last_became_active":"2023-07-12T02:04:02.204597+0000","last_became_peered":"2023-07-12T02:04:02.204597+0000","last_unstale":"2023-07-12T02:04:03.171927+0000","last_undegraded":"2023-07-12T02:04:03.171927+0000","last_fullsized":"2023-07-12T02:04:03.171927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:04:41.043396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706758+0000","last_change":"2023-07-12T02:03:51.909547+0000","last_active":"2023-07-12T02:04:03.706758+0000","last_peered":"2023-07-12T02:04:03.706758+0000","last_clean":"2023-07-12T02:04:03.706758+0000","last_became_active":"2023-07-12T02:03:51.909159+0000","last_became_peered":"2023-07-12T02:03:51.909159+0000","last_unstale":"2023-07-12T02:04:03.706758+0000","last_undegraded":"2023-07-12T02:04:03.706758+0000","last_fullsized":"2023-07-12T02:04:03.706758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:33.734016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173368+0000","last_change":"2023-07-12T02:03:57.150988+0000","last_active":"2023-07-12T02:04:03.173368+0000","last_peered":"2023-07-12T02:04:03.173368+0000","last_clean":"2023-07-12T02:04:03.173368+0000","last_became_active":"2023-07-12T02:03:57.150659+0000","last_became_peered":"2023-07-12T02:03:57.150659+0000","last_unstale":"2023-07-12T02:04:03.173368+0000","last_undegraded":"2023-07-12T02:04:03.173368+0000","last_fullsized":"2023-07-12T02:04:03.173368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:07:48.765025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706282+0000","last_change":"2023-07-12T02:03:58.163335+0000","last_active":"2023-07-12T02:04:03.706282+0000","last_peered":"2023-07-12T02:04:03.706282+0000","last_clean":"2023-07-12T02:04:03.706282+0000","last_became_active":"2023-07-12T02:03:58.163047+0000","last_became_peered":"2023-07-12T02:03:58.163047+0000","last_unstale":"2023-07-12T02:04:03.706282+0000","last_undegraded":"2023-07-12T02:04:03.706282+0000","last_fullsized":"2023-07-12T02:04:03.706282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:53:40.589737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174096+0000","last_change":"2023-07-12T02:04:02.191793+0000","last_active":"2023-07-12T02:04:03.174096+0000","last_peered":"2023-07-12T02:04:03.174096+0000","last_clean":"2023-07-12T02:04:03.174096+0000","last_became_active":"2023-07-12T02:04:02.191370+0000","last_became_peered":"2023-07-12T02:04:02.191370+0000","last_unstale":"2023-07-12T02:04:03.174096+0000","last_undegraded":"2023-07-12T02:04:03.174096+0000","last_fullsized":"2023-07-12T02:04:03.174096+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:49:03.729087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173175+0000","last_change":"2023-07-12T02:03:51.904989+0000","last_active":"2023-07-12T02:04:03.173175+0000","last_peered":"2023-07-12T02:04:03.173175+0000","last_clean":"2023-07-12T02:04:03.173175+0000","last_became_active":"2023-07-12T02:03:51.904497+0000","last_became_peered":"2023-07-12T02:03:51.904497+0000","last_unstale":"2023-07-12T02:04:03.173175+0000","last_undegraded":"2023-07-12T02:04:03.173175+0000","last_fullsized":"2023-07-12T02:04:03.173175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:51:27.688647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706336+0000","last_change":"2023-07-12T02:03:57.141921+0000","last_active":"2023-07-12T02:04:03.706336+0000","last_peered":"2023-07-12T02:04:03.706336+0000","last_clean":"2023-07-12T02:04:03.706336+0000","last_became_active":"2023-07-12T02:03:57.141617+0000","last_became_peered":"2023-07-12T02:03:57.141617+0000","last_unstale":"2023-07-12T02:04:03.706336+0000","last_undegraded":"2023-07-12T02:04:03.706336+0000","last_fullsized":"2023-07-12T02:04:03.706336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:57:56.465849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706855+0000","last_change":"2023-07-12T02:03:58.167642+0000","last_active":"2023-07-12T02:04:03.706855+0000","last_peered":"2023-07-12T02:04:03.706855+0000","last_clean":"2023-07-12T02:04:03.706855+0000","last_became_active":"2023-07-12T02:03:58.166984+0000","last_became_peered":"2023-07-12T02:03:58.166984+0000","last_unstale":"2023-07-12T02:04:03.706855+0000","last_undegraded":"2023-07-12T02:04:03.706855+0000","last_fullsized":"2023-07-12T02:04:03.706855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:52.656557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589980+0000","last_change":"2023-07-12T02:04:02.198255+0000","last_active":"2023-07-12T02:04:03.589980+0000","last_peered":"2023-07-12T02:04:03.589980+0000","last_clean":"2023-07-12T02:04:03.589980+0000","last_became_active":"2023-07-12T02:04:02.197843+0000","last_became_peered":"2023-07-12T02:04:02.197843+0000","last_unstale":"2023-07-12T02:04:03.589980+0000","last_undegraded":"2023-07-12T02:04:03.589980+0000","last_fullsized":"2023-07-12T02:04:03.589980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:58:21.161390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707028+0000","last_change":"2023-07-12T02:03:51.909324+0000","last_active":"2023-07-12T02:04:03.707028+0000","last_peered":"2023-07-12T02:04:03.707028+0000","last_clean":"2023-07-12T02:04:03.707028+0000","last_became_active":"2023-07-12T02:03:51.908982+0000","last_became_peered":"2023-07-12T02:03:51.908982+0000","last_unstale":"2023-07-12T02:04:03.707028+0000","last_undegraded":"2023-07-12T02:04:03.707028+0000","last_fullsized":"2023-07-12T02:04:03.707028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:31.138300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589719+0000","last_change":"2023-07-12T02:03:44.783225+0000","last_active":"2023-07-12T02:04:03.589719+0000","last_peered":"2023-07-12T02:04:03.589719+0000","last_clean":"2023-07-12T02:04:03.589719+0000","last_became_active":"2023-07-12T02:03:44.782048+0000","last_became_peered":"2023-07-12T02:03:44.782048+0000","last_unstale":"2023-07-12T02:04:03.589719+0000","last_undegraded":"2023-07-12T02:04:03.589719+0000","last_fullsized":"2023-07-12T02:04:03.589719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:43.565472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:43.565472+0000","last_clean_scrub_stamp":"2023-07-12T02:03:43.565472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:08.293722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707366+0000","last_change":"2023-07-12T02:03:57.139490+0000","last_active":"2023-07-12T02:04:03.707366+0000","last_peered":"2023-07-12T02:04:03.707366+0000","last_clean":"2023-07-12T02:04:03.707366+0000","last_became_active":"2023-07-12T02:03:57.139072+0000","last_became_peered":"2023-07-12T02:03:57.139072+0000","last_unstale":"2023-07-12T02:04:03.707366+0000","last_undegraded":"2023-07-12T02:04:03.707366+0000","last_fullsized":"2023-07-12T02:04:03.707366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:38:29.157627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707565+0000","last_change":"2023-07-12T02:03:58.154809+0000","last_active":"2023-07-12T02:04:03.707565+0000","last_peered":"2023-07-12T02:04:03.707565+0000","last_clean":"2023-07-12T02:04:03.707565+0000","last_became_active":"2023-07-12T02:03:58.154559+0000","last_became_peered":"2023-07-12T02:03:58.154559+0000","last_unstale":"2023-07-12T02:04:03.707565+0000","last_undegraded":"2023-07-12T02:04:03.707565+0000","last_fullsized":"2023-07-12T02:04:03.707565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:46:33.480535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707383+0000","last_change":"2023-07-12T02:04:02.197503+0000","last_active":"2023-07-12T02:04:03.707383+0000","last_peered":"2023-07-12T02:04:03.707383+0000","last_clean":"2023-07-12T02:04:03.707383+0000","last_became_active":"2023-07-12T02:04:02.197064+0000","last_became_peered":"2023-07-12T02:04:02.197064+0000","last_unstale":"2023-07-12T02:04:03.707383+0000","last_undegraded":"2023-07-12T02:04:03.707383+0000","last_fullsized":"2023-07-12T02:04:03.707383+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:18.923707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590089+0000","last_change":"2023-07-12T02:03:51.909395+0000","last_active":"2023-07-12T02:04:03.590089+0000","last_peered":"2023-07-12T02:04:03.590089+0000","last_clean":"2023-07-12T02:04:03.590089+0000","last_became_active":"2023-07-12T02:03:51.909125+0000","last_became_peered":"2023-07-12T02:03:51.909125+0000","last_unstale":"2023-07-12T02:04:03.590089+0000","last_undegraded":"2023-07-12T02:04:03.590089+0000","last_fullsized":"2023-07-12T02:04:03.590089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:15:15.169698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171436+0000","last_change":"2023-07-12T02:03:57.150059+0000","last_active":"2023-07-12T02:04:03.171436+0000","last_peered":"2023-07-12T02:04:03.171436+0000","last_clean":"2023-07-12T02:04:03.171436+0000","last_became_active":"2023-07-12T02:03:57.149751+0000","last_became_peered":"2023-07-12T02:03:57.149751+0000","last_unstale":"2023-07-12T02:04:03.171436+0000","last_undegraded":"2023-07-12T02:04:03.171436+0000","last_fullsized":"2023-07-12T02:04:03.171436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:53:41.149722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172171+0000","last_change":"2023-07-12T02:03:58.168413+0000","last_active":"2023-07-12T02:04:03.172171+0000","last_peered":"2023-07-12T02:04:03.172171+0000","last_clean":"2023-07-12T02:04:03.172171+0000","last_became_active":"2023-07-12T02:03:58.168106+0000","last_became_peered":"2023-07-12T02:03:58.168106+0000","last_unstale":"2023-07-12T02:04:03.172171+0000","last_undegraded":"2023-07-12T02:04:03.172171+0000","last_fullsized":"2023-07-12T02:04:03.172171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:52.156977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707401+0000","last_change":"2023-07-12T02:04:02.197727+0000","last_active":"2023-07-12T02:04:03.707401+0000","last_peered":"2023-07-12T02:04:03.707401+0000","last_clean":"2023-07-12T02:04:03.707401+0000","last_became_active":"2023-07-12T02:04:02.197340+0000","last_became_peered":"2023-07-12T02:04:02.197340+0000","last_unstale":"2023-07-12T02:04:03.707401+0000","last_undegraded":"2023-07-12T02:04:03.707401+0000","last_fullsized":"2023-07-12T02:04:03.707401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:01:54.191121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590364+0000","last_change":"2023-07-12T02:03:52.304880+0000","last_active":"2023-07-12T02:04:03.590364+0000","last_peered":"2023-07-12T02:04:03.590364+0000","last_clean":"2023-07-12T02:04:03.590364+0000","last_became_active":"2023-07-12T02:03:52.304598+0000","last_became_peered":"2023-07-12T02:03:52.304598+0000","last_unstale":"2023-07-12T02:04:03.590364+0000","last_undegraded":"2023-07-12T02:04:03.590364+0000","last_fullsized":"2023-07-12T02:04:03.590364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:30:38.554090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706579+0000","last_change":"2023-07-12T02:03:57.134671+0000","last_active":"2023-07-12T02:04:03.706579+0000","last_peered":"2023-07-12T02:04:03.706579+0000","last_clean":"2023-07-12T02:04:03.706579+0000","last_became_active":"2023-07-12T02:03:57.134319+0000","last_became_peered":"2023-07-12T02:03:57.134319+0000","last_unstale":"2023-07-12T02:04:03.706579+0000","last_undegraded":"2023-07-12T02:04:03.706579+0000","last_fullsized":"2023-07-12T02:04:03.706579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:21.026700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172428+0000","last_change":"2023-07-12T02:03:58.158643+0000","last_active":"2023-07-12T02:04:03.172428+0000","last_peered":"2023-07-12T02:04:03.172428+0000","last_clean":"2023-07-12T02:04:03.172428+0000","last_became_active":"2023-07-12T02:03:58.158356+0000","last_became_peered":"2023-07-12T02:03:58.158356+0000","last_unstale":"2023-07-12T02:04:03.172428+0000","last_undegraded":"2023-07-12T02:04:03.172428+0000","last_fullsized":"2023-07-12T02:04:03.172428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:37:27.430690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173232+0000","last_change":"2023-07-12T02:04:02.198751+0000","last_active":"2023-07-12T02:04:03.173232+0000","last_peered":"2023-07-12T02:04:03.173232+0000","last_clean":"2023-07-12T02:04:03.173232+0000","last_became_active":"2023-07-12T02:04:02.198369+0000","last_became_peered":"2023-07-12T02:04:02.198369+0000","last_unstale":"2023-07-12T02:04:03.173232+0000","last_undegraded":"2023-07-12T02:04:03.173232+0000","last_fullsized":"2023-07-12T02:04:03.173232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:36:39.188205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707404+0000","last_change":"2023-07-12T02:03:57.140454+0000","last_active":"2023-07-12T02:04:03.707404+0000","last_peered":"2023-07-12T02:04:03.707404+0000","last_clean":"2023-07-12T02:04:03.707404+0000","last_became_active":"2023-07-12T02:03:57.140085+0000","last_became_peered":"2023-07-12T02:03:57.140085+0000","last_unstale":"2023-07-12T02:04:03.707404+0000","last_undegraded":"2023-07-12T02:04:03.707404+0000","last_fullsized":"2023-07-12T02:04:03.707404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:31:40.528381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706901+0000","last_change":"2023-07-12T02:03:51.906406+0000","last_active":"2023-07-12T02:04:03.706901+0000","last_peered":"2023-07-12T02:04:03.706901+0000","last_clean":"2023-07-12T02:04:03.706901+0000","last_became_active":"2023-07-12T02:03:51.905875+0000","last_became_peered":"2023-07-12T02:03:51.905875+0000","last_unstale":"2023-07-12T02:04:03.706901+0000","last_undegraded":"2023-07-12T02:04:03.706901+0000","last_fullsized":"2023-07-12T02:04:03.706901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:33.734016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.705982+0000","last_change":"2023-07-12T02:03:58.156488+0000","last_active":"2023-07-12T02:04:03.705982+0000","last_peered":"2023-07-12T02:04:03.705982+0000","last_clean":"2023-07-12T02:04:03.705982+0000","last_became_active":"2023-07-12T02:03:58.155960+0000","last_became_peered":"2023-07-12T02:03:58.155960+0000","last_unstale":"2023-07-12T02:04:03.705982+0000","last_undegraded":"2023-07-12T02:04:03.705982+0000","last_fullsized":"2023-07-12T02:04:03.705982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:37.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.705926+0000","last_change":"2023-07-12T02:04:02.198638+0000","last_active":"2023-07-12T02:04:03.705926+0000","last_peered":"2023-07-12T02:04:03.705926+0000","last_clean":"2023-07-12T02:04:03.705926+0000","last_became_active":"2023-07-12T02:04:02.198244+0000","last_became_peered":"2023-07-12T02:04:02.198244+0000","last_unstale":"2023-07-12T02:04:03.705926+0000","last_undegraded":"2023-07-12T02:04:03.705926+0000","last_fullsized":"2023-07-12T02:04:03.705926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:44.001444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.708048+0000","last_change":"2023-07-12T02:03:51.908137+0000","last_active":"2023-07-12T02:04:03.708048+0000","last_peered":"2023-07-12T02:04:03.708048+0000","last_clean":"2023-07-12T02:04:03.708048+0000","last_became_active":"2023-07-12T02:03:51.907900+0000","last_became_peered":"2023-07-12T02:03:51.907900+0000","last_unstale":"2023-07-12T02:04:03.708048+0000","last_undegraded":"2023-07-12T02:04:03.708048+0000","last_fullsized":"2023-07-12T02:04:03.708048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:04:38.301609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171901+0000","last_change":"2023-07-12T02:03:57.148723+0000","last_active":"2023-07-12T02:04:03.171901+0000","last_peered":"2023-07-12T02:04:03.171901+0000","last_clean":"2023-07-12T02:04:03.171901+0000","last_became_active":"2023-07-12T02:03:57.148402+0000","last_became_peered":"2023-07-12T02:03:57.148402+0000","last_unstale":"2023-07-12T02:04:03.171901+0000","last_undegraded":"2023-07-12T02:04:03.171901+0000","last_fullsized":"2023-07-12T02:04:03.171901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:51.649402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172813+0000","last_change":"2023-07-12T02:03:58.146752+0000","last_active":"2023-07-12T02:04:03.172813+0000","last_peered":"2023-07-12T02:04:03.172813+0000","last_clean":"2023-07-12T02:04:03.172813+0000","last_became_active":"2023-07-12T02:03:58.146475+0000","last_became_peered":"2023-07-12T02:03:58.146475+0000","last_unstale":"2023-07-12T02:04:03.172813+0000","last_undegraded":"2023-07-12T02:04:03.172813+0000","last_fullsized":"2023-07-12T02:04:03.172813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:18.127189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707349+0000","last_change":"2023-07-12T02:04:02.197112+0000","last_active":"2023-07-12T02:04:03.707349+0000","last_peered":"2023-07-12T02:04:03.707349+0000","last_clean":"2023-07-12T02:04:03.707349+0000","last_became_active":"2023-07-12T02:04:02.196665+0000","last_became_peered":"2023-07-12T02:04:02.196665+0000","last_unstale":"2023-07-12T02:04:03.707349+0000","last_undegraded":"2023-07-12T02:04:03.707349+0000","last_fullsized":"2023-07-12T02:04:03.707349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:25.882427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172383+0000","last_change":"2023-07-12T02:03:57.149946+0000","last_active":"2023-07-12T02:04:03.172383+0000","last_peered":"2023-07-12T02:04:03.172383+0000","last_clean":"2023-07-12T02:04:03.172383+0000","last_became_active":"2023-07-12T02:03:57.149707+0000","last_became_peered":"2023-07-12T02:03:57.149707+0000","last_unstale":"2023-07-12T02:04:03.172383+0000","last_undegraded":"2023-07-12T02:04:03.172383+0000","last_fullsized":"2023-07-12T02:04:03.172383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:13.872319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173635+0000","last_change":"2023-07-12T02:03:58.153412+0000","last_active":"2023-07-12T02:04:03.173635+0000","last_peered":"2023-07-12T02:04:03.173635+0000","last_clean":"2023-07-12T02:04:03.173635+0000","last_became_active":"2023-07-12T02:03:58.153116+0000","last_became_peered":"2023-07-12T02:03:58.153116+0000","last_unstale":"2023-07-12T02:04:03.173635+0000","last_undegraded":"2023-07-12T02:04:03.173635+0000","last_fullsized":"2023-07-12T02:04:03.173635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:37:03.495726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590052+0000","last_change":"2023-07-12T02:04:02.192659+0000","last_active":"2023-07-12T02:04:03.590052+0000","last_peered":"2023-07-12T02:04:03.590052+0000","last_clean":"2023-07-12T02:04:03.590052+0000","last_became_active":"2023-07-12T02:04:02.192139+0000","last_became_peered":"2023-07-12T02:04:02.192139+0000","last_unstale":"2023-07-12T02:04:03.590052+0000","last_undegraded":"2023-07-12T02:04:03.590052+0000","last_fullsized":"2023-07-12T02:04:03.590052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:18.923707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707093+0000","last_change":"2023-07-12T02:03:57.140042+0000","last_active":"2023-07-12T02:04:03.707093+0000","last_peered":"2023-07-12T02:04:03.707093+0000","last_clean":"2023-07-12T02:04:03.707093+0000","last_became_active":"2023-07-12T02:03:57.139652+0000","last_became_peered":"2023-07-12T02:03:57.139652+0000","last_unstale":"2023-07-12T02:04:03.707093+0000","last_undegraded":"2023-07-12T02:04:03.707093+0000","last_fullsized":"2023-07-12T02:04:03.707093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:51.149821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173207+0000","last_change":"2023-07-12T02:03:58.152883+0000","last_active":"2023-07-12T02:04:03.173207+0000","last_peered":"2023-07-12T02:04:03.173207+0000","last_clean":"2023-07-12T02:04:03.173207+0000","last_became_active":"2023-07-12T02:03:58.152591+0000","last_became_peered":"2023-07-12T02:03:58.152591+0000","last_unstale":"2023-07-12T02:04:03.173207+0000","last_undegraded":"2023-07-12T02:04:03.173207+0000","last_fullsized":"2023-07-12T02:04:03.173207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:07:57.297802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707002+0000","last_change":"2023-07-12T02:04:02.198913+0000","last_active":"2023-07-12T02:04:03.707002+0000","last_peered":"2023-07-12T02:04:03.707002+0000","last_clean":"2023-07-12T02:04:03.707002+0000","last_became_active":"2023-07-12T02:04:02.198553+0000","last_became_peered":"2023-07-12T02:04:02.198553+0000","last_unstale":"2023-07-12T02:04:03.707002+0000","last_undegraded":"2023-07-12T02:04:03.707002+0000","last_fullsized":"2023-07-12T02:04:03.707002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:45:02.943144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707838+0000","last_change":"2023-07-12T02:03:57.136048+0000","last_active":"2023-07-12T02:04:03.707838+0000","last_peered":"2023-07-12T02:04:03.707838+0000","last_clean":"2023-07-12T02:04:03.707838+0000","last_became_active":"2023-07-12T02:03:57.135728+0000","last_became_peered":"2023-07-12T02:03:57.135728+0000","last_unstale":"2023-07-12T02:04:03.707838+0000","last_undegraded":"2023-07-12T02:04:03.707838+0000","last_fullsized":"2023-07-12T02:04:03.707838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:19:50.614981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172897+0000","last_change":"2023-07-12T02:03:58.151134+0000","last_active":"2023-07-12T02:04:03.172897+0000","last_peered":"2023-07-12T02:04:03.172897+0000","last_clean":"2023-07-12T02:04:03.172897+0000","last_became_active":"2023-07-12T02:03:58.150880+0000","last_became_peered":"2023-07-12T02:03:58.150880+0000","last_unstale":"2023-07-12T02:04:03.172897+0000","last_undegraded":"2023-07-12T02:04:03.172897+0000","last_fullsized":"2023-07-12T02:04:03.172897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:04:26.740269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172701+0000","last_change":"2023-07-12T02:04:02.195039+0000","last_active":"2023-07-12T02:04:03.172701+0000","last_peered":"2023-07-12T02:04:03.172701+0000","last_clean":"2023-07-12T02:04:03.172701+0000","last_became_active":"2023-07-12T02:04:02.194199+0000","last_became_peered":"2023-07-12T02:04:02.194199+0000","last_unstale":"2023-07-12T02:04:03.172701+0000","last_undegraded":"2023-07-12T02:04:03.172701+0000","last_fullsized":"2023-07-12T02:04:03.172701+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:31:45.579769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706482+0000","last_change":"2023-07-12T02:03:57.135710+0000","last_active":"2023-07-12T02:04:03.706482+0000","last_peered":"2023-07-12T02:04:03.706482+0000","last_clean":"2023-07-12T02:04:03.706482+0000","last_became_active":"2023-07-12T02:03:57.135435+0000","last_became_peered":"2023-07-12T02:03:57.135435+0000","last_unstale":"2023-07-12T02:04:03.706482+0000","last_undegraded":"2023-07-12T02:04:03.706482+0000","last_fullsized":"2023-07-12T02:04:03.706482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:58:16.110002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706668+0000","last_change":"2023-07-12T02:03:58.150539+0000","last_active":"2023-07-12T02:04:03.706668+0000","last_peered":"2023-07-12T02:04:03.706668+0000","last_clean":"2023-07-12T02:04:03.706668+0000","last_became_active":"2023-07-12T02:03:58.150195+0000","last_became_peered":"2023-07-12T02:03:58.150195+0000","last_unstale":"2023-07-12T02:04:03.706668+0000","last_undegraded":"2023-07-12T02:04:03.706668+0000","last_fullsized":"2023-07-12T02:04:03.706668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:14.879474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706643+0000","last_change":"2023-07-12T02:04:02.198230+0000","last_active":"2023-07-12T02:04:03.706643+0000","last_peered":"2023-07-12T02:04:03.706643+0000","last_clean":"2023-07-12T02:04:03.706643+0000","last_became_active":"2023-07-12T02:04:02.197796+0000","last_became_peered":"2023-07-12T02:04:02.197796+0000","last_unstale":"2023-07-12T02:04:03.706643+0000","last_undegraded":"2023-07-12T02:04:03.706643+0000","last_fullsized":"2023-07-12T02:04:03.706643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:53:46.201110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172259+0000","last_change":"2023-07-12T02:03:57.148075+0000","last_active":"2023-07-12T02:04:03.172259+0000","last_peered":"2023-07-12T02:04:03.172259+0000","last_clean":"2023-07-12T02:04:03.172259+0000","last_became_active":"2023-07-12T02:03:57.147809+0000","last_became_peered":"2023-07-12T02:03:57.147809+0000","last_unstale":"2023-07-12T02:04:03.172259+0000","last_undegraded":"2023-07-12T02:04:03.172259+0000","last_fullsized":"2023-07-12T02:04:03.172259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:04.236723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173070+0000","last_change":"2023-07-12T02:03:58.146147+0000","last_active":"2023-07-12T02:04:03.173070+0000","last_peered":"2023-07-12T02:04:03.173070+0000","last_clean":"2023-07-12T02:04:03.173070+0000","last_became_active":"2023-07-12T02:03:58.145855+0000","last_became_peered":"2023-07-12T02:03:58.145855+0000","last_unstale":"2023-07-12T02:04:03.173070+0000","last_undegraded":"2023-07-12T02:04:03.173070+0000","last_fullsized":"2023-07-12T02:04:03.173070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:54:10.220081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706812+0000","last_change":"2023-07-12T02:03:58.165263+0000","last_active":"2023-07-12T02:04:03.706812+0000","last_peered":"2023-07-12T02:04:03.706812+0000","last_clean":"2023-07-12T02:04:03.706812+0000","last_became_active":"2023-07-12T02:03:58.164980+0000","last_became_peered":"2023-07-12T02:03:58.164980+0000","last_unstale":"2023-07-12T02:04:03.706812+0000","last_undegraded":"2023-07-12T02:04:03.706812+0000","last_fullsized":"2023-07-12T02:04:03.706812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:30:32.214383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706936+0000","last_change":"2023-07-12T02:03:58.166005+0000","last_active":"2023-07-12T02:04:03.706936+0000","last_peered":"2023-07-12T02:04:03.706936+0000","last_clean":"2023-07-12T02:04:03.706936+0000","last_became_active":"2023-07-12T02:03:58.165718+0000","last_became_peered":"2023-07-12T02:03:58.165718+0000","last_unstale":"2023-07-12T02:04:03.706936+0000","last_undegraded":"2023-07-12T02:04:03.706936+0000","last_fullsized":"2023-07-12T02:04:03.706936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:29.024675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173193+0000","last_change":"2023-07-12T02:03:58.145894+0000","last_active":"2023-07-12T02:04:03.173193+0000","last_peered":"2023-07-12T02:04:03.173193+0000","last_clean":"2023-07-12T02:04:03.173193+0000","last_became_active":"2023-07-12T02:03:58.145442+0000","last_became_peered":"2023-07-12T02:03:58.145442+0000","last_unstale":"2023-07-12T02:04:03.173193+0000","last_undegraded":"2023-07-12T02:04:03.173193+0000","last_fullsized":"2023-07-12T02:04:03.173193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:52:53.582391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707166+0000","last_change":"2023-07-12T02:03:58.156685+0000","last_active":"2023-07-12T02:04:03.707166+0000","last_peered":"2023-07-12T02:04:03.707166+0000","last_clean":"2023-07-12T02:04:03.707166+0000","last_became_active":"2023-07-12T02:03:58.156127+0000","last_became_peered":"2023-07-12T02:03:58.156127+0000","last_unstale":"2023-07-12T02:04:03.707166+0000","last_undegraded":"2023-07-12T02:04:03.707166+0000","last_fullsized":"2023-07-12T02:04:03.707166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:30:44.777286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706873+0000","last_change":"2023-07-12T02:03:58.159307+0000","last_active":"2023-07-12T02:04:03.706873+0000","last_peered":"2023-07-12T02:04:03.706873+0000","last_clean":"2023-07-12T02:04:03.706873+0000","last_became_active":"2023-07-12T02:03:58.158898+0000","last_became_peered":"2023-07-12T02:03:58.158898+0000","last_unstale":"2023-07-12T02:04:03.706873+0000","last_undegraded":"2023-07-12T02:04:03.706873+0000","last_fullsized":"2023-07-12T02:04:03.706873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:04:36.999164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":884736,"data_stored":709832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-12T02:04:27.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-12T02:04:27.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.607+0000 7f8b301ff700 1 Processor -- start 2023-07-12T02:04:27.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.607+0000 7f8b301ff700 1 -- start start 2023-07-12T02:04:27.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.608+0000 7f8b301ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b280d2640 0x7f8b280b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:27.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.608+0000 7f8b301ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b280d1790 con 0x7f8b2815c460 2023-07-12T02:04:27.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.608+0000 7f8b301ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b280cd950 con 0x7f8b280cf8f0 2023-07-12T02:04:27.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.608+0000 7f8b301ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280cedd0 con 0x7f8b280d2640 2023-07-12T02:04:27.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.608+0000 7f8b2df9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8b2815c460 0x7f8b280cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48528/0 (socket says 172.21.15.37:48528) 2023-07-12T02:04:27.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.608+0000 7f8b2df9b700 1 -- 172.21.15.37:0/2330791235 learned_addr learned my addr 172.21.15.37:0/2330791235 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:27.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.609+0000 7f8b2d79a700 1 --2- 172.21.15.37:0/2330791235 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b280d2640 0x7f8b280b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:27.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.609+0000 7f8b2cf99700 1 -- 172.21.15.37:0/2330791235 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74547465 0 0) 0x7f8b280d1790 con 0x7f8b2815c460 2023-07-12T02:04:27.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.609+0000 7f8b2cf99700 1 -- 172.21.15.37:0/2330791235 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b140035b0 con 0x7f8b2815c460 2023-07-12T02:04:27.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.609+0000 7f8b2cf99700 1 -- 172.21.15.37:0/2330791235 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717424741 0 0) 0x7f8b280cd950 con 0x7f8b280cf8f0 2023-07-12T02:04:27.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.609+0000 7f8b2cf99700 1 -- 172.21.15.37:0/2330791235 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b280d1790 con 0x7f8b280cf8f0 2023-07-12T02:04:27.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.609+0000 7f8b2d79a700 1 -- 172.21.15.37:0/2330791235 >> v1:172.21.15.196:6789/0 conn(0x7f8b280cf8f0 legacy=0x7f8b2815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:27.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.609+0000 7f8b2d79a700 1 -- 172.21.15.37:0/2330791235 >> v1:172.21.15.37:6789/0 conn(0x7f8b2815c460 legacy=0x7f8b280cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:27.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.609+0000 7f8b2d79a700 1 -- 172.21.15.37:0/2330791235 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b280d14b0 con 0x7f8b280d2640 2023-07-12T02:04:27.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.609+0000 7f8b2d79a700 1 --2- 172.21.15.37:0/2330791235 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b280d2640 0x7f8b280b59d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009870 tx=0x7f8b18009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d7a701f8cc5ddad server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:27.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.610+0000 7f8b2cf99700 1 -- 172.21.15.37:0/2330791235 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18011830 con 0x7f8b280d2640 2023-07-12T02:04:27.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.610+0000 7f8b2cf99700 1 -- 172.21.15.37:0/2330791235 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b18011990 con 0x7f8b280d2640 2023-07-12T02:04:27.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.610+0000 7f8b2cf99700 1 -- 172.21.15.37:0/2330791235 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18011d20 con 0x7f8b280d2640 2023-07-12T02:04:27.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.610+0000 7f8b301ff700 1 -- 172.21.15.37:0/2330791235 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b280d2640 msgr2=0x7f8b280b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.610+0000 7f8b301ff700 1 --2- 172.21.15.37:0/2330791235 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b280d2640 0x7f8b280b59d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009870 tx=0x7f8b18009b80 comp rx=0 tx=0).stop 2023-07-12T02:04:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.610+0000 7f8b301ff700 1 -- 172.21.15.37:0/2330791235 shutdown_connections 2023-07-12T02:04:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.610+0000 7f8b301ff700 1 --2- 172.21.15.37:0/2330791235 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b280d2640 0x7f8b280b59d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.610+0000 7f8b301ff700 1 -- 172.21.15.37:0/2330791235 >> 172.21.15.37:0/2330791235 conn(0x7f8b28071660 msgr2=0x7f8b28071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.610+0000 7f8b301ff700 1 -- 172.21.15.37:0/2330791235 shutdown_connections 2023-07-12T02:04:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.610+0000 7f8b301ff700 1 -- 172.21.15.37:0/2330791235 wait complete. 2023-07-12T02:04:27.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.613+0000 7f8b301ff700 1 Processor -- start 2023-07-12T02:04:27.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.613+0000 7f8b301ff700 1 -- start start 2023-07-12T02:04:27.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.614+0000 7f8b301ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b280cf8f0 0x7f8b28150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:27.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.614+0000 7f8b301ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b280d2640 0x7f8b280cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:27.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.614+0000 7f8b301ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b2815c460 0x7f8b281e7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.614+0000 7f8b301ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b281e7670 con 0x7f8b280cf8f0 2023-07-12T02:04:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.614+0000 7f8b301ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b281e78f0 con 0x7f8b2815c460 2023-07-12T02:04:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.614+0000 7f8b301ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b281e7bd0 con 0x7f8b280d2640 2023-07-12T02:04:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.615+0000 7f8b2df9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b280cf8f0 0x7f8b28150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.615+0000 7f8b2df9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b280cf8f0 0x7f8b28150780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49040/0 (socket says 172.21.15.37:49040) 2023-07-12T02:04:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.615+0000 7f8b2df9b700 1 -- 172.21.15.37:0/1198086451 learned_addr learned my addr 172.21.15.37:0/1198086451 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.615+0000 7f8b2d79a700 1 --2- 172.21.15.37:0/1198086451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b280d2640 0x7f8b280cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.615+0000 7f8b2e79c700 1 --2- 172.21.15.37:0/1198086451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b2815c460 0x7f8b281e7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:27.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.615+0000 7f8b2df9b700 1 -- 172.21.15.37:0/1198086451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b280d2640 msgr2=0x7f8b280cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.615+0000 7f8b2df9b700 1 --2- 172.21.15.37:0/1198086451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b280d2640 0x7f8b280cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.615+0000 7f8b2df9b700 1 -- 172.21.15.37:0/1198086451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b2815c460 msgr2=0x7f8b281e7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.615+0000 7f8b2df9b700 1 --2- 172.21.15.37:0/1198086451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b2815c460 0x7f8b281e7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.615+0000 7f8b2df9b700 1 -- 172.21.15.37:0/1198086451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b180094a0 con 0x7f8b280cf8f0 2023-07-12T02:04:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.615+0000 7f8b2df9b700 1 --2- 172.21.15.37:0/1198086451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b280cf8f0 0x7f8b28150780 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400c700 tx=0x7f8b2400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.616+0000 7f8b1e7fc700 1 -- 172.21.15.37:0/1198086451 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24005d70 con 0x7f8b280cf8f0 2023-07-12T02:04:27.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.616+0000 7f8b1e7fc700 1 -- 172.21.15.37:0/1198086451 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b240070d0 con 0x7f8b280cf8f0 2023-07-12T02:04:27.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.616+0000 7f8b1e7fc700 1 -- 172.21.15.37:0/1198086451 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24007460 con 0x7f8b280cf8f0 2023-07-12T02:04:27.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.616+0000 7f8b301ff700 1 -- 172.21.15.37:0/1198086451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b281e7eb0 con 0x7f8b280cf8f0 2023-07-12T02:04:27.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.616+0000 7f8b301ff700 1 -- 172.21.15.37:0/1198086451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2815eca0 con 0x7f8b280cf8f0 2023-07-12T02:04:27.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.617+0000 7f8b301ff700 1 -- 172.21.15.37:0/1198086451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b281e83d0 con 0x7f8b280cf8f0 2023-07-12T02:04:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.618+0000 7f8b1e7fc700 1 -- 172.21.15.37:0/1198086451 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b240075c0 con 0x7f8b280cf8f0 2023-07-12T02:04:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.619+0000 7f8b1e7fc700 1 --2- 172.21.15.37:0/1198086451 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b0c06ace0 0x7f8b0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.619+0000 7f8b1e7fc700 1 -- 172.21.15.37:0/1198086451 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8b24088be0 con 0x7f8b280cf8f0 2023-07-12T02:04:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.619+0000 7f8b2d79a700 1 --2- 172.21.15.37:0/1198086451 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b0c06ace0 0x7f8b0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.620+0000 7f8b2d79a700 1 --2- 172.21.15.37:0/1198086451 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b0c06ace0 0x7f8b0c06d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b180097c0 tx=0x7f8b1801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:27.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.623+0000 7f8b1e7fc700 1 -- 172.21.15.37:0/1198086451 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8b24053990 con 0x7f8b280cf8f0 2023-07-12T02:04:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.826+0000 7f8b301ff700 1 -- 172.21.15.37:0/1198086451 --> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b281e7a60 con 0x7f8b0c06ace0 2023-07-12T02:04:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.837+0000 7f8b1e7fc700 1 -- 172.21.15.37:0/1198086451 <== mgr.4099 v2:172.21.15.196:6832/3490435896 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367376 (secure 0 0 0) 0x7f8b281e7a60 con 0x7f8b0c06ace0 2023-07-12T02:04:27.844 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.841+0000 7f8b301ff700 1 -- 172.21.15.37:0/1198086451 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b0c06ace0 msgr2=0x7f8b0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.841+0000 7f8b301ff700 1 --2- 172.21.15.37:0/1198086451 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b0c06ace0 0x7f8b0c06d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b180097c0 tx=0x7f8b1801c040 comp rx=0 tx=0).stop 2023-07-12T02:04:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.841+0000 7f8b301ff700 1 -- 172.21.15.37:0/1198086451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b280cf8f0 msgr2=0x7f8b28150780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.841+0000 7f8b301ff700 1 --2- 172.21.15.37:0/1198086451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b280cf8f0 0x7f8b28150780 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400c700 tx=0x7f8b2400ca10 comp rx=0 tx=0).stop 2023-07-12T02:04:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.842+0000 7f8b301ff700 1 -- 172.21.15.37:0/1198086451 shutdown_connections 2023-07-12T02:04:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.842+0000 7f8b301ff700 1 --2- 172.21.15.37:0/1198086451 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b0c06ace0 0x7f8b0c06d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.842+0000 7f8b301ff700 1 --2- 172.21.15.37:0/1198086451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b280cf8f0 0x7f8b28150780 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.842+0000 7f8b301ff700 1 --2- 172.21.15.37:0/1198086451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b2815c460 0x7f8b281e7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.842+0000 7f8b301ff700 1 --2- 172.21.15.37:0/1198086451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b280d2640 0x7f8b280cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.842+0000 7f8b301ff700 1 -- 172.21.15.37:0/1198086451 >> 172.21.15.37:0/1198086451 conn(0x7f8b28071660 msgr2=0x7f8b280b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.842+0000 7f8b301ff700 1 -- 172.21.15.37:0/1198086451 shutdown_connections 2023-07-12T02:04:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:27.842+0000 7f8b301ff700 1 -- 172.21.15.37:0/1198086451 wait complete. 2023-07-12T02:04:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-12T02:04:27.863 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2023-07-12T02:04:27.352113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219684,"kb_used_data":3492,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755036,"statfs":{"total":773094113280,"available":772869156864,"internally_reserved":0,"allocated":3575808,"data_stored":2148109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003612"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173964+0000","last_change":"2023-07-12T02:03:58.150799+0000","last_active":"2023-07-12T02:04:03.173964+0000","last_peered":"2023-07-12T02:04:03.173964+0000","last_clean":"2023-07-12T02:04:03.173964+0000","last_became_active":"2023-07-12T02:03:58.150302+0000","last_became_peered":"2023-07-12T02:03:58.150302+0000","last_unstale":"2023-07-12T02:04:03.173964+0000","last_undegraded":"2023-07-12T02:04:03.173964+0000","last_fullsized":"2023-07-12T02:04:03.173964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:34:50.094079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707297+0000","last_change":"2023-07-12T02:03:58.167958+0000","last_active":"2023-07-12T02:04:03.707297+0000","last_peered":"2023-07-12T02:04:03.707297+0000","last_clean":"2023-07-12T02:04:03.707297+0000","last_became_active":"2023-07-12T02:03:58.167409+0000","last_became_peered":"2023-07-12T02:03:58.167409+0000","last_unstale":"2023-07-12T02:04:03.707297+0000","last_undegraded":"2023-07-12T02:04:03.707297+0000","last_fullsized":"2023-07-12T02:04:03.707297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:15:21.392894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174114+0000","last_change":"2023-07-12T02:03:58.158253+0000","last_active":"2023-07-12T02:04:03.174114+0000","last_peered":"2023-07-12T02:04:03.174114+0000","last_clean":"2023-07-12T02:04:03.174114+0000","last_became_active":"2023-07-12T02:03:58.158005+0000","last_became_peered":"2023-07-12T02:03:58.158005+0000","last_unstale":"2023-07-12T02:04:03.174114+0000","last_undegraded":"2023-07-12T02:04:03.174114+0000","last_fullsized":"2023-07-12T02:04:03.174114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:07:16.216455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707579+0000","last_change":"2023-07-12T02:03:58.155943+0000","last_active":"2023-07-12T02:04:03.707579+0000","last_peered":"2023-07-12T02:04:03.707579+0000","last_clean":"2023-07-12T02:04:03.707579+0000","last_became_active":"2023-07-12T02:03:58.155672+0000","last_became_peered":"2023-07-12T02:03:58.155672+0000","last_unstale":"2023-07-12T02:04:03.707579+0000","last_undegraded":"2023-07-12T02:04:03.707579+0000","last_fullsized":"2023-07-12T02:04:03.707579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:59:41.793818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172594+0000","last_change":"2023-07-12T02:03:58.163745+0000","last_active":"2023-07-12T02:04:03.172594+0000","last_peered":"2023-07-12T02:04:03.172594+0000","last_clean":"2023-07-12T02:04:03.172594+0000","last_became_active":"2023-07-12T02:03:58.163198+0000","last_became_peered":"2023-07-12T02:03:58.163198+0000","last_unstale":"2023-07-12T02:04:03.172594+0000","last_undegraded":"2023-07-12T02:04:03.172594+0000","last_fullsized":"2023-07-12T02:04:03.172594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:29.024675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173684+0000","last_change":"2023-07-12T02:03:58.160380+0000","last_active":"2023-07-12T02:04:03.173684+0000","last_peered":"2023-07-12T02:04:03.173684+0000","last_clean":"2023-07-12T02:04:03.173684+0000","last_became_active":"2023-07-12T02:03:58.160102+0000","last_became_peered":"2023-07-12T02:03:58.160102+0000","last_unstale":"2023-07-12T02:04:03.173684+0000","last_undegraded":"2023-07-12T02:04:03.173684+0000","last_fullsized":"2023-07-12T02:04:03.173684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:08:29.661400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589781+0000","last_change":"2023-07-12T02:03:58.153608+0000","last_active":"2023-07-12T02:04:03.589781+0000","last_peered":"2023-07-12T02:04:03.589781+0000","last_clean":"2023-07-12T02:04:03.589781+0000","last_became_active":"2023-07-12T02:03:58.153320+0000","last_became_peered":"2023-07-12T02:03:58.153320+0000","last_unstale":"2023-07-12T02:04:03.589781+0000","last_undegraded":"2023-07-12T02:04:03.589781+0000","last_fullsized":"2023-07-12T02:04:03.589781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:37.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706388+0000","last_change":"2023-07-12T02:03:58.157485+0000","last_active":"2023-07-12T02:04:03.706388+0000","last_peered":"2023-07-12T02:04:03.706388+0000","last_clean":"2023-07-12T02:04:03.706388+0000","last_became_active":"2023-07-12T02:03:58.157195+0000","last_became_peered":"2023-07-12T02:03:58.157195+0000","last_unstale":"2023-07-12T02:04:03.706388+0000","last_undegraded":"2023-07-12T02:04:03.706388+0000","last_fullsized":"2023-07-12T02:04:03.706388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:52.656557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171917+0000","last_change":"2023-07-12T02:03:58.162632+0000","last_active":"2023-07-12T02:04:03.171917+0000","last_peered":"2023-07-12T02:04:03.171917+0000","last_clean":"2023-07-12T02:04:03.171917+0000","last_became_active":"2023-07-12T02:03:58.162344+0000","last_became_peered":"2023-07-12T02:03:58.162344+0000","last_unstale":"2023-07-12T02:04:03.171917+0000","last_undegraded":"2023-07-12T02:04:03.171917+0000","last_fullsized":"2023-07-12T02:04:03.171917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:39.957211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707756+0000","last_change":"2023-07-12T02:03:58.165129+0000","last_active":"2023-07-12T02:04:03.707756+0000","last_peered":"2023-07-12T02:04:03.707756+0000","last_clean":"2023-07-12T02:04:03.707756+0000","last_became_active":"2023-07-12T02:03:58.164826+0000","last_became_peered":"2023-07-12T02:03:58.164826+0000","last_unstale":"2023-07-12T02:04:03.707756+0000","last_undegraded":"2023-07-12T02:04:03.707756+0000","last_fullsized":"2023-07-12T02:04:03.707756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:30:44.777286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174276+0000","last_change":"2023-07-12T02:03:58.167779+0000","last_active":"2023-07-12T02:04:03.174276+0000","last_peered":"2023-07-12T02:04:03.174276+0000","last_clean":"2023-07-12T02:04:03.174276+0000","last_became_active":"2023-07-12T02:03:58.167405+0000","last_became_peered":"2023-07-12T02:03:58.167405+0000","last_unstale":"2023-07-12T02:04:03.174276+0000","last_undegraded":"2023-07-12T02:04:03.174276+0000","last_fullsized":"2023-07-12T02:04:03.174276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:05:20.293113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173473+0000","last_change":"2023-07-12T02:03:58.140088+0000","last_active":"2023-07-12T02:04:03.173473+0000","last_peered":"2023-07-12T02:04:03.173473+0000","last_clean":"2023-07-12T02:04:03.173473+0000","last_became_active":"2023-07-12T02:03:58.139727+0000","last_became_peered":"2023-07-12T02:03:58.139727+0000","last_unstale":"2023-07-12T02:04:03.173473+0000","last_undegraded":"2023-07-12T02:04:03.173473+0000","last_fullsized":"2023-07-12T02:04:03.173473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:50.799195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173642+0000","last_change":"2023-07-12T02:03:58.152355+0000","last_active":"2023-07-12T02:04:03.173642+0000","last_peered":"2023-07-12T02:04:03.173642+0000","last_clean":"2023-07-12T02:04:03.173642+0000","last_became_active":"2023-07-12T02:03:58.151997+0000","last_became_peered":"2023-07-12T02:03:58.151997+0000","last_unstale":"2023-07-12T02:04:03.173642+0000","last_undegraded":"2023-07-12T02:04:03.173642+0000","last_fullsized":"2023-07-12T02:04:03.173642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:50:47.044125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706694+0000","last_change":"2023-07-12T02:03:58.155958+0000","last_active":"2023-07-12T02:04:03.706694+0000","last_peered":"2023-07-12T02:04:03.706694+0000","last_clean":"2023-07-12T02:04:03.706694+0000","last_became_active":"2023-07-12T02:03:58.155646+0000","last_became_peered":"2023-07-12T02:03:58.155646+0000","last_unstale":"2023-07-12T02:04:03.706694+0000","last_undegraded":"2023-07-12T02:04:03.706694+0000","last_fullsized":"2023-07-12T02:04:03.706694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:04:36.999164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589619+0000","last_change":"2023-07-12T02:03:58.162352+0000","last_active":"2023-07-12T02:04:03.589619+0000","last_peered":"2023-07-12T02:04:03.589619+0000","last_clean":"2023-07-12T02:04:03.589619+0000","last_became_active":"2023-07-12T02:03:58.162011+0000","last_became_peered":"2023-07-12T02:03:58.162011+0000","last_unstale":"2023-07-12T02:04:03.589619+0000","last_undegraded":"2023-07-12T02:04:03.589619+0000","last_fullsized":"2023-07-12T02:04:03.589619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:04:36.999164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173236+0000","last_change":"2023-07-12T02:03:58.162838+0000","last_active":"2023-07-12T02:04:03.173236+0000","last_peered":"2023-07-12T02:04:03.173236+0000","last_clean":"2023-07-12T02:04:03.173236+0000","last_became_active":"2023-07-12T02:03:58.162528+0000","last_became_peered":"2023-07-12T02:03:58.162528+0000","last_unstale":"2023-07-12T02:04:03.173236+0000","last_undegraded":"2023-07-12T02:04:03.173236+0000","last_fullsized":"2023-07-12T02:04:03.173236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:42:38.629324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172071+0000","last_change":"2023-07-12T02:03:58.162549+0000","last_active":"2023-07-12T02:04:03.172071+0000","last_peered":"2023-07-12T02:04:03.172071+0000","last_clean":"2023-07-12T02:04:03.172071+0000","last_became_active":"2023-07-12T02:03:58.161983+0000","last_became_peered":"2023-07-12T02:03:58.161983+0000","last_unstale":"2023-07-12T02:04:03.172071+0000","last_undegraded":"2023-07-12T02:04:03.172071+0000","last_fullsized":"2023-07-12T02:04:03.172071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:37.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174066+0000","last_change":"2023-07-12T02:03:58.140088+0000","last_active":"2023-07-12T02:04:03.174066+0000","last_peered":"2023-07-12T02:04:03.174066+0000","last_clean":"2023-07-12T02:04:03.174066+0000","last_became_active":"2023-07-12T02:03:58.139825+0000","last_became_peered":"2023-07-12T02:03:58.139825+0000","last_unstale":"2023-07-12T02:04:03.174066+0000","last_undegraded":"2023-07-12T02:04:03.174066+0000","last_fullsized":"2023-07-12T02:04:03.174066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:22:57.380427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173781+0000","last_change":"2023-07-12T02:03:58.149388+0000","last_active":"2023-07-12T02:04:03.173781+0000","last_peered":"2023-07-12T02:04:03.173781+0000","last_clean":"2023-07-12T02:04:03.173781+0000","last_became_active":"2023-07-12T02:03:58.149009+0000","last_became_peered":"2023-07-12T02:03:58.149009+0000","last_unstale":"2023-07-12T02:04:03.173781+0000","last_undegraded":"2023-07-12T02:04:03.173781+0000","last_fullsized":"2023-07-12T02:04:03.173781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:18:25.150845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173690+0000","last_change":"2023-07-12T02:03:58.144677+0000","last_active":"2023-07-12T02:04:03.173690+0000","last_peered":"2023-07-12T02:04:03.173690+0000","last_clean":"2023-07-12T02:04:03.173690+0000","last_became_active":"2023-07-12T02:03:58.144365+0000","last_became_peered":"2023-07-12T02:03:58.144365+0000","last_unstale":"2023-07-12T02:04:03.173690+0000","last_undegraded":"2023-07-12T02:04:03.173690+0000","last_fullsized":"2023-07-12T02:04:03.173690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:46:02.333414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590198+0000","last_change":"2023-07-12T02:03:58.156054+0000","last_active":"2023-07-12T02:04:03.590198+0000","last_peered":"2023-07-12T02:04:03.590198+0000","last_clean":"2023-07-12T02:04:03.590198+0000","last_became_active":"2023-07-12T02:03:58.155755+0000","last_became_peered":"2023-07-12T02:03:58.155755+0000","last_unstale":"2023-07-12T02:04:03.590198+0000","last_undegraded":"2023-07-12T02:04:03.590198+0000","last_fullsized":"2023-07-12T02:04:03.590198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:37:27.430690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171482+0000","last_change":"2023-07-12T02:03:58.169838+0000","last_active":"2023-07-12T02:04:03.171482+0000","last_peered":"2023-07-12T02:04:03.171482+0000","last_clean":"2023-07-12T02:04:03.171482+0000","last_became_active":"2023-07-12T02:03:58.169574+0000","last_became_peered":"2023-07-12T02:03:58.169574+0000","last_unstale":"2023-07-12T02:04:03.171482+0000","last_undegraded":"2023-07-12T02:04:03.171482+0000","last_fullsized":"2023-07-12T02:04:03.171482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:03:49.584323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706395+0000","last_change":"2023-07-12T02:03:58.158643+0000","last_active":"2023-07-12T02:04:03.706395+0000","last_peered":"2023-07-12T02:04:03.706395+0000","last_clean":"2023-07-12T02:04:03.706395+0000","last_became_active":"2023-07-12T02:03:58.158228+0000","last_became_peered":"2023-07-12T02:03:58.158228+0000","last_unstale":"2023-07-12T02:04:03.706395+0000","last_undegraded":"2023-07-12T02:04:03.706395+0000","last_fullsized":"2023-07-12T02:04:03.706395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:15:21.392894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589781+0000","last_change":"2023-07-12T02:03:58.155246+0000","last_active":"2023-07-12T02:04:03.589781+0000","last_peered":"2023-07-12T02:04:03.589781+0000","last_clean":"2023-07-12T02:04:03.589781+0000","last_became_active":"2023-07-12T02:03:58.154842+0000","last_became_peered":"2023-07-12T02:03:58.154842+0000","last_unstale":"2023-07-12T02:04:03.589781+0000","last_undegraded":"2023-07-12T02:04:03.589781+0000","last_fullsized":"2023-07-12T02:04:03.589781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:52.156977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706732+0000","last_change":"2023-07-12T02:03:58.167506+0000","last_active":"2023-07-12T02:04:03.706732+0000","last_peered":"2023-07-12T02:04:03.706732+0000","last_clean":"2023-07-12T02:04:03.706732+0000","last_became_active":"2023-07-12T02:03:58.166701+0000","last_became_peered":"2023-07-12T02:03:58.166701+0000","last_unstale":"2023-07-12T02:04:03.706732+0000","last_undegraded":"2023-07-12T02:04:03.706732+0000","last_fullsized":"2023-07-12T02:04:03.706732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:03:49.584323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706759+0000","last_change":"2023-07-12T02:03:58.164411+0000","last_active":"2023-07-12T02:04:03.706759+0000","last_peered":"2023-07-12T02:04:03.706759+0000","last_clean":"2023-07-12T02:04:03.706759+0000","last_became_active":"2023-07-12T02:03:58.164136+0000","last_became_peered":"2023-07-12T02:03:58.164136+0000","last_unstale":"2023-07-12T02:04:03.706759+0000","last_undegraded":"2023-07-12T02:04:03.706759+0000","last_fullsized":"2023-07-12T02:04:03.706759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:40:41.452100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707500+0000","last_change":"2023-07-12T02:03:58.158327+0000","last_active":"2023-07-12T02:04:03.707500+0000","last_peered":"2023-07-12T02:04:03.707500+0000","last_clean":"2023-07-12T02:04:03.707500+0000","last_became_active":"2023-07-12T02:03:58.158038+0000","last_became_peered":"2023-07-12T02:03:58.158038+0000","last_unstale":"2023-07-12T02:04:03.707500+0000","last_undegraded":"2023-07-12T02:04:03.707500+0000","last_fullsized":"2023-07-12T02:04:03.707500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:37:27.430690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174072+0000","last_change":"2023-07-12T02:04:02.205882+0000","last_active":"2023-07-12T02:04:03.174072+0000","last_peered":"2023-07-12T02:04:03.174072+0000","last_clean":"2023-07-12T02:04:03.174072+0000","last_became_active":"2023-07-12T02:04:02.205422+0000","last_became_peered":"2023-07-12T02:04:02.205422+0000","last_unstale":"2023-07-12T02:04:03.174072+0000","last_undegraded":"2023-07-12T02:04:03.174072+0000","last_fullsized":"2023-07-12T02:04:03.174072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:00:06.567816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173559+0000","last_change":"2023-07-12T02:03:57.132659+0000","last_active":"2023-07-12T02:04:03.173559+0000","last_peered":"2023-07-12T02:04:03.173559+0000","last_clean":"2023-07-12T02:04:03.173559+0000","last_became_active":"2023-07-12T02:03:57.132296+0000","last_became_peered":"2023-07-12T02:03:57.132296+0000","last_unstale":"2023-07-12T02:04:03.173559+0000","last_undegraded":"2023-07-12T02:04:03.173559+0000","last_fullsized":"2023-07-12T02:04:03.173559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:13:18.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706776+0000","last_change":"2023-07-12T02:03:58.168189+0000","last_active":"2023-07-12T02:04:03.706776+0000","last_peered":"2023-07-12T02:04:03.706776+0000","last_clean":"2023-07-12T02:04:03.706776+0000","last_became_active":"2023-07-12T02:03:58.167837+0000","last_became_peered":"2023-07-12T02:03:58.167837+0000","last_unstale":"2023-07-12T02:04:03.706776+0000","last_undegraded":"2023-07-12T02:04:03.706776+0000","last_fullsized":"2023-07-12T02:04:03.706776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:37:27.430690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.708053+0000","last_change":"2023-07-12T02:04:02.192589+0000","last_active":"2023-07-12T02:04:03.708053+0000","last_peered":"2023-07-12T02:04:03.708053+0000","last_clean":"2023-07-12T02:04:03.708053+0000","last_became_active":"2023-07-12T02:04:02.192078+0000","last_became_peered":"2023-07-12T02:04:02.192078+0000","last_unstale":"2023-07-12T02:04:03.708053+0000","last_undegraded":"2023-07-12T02:04:03.708053+0000","last_fullsized":"2023-07-12T02:04:03.708053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:13:11.653857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706270+0000","last_change":"2023-07-12T02:03:57.137950+0000","last_active":"2023-07-12T02:04:03.706270+0000","last_peered":"2023-07-12T02:04:03.706270+0000","last_clean":"2023-07-12T02:04:03.706270+0000","last_became_active":"2023-07-12T02:03:57.137512+0000","last_became_peered":"2023-07-12T02:03:57.137512+0000","last_unstale":"2023-07-12T02:04:03.706270+0000","last_undegraded":"2023-07-12T02:04:03.706270+0000","last_fullsized":"2023-07-12T02:04:03.706270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:23:19.169613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172604+0000","last_change":"2023-07-12T02:03:58.161489+0000","last_active":"2023-07-12T02:04:03.172604+0000","last_peered":"2023-07-12T02:04:03.172604+0000","last_clean":"2023-07-12T02:04:03.172604+0000","last_became_active":"2023-07-12T02:03:58.161146+0000","last_became_peered":"2023-07-12T02:03:58.161146+0000","last_unstale":"2023-07-12T02:04:03.172604+0000","last_undegraded":"2023-07-12T02:04:03.172604+0000","last_fullsized":"2023-07-12T02:04:03.172604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:30:44.777286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172742+0000","last_change":"2023-07-12T02:04:02.199897+0000","last_active":"2023-07-12T02:04:03.172742+0000","last_peered":"2023-07-12T02:04:03.172742+0000","last_clean":"2023-07-12T02:04:03.172742+0000","last_became_active":"2023-07-12T02:04:02.198813+0000","last_became_peered":"2023-07-12T02:04:02.198813+0000","last_unstale":"2023-07-12T02:04:03.172742+0000","last_undegraded":"2023-07-12T02:04:03.172742+0000","last_fullsized":"2023-07-12T02:04:03.172742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:12.327958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706246+0000","last_change":"2023-07-12T02:03:57.150630+0000","last_active":"2023-07-12T02:04:03.706246+0000","last_peered":"2023-07-12T02:04:03.706246+0000","last_clean":"2023-07-12T02:04:03.706246+0000","last_became_active":"2023-07-12T02:03:57.150342+0000","last_became_peered":"2023-07-12T02:03:57.150342+0000","last_unstale":"2023-07-12T02:04:03.706246+0000","last_undegraded":"2023-07-12T02:04:03.706246+0000","last_fullsized":"2023-07-12T02:04:03.706246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:44:57.891756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.708148+0000","last_change":"2023-07-12T02:03:58.151183+0000","last_active":"2023-07-12T02:04:03.708148+0000","last_peered":"2023-07-12T02:04:03.708148+0000","last_clean":"2023-07-12T02:04:03.708148+0000","last_became_active":"2023-07-12T02:03:58.150257+0000","last_became_peered":"2023-07-12T02:03:58.150257+0000","last_unstale":"2023-07-12T02:04:03.708148+0000","last_undegraded":"2023-07-12T02:04:03.708148+0000","last_fullsized":"2023-07-12T02:04:03.708148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:59:55.615077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707354+0000","last_change":"2023-07-12T02:04:02.193315+0000","last_active":"2023-07-12T02:04:03.707354+0000","last_peered":"2023-07-12T02:04:03.707354+0000","last_clean":"2023-07-12T02:04:03.707354+0000","last_became_active":"2023-07-12T02:04:02.192915+0000","last_became_peered":"2023-07-12T02:04:02.192915+0000","last_unstale":"2023-07-12T02:04:03.707354+0000","last_undegraded":"2023-07-12T02:04:03.707354+0000","last_fullsized":"2023-07-12T02:04:03.707354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:48:36.242589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172114+0000","last_change":"2023-07-12T02:03:57.147980+0000","last_active":"2023-07-12T02:04:03.172114+0000","last_peered":"2023-07-12T02:04:03.172114+0000","last_clean":"2023-07-12T02:04:03.172114+0000","last_became_active":"2023-07-12T02:03:57.147701+0000","last_became_peered":"2023-07-12T02:03:57.147701+0000","last_unstale":"2023-07-12T02:04:03.172114+0000","last_undegraded":"2023-07-12T02:04:03.172114+0000","last_fullsized":"2023-07-12T02:04:03.172114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:20.831039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706124+0000","last_change":"2023-07-12T02:03:58.162466+0000","last_active":"2023-07-12T02:04:03.706124+0000","last_peered":"2023-07-12T02:04:03.706124+0000","last_clean":"2023-07-12T02:04:03.706124+0000","last_became_active":"2023-07-12T02:03:58.162232+0000","last_became_peered":"2023-07-12T02:03:58.162232+0000","last_unstale":"2023-07-12T02:04:03.706124+0000","last_undegraded":"2023-07-12T02:04:03.706124+0000","last_fullsized":"2023-07-12T02:04:03.706124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:52.156977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589544+0000","last_change":"2023-07-12T02:04:02.199601+0000","last_active":"2023-07-12T02:04:03.589544+0000","last_peered":"2023-07-12T02:04:03.589544+0000","last_clean":"2023-07-12T02:04:03.589544+0000","last_became_active":"2023-07-12T02:04:02.199218+0000","last_became_peered":"2023-07-12T02:04:02.199218+0000","last_unstale":"2023-07-12T02:04:03.589544+0000","last_undegraded":"2023-07-12T02:04:03.589544+0000","last_fullsized":"2023-07-12T02:04:03.589544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:56.700790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707513+0000","last_change":"2023-07-12T02:03:57.144471+0000","last_active":"2023-07-12T02:04:03.707513+0000","last_peered":"2023-07-12T02:04:03.707513+0000","last_clean":"2023-07-12T02:04:03.707513+0000","last_became_active":"2023-07-12T02:03:57.144183+0000","last_became_peered":"2023-07-12T02:03:57.144183+0000","last_unstale":"2023-07-12T02:04:03.707513+0000","last_undegraded":"2023-07-12T02:04:03.707513+0000","last_fullsized":"2023-07-12T02:04:03.707513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:28.017520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706261+0000","last_change":"2023-07-12T02:03:58.155253+0000","last_active":"2023-07-12T02:04:03.706261+0000","last_peered":"2023-07-12T02:04:03.706261+0000","last_clean":"2023-07-12T02:04:03.706261+0000","last_became_active":"2023-07-12T02:03:58.154981+0000","last_became_peered":"2023-07-12T02:03:58.154981+0000","last_unstale":"2023-07-12T02:04:03.706261+0000","last_undegraded":"2023-07-12T02:04:03.706261+0000","last_fullsized":"2023-07-12T02:04:03.706261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:05.243878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707342+0000","last_change":"2023-07-12T02:04:02.199311+0000","last_active":"2023-07-12T02:04:03.707342+0000","last_peered":"2023-07-12T02:04:03.707342+0000","last_clean":"2023-07-12T02:04:03.707342+0000","last_became_active":"2023-07-12T02:04:02.198883+0000","last_became_peered":"2023-07-12T02:04:02.198883+0000","last_unstale":"2023-07-12T02:04:03.707342+0000","last_undegraded":"2023-07-12T02:04:03.707342+0000","last_fullsized":"2023-07-12T02:04:03.707342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:19:55.666369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590314+0000","last_change":"2023-07-12T02:03:57.150937+0000","last_active":"2023-07-12T02:04:03.590314+0000","last_peered":"2023-07-12T02:04:03.590314+0000","last_clean":"2023-07-12T02:04:03.590314+0000","last_became_active":"2023-07-12T02:03:57.150617+0000","last_became_peered":"2023-07-12T02:03:57.150617+0000","last_unstale":"2023-07-12T02:04:03.590314+0000","last_undegraded":"2023-07-12T02:04:03.590314+0000","last_fullsized":"2023-07-12T02:04:03.590314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:07.276570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707832+0000","last_change":"2023-07-12T02:03:58.160889+0000","last_active":"2023-07-12T02:04:03.707832+0000","last_peered":"2023-07-12T02:04:03.707832+0000","last_clean":"2023-07-12T02:04:03.707832+0000","last_became_active":"2023-07-12T02:03:58.160594+0000","last_became_peered":"2023-07-12T02:03:58.160594+0000","last_unstale":"2023-07-12T02:04:03.707832+0000","last_undegraded":"2023-07-12T02:04:03.707832+0000","last_fullsized":"2023-07-12T02:04:03.707832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:05.243878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707549+0000","last_change":"2023-07-12T02:04:02.191342+0000","last_active":"2023-07-12T02:04:03.707549+0000","last_peered":"2023-07-12T02:04:03.707549+0000","last_clean":"2023-07-12T02:04:03.707549+0000","last_became_active":"2023-07-12T02:04:02.190277+0000","last_became_peered":"2023-07-12T02:04:02.190277+0000","last_unstale":"2023-07-12T02:04:03.707549+0000","last_undegraded":"2023-07-12T02:04:03.707549+0000","last_fullsized":"2023-07-12T02:04:03.707549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:56.201209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:16.744060+0000","last_change":"2023-07-12T02:03:57.141317+0000","last_active":"2023-07-12T02:04:16.744060+0000","last_peered":"2023-07-12T02:04:16.744060+0000","last_clean":"2023-07-12T02:04:16.744060+0000","last_became_active":"2023-07-12T02:03:57.140668+0000","last_became_peered":"2023-07-12T02:03:57.140668+0000","last_unstale":"2023-07-12T02:04:16.744060+0000","last_undegraded":"2023-07-12T02:04:16.744060+0000","last_fullsized":"2023-07-12T02:04:16.744060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:26:13.420313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173616+0000","last_change":"2023-07-12T02:03:58.147529+0000","last_active":"2023-07-12T02:04:03.173616+0000","last_peered":"2023-07-12T02:04:03.173616+0000","last_clean":"2023-07-12T02:04:03.173616+0000","last_became_active":"2023-07-12T02:03:58.147226+0000","last_became_peered":"2023-07-12T02:03:58.147226+0000","last_unstale":"2023-07-12T02:04:03.173616+0000","last_undegraded":"2023-07-12T02:04:03.173616+0000","last_fullsized":"2023-07-12T02:04:03.173616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:41:34.175917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707746+0000","last_change":"2023-07-12T02:04:02.199731+0000","last_active":"2023-07-12T02:04:03.707746+0000","last_peered":"2023-07-12T02:04:03.707746+0000","last_clean":"2023-07-12T02:04:03.707746+0000","last_became_active":"2023-07-12T02:04:02.199360+0000","last_became_peered":"2023-07-12T02:04:02.199360+0000","last_unstale":"2023-07-12T02:04:03.707746+0000","last_undegraded":"2023-07-12T02:04:03.707746+0000","last_fullsized":"2023-07-12T02:04:03.707746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:09:51.362187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590031+0000","last_change":"2023-07-12T02:03:57.146809+0000","last_active":"2023-07-12T02:04:03.590031+0000","last_peered":"2023-07-12T02:04:03.590031+0000","last_clean":"2023-07-12T02:04:03.590031+0000","last_became_active":"2023-07-12T02:03:57.146430+0000","last_became_peered":"2023-07-12T02:03:57.146430+0000","last_unstale":"2023-07-12T02:04:03.590031+0000","last_undegraded":"2023-07-12T02:04:03.590031+0000","last_fullsized":"2023-07-12T02:04:03.590031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:04.236723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707769+0000","last_change":"2023-07-12T02:03:58.152748+0000","last_active":"2023-07-12T02:04:03.707769+0000","last_peered":"2023-07-12T02:04:03.707769+0000","last_clean":"2023-07-12T02:04:03.707769+0000","last_became_active":"2023-07-12T02:03:58.152426+0000","last_became_peered":"2023-07-12T02:03:58.152426+0000","last_unstale":"2023-07-12T02:04:03.707769+0000","last_undegraded":"2023-07-12T02:04:03.707769+0000","last_fullsized":"2023-07-12T02:04:03.707769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:04:26.740269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707577+0000","last_change":"2023-07-12T02:04:02.192398+0000","last_active":"2023-07-12T02:04:03.707577+0000","last_peered":"2023-07-12T02:04:03.707577+0000","last_clean":"2023-07-12T02:04:03.707577+0000","last_became_active":"2023-07-12T02:04:02.191940+0000","last_became_peered":"2023-07-12T02:04:02.191940+0000","last_unstale":"2023-07-12T02:04:03.707577+0000","last_undegraded":"2023-07-12T02:04:03.707577+0000","last_fullsized":"2023-07-12T02:04:03.707577+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:22.171422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171647+0000","last_change":"2023-07-12T02:03:57.146620+0000","last_active":"2023-07-12T02:04:03.171647+0000","last_peered":"2023-07-12T02:04:03.171647+0000","last_clean":"2023-07-12T02:04:03.171647+0000","last_became_active":"2023-07-12T02:03:57.144751+0000","last_became_peered":"2023-07-12T02:03:57.144751+0000","last_unstale":"2023-07-12T02:04:03.171647+0000","last_undegraded":"2023-07-12T02:04:03.171647+0000","last_fullsized":"2023-07-12T02:04:03.171647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:40:40.444944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707376+0000","last_change":"2023-07-12T02:03:58.158785+0000","last_active":"2023-07-12T02:04:03.707376+0000","last_peered":"2023-07-12T02:04:03.707376+0000","last_clean":"2023-07-12T02:04:03.707376+0000","last_became_active":"2023-07-12T02:03:58.158476+0000","last_became_peered":"2023-07-12T02:03:58.158476+0000","last_unstale":"2023-07-12T02:04:03.707376+0000","last_undegraded":"2023-07-12T02:04:03.707376+0000","last_fullsized":"2023-07-12T02:04:03.707376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:58:17.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707289+0000","last_change":"2023-07-12T02:04:02.198903+0000","last_active":"2023-07-12T02:04:03.707289+0000","last_peered":"2023-07-12T02:04:03.707289+0000","last_clean":"2023-07-12T02:04:03.707289+0000","last_became_active":"2023-07-12T02:04:02.198445+0000","last_became_peered":"2023-07-12T02:04:02.198445+0000","last_unstale":"2023-07-12T02:04:03.707289+0000","last_undegraded":"2023-07-12T02:04:03.707289+0000","last_fullsized":"2023-07-12T02:04:03.707289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:09:51.362187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589697+0000","last_change":"2023-07-12T02:03:57.143073+0000","last_active":"2023-07-12T02:04:03.589697+0000","last_peered":"2023-07-12T02:04:03.589697+0000","last_clean":"2023-07-12T02:04:03.589697+0000","last_became_active":"2023-07-12T02:03:57.142805+0000","last_became_peered":"2023-07-12T02:03:57.142805+0000","last_unstale":"2023-07-12T02:04:03.589697+0000","last_undegraded":"2023-07-12T02:04:03.589697+0000","last_fullsized":"2023-07-12T02:04:03.589697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:38.950056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172309+0000","last_change":"2023-07-12T02:03:58.161612+0000","last_active":"2023-07-12T02:04:03.172309+0000","last_peered":"2023-07-12T02:04:03.172309+0000","last_clean":"2023-07-12T02:04:03.172309+0000","last_became_active":"2023-07-12T02:03:58.161329+0000","last_became_peered":"2023-07-12T02:03:58.161329+0000","last_unstale":"2023-07-12T02:04:03.172309+0000","last_undegraded":"2023-07-12T02:04:03.172309+0000","last_fullsized":"2023-07-12T02:04:03.172309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:58:17.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707911+0000","last_change":"2023-07-12T02:04:02.201466+0000","last_active":"2023-07-12T02:04:03.707911+0000","last_peered":"2023-07-12T02:04:03.707911+0000","last_clean":"2023-07-12T02:04:03.707911+0000","last_became_active":"2023-07-12T02:04:02.200829+0000","last_became_peered":"2023-07-12T02:04:02.200829+0000","last_unstale":"2023-07-12T02:04:03.707911+0000","last_undegraded":"2023-07-12T02:04:03.707911+0000","last_fullsized":"2023-07-12T02:04:03.707911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:38:34.209015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706866+0000","last_change":"2023-07-12T02:03:57.151484+0000","last_active":"2023-07-12T02:04:03.706866+0000","last_peered":"2023-07-12T02:04:03.706866+0000","last_clean":"2023-07-12T02:04:03.706866+0000","last_became_active":"2023-07-12T02:03:57.151265+0000","last_became_peered":"2023-07-12T02:03:57.151265+0000","last_unstale":"2023-07-12T02:04:03.706866+0000","last_undegraded":"2023-07-12T02:04:03.706866+0000","last_fullsized":"2023-07-12T02:04:03.706866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:20:54.377849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707483+0000","last_change":"2023-07-12T02:03:58.155235+0000","last_active":"2023-07-12T02:04:03.707483+0000","last_peered":"2023-07-12T02:04:03.707483+0000","last_clean":"2023-07-12T02:04:03.707483+0000","last_became_active":"2023-07-12T02:03:58.154930+0000","last_became_peered":"2023-07-12T02:03:58.154930+0000","last_unstale":"2023-07-12T02:04:03.707483+0000","last_undegraded":"2023-07-12T02:04:03.707483+0000","last_fullsized":"2023-07-12T02:04:03.707483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:49:27.944683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589908+0000","last_change":"2023-07-12T02:04:02.192401+0000","last_active":"2023-07-12T02:04:03.589908+0000","last_peered":"2023-07-12T02:04:03.589908+0000","last_clean":"2023-07-12T02:04:03.589908+0000","last_became_active":"2023-07-12T02:04:02.191970+0000","last_became_peered":"2023-07-12T02:04:02.191970+0000","last_unstale":"2023-07-12T02:04:03.589908+0000","last_undegraded":"2023-07-12T02:04:03.589908+0000","last_fullsized":"2023-07-12T02:04:03.589908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:45:02.943144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590605+0000","last_change":"2023-07-12T02:03:57.147171+0000","last_active":"2023-07-12T02:04:03.590605+0000","last_peered":"2023-07-12T02:04:03.590605+0000","last_clean":"2023-07-12T02:04:03.590605+0000","last_became_active":"2023-07-12T02:03:57.146834+0000","last_became_peered":"2023-07-12T02:03:57.146834+0000","last_unstale":"2023-07-12T02:04:03.590605+0000","last_undegraded":"2023-07-12T02:04:03.590605+0000","last_fullsized":"2023-07-12T02:04:03.590605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:19:50.614981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706300+0000","last_change":"2023-07-12T02:03:58.158172+0000","last_active":"2023-07-12T02:04:03.706300+0000","last_peered":"2023-07-12T02:04:03.706300+0000","last_clean":"2023-07-12T02:04:03.706300+0000","last_became_active":"2023-07-12T02:03:58.157899+0000","last_became_peered":"2023-07-12T02:03:58.157899+0000","last_unstale":"2023-07-12T02:04:03.706300+0000","last_undegraded":"2023-07-12T02:04:03.706300+0000","last_fullsized":"2023-07-12T02:04:03.706300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:40:41.452100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173071+0000","last_change":"2023-07-12T02:04:02.204856+0000","last_active":"2023-07-12T02:04:03.173071+0000","last_peered":"2023-07-12T02:04:03.173071+0000","last_clean":"2023-07-12T02:04:03.173071+0000","last_became_active":"2023-07-12T02:04:02.204417+0000","last_became_peered":"2023-07-12T02:04:02.204417+0000","last_unstale":"2023-07-12T02:04:03.173071+0000","last_undegraded":"2023-07-12T02:04:03.173071+0000","last_fullsized":"2023-07-12T02:04:03.173071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:48:27.384109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590285+0000","last_change":"2023-07-12T02:03:57.146813+0000","last_active":"2023-07-12T02:04:03.590285+0000","last_peered":"2023-07-12T02:04:03.590285+0000","last_clean":"2023-07-12T02:04:03.590285+0000","last_became_active":"2023-07-12T02:03:57.146386+0000","last_became_peered":"2023-07-12T02:03:57.146386+0000","last_unstale":"2023-07-12T02:04:03.590285+0000","last_undegraded":"2023-07-12T02:04:03.590285+0000","last_fullsized":"2023-07-12T02:04:03.590285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:28.017520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173036+0000","last_change":"2023-07-12T02:03:58.150492+0000","last_active":"2023-07-12T02:04:03.173036+0000","last_peered":"2023-07-12T02:04:03.173036+0000","last_clean":"2023-07-12T02:04:03.173036+0000","last_became_active":"2023-07-12T02:03:58.150197+0000","last_became_peered":"2023-07-12T02:03:58.150197+0000","last_unstale":"2023-07-12T02:04:03.173036+0000","last_undegraded":"2023-07-12T02:04:03.173036+0000","last_fullsized":"2023-07-12T02:04:03.173036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:58:53.219351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173480+0000","last_change":"2023-07-12T02:04:02.208486+0000","last_active":"2023-07-12T02:04:03.173480+0000","last_peered":"2023-07-12T02:04:03.173480+0000","last_clean":"2023-07-12T02:04:03.173480+0000","last_became_active":"2023-07-12T02:04:02.207988+0000","last_became_peered":"2023-07-12T02:04:02.207988+0000","last_unstale":"2023-07-12T02:04:03.173480+0000","last_undegraded":"2023-07-12T02:04:03.173480+0000","last_fullsized":"2023-07-12T02:04:03.173480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:35:12.462957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590458+0000","last_change":"2023-07-12T02:03:57.147092+0000","last_active":"2023-07-12T02:04:03.590458+0000","last_peered":"2023-07-12T02:04:03.590458+0000","last_clean":"2023-07-12T02:04:03.590458+0000","last_became_active":"2023-07-12T02:03:57.146801+0000","last_became_peered":"2023-07-12T02:03:57.146801+0000","last_unstale":"2023-07-12T02:04:03.590458+0000","last_undegraded":"2023-07-12T02:04:03.590458+0000","last_fullsized":"2023-07-12T02:04:03.590458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:09:46.310799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707708+0000","last_change":"2023-07-12T02:03:58.168581+0000","last_active":"2023-07-12T02:04:03.707708+0000","last_peered":"2023-07-12T02:04:03.707708+0000","last_clean":"2023-07-12T02:04:03.707708+0000","last_became_active":"2023-07-12T02:03:58.168315+0000","last_became_peered":"2023-07-12T02:03:58.168315+0000","last_unstale":"2023-07-12T02:04:03.707708+0000","last_undegraded":"2023-07-12T02:04:03.707708+0000","last_fullsized":"2023-07-12T02:04:03.707708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:58:16.528209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173461+0000","last_change":"2023-07-12T02:04:02.193052+0000","last_active":"2023-07-12T02:04:03.173461+0000","last_peered":"2023-07-12T02:04:03.173461+0000","last_clean":"2023-07-12T02:04:03.173461+0000","last_became_active":"2023-07-12T02:04:02.192566+0000","last_became_peered":"2023-07-12T02:04:02.192566+0000","last_unstale":"2023-07-12T02:04:03.173461+0000","last_undegraded":"2023-07-12T02:04:03.173461+0000","last_fullsized":"2023-07-12T02:04:03.173461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:14:44.922812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706990+0000","last_change":"2023-07-12T02:03:57.140828+0000","last_active":"2023-07-12T02:04:03.706990+0000","last_peered":"2023-07-12T02:04:03.706990+0000","last_clean":"2023-07-12T02:04:03.706990+0000","last_became_active":"2023-07-12T02:03:57.140464+0000","last_became_peered":"2023-07-12T02:03:57.140464+0000","last_unstale":"2023-07-12T02:04:03.706990+0000","last_undegraded":"2023-07-12T02:04:03.706990+0000","last_fullsized":"2023-07-12T02:04:03.706990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:20.831039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172247+0000","last_change":"2023-07-12T02:03:58.169131+0000","last_active":"2023-07-12T02:04:03.172247+0000","last_peered":"2023-07-12T02:04:03.172247+0000","last_clean":"2023-07-12T02:04:03.172247+0000","last_became_active":"2023-07-12T02:03:58.168799+0000","last_became_peered":"2023-07-12T02:03:58.168799+0000","last_unstale":"2023-07-12T02:04:03.172247+0000","last_undegraded":"2023-07-12T02:04:03.172247+0000","last_fullsized":"2023-07-12T02:04:03.172247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:44:58.898911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173850+0000","last_change":"2023-07-12T02:04:02.190747+0000","last_active":"2023-07-12T02:04:03.173850+0000","last_peered":"2023-07-12T02:04:03.173850+0000","last_clean":"2023-07-12T02:04:03.173850+0000","last_became_active":"2023-07-12T02:04:02.190302+0000","last_became_peered":"2023-07-12T02:04:02.190302+0000","last_unstale":"2023-07-12T02:04:03.173850+0000","last_undegraded":"2023-07-12T02:04:03.173850+0000","last_fullsized":"2023-07-12T02:04:03.173850+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:33:37.078500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706960+0000","last_change":"2023-07-12T02:03:57.146313+0000","last_active":"2023-07-12T02:04:03.706960+0000","last_peered":"2023-07-12T02:04:03.706960+0000","last_clean":"2023-07-12T02:04:03.706960+0000","last_became_active":"2023-07-12T02:03:57.146009+0000","last_became_peered":"2023-07-12T02:03:57.146009+0000","last_unstale":"2023-07-12T02:04:03.706960+0000","last_undegraded":"2023-07-12T02:04:03.706960+0000","last_fullsized":"2023-07-12T02:04:03.706960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:07.276570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173066+0000","last_change":"2023-07-12T02:03:58.152369+0000","last_active":"2023-07-12T02:04:03.173066+0000","last_peered":"2023-07-12T02:04:03.173066+0000","last_clean":"2023-07-12T02:04:03.173066+0000","last_became_active":"2023-07-12T02:03:58.152135+0000","last_became_peered":"2023-07-12T02:03:58.152135+0000","last_unstale":"2023-07-12T02:04:03.173066+0000","last_undegraded":"2023-07-12T02:04:03.173066+0000","last_fullsized":"2023-07-12T02:04:03.173066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:50:41.194014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706141+0000","last_change":"2023-07-12T02:04:02.197112+0000","last_active":"2023-07-12T02:04:03.706141+0000","last_peered":"2023-07-12T02:04:03.706141+0000","last_clean":"2023-07-12T02:04:03.706141+0000","last_became_active":"2023-07-12T02:04:02.196690+0000","last_became_peered":"2023-07-12T02:04:02.196690+0000","last_unstale":"2023-07-12T02:04:03.706141+0000","last_undegraded":"2023-07-12T02:04:03.706141+0000","last_fullsized":"2023-07-12T02:04:03.706141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:13:26.428845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707558+0000","last_change":"2023-07-12T02:03:57.142419+0000","last_active":"2023-07-12T02:04:03.707558+0000","last_peered":"2023-07-12T02:04:03.707558+0000","last_clean":"2023-07-12T02:04:03.707558+0000","last_became_active":"2023-07-12T02:03:57.142100+0000","last_became_peered":"2023-07-12T02:03:57.142100+0000","last_unstale":"2023-07-12T02:04:03.707558+0000","last_undegraded":"2023-07-12T02:04:03.707558+0000","last_fullsized":"2023-07-12T02:04:03.707558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:56:37.546908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173901+0000","last_change":"2023-07-12T02:03:58.139451+0000","last_active":"2023-07-12T02:04:03.173901+0000","last_peered":"2023-07-12T02:04:03.173901+0000","last_clean":"2023-07-12T02:04:03.173901+0000","last_became_active":"2023-07-12T02:03:58.139177+0000","last_became_peered":"2023-07-12T02:03:58.139177+0000","last_unstale":"2023-07-12T02:04:03.173901+0000","last_undegraded":"2023-07-12T02:04:03.173901+0000","last_fullsized":"2023-07-12T02:04:03.173901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:55:54.389650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707633+0000","last_change":"2023-07-12T02:04:02.195542+0000","last_active":"2023-07-12T02:04:03.707633+0000","last_peered":"2023-07-12T02:04:03.707633+0000","last_clean":"2023-07-12T02:04:03.707633+0000","last_became_active":"2023-07-12T02:04:02.195110+0000","last_became_peered":"2023-07-12T02:04:02.195110+0000","last_unstale":"2023-07-12T02:04:03.707633+0000","last_undegraded":"2023-07-12T02:04:03.707633+0000","last_fullsized":"2023-07-12T02:04:03.707633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:12.327958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172725+0000","last_change":"2023-07-12T02:03:57.139384+0000","last_active":"2023-07-12T02:04:03.172725+0000","last_peered":"2023-07-12T02:04:03.172725+0000","last_clean":"2023-07-12T02:04:03.172725+0000","last_became_active":"2023-07-12T02:03:57.139029+0000","last_became_peered":"2023-07-12T02:03:57.139029+0000","last_unstale":"2023-07-12T02:04:03.172725+0000","last_undegraded":"2023-07-12T02:04:03.172725+0000","last_fullsized":"2023-07-12T02:04:03.172725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:49:26.937527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174239+0000","last_change":"2023-07-12T02:03:58.147472+0000","last_active":"2023-07-12T02:04:03.174239+0000","last_peered":"2023-07-12T02:04:03.174239+0000","last_clean":"2023-07-12T02:04:03.174239+0000","last_became_active":"2023-07-12T02:03:58.147122+0000","last_became_peered":"2023-07-12T02:03:58.147122+0000","last_unstale":"2023-07-12T02:04:03.174239+0000","last_undegraded":"2023-07-12T02:04:03.174239+0000","last_fullsized":"2023-07-12T02:04:03.174239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:01:36.223649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174157+0000","last_change":"2023-07-12T02:04:02.198219+0000","last_active":"2023-07-12T02:04:03.174157+0000","last_peered":"2023-07-12T02:04:03.174157+0000","last_clean":"2023-07-12T02:04:03.174157+0000","last_became_active":"2023-07-12T02:04:02.197795+0000","last_became_peered":"2023-07-12T02:04:02.197795+0000","last_unstale":"2023-07-12T02:04:03.174157+0000","last_undegraded":"2023-07-12T02:04:03.174157+0000","last_fullsized":"2023-07-12T02:04:03.174157+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:34:25.707588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706092+0000","last_change":"2023-07-12T02:03:57.135818+0000","last_active":"2023-07-12T02:04:03.706092+0000","last_peered":"2023-07-12T02:04:03.706092+0000","last_clean":"2023-07-12T02:04:03.706092+0000","last_became_active":"2023-07-12T02:03:57.135457+0000","last_became_peered":"2023-07-12T02:03:57.135457+0000","last_unstale":"2023-07-12T02:04:03.706092+0000","last_undegraded":"2023-07-12T02:04:03.706092+0000","last_fullsized":"2023-07-12T02:04:03.706092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:20.831039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706991+0000","last_change":"2023-07-12T02:03:58.167298+0000","last_active":"2023-07-12T02:04:03.706991+0000","last_peered":"2023-07-12T02:04:03.706991+0000","last_clean":"2023-07-12T02:04:03.706991+0000","last_became_active":"2023-07-12T02:03:58.166301+0000","last_became_peered":"2023-07-12T02:03:58.166301+0000","last_unstale":"2023-07-12T02:04:03.706991+0000","last_undegraded":"2023-07-12T02:04:03.706991+0000","last_fullsized":"2023-07-12T02:04:03.706991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:37.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171935+0000","last_change":"2023-07-12T02:04:02.200517+0000","last_active":"2023-07-12T02:04:03.171935+0000","last_peered":"2023-07-12T02:04:03.171935+0000","last_clean":"2023-07-12T02:04:03.171935+0000","last_became_active":"2023-07-12T02:04:02.200076+0000","last_became_peered":"2023-07-12T02:04:02.200076+0000","last_unstale":"2023-07-12T02:04:03.171935+0000","last_undegraded":"2023-07-12T02:04:03.171935+0000","last_fullsized":"2023-07-12T02:04:03.171935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:15:25.437127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706448+0000","last_change":"2023-07-12T02:03:52.304302+0000","last_active":"2023-07-12T02:04:03.706448+0000","last_peered":"2023-07-12T02:04:03.706448+0000","last_clean":"2023-07-12T02:04:03.706448+0000","last_became_active":"2023-07-12T02:03:52.303905+0000","last_became_peered":"2023-07-12T02:03:52.303905+0000","last_unstale":"2023-07-12T02:04:03.706448+0000","last_undegraded":"2023-07-12T02:04:03.706448+0000","last_fullsized":"2023-07-12T02:04:03.706448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:06.990537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707239+0000","last_change":"2023-07-12T02:03:57.141396+0000","last_active":"2023-07-12T02:04:03.707239+0000","last_peered":"2023-07-12T02:04:03.707239+0000","last_clean":"2023-07-12T02:04:03.707239+0000","last_became_active":"2023-07-12T02:03:57.141107+0000","last_became_peered":"2023-07-12T02:03:57.141107+0000","last_unstale":"2023-07-12T02:04:03.707239+0000","last_undegraded":"2023-07-12T02:04:03.707239+0000","last_fullsized":"2023-07-12T02:04:03.707239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:04.236723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707745+0000","last_change":"2023-07-12T02:03:58.159883+0000","last_active":"2023-07-12T02:04:03.707745+0000","last_peered":"2023-07-12T02:04:03.707745+0000","last_clean":"2023-07-12T02:04:03.707745+0000","last_became_active":"2023-07-12T02:03:58.159572+0000","last_became_peered":"2023-07-12T02:03:58.159572+0000","last_unstale":"2023-07-12T02:04:03.707745+0000","last_undegraded":"2023-07-12T02:04:03.707745+0000","last_fullsized":"2023-07-12T02:04:03.707745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:44:58.898911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171927+0000","last_change":"2023-07-12T02:04:02.205064+0000","last_active":"2023-07-12T02:04:03.171927+0000","last_peered":"2023-07-12T02:04:03.171927+0000","last_clean":"2023-07-12T02:04:03.171927+0000","last_became_active":"2023-07-12T02:04:02.204597+0000","last_became_peered":"2023-07-12T02:04:02.204597+0000","last_unstale":"2023-07-12T02:04:03.171927+0000","last_undegraded":"2023-07-12T02:04:03.171927+0000","last_fullsized":"2023-07-12T02:04:03.171927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:04:41.043396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706758+0000","last_change":"2023-07-12T02:03:51.909547+0000","last_active":"2023-07-12T02:04:03.706758+0000","last_peered":"2023-07-12T02:04:03.706758+0000","last_clean":"2023-07-12T02:04:03.706758+0000","last_became_active":"2023-07-12T02:03:51.909159+0000","last_became_peered":"2023-07-12T02:03:51.909159+0000","last_unstale":"2023-07-12T02:04:03.706758+0000","last_undegraded":"2023-07-12T02:04:03.706758+0000","last_fullsized":"2023-07-12T02:04:03.706758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:33.734016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173368+0000","last_change":"2023-07-12T02:03:57.150988+0000","last_active":"2023-07-12T02:04:03.173368+0000","last_peered":"2023-07-12T02:04:03.173368+0000","last_clean":"2023-07-12T02:04:03.173368+0000","last_became_active":"2023-07-12T02:03:57.150659+0000","last_became_peered":"2023-07-12T02:03:57.150659+0000","last_unstale":"2023-07-12T02:04:03.173368+0000","last_undegraded":"2023-07-12T02:04:03.173368+0000","last_fullsized":"2023-07-12T02:04:03.173368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:07:48.765025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706282+0000","last_change":"2023-07-12T02:03:58.163335+0000","last_active":"2023-07-12T02:04:03.706282+0000","last_peered":"2023-07-12T02:04:03.706282+0000","last_clean":"2023-07-12T02:04:03.706282+0000","last_became_active":"2023-07-12T02:03:58.163047+0000","last_became_peered":"2023-07-12T02:03:58.163047+0000","last_unstale":"2023-07-12T02:04:03.706282+0000","last_undegraded":"2023-07-12T02:04:03.706282+0000","last_fullsized":"2023-07-12T02:04:03.706282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:53:40.589737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174096+0000","last_change":"2023-07-12T02:04:02.191793+0000","last_active":"2023-07-12T02:04:03.174096+0000","last_peered":"2023-07-12T02:04:03.174096+0000","last_clean":"2023-07-12T02:04:03.174096+0000","last_became_active":"2023-07-12T02:04:02.191370+0000","last_became_peered":"2023-07-12T02:04:02.191370+0000","last_unstale":"2023-07-12T02:04:03.174096+0000","last_undegraded":"2023-07-12T02:04:03.174096+0000","last_fullsized":"2023-07-12T02:04:03.174096+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:49:03.729087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173175+0000","last_change":"2023-07-12T02:03:51.904989+0000","last_active":"2023-07-12T02:04:03.173175+0000","last_peered":"2023-07-12T02:04:03.173175+0000","last_clean":"2023-07-12T02:04:03.173175+0000","last_became_active":"2023-07-12T02:03:51.904497+0000","last_became_peered":"2023-07-12T02:03:51.904497+0000","last_unstale":"2023-07-12T02:04:03.173175+0000","last_undegraded":"2023-07-12T02:04:03.173175+0000","last_fullsized":"2023-07-12T02:04:03.173175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:51:27.688647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706336+0000","last_change":"2023-07-12T02:03:57.141921+0000","last_active":"2023-07-12T02:04:03.706336+0000","last_peered":"2023-07-12T02:04:03.706336+0000","last_clean":"2023-07-12T02:04:03.706336+0000","last_became_active":"2023-07-12T02:03:57.141617+0000","last_became_peered":"2023-07-12T02:03:57.141617+0000","last_unstale":"2023-07-12T02:04:03.706336+0000","last_undegraded":"2023-07-12T02:04:03.706336+0000","last_fullsized":"2023-07-12T02:04:03.706336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:57:56.465849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706855+0000","last_change":"2023-07-12T02:03:58.167642+0000","last_active":"2023-07-12T02:04:03.706855+0000","last_peered":"2023-07-12T02:04:03.706855+0000","last_clean":"2023-07-12T02:04:03.706855+0000","last_became_active":"2023-07-12T02:03:58.166984+0000","last_became_peered":"2023-07-12T02:03:58.166984+0000","last_unstale":"2023-07-12T02:04:03.706855+0000","last_undegraded":"2023-07-12T02:04:03.706855+0000","last_fullsized":"2023-07-12T02:04:03.706855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:52.656557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589980+0000","last_change":"2023-07-12T02:04:02.198255+0000","last_active":"2023-07-12T02:04:03.589980+0000","last_peered":"2023-07-12T02:04:03.589980+0000","last_clean":"2023-07-12T02:04:03.589980+0000","last_became_active":"2023-07-12T02:04:02.197843+0000","last_became_peered":"2023-07-12T02:04:02.197843+0000","last_unstale":"2023-07-12T02:04:03.589980+0000","last_undegraded":"2023-07-12T02:04:03.589980+0000","last_fullsized":"2023-07-12T02:04:03.589980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:58:21.161390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707028+0000","last_change":"2023-07-12T02:03:51.909324+0000","last_active":"2023-07-12T02:04:03.707028+0000","last_peered":"2023-07-12T02:04:03.707028+0000","last_clean":"2023-07-12T02:04:03.707028+0000","last_became_active":"2023-07-12T02:03:51.908982+0000","last_became_peered":"2023-07-12T02:03:51.908982+0000","last_unstale":"2023-07-12T02:04:03.707028+0000","last_undegraded":"2023-07-12T02:04:03.707028+0000","last_fullsized":"2023-07-12T02:04:03.707028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:31.138300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589719+0000","last_change":"2023-07-12T02:03:44.783225+0000","last_active":"2023-07-12T02:04:03.589719+0000","last_peered":"2023-07-12T02:04:03.589719+0000","last_clean":"2023-07-12T02:04:03.589719+0000","last_became_active":"2023-07-12T02:03:44.782048+0000","last_became_peered":"2023-07-12T02:03:44.782048+0000","last_unstale":"2023-07-12T02:04:03.589719+0000","last_undegraded":"2023-07-12T02:04:03.589719+0000","last_fullsized":"2023-07-12T02:04:03.589719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:43.565472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:43.565472+0000","last_clean_scrub_stamp":"2023-07-12T02:03:43.565472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:08.293722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707366+0000","last_change":"2023-07-12T02:03:57.139490+0000","last_active":"2023-07-12T02:04:03.707366+0000","last_peered":"2023-07-12T02:04:03.707366+0000","last_clean":"2023-07-12T02:04:03.707366+0000","last_became_active":"2023-07-12T02:03:57.139072+0000","last_became_peered":"2023-07-12T02:03:57.139072+0000","last_unstale":"2023-07-12T02:04:03.707366+0000","last_undegraded":"2023-07-12T02:04:03.707366+0000","last_fullsized":"2023-07-12T02:04:03.707366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:38:29.157627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707565+0000","last_change":"2023-07-12T02:03:58.154809+0000","last_active":"2023-07-12T02:04:03.707565+0000","last_peered":"2023-07-12T02:04:03.707565+0000","last_clean":"2023-07-12T02:04:03.707565+0000","last_became_active":"2023-07-12T02:03:58.154559+0000","last_became_peered":"2023-07-12T02:03:58.154559+0000","last_unstale":"2023-07-12T02:04:03.707565+0000","last_undegraded":"2023-07-12T02:04:03.707565+0000","last_fullsized":"2023-07-12T02:04:03.707565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:46:33.480535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707383+0000","last_change":"2023-07-12T02:04:02.197503+0000","last_active":"2023-07-12T02:04:03.707383+0000","last_peered":"2023-07-12T02:04:03.707383+0000","last_clean":"2023-07-12T02:04:03.707383+0000","last_became_active":"2023-07-12T02:04:02.197064+0000","last_became_peered":"2023-07-12T02:04:02.197064+0000","last_unstale":"2023-07-12T02:04:03.707383+0000","last_undegraded":"2023-07-12T02:04:03.707383+0000","last_fullsized":"2023-07-12T02:04:03.707383+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:18.923707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590089+0000","last_change":"2023-07-12T02:03:51.909395+0000","last_active":"2023-07-12T02:04:03.590089+0000","last_peered":"2023-07-12T02:04:03.590089+0000","last_clean":"2023-07-12T02:04:03.590089+0000","last_became_active":"2023-07-12T02:03:51.909125+0000","last_became_peered":"2023-07-12T02:03:51.909125+0000","last_unstale":"2023-07-12T02:04:03.590089+0000","last_undegraded":"2023-07-12T02:04:03.590089+0000","last_fullsized":"2023-07-12T02:04:03.590089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:15:15.169698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171436+0000","last_change":"2023-07-12T02:03:57.150059+0000","last_active":"2023-07-12T02:04:03.171436+0000","last_peered":"2023-07-12T02:04:03.171436+0000","last_clean":"2023-07-12T02:04:03.171436+0000","last_became_active":"2023-07-12T02:03:57.149751+0000","last_became_peered":"2023-07-12T02:03:57.149751+0000","last_unstale":"2023-07-12T02:04:03.171436+0000","last_undegraded":"2023-07-12T02:04:03.171436+0000","last_fullsized":"2023-07-12T02:04:03.171436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:53:41.149722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172171+0000","last_change":"2023-07-12T02:03:58.168413+0000","last_active":"2023-07-12T02:04:03.172171+0000","last_peered":"2023-07-12T02:04:03.172171+0000","last_clean":"2023-07-12T02:04:03.172171+0000","last_became_active":"2023-07-12T02:03:58.168106+0000","last_became_peered":"2023-07-12T02:03:58.168106+0000","last_unstale":"2023-07-12T02:04:03.172171+0000","last_undegraded":"2023-07-12T02:04:03.172171+0000","last_fullsized":"2023-07-12T02:04:03.172171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:52.156977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707401+0000","last_change":"2023-07-12T02:04:02.197727+0000","last_active":"2023-07-12T02:04:03.707401+0000","last_peered":"2023-07-12T02:04:03.707401+0000","last_clean":"2023-07-12T02:04:03.707401+0000","last_became_active":"2023-07-12T02:04:02.197340+0000","last_became_peered":"2023-07-12T02:04:02.197340+0000","last_unstale":"2023-07-12T02:04:03.707401+0000","last_undegraded":"2023-07-12T02:04:03.707401+0000","last_fullsized":"2023-07-12T02:04:03.707401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:01:54.191121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590364+0000","last_change":"2023-07-12T02:03:52.304880+0000","last_active":"2023-07-12T02:04:03.590364+0000","last_peered":"2023-07-12T02:04:03.590364+0000","last_clean":"2023-07-12T02:04:03.590364+0000","last_became_active":"2023-07-12T02:03:52.304598+0000","last_became_peered":"2023-07-12T02:03:52.304598+0000","last_unstale":"2023-07-12T02:04:03.590364+0000","last_undegraded":"2023-07-12T02:04:03.590364+0000","last_fullsized":"2023-07-12T02:04:03.590364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:30:38.554090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706579+0000","last_change":"2023-07-12T02:03:57.134671+0000","last_active":"2023-07-12T02:04:03.706579+0000","last_peered":"2023-07-12T02:04:03.706579+0000","last_clean":"2023-07-12T02:04:03.706579+0000","last_became_active":"2023-07-12T02:03:57.134319+0000","last_became_peered":"2023-07-12T02:03:57.134319+0000","last_unstale":"2023-07-12T02:04:03.706579+0000","last_undegraded":"2023-07-12T02:04:03.706579+0000","last_fullsized":"2023-07-12T02:04:03.706579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:21.026700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172428+0000","last_change":"2023-07-12T02:03:58.158643+0000","last_active":"2023-07-12T02:04:03.172428+0000","last_peered":"2023-07-12T02:04:03.172428+0000","last_clean":"2023-07-12T02:04:03.172428+0000","last_became_active":"2023-07-12T02:03:58.158356+0000","last_became_peered":"2023-07-12T02:03:58.158356+0000","last_unstale":"2023-07-12T02:04:03.172428+0000","last_undegraded":"2023-07-12T02:04:03.172428+0000","last_fullsized":"2023-07-12T02:04:03.172428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:37:27.430690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173232+0000","last_change":"2023-07-12T02:04:02.198751+0000","last_active":"2023-07-12T02:04:03.173232+0000","last_peered":"2023-07-12T02:04:03.173232+0000","last_clean":"2023-07-12T02:04:03.173232+0000","last_became_active":"2023-07-12T02:04:02.198369+0000","last_became_peered":"2023-07-12T02:04:02.198369+0000","last_unstale":"2023-07-12T02:04:03.173232+0000","last_undegraded":"2023-07-12T02:04:03.173232+0000","last_fullsized":"2023-07-12T02:04:03.173232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:36:39.188205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707404+0000","last_change":"2023-07-12T02:03:57.140454+0000","last_active":"2023-07-12T02:04:03.707404+0000","last_peered":"2023-07-12T02:04:03.707404+0000","last_clean":"2023-07-12T02:04:03.707404+0000","last_became_active":"2023-07-12T02:03:57.140085+0000","last_became_peered":"2023-07-12T02:03:57.140085+0000","last_unstale":"2023-07-12T02:04:03.707404+0000","last_undegraded":"2023-07-12T02:04:03.707404+0000","last_fullsized":"2023-07-12T02:04:03.707404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:31:40.528381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706901+0000","last_change":"2023-07-12T02:03:51.906406+0000","last_active":"2023-07-12T02:04:03.706901+0000","last_peered":"2023-07-12T02:04:03.706901+0000","last_clean":"2023-07-12T02:04:03.706901+0000","last_became_active":"2023-07-12T02:03:51.905875+0000","last_became_peered":"2023-07-12T02:03:51.905875+0000","last_unstale":"2023-07-12T02:04:03.706901+0000","last_undegraded":"2023-07-12T02:04:03.706901+0000","last_fullsized":"2023-07-12T02:04:03.706901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:33.734016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.705982+0000","last_change":"2023-07-12T02:03:58.156488+0000","last_active":"2023-07-12T02:04:03.705982+0000","last_peered":"2023-07-12T02:04:03.705982+0000","last_clean":"2023-07-12T02:04:03.705982+0000","last_became_active":"2023-07-12T02:03:58.155960+0000","last_became_peered":"2023-07-12T02:03:58.155960+0000","last_unstale":"2023-07-12T02:04:03.705982+0000","last_undegraded":"2023-07-12T02:04:03.705982+0000","last_fullsized":"2023-07-12T02:04:03.705982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:37.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.705926+0000","last_change":"2023-07-12T02:04:02.198638+0000","last_active":"2023-07-12T02:04:03.705926+0000","last_peered":"2023-07-12T02:04:03.705926+0000","last_clean":"2023-07-12T02:04:03.705926+0000","last_became_active":"2023-07-12T02:04:02.198244+0000","last_became_peered":"2023-07-12T02:04:02.198244+0000","last_unstale":"2023-07-12T02:04:03.705926+0000","last_undegraded":"2023-07-12T02:04:03.705926+0000","last_fullsized":"2023-07-12T02:04:03.705926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:44.001444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.708048+0000","last_change":"2023-07-12T02:03:51.908137+0000","last_active":"2023-07-12T02:04:03.708048+0000","last_peered":"2023-07-12T02:04:03.708048+0000","last_clean":"2023-07-12T02:04:03.708048+0000","last_became_active":"2023-07-12T02:03:51.907900+0000","last_became_peered":"2023-07-12T02:03:51.907900+0000","last_unstale":"2023-07-12T02:04:03.708048+0000","last_undegraded":"2023-07-12T02:04:03.708048+0000","last_fullsized":"2023-07-12T02:04:03.708048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:04:38.301609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171901+0000","last_change":"2023-07-12T02:03:57.148723+0000","last_active":"2023-07-12T02:04:03.171901+0000","last_peered":"2023-07-12T02:04:03.171901+0000","last_clean":"2023-07-12T02:04:03.171901+0000","last_became_active":"2023-07-12T02:03:57.148402+0000","last_became_peered":"2023-07-12T02:03:57.148402+0000","last_unstale":"2023-07-12T02:04:03.171901+0000","last_undegraded":"2023-07-12T02:04:03.171901+0000","last_fullsized":"2023-07-12T02:04:03.171901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:51.649402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172813+0000","last_change":"2023-07-12T02:03:58.146752+0000","last_active":"2023-07-12T02:04:03.172813+0000","last_peered":"2023-07-12T02:04:03.172813+0000","last_clean":"2023-07-12T02:04:03.172813+0000","last_became_active":"2023-07-12T02:03:58.146475+0000","last_became_peered":"2023-07-12T02:03:58.146475+0000","last_unstale":"2023-07-12T02:04:03.172813+0000","last_undegraded":"2023-07-12T02:04:03.172813+0000","last_fullsized":"2023-07-12T02:04:03.172813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:18.127189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707349+0000","last_change":"2023-07-12T02:04:02.197112+0000","last_active":"2023-07-12T02:04:03.707349+0000","last_peered":"2023-07-12T02:04:03.707349+0000","last_clean":"2023-07-12T02:04:03.707349+0000","last_became_active":"2023-07-12T02:04:02.196665+0000","last_became_peered":"2023-07-12T02:04:02.196665+0000","last_unstale":"2023-07-12T02:04:03.707349+0000","last_undegraded":"2023-07-12T02:04:03.707349+0000","last_fullsized":"2023-07-12T02:04:03.707349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:25.882427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172383+0000","last_change":"2023-07-12T02:03:57.149946+0000","last_active":"2023-07-12T02:04:03.172383+0000","last_peered":"2023-07-12T02:04:03.172383+0000","last_clean":"2023-07-12T02:04:03.172383+0000","last_became_active":"2023-07-12T02:03:57.149707+0000","last_became_peered":"2023-07-12T02:03:57.149707+0000","last_unstale":"2023-07-12T02:04:03.172383+0000","last_undegraded":"2023-07-12T02:04:03.172383+0000","last_fullsized":"2023-07-12T02:04:03.172383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:13.872319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173635+0000","last_change":"2023-07-12T02:03:58.153412+0000","last_active":"2023-07-12T02:04:03.173635+0000","last_peered":"2023-07-12T02:04:03.173635+0000","last_clean":"2023-07-12T02:04:03.173635+0000","last_became_active":"2023-07-12T02:03:58.153116+0000","last_became_peered":"2023-07-12T02:03:58.153116+0000","last_unstale":"2023-07-12T02:04:03.173635+0000","last_undegraded":"2023-07-12T02:04:03.173635+0000","last_fullsized":"2023-07-12T02:04:03.173635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:37:03.495726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590052+0000","last_change":"2023-07-12T02:04:02.192659+0000","last_active":"2023-07-12T02:04:03.590052+0000","last_peered":"2023-07-12T02:04:03.590052+0000","last_clean":"2023-07-12T02:04:03.590052+0000","last_became_active":"2023-07-12T02:04:02.192139+0000","last_became_peered":"2023-07-12T02:04:02.192139+0000","last_unstale":"2023-07-12T02:04:03.590052+0000","last_undegraded":"2023-07-12T02:04:03.590052+0000","last_fullsized":"2023-07-12T02:04:03.590052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:18.923707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707093+0000","last_change":"2023-07-12T02:03:57.140042+0000","last_active":"2023-07-12T02:04:03.707093+0000","last_peered":"2023-07-12T02:04:03.707093+0000","last_clean":"2023-07-12T02:04:03.707093+0000","last_became_active":"2023-07-12T02:03:57.139652+0000","last_became_peered":"2023-07-12T02:03:57.139652+0000","last_unstale":"2023-07-12T02:04:03.707093+0000","last_undegraded":"2023-07-12T02:04:03.707093+0000","last_fullsized":"2023-07-12T02:04:03.707093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:51.149821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173207+0000","last_change":"2023-07-12T02:03:58.152883+0000","last_active":"2023-07-12T02:04:03.173207+0000","last_peered":"2023-07-12T02:04:03.173207+0000","last_clean":"2023-07-12T02:04:03.173207+0000","last_became_active":"2023-07-12T02:03:58.152591+0000","last_became_peered":"2023-07-12T02:03:58.152591+0000","last_unstale":"2023-07-12T02:04:03.173207+0000","last_undegraded":"2023-07-12T02:04:03.173207+0000","last_fullsized":"2023-07-12T02:04:03.173207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:07:57.297802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707002+0000","last_change":"2023-07-12T02:04:02.198913+0000","last_active":"2023-07-12T02:04:03.707002+0000","last_peered":"2023-07-12T02:04:03.707002+0000","last_clean":"2023-07-12T02:04:03.707002+0000","last_became_active":"2023-07-12T02:04:02.198553+0000","last_became_peered":"2023-07-12T02:04:02.198553+0000","last_unstale":"2023-07-12T02:04:03.707002+0000","last_undegraded":"2023-07-12T02:04:03.707002+0000","last_fullsized":"2023-07-12T02:04:03.707002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:45:02.943144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707838+0000","last_change":"2023-07-12T02:03:57.136048+0000","last_active":"2023-07-12T02:04:03.707838+0000","last_peered":"2023-07-12T02:04:03.707838+0000","last_clean":"2023-07-12T02:04:03.707838+0000","last_became_active":"2023-07-12T02:03:57.135728+0000","last_became_peered":"2023-07-12T02:03:57.135728+0000","last_unstale":"2023-07-12T02:04:03.707838+0000","last_undegraded":"2023-07-12T02:04:03.707838+0000","last_fullsized":"2023-07-12T02:04:03.707838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:19:50.614981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172897+0000","last_change":"2023-07-12T02:03:58.151134+0000","last_active":"2023-07-12T02:04:03.172897+0000","last_peered":"2023-07-12T02:04:03.172897+0000","last_clean":"2023-07-12T02:04:03.172897+0000","last_became_active":"2023-07-12T02:03:58.150880+0000","last_became_peered":"2023-07-12T02:03:58.150880+0000","last_unstale":"2023-07-12T02:04:03.172897+0000","last_undegraded":"2023-07-12T02:04:03.172897+0000","last_fullsized":"2023-07-12T02:04:03.172897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:04:26.740269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172701+0000","last_change":"2023-07-12T02:04:02.195039+0000","last_active":"2023-07-12T02:04:03.172701+0000","last_peered":"2023-07-12T02:04:03.172701+0000","last_clean":"2023-07-12T02:04:03.172701+0000","last_became_active":"2023-07-12T02:04:02.194199+0000","last_became_peered":"2023-07-12T02:04:02.194199+0000","last_unstale":"2023-07-12T02:04:03.172701+0000","last_undegraded":"2023-07-12T02:04:03.172701+0000","last_fullsized":"2023-07-12T02:04:03.172701+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:31:45.579769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706482+0000","last_change":"2023-07-12T02:03:57.135710+0000","last_active":"2023-07-12T02:04:03.706482+0000","last_peered":"2023-07-12T02:04:03.706482+0000","last_clean":"2023-07-12T02:04:03.706482+0000","last_became_active":"2023-07-12T02:03:57.135435+0000","last_became_peered":"2023-07-12T02:03:57.135435+0000","last_unstale":"2023-07-12T02:04:03.706482+0000","last_undegraded":"2023-07-12T02:04:03.706482+0000","last_fullsized":"2023-07-12T02:04:03.706482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:58:16.110002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706668+0000","last_change":"2023-07-12T02:03:58.150539+0000","last_active":"2023-07-12T02:04:03.706668+0000","last_peered":"2023-07-12T02:04:03.706668+0000","last_clean":"2023-07-12T02:04:03.706668+0000","last_became_active":"2023-07-12T02:03:58.150195+0000","last_became_peered":"2023-07-12T02:03:58.150195+0000","last_unstale":"2023-07-12T02:04:03.706668+0000","last_undegraded":"2023-07-12T02:04:03.706668+0000","last_fullsized":"2023-07-12T02:04:03.706668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:14.879474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706643+0000","last_change":"2023-07-12T02:04:02.198230+0000","last_active":"2023-07-12T02:04:03.706643+0000","last_peered":"2023-07-12T02:04:03.706643+0000","last_clean":"2023-07-12T02:04:03.706643+0000","last_became_active":"2023-07-12T02:04:02.197796+0000","last_became_peered":"2023-07-12T02:04:02.197796+0000","last_unstale":"2023-07-12T02:04:03.706643+0000","last_undegraded":"2023-07-12T02:04:03.706643+0000","last_fullsized":"2023-07-12T02:04:03.706643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:53:46.201110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172259+0000","last_change":"2023-07-12T02:03:57.148075+0000","last_active":"2023-07-12T02:04:03.172259+0000","last_peered":"2023-07-12T02:04:03.172259+0000","last_clean":"2023-07-12T02:04:03.172259+0000","last_became_active":"2023-07-12T02:03:57.147809+0000","last_became_peered":"2023-07-12T02:03:57.147809+0000","last_unstale":"2023-07-12T02:04:03.172259+0000","last_undegraded":"2023-07-12T02:04:03.172259+0000","last_fullsized":"2023-07-12T02:04:03.172259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:04.236723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173070+0000","last_change":"2023-07-12T02:03:58.146147+0000","last_active":"2023-07-12T02:04:03.173070+0000","last_peered":"2023-07-12T02:04:03.173070+0000","last_clean":"2023-07-12T02:04:03.173070+0000","last_became_active":"2023-07-12T02:03:58.145855+0000","last_became_peered":"2023-07-12T02:03:58.145855+0000","last_unstale":"2023-07-12T02:04:03.173070+0000","last_undegraded":"2023-07-12T02:04:03.173070+0000","last_fullsized":"2023-07-12T02:04:03.173070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:54:10.220081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706812+0000","last_change":"2023-07-12T02:03:58.165263+0000","last_active":"2023-07-12T02:04:03.706812+0000","last_peered":"2023-07-12T02:04:03.706812+0000","last_clean":"2023-07-12T02:04:03.706812+0000","last_became_active":"2023-07-12T02:03:58.164980+0000","last_became_peered":"2023-07-12T02:03:58.164980+0000","last_unstale":"2023-07-12T02:04:03.706812+0000","last_undegraded":"2023-07-12T02:04:03.706812+0000","last_fullsized":"2023-07-12T02:04:03.706812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:30:32.214383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706936+0000","last_change":"2023-07-12T02:03:58.166005+0000","last_active":"2023-07-12T02:04:03.706936+0000","last_peered":"2023-07-12T02:04:03.706936+0000","last_clean":"2023-07-12T02:04:03.706936+0000","last_became_active":"2023-07-12T02:03:58.165718+0000","last_became_peered":"2023-07-12T02:03:58.165718+0000","last_unstale":"2023-07-12T02:04:03.706936+0000","last_undegraded":"2023-07-12T02:04:03.706936+0000","last_fullsized":"2023-07-12T02:04:03.706936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:29.024675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173193+0000","last_change":"2023-07-12T02:03:58.145894+0000","last_active":"2023-07-12T02:04:03.173193+0000","last_peered":"2023-07-12T02:04:03.173193+0000","last_clean":"2023-07-12T02:04:03.173193+0000","last_became_active":"2023-07-12T02:03:58.145442+0000","last_became_peered":"2023-07-12T02:03:58.145442+0000","last_unstale":"2023-07-12T02:04:03.173193+0000","last_undegraded":"2023-07-12T02:04:03.173193+0000","last_fullsized":"2023-07-12T02:04:03.173193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:52:53.582391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707166+0000","last_change":"2023-07-12T02:03:58.156685+0000","last_active":"2023-07-12T02:04:03.707166+0000","last_peered":"2023-07-12T02:04:03.707166+0000","last_clean":"2023-07-12T02:04:03.707166+0000","last_became_active":"2023-07-12T02:03:58.156127+0000","last_became_peered":"2023-07-12T02:03:58.156127+0000","last_unstale":"2023-07-12T02:04:03.707166+0000","last_undegraded":"2023-07-12T02:04:03.707166+0000","last_fullsized":"2023-07-12T02:04:03.707166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:30:44.777286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706873+0000","last_change":"2023-07-12T02:03:58.159307+0000","last_active":"2023-07-12T02:04:03.706873+0000","last_peered":"2023-07-12T02:04:03.706873+0000","last_clean":"2023-07-12T02:04:03.706873+0000","last_became_active":"2023-07-12T02:03:58.158898+0000","last_became_peered":"2023-07-12T02:03:58.158898+0000","last_unstale":"2023-07-12T02:04:03.706873+0000","last_undegraded":"2023-07-12T02:04:03.706873+0000","last_fullsized":"2023-07-12T02:04:03.706873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:04:36.999164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":884736,"data_stored":709832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-12T02:04:27.871 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-12T02:04:27.872 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-12T02:04:27.872 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-12T02:04:27.872 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-12T02:04:27.873 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-12T02:04:28.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.101+0000 7f3f57bff700 1 Processor -- start 2023-07-12T02:04:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.101+0000 7f3f57bff700 1 -- start start 2023-07-12T02:04:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.102+0000 7f3f57bff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f500d2640 0x7f3f500b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.102+0000 7f3f57bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f500d1790 con 0x7f3f500cf8f0 2023-07-12T02:04:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.102+0000 7f3f57bff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f500cd950 con 0x7f3f5015c460 2023-07-12T02:04:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.102+0000 7f3f57bff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500cedd0 con 0x7f3f500d2640 2023-07-12T02:04:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.102+0000 7f3f5619c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3f500cf8f0 0x7f3f5015fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48544/0 (socket says 172.21.15.37:48544) 2023-07-12T02:04:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.102+0000 7f3f5619c700 1 -- 172.21.15.37:0/2272025650 learned_addr learned my addr 172.21.15.37:0/2272025650 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:28.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.102+0000 7f3f5519a700 1 --2- 172.21.15.37:0/2272025650 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f500d2640 0x7f3f500b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:28.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.103+0000 7f3f54999700 1 -- 172.21.15.37:0/2272025650 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603108165 0 0) 0x7f3f500d1790 con 0x7f3f500cf8f0 2023-07-12T02:04:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.103+0000 7f3f54999700 1 -- 172.21.15.37:0/2272025650 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f3c0035b0 con 0x7f3f500cf8f0 2023-07-12T02:04:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.103+0000 7f3f5519a700 1 -- 172.21.15.37:0/2272025650 >> v1:172.21.15.196:6789/0 conn(0x7f3f5015c460 legacy=0x7f3f500cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.103+0000 7f3f54999700 1 -- 172.21.15.37:0/2272025650 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3710377317 0 0) 0x7f3f3c0035b0 con 0x7f3f500cf8f0 2023-07-12T02:04:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.103+0000 7f3f5519a700 1 -- 172.21.15.37:0/2272025650 >> v1:172.21.15.37:6789/0 conn(0x7f3f500cf8f0 legacy=0x7f3f5015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.103+0000 7f3f5519a700 1 -- 172.21.15.37:0/2272025650 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f500d14b0 con 0x7f3f500d2640 2023-07-12T02:04:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.103+0000 7f3f5519a700 1 --2- 172.21.15.37:0/2272025650 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f500d2640 0x7f3f500b59d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009870 tx=0x7f3f40009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3083a501e37e6da4 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.103+0000 7f3f54999700 1 -- 172.21.15.37:0/2272025650 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480019f0 con 0x7f3f500d2640 2023-07-12T02:04:28.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.103+0000 7f3f54999700 1 -- 172.21.15.37:0/2272025650 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f40004030 con 0x7f3f500d2640 2023-07-12T02:04:28.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.103+0000 7f3f54999700 1 -- 172.21.15.37:0/2272025650 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f400043c0 con 0x7f3f500d2640 2023-07-12T02:04:28.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.104+0000 7f3f57bff700 1 -- 172.21.15.37:0/2272025650 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f500d2640 msgr2=0x7f3f500b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:28.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.104+0000 7f3f57bff700 1 --2- 172.21.15.37:0/2272025650 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f500d2640 0x7f3f500b59d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009870 tx=0x7f3f40009b80 comp rx=0 tx=0).stop 2023-07-12T02:04:28.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.104+0000 7f3f57bff700 1 -- 172.21.15.37:0/2272025650 shutdown_connections 2023-07-12T02:04:28.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.104+0000 7f3f57bff700 1 --2- 172.21.15.37:0/2272025650 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f500d2640 0x7f3f500b59d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:28.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.104+0000 7f3f57bff700 1 -- 172.21.15.37:0/2272025650 >> 172.21.15.37:0/2272025650 conn(0x7f3f50071660 msgr2=0x7f3f50071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:28.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.104+0000 7f3f57bff700 1 -- 172.21.15.37:0/2272025650 shutdown_connections 2023-07-12T02:04:28.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.104+0000 7f3f57bff700 1 -- 172.21.15.37:0/2272025650 wait complete. 2023-07-12T02:04:28.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.106+0000 7f3f57bff700 1 Processor -- start 2023-07-12T02:04:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.107+0000 7f3f57bff700 1 -- start start 2023-07-12T02:04:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.107+0000 7f3f57bff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f500cf8f0 0x7f3f50153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f57bff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f500d2640 0x7f3f5014d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f57bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f5015c460 0x7f3f5014d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f57bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500c9230 con 0x7f3f5015c460 2023-07-12T02:04:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f57bff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500c8660 con 0x7f3f500d2640 2023-07-12T02:04:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f57bff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500c8900 con 0x7f3f500cf8f0 2023-07-12T02:04:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f5619c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f5015c460 0x7f3f5014d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f5619c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f5015c460 0x7f3f5014d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49042/0 (socket says 172.21.15.37:49042) 2023-07-12T02:04:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f5619c700 1 -- 172.21.15.37:0/4277725694 learned_addr learned my addr 172.21.15.37:0/4277725694 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f5519a700 1 --2- 172.21.15.37:0/4277725694 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f500d2640 0x7f3f5014d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f5599b700 1 --2- 172.21.15.37:0/4277725694 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f500cf8f0 0x7f3f50153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f5619c700 1 -- 172.21.15.37:0/4277725694 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f500cf8f0 msgr2=0x7f3f50153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f5619c700 1 --2- 172.21.15.37:0/4277725694 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f500cf8f0 0x7f3f50153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f5619c700 1 -- 172.21.15.37:0/4277725694 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f500d2640 msgr2=0x7f3f5014d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f5619c700 1 --2- 172.21.15.37:0/4277725694 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f500d2640 0x7f3f5014d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f5619c700 1 -- 172.21.15.37:0/4277725694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f400094a0 con 0x7f3f5015c460 2023-07-12T02:04:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f5599b700 1 --2- 172.21.15.37:0/4277725694 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f500cf8f0 0x7f3f50153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.108+0000 7f3f5619c700 1 --2- 172.21.15.37:0/4277725694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f5015c460 0x7f3f5014d5b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800cc20 tx=0x7f3f4800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.109+0000 7f3f467fc700 1 -- 172.21.15.37:0/4277725694 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800ab10 con 0x7f3f5015c460 2023-07-12T02:04:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.109+0000 7f3f467fc700 1 -- 172.21.15.37:0/4277725694 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4800ac90 con 0x7f3f5015c460 2023-07-12T02:04:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.109+0000 7f3f467fc700 1 -- 172.21.15.37:0/4277725694 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480070d0 con 0x7f3f5015c460 2023-07-12T02:04:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.109+0000 7f3f57bff700 1 -- 172.21.15.37:0/4277725694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f500c8be0 con 0x7f3f5015c460 2023-07-12T02:04:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.109+0000 7f3f57bff700 1 -- 172.21.15.37:0/4277725694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5014e3d0 con 0x7f3f5015c460 2023-07-12T02:04:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.110+0000 7f3f57bff700 1 -- 172.21.15.37:0/4277725694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f500c93a0 con 0x7f3f5015c460 2023-07-12T02:04:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.111+0000 7f3f467fc700 1 -- 172.21.15.37:0/4277725694 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f48007230 con 0x7f3f5015c460 2023-07-12T02:04:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.113+0000 7f3f467fc700 1 --2- 172.21.15.37:0/4277725694 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3f3406ace0 0x7f3f3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.113+0000 7f3f467fc700 1 -- 172.21.15.37:0/4277725694 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3f48089370 con 0x7f3f5015c460 2023-07-12T02:04:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.113+0000 7f3f5599b700 1 --2- 172.21.15.37:0/4277725694 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3f3406ace0 0x7f3f3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.114+0000 7f3f5599b700 1 --2- 172.21.15.37:0/4277725694 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3f3406ace0 0x7f3f3406d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c000f60 tx=0x7f3f4c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.117+0000 7f3f467fc700 1 -- 172.21.15.37:0/4277725694 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3f48054090 con 0x7f3f5015c460 2023-07-12T02:04:28.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.387+0000 7f3f57bff700 1 -- 172.21.15.37:0/4277725694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3f5004ea60 con 0x7f3f5015c460 2023-07-12T02:04:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.390+0000 7f3f467fc700 1 -- 172.21.15.37:0/4277725694 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170848 (secure 0 0 0) 0x7f3f480576b0 con 0x7f3f5015c460 2023-07-12T02:04:28.396 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.394+0000 7f3f57bff700 1 -- 172.21.15.37:0/4277725694 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3f3406ace0 msgr2=0x7f3f3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.394+0000 7f3f57bff700 1 --2- 172.21.15.37:0/4277725694 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3f3406ace0 0x7f3f3406d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c000f60 tx=0x7f3f4c009040 comp rx=0 tx=0).stop 2023-07-12T02:04:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.394+0000 7f3f57bff700 1 -- 172.21.15.37:0/4277725694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f5015c460 msgr2=0x7f3f5014d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.394+0000 7f3f57bff700 1 --2- 172.21.15.37:0/4277725694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f5015c460 0x7f3f5014d5b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800cc20 tx=0x7f3f4800cf30 comp rx=0 tx=0).stop 2023-07-12T02:04:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.394+0000 7f3f57bff700 1 -- 172.21.15.37:0/4277725694 shutdown_connections 2023-07-12T02:04:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.394+0000 7f3f57bff700 1 --2- 172.21.15.37:0/4277725694 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3f3406ace0 0x7f3f3406d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.394+0000 7f3f57bff700 1 --2- 172.21.15.37:0/4277725694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f5015c460 0x7f3f5014d5b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.394+0000 7f3f57bff700 1 --2- 172.21.15.37:0/4277725694 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f500cf8f0 0x7f3f50153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:28.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.394+0000 7f3f57bff700 1 --2- 172.21.15.37:0/4277725694 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f500d2640 0x7f3f5014d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:28.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.394+0000 7f3f57bff700 1 -- 172.21.15.37:0/4277725694 >> 172.21.15.37:0/4277725694 conn(0x7f3f50071660 msgr2=0x7f3f500b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:28.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.394+0000 7f3f57bff700 1 -- 172.21.15.37:0/4277725694 shutdown_connections 2023-07-12T02:04:28.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.394+0000 7f3f57bff700 1 -- 172.21.15.37:0/4277725694 wait complete. 2023-07-12T02:04:28.415 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3490435896},{"type":"v1","addr":"172.21.15.196:6833","nonce":3490435896}]},"active_addr":"172.21.15.196:6833/3490435896","active_change":"2023-07-12T02:03:37.329079+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":2291745696}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":462078374}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":3705307823}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":2925538999}]}]} 2023-07-12T02:04:28.420 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-12T02:04:28.420 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-12T02:04:28.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:04:28.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.618+0000 7f8460dff700 1 Processor -- start 2023-07-12T02:04:28.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.619+0000 7f8460dff700 1 -- start start 2023-07-12T02:04:28.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.620+0000 7f8460dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f845c0d2640 0x7f845c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:28.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.620+0000 7f8460dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c0d1790 con 0x7f845c15c460 2023-07-12T02:04:28.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.620+0000 7f8460dff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c0cd950 con 0x7f845c0cf8f0 2023-07-12T02:04:28.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.620+0000 7f8460dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c0cedd0 con 0x7f845c0d2640 2023-07-12T02:04:28.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.620+0000 7f845a59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f845c15c460 0x7f845c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48554/0 (socket says 172.21.15.37:48554) 2023-07-12T02:04:28.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.620+0000 7f845a59c700 1 -- 172.21.15.37:0/1096345799 learned_addr learned my addr 172.21.15.37:0/1096345799 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:28.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.620+0000 7f8453fff700 1 --2- 172.21.15.37:0/1096345799 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f845c0d2640 0x7f845c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:28.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.621+0000 7f8459d9b700 1 -- 172.21.15.37:0/1096345799 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837327250 0 0) 0x7f845c0d1790 con 0x7f845c15c460 2023-07-12T02:04:28.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.621+0000 7f8459d9b700 1 -- 172.21.15.37:0/1096345799 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84480035b0 con 0x7f845c15c460 2023-07-12T02:04:28.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.621+0000 7f8459d9b700 1 -- 172.21.15.37:0/1096345799 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038754547 0 0) 0x7f845c0cd950 con 0x7f845c0cf8f0 2023-07-12T02:04:28.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.621+0000 7f8459d9b700 1 -- 172.21.15.37:0/1096345799 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f845c0d1790 con 0x7f845c0cf8f0 2023-07-12T02:04:28.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.621+0000 7f8453fff700 1 -- 172.21.15.37:0/1096345799 >> v1:172.21.15.196:6789/0 conn(0x7f845c0cf8f0 legacy=0x7f845c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:28.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.621+0000 7f8453fff700 1 -- 172.21.15.37:0/1096345799 >> v1:172.21.15.37:6789/0 conn(0x7f845c15c460 legacy=0x7f845c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:28.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.621+0000 7f8453fff700 1 -- 172.21.15.37:0/1096345799 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c0d14b0 con 0x7f845c0d2640 2023-07-12T02:04:28.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.621+0000 7f8453fff700 1 --2- 172.21.15.37:0/1096345799 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f845c0d2640 0x7f845c0b59d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8444009870 tx=0x7f8444009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2de10fefee371dbc server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:28.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.621+0000 7f8459d9b700 1 -- 172.21.15.37:0/1096345799 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444011830 con 0x7f845c0d2640 2023-07-12T02:04:28.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.621+0000 7f8459d9b700 1 -- 172.21.15.37:0/1096345799 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8444011990 con 0x7f845c0d2640 2023-07-12T02:04:28.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.621+0000 7f8459d9b700 1 -- 172.21.15.37:0/1096345799 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444011d00 con 0x7f845c0d2640 2023-07-12T02:04:28.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.622+0000 7f8460dff700 1 -- 172.21.15.37:0/1096345799 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f845c0d2640 msgr2=0x7f845c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:28.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.622+0000 7f8460dff700 1 --2- 172.21.15.37:0/1096345799 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f845c0d2640 0x7f845c0b59d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8444009870 tx=0x7f8444009b80 comp rx=0 tx=0).stop 2023-07-12T02:04:28.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.622+0000 7f8460dff700 1 -- 172.21.15.37:0/1096345799 shutdown_connections 2023-07-12T02:04:28.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.622+0000 7f8460dff700 1 --2- 172.21.15.37:0/1096345799 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f845c0d2640 0x7f845c0b59d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:28.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.622+0000 7f8460dff700 1 -- 172.21.15.37:0/1096345799 >> 172.21.15.37:0/1096345799 conn(0x7f845c071660 msgr2=0x7f845c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:28.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.622+0000 7f8460dff700 1 -- 172.21.15.37:0/1096345799 shutdown_connections 2023-07-12T02:04:28.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.622+0000 7f8460dff700 1 -- 172.21.15.37:0/1096345799 wait complete. 2023-07-12T02:04:28.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.624+0000 7f8460dff700 1 Processor -- start 2023-07-12T02:04:28.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.624+0000 7f8460dff700 1 -- start start 2023-07-12T02:04:28.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.625+0000 7f8460dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f845c0cf8f0 0x7f845c14eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:28.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.625+0000 7f8460dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f845c0d2640 0x7f845c160180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:28.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.625+0000 7f8460dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f845c15c460 0x7f845c1606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:28.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.625+0000 7f8460dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c1509f0 con 0x7f845c15c460 2023-07-12T02:04:28.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.625+0000 7f8460dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c15e490 con 0x7f845c0cf8f0 2023-07-12T02:04:28.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.625+0000 7f8460dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c15e770 con 0x7f845c0d2640 2023-07-12T02:04:28.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.625+0000 7f845ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f845c15c460 0x7f845c1606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:28.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.625+0000 7f845a59c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f845c0cf8f0 0x7f845c14eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:28.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.625+0000 7f8453fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f845c0d2640 0x7f845c160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:28.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.625+0000 7f845ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f845c15c460 0x7f845c1606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49046/0 (socket says 172.21.15.37:49046) 2023-07-12T02:04:28.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.625+0000 7f845ad9d700 1 -- 172.21.15.37:0/909996576 learned_addr learned my addr 172.21.15.37:0/909996576 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:28.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.626+0000 7f845a59c700 1 -- 172.21.15.37:0/909996576 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f845c0d2640 msgr2=0x7f845c160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:28.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.626+0000 7f845a59c700 1 --2- 172.21.15.37:0/909996576 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f845c0d2640 0x7f845c160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:28.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.626+0000 7f845a59c700 1 -- 172.21.15.37:0/909996576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f845c15c460 msgr2=0x7f845c1606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:28.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.626+0000 7f845a59c700 1 --2- 172.21.15.37:0/909996576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f845c15c460 0x7f845c1606c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:28.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.626+0000 7f845a59c700 1 -- 172.21.15.37:0/909996576 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84440094a0 con 0x7f845c0cf8f0 2023-07-12T02:04:28.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.626+0000 7f845ad9d700 1 --2- 172.21.15.37:0/909996576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f845c15c460 0x7f845c1606c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:04:28.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.626+0000 7f8453fff700 1 --2- 172.21.15.37:0/909996576 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f845c0d2640 0x7f845c160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:04:28.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.626+0000 7f845a59c700 1 --2- 172.21.15.37:0/909996576 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f845c0cf8f0 0x7f845c14eb60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f844c00c4d0 tx=0x7f844c00c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:28.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.626+0000 7f8452ffd700 1 -- 172.21.15.37:0/909996576 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c005d70 con 0x7f845c0cf8f0 2023-07-12T02:04:28.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.627+0000 7f8452ffd700 1 -- 172.21.15.37:0/909996576 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c0070d0 con 0x7f845c0cf8f0 2023-07-12T02:04:28.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.627+0000 7f8460dff700 1 -- 172.21.15.37:0/909996576 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845c15ea50 con 0x7f845c0cf8f0 2023-07-12T02:04:28.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.627+0000 7f8452ffd700 1 -- 172.21.15.37:0/909996576 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c007480 con 0x7f845c0cf8f0 2023-07-12T02:04:28.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.627+0000 7f8460dff700 1 -- 172.21.15.37:0/909996576 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845c15f010 con 0x7f845c0cf8f0 2023-07-12T02:04:28.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.628+0000 7f8460dff700 1 -- 172.21.15.37:0/909996576 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845c0d1140 con 0x7f845c0cf8f0 2023-07-12T02:04:28.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.629+0000 7f8452ffd700 1 -- 172.21.15.37:0/909996576 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f844c0075e0 con 0x7f845c0cf8f0 2023-07-12T02:04:28.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.630+0000 7f8452ffd700 1 --2- 172.21.15.37:0/909996576 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f843c06ace0 0x7f843c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:28.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.630+0000 7f8452ffd700 1 -- 172.21.15.37:0/909996576 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f844c088c60 con 0x7f845c0cf8f0 2023-07-12T02:04:28.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.630+0000 7f8453fff700 1 --2- 172.21.15.37:0/909996576 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f843c06ace0 0x7f843c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:28.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.631+0000 7f8453fff700 1 --2- 172.21.15.37:0/909996576 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f843c06ace0 0x7f843c06d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f84440090b0 tx=0x7f844401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:28.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.635+0000 7f8452ffd700 1 -- 172.21.15.37:0/909996576 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f844c053b50 con 0x7f845c0cf8f0 2023-07-12T02:04:28.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.843+0000 7f8460dff700 1 -- 172.21.15.37:0/909996576 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f845c0d1140 con 0x7f845c0cf8f0 2023-07-12T02:04:28.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.846+0000 7f8452ffd700 1 -- 172.21.15.37:0/909996576 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f845c0d1140 con 0x7f845c0cf8f0 2023-07-12T02:04:28.849 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:28.849 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:02.702198+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:04:28.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.847+0000 7f8460dff700 1 -- 172.21.15.37:0/909996576 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f843c06ace0 msgr2=0x7f843c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:28.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.847+0000 7f8460dff700 1 --2- 172.21.15.37:0/909996576 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f843c06ace0 0x7f843c06d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f84440090b0 tx=0x7f844401c040 comp rx=0 tx=0).stop 2023-07-12T02:04:28.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.847+0000 7f8460dff700 1 -- 172.21.15.37:0/909996576 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f845c0cf8f0 msgr2=0x7f845c14eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:28.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.847+0000 7f8460dff700 1 --2- 172.21.15.37:0/909996576 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f845c0cf8f0 0x7f845c14eb60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f844c00c4d0 tx=0x7f844c00c7e0 comp rx=0 tx=0).stop 2023-07-12T02:04:28.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.847+0000 7f8460dff700 1 -- 172.21.15.37:0/909996576 shutdown_connections 2023-07-12T02:04:28.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.847+0000 7f8460dff700 1 --2- 172.21.15.37:0/909996576 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f843c06ace0 0x7f843c06d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:28.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.847+0000 7f8460dff700 1 --2- 172.21.15.37:0/909996576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f845c15c460 0x7f845c1606c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:28.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.847+0000 7f8460dff700 1 --2- 172.21.15.37:0/909996576 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f845c0cf8f0 0x7f845c14eb60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:28.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.847+0000 7f8460dff700 1 --2- 172.21.15.37:0/909996576 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f845c0d2640 0x7f845c160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:28.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.847+0000 7f8460dff700 1 -- 172.21.15.37:0/909996576 >> 172.21.15.37:0/909996576 conn(0x7f845c071660 msgr2=0x7f845c1574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:28.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.847+0000 7f8460dff700 1 -- 172.21.15.37:0/909996576 shutdown_connections 2023-07-12T02:04:28.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:28.847+0000 7f8460dff700 1 -- 172.21.15.37:0/909996576 wait complete. 2023-07-12T02:04:28.869 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-12T02:04:28.869 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:04:29.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.067+0000 7f0628fff700 1 Processor -- start 2023-07-12T02:04:29.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.067+0000 7f0628fff700 1 -- start start 2023-07-12T02:04:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.068+0000 7f0628fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f062415c460 0x7f06240b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.068+0000 7f0628fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06240d2640 0x7f06240cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.068+0000 7f0628fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06240d1790 con 0x7f06240cf720 2023-07-12T02:04:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.068+0000 7f0628fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06240cedd0 con 0x7f06240d2640 2023-07-12T02:04:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.068+0000 7f0628fff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06240cd950 con 0x7f062415c460 2023-07-12T02:04:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.068+0000 7f0622d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f06240cf720 0x7f06240d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48558/0 (socket says 172.21.15.37:48558) 2023-07-12T02:04:29.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.068+0000 7f0621d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06240d2640 0x7f06240cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.068+0000 7f0622d9d700 1 -- 172.21.15.37:0/2039510048 learned_addr learned my addr 172.21.15.37:0/2039510048 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:29.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.069+0000 7f062259c700 1 --2- 172.21.15.37:0/2039510048 >> v2:172.21.15.196:3300/0 conn(0x7f062415c460 0x7f06240b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.069+0000 7f062159a700 1 -- 172.21.15.37:0/2039510048 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3976151724 0 0) 0x7f06240d1790 con 0x7f06240cf720 2023-07-12T02:04:29.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.069+0000 7f062159a700 1 -- 172.21.15.37:0/2039510048 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f060c0035b0 con 0x7f06240cf720 2023-07-12T02:04:29.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.069+0000 7f0621d9b700 1 -- 172.21.15.37:0/2039510048 >> v2:172.21.15.196:3300/0 conn(0x7f062415c460 msgr2=0x7f06240b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:29.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.069+0000 7f0621d9b700 1 --2- 172.21.15.37:0/2039510048 >> v2:172.21.15.196:3300/0 conn(0x7f062415c460 0x7f06240b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.069+0000 7f0621d9b700 1 -- 172.21.15.37:0/2039510048 >> v1:172.21.15.37:6789/0 conn(0x7f06240cf720 legacy=0x7f06240d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.069+0000 7f0621d9b700 1 -- 172.21.15.37:0/2039510048 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06240d14b0 con 0x7f06240d2640 2023-07-12T02:04:29.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.069+0000 7f0621d9b700 1 --2- 172.21.15.37:0/2039510048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06240d2640 0x7f06240cf1e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f06240b4f00 tx=0x7f0618009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3238c93796fc2e server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.069+0000 7f062159a700 1 -- 172.21.15.37:0/2039510048 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618011830 con 0x7f06240d2640 2023-07-12T02:04:29.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.069+0000 7f062159a700 1 -- 172.21.15.37:0/2039510048 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0618011990 con 0x7f06240d2640 2023-07-12T02:04:29.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.069+0000 7f062159a700 1 -- 172.21.15.37:0/2039510048 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618011d20 con 0x7f06240d2640 2023-07-12T02:04:29.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.070+0000 7f0628fff700 1 -- 172.21.15.37:0/2039510048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06240d2640 msgr2=0x7f06240cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.070+0000 7f0628fff700 1 --2- 172.21.15.37:0/2039510048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06240d2640 0x7f06240cf1e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f06240b4f00 tx=0x7f0618009b20 comp rx=0 tx=0).stop 2023-07-12T02:04:29.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.070+0000 7f0628fff700 1 -- 172.21.15.37:0/2039510048 shutdown_connections 2023-07-12T02:04:29.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.070+0000 7f0628fff700 1 --2- 172.21.15.37:0/2039510048 >> v2:172.21.15.196:3300/0 conn(0x7f062415c460 0x7f06240b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.070+0000 7f0628fff700 1 --2- 172.21.15.37:0/2039510048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06240d2640 0x7f06240cf1e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.070+0000 7f0628fff700 1 -- 172.21.15.37:0/2039510048 >> 172.21.15.37:0/2039510048 conn(0x7f0624071660 msgr2=0x7f0624071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.070+0000 7f0628fff700 1 -- 172.21.15.37:0/2039510048 shutdown_connections 2023-07-12T02:04:29.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.070+0000 7f0628fff700 1 -- 172.21.15.37:0/2039510048 wait complete. 2023-07-12T02:04:29.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.072+0000 7f0628fff700 1 Processor -- start 2023-07-12T02:04:29.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.072+0000 7f0628fff700 1 -- start start 2023-07-12T02:04:29.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.073+0000 7f0628fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06240cf720 0x7f06241f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.073+0000 7f0628fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06240d2640 0x7f062415f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.073+0000 7f0628fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f062415c460 0x7f06241f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.073+0000 7f0628fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06240ca300 con 0x7f06240cf720 2023-07-12T02:04:29.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.073+0000 7f0628fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06240c9d80 con 0x7f06240d2640 2023-07-12T02:04:29.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.073+0000 7f0628fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062415f7c0 con 0x7f062415c460 2023-07-12T02:04:29.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.073+0000 7f062259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06240cf720 0x7f06241f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.073+0000 7f062259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06240cf720 0x7f06241f6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49076/0 (socket says 172.21.15.37:49076) 2023-07-12T02:04:29.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.073+0000 7f062259c700 1 -- 172.21.15.37:0/1299158577 learned_addr learned my addr 172.21.15.37:0/1299158577 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:29.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.074+0000 7f0622d9d700 1 --2- 172.21.15.37:0/1299158577 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f062415c460 0x7f06241f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.074+0000 7f0621d9b700 1 --2- 172.21.15.37:0/1299158577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06240d2640 0x7f062415f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.074+0000 7f062259c700 1 -- 172.21.15.37:0/1299158577 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f062415c460 msgr2=0x7f06241f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.074+0000 7f062259c700 1 --2- 172.21.15.37:0/1299158577 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f062415c460 0x7f06241f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.074+0000 7f062259c700 1 -- 172.21.15.37:0/1299158577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06240d2640 msgr2=0x7f062415f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.074+0000 7f062259c700 1 --2- 172.21.15.37:0/1299158577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06240d2640 0x7f062415f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.074+0000 7f062259c700 1 -- 172.21.15.37:0/1299158577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06180094a0 con 0x7f06240cf720 2023-07-12T02:04:29.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.074+0000 7f0621d9b700 1 --2- 172.21.15.37:0/1299158577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06240d2640 0x7f062415f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:29.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.074+0000 7f0622d9d700 1 --2- 172.21.15.37:0/1299158577 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f062415c460 0x7f06241f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:29.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.074+0000 7f062259c700 1 --2- 172.21.15.37:0/1299158577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06240cf720 0x7f06241f6220 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f061400e9b0 tx=0x7f061400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.074+0000 7f0612ffd700 1 -- 172.21.15.37:0/1299158577 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0614009710 con 0x7f06240cf720 2023-07-12T02:04:29.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.074+0000 7f0612ffd700 1 -- 172.21.15.37:0/1299158577 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061400c850 con 0x7f06240cf720 2023-07-12T02:04:29.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.074+0000 7f0628fff700 1 -- 172.21.15.37:0/1299158577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06240ca020 con 0x7f06240cf720 2023-07-12T02:04:29.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.075+0000 7f0612ffd700 1 -- 172.21.15.37:0/1299158577 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061400cbc0 con 0x7f06240cf720 2023-07-12T02:04:29.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.075+0000 7f0628fff700 1 -- 172.21.15.37:0/1299158577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06240ccd00 con 0x7f06240cf720 2023-07-12T02:04:29.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.076+0000 7f0628fff700 1 -- 172.21.15.37:0/1299158577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062404ea60 con 0x7f06240cf720 2023-07-12T02:04:29.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.077+0000 7f0612ffd700 1 -- 172.21.15.37:0/1299158577 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f061400cd20 con 0x7f06240cf720 2023-07-12T02:04:29.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.077+0000 7f0612ffd700 1 --2- 172.21.15.37:0/1299158577 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f060406ace0 0x7f060406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.078+0000 7f0612ffd700 1 -- 172.21.15.37:0/1299158577 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0614089890 con 0x7f06240cf720 2023-07-12T02:04:29.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.078+0000 7f0621d9b700 1 --2- 172.21.15.37:0/1299158577 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f060406ace0 0x7f060406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.079+0000 7f0621d9b700 1 --2- 172.21.15.37:0/1299158577 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f060406ace0 0x7f060406d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f06180090b0 tx=0x7f061801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.082+0000 7f0612ffd700 1 -- 172.21.15.37:0/1299158577 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f06140580d0 con 0x7f06240cf720 2023-07-12T02:04:29.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.291+0000 7f0628fff700 1 -- 172.21.15.37:0/1299158577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06240d1130 con 0x7f06240cf720 2023-07-12T02:04:29.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.292+0000 7f0612ffd700 1 -- 172.21.15.37:0/1299158577 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f0614057c60 con 0x7f06240cf720 2023-07-12T02:04:29.296 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:29.297 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:02.702198+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:04:29.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.295+0000 7f0628fff700 1 -- 172.21.15.37:0/1299158577 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f060406ace0 msgr2=0x7f060406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.295+0000 7f0628fff700 1 --2- 172.21.15.37:0/1299158577 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f060406ace0 0x7f060406d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f06180090b0 tx=0x7f061801c040 comp rx=0 tx=0).stop 2023-07-12T02:04:29.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.295+0000 7f0628fff700 1 -- 172.21.15.37:0/1299158577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06240cf720 msgr2=0x7f06241f6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.295+0000 7f0628fff700 1 --2- 172.21.15.37:0/1299158577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06240cf720 0x7f06241f6220 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f061400e9b0 tx=0x7f061400ed70 comp rx=0 tx=0).stop 2023-07-12T02:04:29.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.295+0000 7f0628fff700 1 -- 172.21.15.37:0/1299158577 shutdown_connections 2023-07-12T02:04:29.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.295+0000 7f0628fff700 1 --2- 172.21.15.37:0/1299158577 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f060406ace0 0x7f060406d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.295+0000 7f0628fff700 1 --2- 172.21.15.37:0/1299158577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06240cf720 0x7f06241f6220 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.295+0000 7f0628fff700 1 --2- 172.21.15.37:0/1299158577 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f062415c460 0x7f06241f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.295+0000 7f0628fff700 1 --2- 172.21.15.37:0/1299158577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06240d2640 0x7f062415f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.295+0000 7f0628fff700 1 -- 172.21.15.37:0/1299158577 >> 172.21.15.37:0/1299158577 conn(0x7f0624071660 msgr2=0x7f0624157180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.295+0000 7f0628fff700 1 -- 172.21.15.37:0/1299158577 shutdown_connections 2023-07-12T02:04:29.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.295+0000 7f0628fff700 1 -- 172.21.15.37:0/1299158577 wait complete. 2023-07-12T02:04:29.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-12T02:04:29.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-12T02:04:29.318 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-12T02:04:29.318 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-12T02:04:29.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-12T02:04:29.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-12T02:04:29.320 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-12T02:04:29.320 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-12T02:04:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.683+0000 7f81477ff700 1 Processor -- start 2023-07-12T02:04:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.683+0000 7f81477ff700 1 -- start start 2023-07-12T02:04:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.686+0000 7f81477ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81401606e0 0x7f81400ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.686+0000 7f81477ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8140160ab0 0x7f814006c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.686+0000 7f81477ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81400c1d30 con 0x7f81400ad710 2023-07-12T02:04:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.686+0000 7f81477ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81400ce670 con 0x7f81401606e0 2023-07-12T02:04:29.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.686+0000 7f81477ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81400cc840 con 0x7f8140160ab0 2023-07-12T02:04:29.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.687+0000 7f8144d9a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8140160ab0 0x7f814006c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.687+0000 7f8144d9a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8140160ab0 0x7f814006c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:45594/0 (socket says 172.21.15.37:45594) 2023-07-12T02:04:29.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.687+0000 7f8144d9a700 1 -- 172.21.15.37:0/1790323653 learned_addr learned my addr 172.21.15.37:0/1790323653 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:29.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.687+0000 7f814559b700 1 --2- 172.21.15.37:0/1790323653 >> v2:172.21.15.37:3300/0 conn(0x7f81401606e0 0x7f81400ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.688+0000 7f8144d9a700 1 -- 172.21.15.37:0/1790323653 >> v2:172.21.15.37:3300/0 conn(0x7f81401606e0 msgr2=0x7f81400ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.688+0000 7f8144d9a700 1 --2- 172.21.15.37:0/1790323653 >> v2:172.21.15.37:3300/0 conn(0x7f81401606e0 0x7f81400ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.688+0000 7f8144d9a700 1 -- 172.21.15.37:0/1790323653 >> v1:172.21.15.37:6789/0 conn(0x7f81400ad710 legacy=0x7f81400cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.688+0000 7f8144d9a700 1 -- 172.21.15.37:0/1790323653 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814006c930 con 0x7f8140160ab0 2023-07-12T02:04:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.688+0000 7f8144d9a700 1 --2- 172.21.15.37:0/1790323653 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8140160ab0 0x7f814006c3f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f81300098f0 tx=0x7f8130009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d9df042e19b22fe server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.689+0000 7f8137fff700 1 -- 172.21.15.37:0/1790323653 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130011830 con 0x7f8140160ab0 2023-07-12T02:04:29.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.689+0000 7f8137fff700 1 -- 172.21.15.37:0/1790323653 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8130011990 con 0x7f8140160ab0 2023-07-12T02:04:29.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.689+0000 7f8137fff700 1 -- 172.21.15.37:0/1790323653 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130011d20 con 0x7f8140160ab0 2023-07-12T02:04:29.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.690+0000 7f81477ff700 1 -- 172.21.15.37:0/1790323653 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8140160ab0 msgr2=0x7f814006c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.690+0000 7f81477ff700 1 --2- 172.21.15.37:0/1790323653 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8140160ab0 0x7f814006c3f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f81300098f0 tx=0x7f8130009c00 comp rx=0 tx=0).stop 2023-07-12T02:04:29.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.691+0000 7f81477ff700 1 -- 172.21.15.37:0/1790323653 shutdown_connections 2023-07-12T02:04:29.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.691+0000 7f81477ff700 1 --2- 172.21.15.37:0/1790323653 >> v2:172.21.15.37:3300/0 conn(0x7f81401606e0 0x7f81400ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.691+0000 7f81477ff700 1 --2- 172.21.15.37:0/1790323653 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8140160ab0 0x7f814006c3f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.691+0000 7f81477ff700 1 -- 172.21.15.37:0/1790323653 >> 172.21.15.37:0/1790323653 conn(0x7f814006abc0 msgr2=0x7f81400b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.690+0000 7f8cb21ff700 1 Processor -- start 2023-07-12T02:04:29.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.690+0000 7f8cb21ff700 1 -- start start 2023-07-12T02:04:29.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.693+0000 7f8cb21ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8cac0cc840 0x7f8cac06cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.693+0000 7f8cb21ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cac169540 con 0x7f8cac0cb1d0 2023-07-12T02:04:29.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.693+0000 7f8cb21ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cac0ccd20 con 0x7f8cac089be0 2023-07-12T02:04:29.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.693+0000 7f8cb21ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cac0cd000 con 0x7f8cac0cc840 2023-07-12T02:04:29.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.693+0000 7f208c9ff700 1 Processor -- start 2023-07-12T02:04:29.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.693+0000 7f208c9ff700 1 -- start start 2023-07-12T02:04:29.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.695+0000 7f208c9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f20880ade20 0x7f208815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.695+0000 7f208c9ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f208815cf80 con 0x7f20880cc390 2023-07-12T02:04:29.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.695+0000 7f208c9ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20880ccf30 con 0x7f20881583d0 2023-07-12T02:04:29.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.695+0000 7f208c9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f208806c7e0 con 0x7f20880ade20 2023-07-12T02:04:29.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.696+0000 7f208659c700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f20881583d0 0x7f20880c8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:56318/0 (socket says 172.21.15.37:56318) 2023-07-12T02:04:29.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.696+0000 7f208659c700 1 -- 172.21.15.37:0/3490202989 learned_addr learned my addr 172.21.15.37:0/3490202989 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:29.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.697+0000 7f208559a700 1 -- 172.21.15.37:0/3490202989 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561728915 0 0) 0x7f20880ccf30 con 0x7f20881583d0 2023-07-12T02:04:29.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.697+0000 7f208559a700 1 -- 172.21.15.37:0/3490202989 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20700035b0 con 0x7f20881583d0 2023-07-12T02:04:29.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f208559a700 1 -- 172.21.15.37:0/3490202989 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4034915364 0 0) 0x7f20700035b0 con 0x7f20881583d0 2023-07-12T02:04:29.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f208559a700 1 -- 172.21.15.37:0/3490202989 >> v2:172.21.15.37:3300/0 conn(0x7f20880ade20 msgr2=0x7f208815ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:29.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f208559a700 1 --2- 172.21.15.37:0/3490202989 >> v2:172.21.15.37:3300/0 conn(0x7f20880ade20 0x7f208815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f208559a700 1 -- 172.21.15.37:0/3490202989 >> v1:172.21.15.37:6789/0 conn(0x7f20880cc390 legacy=0x7f20880ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f208559a700 1 -- 172.21.15.37:0/3490202989 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20880cc970 con 0x7f20881583d0 2023-07-12T02:04:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f208559a700 1 -- 172.21.15.37:0/3490202989 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7f2078001670 con 0x7f20881583d0 2023-07-12T02:04:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f208559a700 1 -- 172.21.15.37:0/3490202989 >> v1:172.21.15.196:6789/0 conn(0x7f20881583d0 legacy=0x7f20880c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f208559a700 1 --2- 172.21.15.37:0/3490202989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2070003a00 0x7f2070003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f208559a700 1 --2- 172.21.15.37:0/3490202989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2070004850 0x7f2070004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f208559a700 1 --2- 172.21.15.37:0/3490202989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2070005400 0x7f207000ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f208559a700 1 -- 172.21.15.37:0/3490202989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208806c7e0 con 0x7f2070005400 2023-07-12T02:04:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f208559a700 1 -- 172.21.15.37:0/3490202989 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207002e340 con 0x7f2070003a00 2023-07-12T02:04:29.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f208559a700 1 -- 172.21.15.37:0/3490202989 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207002e500 con 0x7f2070004850 2023-07-12T02:04:29.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f2085d9b700 1 --2- 172.21.15.37:0/3490202989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2070004850 0x7f2070004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.696+0000 7f8caaffd700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f8cac089be0 0x7f8cac06c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:56304/0 (socket says 172.21.15.37:56304) 2023-07-12T02:04:29.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.696+0000 7f8caaffd700 1 -- 172.21.15.37:0/3624924698 learned_addr learned my addr 172.21.15.37:0/3624924698 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:29.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.697+0000 7f8caa7fc700 1 -- 172.21.15.37:0/3624924698 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438536680 0 0) 0x7f8cac0ccd20 con 0x7f8cac089be0 2023-07-12T02:04:29.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.697+0000 7f8caa7fc700 1 -- 172.21.15.37:0/3624924698 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c940035b0 con 0x7f8cac089be0 2023-07-12T02:04:29.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8caa7fc700 1 -- 172.21.15.37:0/3624924698 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1780169027 0 0) 0x7f8c940035b0 con 0x7f8cac089be0 2023-07-12T02:04:29.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8caa7fc700 1 -- 172.21.15.37:0/3624924698 >> v2:172.21.15.196:3300/0 conn(0x7f8cac0cc840 msgr2=0x7f8cac06cb00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:04:29.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8caa7fc700 1 --2- 172.21.15.37:0/3624924698 >> v2:172.21.15.196:3300/0 conn(0x7f8cac0cc840 0x7f8cac06cb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8caa7fc700 1 -- 172.21.15.37:0/3624924698 >> v1:172.21.15.37:6789/0 conn(0x7f8cac0cb1d0 legacy=0x7f8cac0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:29.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8caa7fc700 1 -- 172.21.15.37:0/3624924698 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0cd2e0 con 0x7f8cac089be0 2023-07-12T02:04:29.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8caa7fc700 1 -- 172.21.15.37:0/3624924698 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7f8ca0001670 con 0x7f8cac089be0 2023-07-12T02:04:29.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8caa7fc700 1 -- 172.21.15.37:0/3624924698 >> v1:172.21.15.196:6789/0 conn(0x7f8cac089be0 legacy=0x7f8cac06c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8caa7fc700 1 --2- 172.21.15.37:0/3624924698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c94003a00 0x7f8c94003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8caa7fc700 1 --2- 172.21.15.37:0/3624924698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c94004850 0x7f8c94004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8caa7fc700 1 --2- 172.21.15.37:0/3624924698 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c94005320 0x7f8c9400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8caa7fc700 1 -- 172.21.15.37:0/3624924698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac0cd000 con 0x7f8c94004850 2023-07-12T02:04:29.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8caa7fc700 1 -- 172.21.15.37:0/3624924698 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9400c1e0 con 0x7f8c94003a00 2023-07-12T02:04:29.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8caa7fc700 1 -- 172.21.15.37:0/3624924698 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9400c3a0 con 0x7f8c94005320 2023-07-12T02:04:29.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.695+0000 7f80f83ff700 1 Processor -- start 2023-07-12T02:04:29.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.695+0000 7f80f83ff700 1 -- start start 2023-07-12T02:04:29.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.697+0000 7f80f83ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80f015c460 0x7f80f00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.697+0000 7f80f83ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80f00d2640 0x7f80f00cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.697+0000 7f80f83ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f80f00cf720 0x7f80f00cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.697+0000 7f80f83ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f00cedd0 con 0x7f80f015c460 2023-07-12T02:04:29.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.697+0000 7f80f83ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f00d1790 con 0x7f80f00cf720 2023-07-12T02:04:29.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.697+0000 7f80f83ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00cd950 con 0x7f80f00d2640 2023-07-12T02:04:29.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f80f599a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80f00d2640 0x7f80f00cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f80f599a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80f00d2640 0x7f80f00cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:45610/0 (socket says 172.21.15.37:45610) 2023-07-12T02:04:29.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f80f599a700 1 -- 172.21.15.37:0/2734472810 learned_addr learned my addr 172.21.15.37:0/2734472810 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:29.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f80f699c700 1 --2- 172.21.15.37:0/2734472810 >> v2:172.21.15.196:3300/0 conn(0x7f80f00cf720 0x7f80f00cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.692+0000 7f81477ff700 1 -- 172.21.15.37:0/1790323653 shutdown_connections 2023-07-12T02:04:29.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.692+0000 7f81477ff700 1 -- 172.21.15.37:0/1790323653 wait complete. 2023-07-12T02:04:29.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.695+0000 7f81477ff700 1 Processor -- start 2023-07-12T02:04:29.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.695+0000 7f81477ff700 1 -- start start 2023-07-12T02:04:29.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.696+0000 7f81477ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81400ad710 0x7f814014ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.696+0000 7f81477ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81401606e0 0x7f8140158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.696+0000 7f81477ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8140160ab0 0x7f814006cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.696+0000 7f81477ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81400b4530 con 0x7f81400ad710 2023-07-12T02:04:29.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.696+0000 7f81477ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814006d460 con 0x7f8140160ab0 2023-07-12T02:04:29.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.696+0000 7f81477ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814013e590 con 0x7f81401606e0 2023-07-12T02:04:29.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.697+0000 7f8145d9c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8140160ab0 0x7f814006cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.697+0000 7f8145d9c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8140160ab0 0x7f814006cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:45090/0 (socket says 172.21.15.37:45090) 2023-07-12T02:04:29.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.697+0000 7f8145d9c700 1 -- 172.21.15.37:0/2463686059 learned_addr learned my addr 172.21.15.37:0/2463686059 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:29.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f8144d9a700 1 --2- 172.21.15.37:0/2463686059 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81401606e0 0x7f8140158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f8145d9c700 1 -- 172.21.15.37:0/2463686059 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81401606e0 msgr2=0x7f8140158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f8145d9c700 1 --2- 172.21.15.37:0/2463686059 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81401606e0 0x7f8140158bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f8145d9c700 1 -- 172.21.15.37:0/2463686059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81400ad710 msgr2=0x7f814014ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f8145d9c700 1 --2- 172.21.15.37:0/2463686059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81400ad710 0x7f814014ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.698+0000 7f8145d9c700 1 -- 172.21.15.37:0/2463686059 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8130009550 con 0x7f8140160ab0 2023-07-12T02:04:29.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8145d9c700 1 --2- 172.21.15.37:0/2463686059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8140160ab0 0x7f814006cf20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f813800cba0 tx=0x7f813800cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f208659c700 1 --2- 172.21.15.37:0/3490202989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2070003a00 0x7f2070003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.700+0000 7f8cabfff700 1 --2- 172.21.15.37:0/3624924698 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c94005320 0x7f8c9400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f80f699c700 1 -- 172.21.15.37:0/2734472810 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80f00d2640 msgr2=0x7f80f00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:29.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f80f699c700 1 --2- 172.21.15.37:0/2734472810 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80f00d2640 0x7f80f00cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f80f699c700 1 -- 172.21.15.37:0/2734472810 >> v2:172.21.15.37:3300/0 conn(0x7f80f015c460 msgr2=0x7f80f00b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:29.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f80f699c700 1 --2- 172.21.15.37:0/2734472810 >> v2:172.21.15.37:3300/0 conn(0x7f80f015c460 0x7f80f00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f80f699c700 1 -- 172.21.15.37:0/2734472810 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f00d14b0 con 0x7f80f00cf720 2023-07-12T02:04:29.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.700+0000 7f208659c700 1 -- 172.21.15.37:0/3490202989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2070004850 msgr2=0x7f2070004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:29.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.700+0000 7f208659c700 1 --2- 172.21.15.37:0/3490202989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2070004850 0x7f2070004cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.700+0000 7f208659c700 1 -- 172.21.15.37:0/3490202989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2070005400 msgr2=0x7f207000ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:29.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.700+0000 7f208659c700 1 --2- 172.21.15.37:0/3490202989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2070005400 0x7f207000ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.700+0000 7f208659c700 1 -- 172.21.15.37:0/3490202989 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20880cc970 con 0x7f2070003a00 2023-07-12T02:04:29.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.700+0000 7f2086d9d700 1 -- 172.21.15.37:0/3490202989 reap_dead start 2023-07-12T02:04:29.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.700+0000 7f8cab7fe700 1 --2- 172.21.15.37:0/3624924698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c94003a00 0x7f8c94003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.700+0000 7f80f699c700 1 --2- 172.21.15.37:0/2734472810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80f00cf720 0x7f80f00cfbc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f80f008bf90 tx=0x7f80e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5741e00beeb24792 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8135ffb700 1 -- 172.21.15.37:0/2463686059 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138003c00 con 0x7f8140160ab0 2023-07-12T02:04:29.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8135ffb700 1 -- 172.21.15.37:0/2463686059 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8138003d60 con 0x7f8140160ab0 2023-07-12T02:04:29.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.699+0000 7f8135ffb700 1 -- 172.21.15.37:0/2463686059 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813800abc0 con 0x7f8140160ab0 2023-07-12T02:04:29.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.700+0000 7f81477ff700 1 -- 172.21.15.37:0/2463686059 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814013e830 con 0x7f8140160ab0 2023-07-12T02:04:29.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.701+0000 7f8cab7fe700 1 -- 172.21.15.37:0/3624924698 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c94005320 msgr2=0x7f8c9400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:29.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.701+0000 7f8cab7fe700 1 --2- 172.21.15.37:0/3624924698 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c94005320 0x7f8c9400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.701+0000 7f8cab7fe700 1 -- 172.21.15.37:0/3624924698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c94004850 msgr2=0x7f8c94004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:29.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.701+0000 7f8cab7fe700 1 --2- 172.21.15.37:0/3624924698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c94004850 0x7f8c94004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.701+0000 7f8cab7fe700 1 -- 172.21.15.37:0/3624924698 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0cd2e0 con 0x7f8c94003a00 2023-07-12T02:04:29.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.701+0000 7f8cabfff700 1 -- 172.21.15.37:0/3624924698 reap_dead start 2023-07-12T02:04:29.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.701+0000 7f8cab7fe700 1 --2- 172.21.15.37:0/3624924698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c94003a00 0x7f8c94003df0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4001de0 tx=0x7f8c94005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37cb4e4729d3f3b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.701+0000 7f81477ff700 1 -- 172.21.15.37:0/2463686059 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814013edf0 con 0x7f8140160ab0 2023-07-12T02:04:29.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.701+0000 7f208659c700 1 --2- 172.21.15.37:0/3490202989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2070003a00 0x7f2070003df0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2078009230 tx=0x7f2070005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfa93c0b20a861ad server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.703+0000 7f208559a700 1 -- 172.21.15.37:0/3490202989 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2078011070 con 0x7f2070003a00 2023-07-12T02:04:29.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.703+0000 7f208559a700 1 -- 172.21.15.37:0/3490202989 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2078005960 con 0x7f2070003a00 2023-07-12T02:04:29.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.703+0000 7f208559a700 1 -- 172.21.15.37:0/3490202989 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2078005d10 con 0x7f2070003a00 2023-07-12T02:04:29.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.702+0000 7f8caa7fc700 1 -- 172.21.15.37:0/3624924698 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4003c00 con 0x7f8c94003a00 2023-07-12T02:04:29.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.702+0000 7f8caa7fc700 1 -- 172.21.15.37:0/3624924698 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca4003d60 con 0x7f8c94003a00 2023-07-12T02:04:29.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.702+0000 7f8caa7fc700 1 -- 172.21.15.37:0/3624924698 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4005310 con 0x7f8c94003a00 2023-07-12T02:04:29.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.703+0000 7f8cb21ff700 1 -- 172.21.15.37:0/3624924698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c94003a00 msgr2=0x7f8c94003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.703+0000 7f8cb21ff700 1 --2- 172.21.15.37:0/3624924698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c94003a00 0x7f8c94003df0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4001de0 tx=0x7f8c94005880 comp rx=0 tx=0).stop 2023-07-12T02:04:29.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.701+0000 7f80f5199700 1 -- 172.21.15.37:0/2734472810 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e800e070 con 0x7f80f00cf720 2023-07-12T02:04:29.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.701+0000 7f80f5199700 1 -- 172.21.15.37:0/2734472810 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e800bb20 con 0x7f80f00cf720 2023-07-12T02:04:29.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.701+0000 7f80f5199700 1 -- 172.21.15.37:0/2734472810 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8012430 con 0x7f80f00cf720 2023-07-12T02:04:29.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.702+0000 7f80f83ff700 1 -- 172.21.15.37:0/2734472810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80f00cf720 msgr2=0x7f80f00cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.702+0000 7f80f83ff700 1 --2- 172.21.15.37:0/2734472810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80f00cf720 0x7f80f00cfbc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f80f008bf90 tx=0x7f80e800b330 comp rx=0 tx=0).stop 2023-07-12T02:04:29.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.702+0000 7f80f83ff700 1 -- 172.21.15.37:0/2734472810 shutdown_connections 2023-07-12T02:04:29.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.702+0000 7f80f83ff700 1 --2- 172.21.15.37:0/2734472810 >> v2:172.21.15.37:3300/0 conn(0x7f80f015c460 0x7f80f00b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.702+0000 7f80f83ff700 1 --2- 172.21.15.37:0/2734472810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80f00cf720 0x7f80f00cfbc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.702+0000 7f80f83ff700 1 --2- 172.21.15.37:0/2734472810 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80f00d2640 0x7f80f00cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.702+0000 7f80f83ff700 1 -- 172.21.15.37:0/2734472810 >> 172.21.15.37:0/2734472810 conn(0x7f80f0071660 msgr2=0x7f80f0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.703+0000 7f80f83ff700 1 -- 172.21.15.37:0/2734472810 shutdown_connections 2023-07-12T02:04:29.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.702+0000 7f81477ff700 1 -- 172.21.15.37:0/2463686059 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f81400adf40 con 0x7f8140160ab0 2023-07-12T02:04:29.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.704+0000 7f208c9ff700 1 -- 172.21.15.37:0/3490202989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2070003a00 msgr2=0x7f2070003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.704+0000 7f208c9ff700 1 --2- 172.21.15.37:0/3490202989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2070003a00 0x7f2070003df0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2078009230 tx=0x7f2070005880 comp rx=0 tx=0).stop 2023-07-12T02:04:29.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.704+0000 7f8ad0fff700 1 Processor -- start 2023-07-12T02:04:29.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.704+0000 7f8cb21ff700 1 -- 172.21.15.37:0/3624924698 shutdown_connections 2023-07-12T02:04:29.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.704+0000 7f8cb21ff700 1 --2- 172.21.15.37:0/3624924698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c94003a00 0x7f8c94003df0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.704+0000 7f8cb21ff700 1 -- 172.21.15.37:0/3624924698 >> 172.21.15.37:0/3624924698 conn(0x7f8cac06abc0 msgr2=0x7f8cac0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.704+0000 7f8135ffb700 1 -- 172.21.15.37:0/2463686059 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f813800ad20 con 0x7f8140160ab0 2023-07-12T02:04:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.703+0000 7f80f83ff700 1 -- 172.21.15.37:0/2734472810 wait complete. 2023-07-12T02:04:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.705+0000 7f8cb21ff700 1 -- 172.21.15.37:0/3624924698 shutdown_connections 2023-07-12T02:04:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.705+0000 7f80f83ff700 1 Processor -- start 2023-07-12T02:04:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.706+0000 7f80f83ff700 1 -- start start 2023-07-12T02:04:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.707+0000 7f80f83ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80f00cf720 0x7f80f01505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.707+0000 7f80f83ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80f00d2640 0x7f80f0070b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.706+0000 7f8135ffb700 1 --2- 172.21.15.37:0/2463686059 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f812406adb0 0x7f812406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.706+0000 7f8135ffb700 1 -- 172.21.15.37:0/2463686059 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f813808a120 con 0x7f8140160ab0 2023-07-12T02:04:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.706+0000 7f8135ffb700 1 --2- 172.21.15.37:0/2463686059 >> [v2:172.21.15.37:6810/2081951691,v1:172.21.15.37:6812/2081951691] conn(0x7f8124074a80 0x7f8124076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.706+0000 7f8135ffb700 1 -- 172.21.15.37:0/2463686059 --> [v2:172.21.15.37:6810/2081951691,v1:172.21.15.37:6812/2081951691] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8124077580 con 0x7f8124074a80 2023-07-12T02:04:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.706+0000 7f8135ffb700 1 -- 172.21.15.37:0/2463686059 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f813808a4d0 con 0x7f8140160ab0 2023-07-12T02:04:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.707+0000 7f8144d9a700 1 --2- 172.21.15.37:0/2463686059 >> [v2:172.21.15.37:6810/2081951691,v1:172.21.15.37:6812/2081951691] conn(0x7f8124074a80 0x7f8124076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.704+0000 7f8ad0fff700 1 -- start start 2023-07-12T02:04:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.706+0000 7f8ad0fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8acc0c9d40 0x7f8acc0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.706+0000 7f8ad0fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc0ce5d0 con 0x7f8acc0c9970 2023-07-12T02:04:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.707+0000 7f8ad0fff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc0cce20 con 0x7f8acc0cb6e0 2023-07-12T02:04:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.707+0000 7f8ad0fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8acc0cd100 con 0x7f8acc0c9d40 2023-07-12T02:04:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.707+0000 7f8ac9d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8acc0c9d40 0x7f8acc0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.707+0000 7f8acad9d700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f8acc0cb6e0 0x7f8acc157d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:56334/0 (socket says 172.21.15.37:56334) 2023-07-12T02:04:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.707+0000 7f8acad9d700 1 -- 172.21.15.37:0/4049775155 learned_addr learned my addr 172.21.15.37:0/4049775155 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.708+0000 7f8ac9d9b700 1 -- 172.21.15.37:0/4049775155 >> v1:172.21.15.196:6789/0 conn(0x7f8acc0cb6e0 legacy=0x7f8acc157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.708+0000 7f8ac9d9b700 1 -- 172.21.15.37:0/4049775155 >> v1:172.21.15.37:6789/0 conn(0x7f8acc0c9970 legacy=0x7f8acc0cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.708+0000 7f8ac9d9b700 1 -- 172.21.15.37:0/4049775155 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc0cd3e0 con 0x7f8acc0c9d40 2023-07-12T02:04:29.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.708+0000 7f8144d9a700 1 --2- 172.21.15.37:0/2463686059 >> [v2:172.21.15.37:6810/2081951691,v1:172.21.15.37:6812/2081951691] conn(0x7f8124074a80 0x7f8124076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.705+0000 7f8cb21ff700 1 -- 172.21.15.37:0/3624924698 wait complete. 2023-07-12T02:04:29.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.708+0000 7f8cb21ff700 1 Processor -- start 2023-07-12T02:04:29.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.709+0000 7f8cb21ff700 1 -- start start 2023-07-12T02:04:29.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.708+0000 7f8ac9d9b700 1 --2- 172.21.15.37:0/4049775155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8acc0c9d40 0x7f8acc0cb1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8ac400bfd0 tx=0x7f8ac400d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd547286312041d server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.707+0000 7f208c9ff700 1 -- 172.21.15.37:0/3490202989 shutdown_connections 2023-07-12T02:04:29.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.707+0000 7f208c9ff700 1 --2- 172.21.15.37:0/3490202989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2070003a00 0x7f2070003df0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.707+0000 7f208c9ff700 1 -- 172.21.15.37:0/3490202989 >> 172.21.15.37:0/3490202989 conn(0x7f20880b0390 msgr2=0x7f20880b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.708+0000 7f208c9ff700 1 -- 172.21.15.37:0/3490202989 shutdown_connections 2023-07-12T02:04:29.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.708+0000 7f208c9ff700 1 -- 172.21.15.37:0/3490202989 wait complete. 2023-07-12T02:04:29.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.709+0000 7f80f619b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80f00cf720 0x7f80f01505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.709+0000 7f80f619b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80f00cf720 0x7f80f01505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:45128/0 (socket says 172.21.15.37:45128) 2023-07-12T02:04:29.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.709+0000 7f80f83ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80f015c460 0x7f80f0071090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.709+0000 7f80f83ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f006ff80 con 0x7f80f015c460 2023-07-12T02:04:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.709+0000 7f80f83ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00c9d80 con 0x7f80f00cf720 2023-07-12T02:04:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.709+0000 7f80f83ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00ca060 con 0x7f80f00d2640 2023-07-12T02:04:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.709+0000 7f80f619b700 1 -- 172.21.15.37:0/643231585 learned_addr learned my addr 172.21.15.37:0/643231585 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.709+0000 7f814559b700 1 --2- 172.21.15.37:0/2463686059 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f812406adb0 0x7f812406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.709+0000 7f8ac959a700 1 -- 172.21.15.37:0/4049775155 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4010070 con 0x7f8acc0c9d40 2023-07-12T02:04:29.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.709+0000 7f8ac959a700 1 -- 172.21.15.37:0/4049775155 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac400b2e0 con 0x7f8acc0c9d40 2023-07-12T02:04:29.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.709+0000 7f8ac959a700 1 -- 172.21.15.37:0/4049775155 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4003c40 con 0x7f8acc0c9d40 2023-07-12T02:04:29.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.710+0000 7f8ad0fff700 1 -- 172.21.15.37:0/4049775155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8acc0c9d40 msgr2=0x7f8acc0cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.710+0000 7f8ad0fff700 1 --2- 172.21.15.37:0/4049775155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8acc0c9d40 0x7f8acc0cb1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8ac400bfd0 tx=0x7f8ac400d330 comp rx=0 tx=0).stop 2023-07-12T02:04:29.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.710+0000 7f208c9ff700 1 Processor -- start 2023-07-12T02:04:29.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.710+0000 7f208c9ff700 1 -- start start 2023-07-12T02:04:29.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.711+0000 7f8ad0fff700 1 -- 172.21.15.37:0/4049775155 shutdown_connections 2023-07-12T02:04:29.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.711+0000 7f8ad0fff700 1 --2- 172.21.15.37:0/4049775155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8acc0c9d40 0x7f8acc0cb1a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.711+0000 7f8ad0fff700 1 -- 172.21.15.37:0/4049775155 >> 172.21.15.37:0/4049775155 conn(0x7f8acc06abc0 msgr2=0x7f8acc0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.711+0000 7f8ad0fff700 1 -- 172.21.15.37:0/4049775155 shutdown_connections 2023-07-12T02:04:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.710+0000 7f80f619b700 1 -- 172.21.15.37:0/643231585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80f00d2640 msgr2=0x7f80f0070b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-12T02:04:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.710+0000 7f80f619b700 1 --2- 172.21.15.37:0/643231585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80f00d2640 0x7f80f0070b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.710+0000 7f80f619b700 1 -- 172.21.15.37:0/643231585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80f015c460 msgr2=0x7f80f0071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.710+0000 7f80f619b700 1 --2- 172.21.15.37:0/643231585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80f015c460 0x7f80f0071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.710+0000 7f80f619b700 1 -- 172.21.15.37:0/643231585 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e8009a70 con 0x7f80f00cf720 2023-07-12T02:04:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.711+0000 7f80f619b700 1 --2- 172.21.15.37:0/643231585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80f00cf720 0x7f80f01505d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00b4a0 tx=0x7f80ec00b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.711+0000 7f8135ffb700 1 -- 172.21.15.37:0/2463686059 <== osd.3 v2:172.21.15.37:6810/2081951691 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8124077580 con 0x7f8124074a80 2023-07-12T02:04:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.711+0000 7f8ad0fff700 1 -- 172.21.15.37:0/4049775155 wait complete. 2023-07-12T02:04:29.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.712+0000 7f208c9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2070003a00 0x7f20880c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.712+0000 7f208c9ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20880c96d0 0x7f208814b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.712+0000 7f208c9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20880c3910 0x7f20880c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.712+0000 7f208c9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20880c9b40 con 0x7f2070003a00 2023-07-12T02:04:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.712+0000 7f208c9ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20880c7fb0 con 0x7f20880c96d0 2023-07-12T02:04:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.712+0000 7f208c9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20880c7cd0 con 0x7f20880c3910 2023-07-12T02:04:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.712+0000 7f2085d9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20880c96d0 0x7f208814b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.712+0000 7f2085d9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20880c96d0 0x7f208814b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:45142/0 (socket says 172.21.15.37:45142) 2023-07-12T02:04:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.713+0000 7f2085d9b700 1 -- 172.21.15.37:0/2114348910 learned_addr learned my addr 172.21.15.37:0/2114348910 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.713+0000 7f2086d9d700 1 --2- 172.21.15.37:0/2114348910 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20880c3910 0x7f20880c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.713+0000 7f208659c700 1 --2- 172.21.15.37:0/2114348910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2070003a00 0x7f20880c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.713+0000 7f2085d9b700 1 -- 172.21.15.37:0/2114348910 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20880c3910 msgr2=0x7f20880c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.713+0000 7f2085d9b700 1 --2- 172.21.15.37:0/2114348910 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f20880c3910 0x7f20880c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.713+0000 7f2085d9b700 1 -- 172.21.15.37:0/2114348910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2070003a00 msgr2=0x7f20880c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.713+0000 7f2085d9b700 1 --2- 172.21.15.37:0/2114348910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2070003a00 0x7f20880c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.713+0000 7f2085d9b700 1 -- 172.21.15.37:0/2114348910 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20880c2e30 con 0x7f20880c96d0 2023-07-12T02:04:29.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.713+0000 7f9ab55ff700 1 Processor -- start 2023-07-12T02:04:29.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.714+0000 7f2085d9b700 1 --2- 172.21.15.37:0/2114348910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20880c96d0 0x7f208814b0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f208000d7a0 tx=0x7f208000dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.714+0000 7f2076ffd700 1 -- 172.21.15.37:0/2114348910 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080003e10 con 0x7f20880c96d0 2023-07-12T02:04:29.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.714+0000 7f2076ffd700 1 -- 172.21.15.37:0/2114348910 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2080005070 con 0x7f20880c96d0 2023-07-12T02:04:29.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.714+0000 7f2076ffd700 1 -- 172.21.15.37:0/2114348910 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080005420 con 0x7f20880c96d0 2023-07-12T02:04:29.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.714+0000 7f208c9ff700 1 -- 172.21.15.37:0/2114348910 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20880c3110 con 0x7f20880c96d0 2023-07-12T02:04:29.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.715+0000 7f208c9ff700 1 -- 172.21.15.37:0/2114348910 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20880c7910 con 0x7f20880c96d0 2023-07-12T02:04:29.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.715+0000 7f208c9ff700 1 -- 172.21.15.37:0/2114348910 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f208806c470 con 0x7f20880c96d0 2023-07-12T02:04:29.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.715+0000 7f8cb21ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c94003a00 0x7f8cac16a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.715+0000 7f8cb21ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8cac06db00 0x7f8cac06df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.715+0000 7f8cb21ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cac0c1110 0x7f8cac0c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.715+0000 7f8cb21ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac0c3490 con 0x7f8cac0c1110 2023-07-12T02:04:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.715+0000 7f8cb21ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac165f80 con 0x7f8c94003a00 2023-07-12T02:04:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.715+0000 7f8cb21ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac16ac30 con 0x7f8cac06db00 2023-07-12T02:04:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f8cab7fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c94003a00 0x7f8cac16a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f8cab7fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c94003a00 0x7f8cac16a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:45148/0 (socket says 172.21.15.37:45148) 2023-07-12T02:04:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f8cab7fe700 1 -- 172.21.15.37:0/3697667255 learned_addr learned my addr 172.21.15.37:0/3697667255 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f8cabfff700 1 --2- 172.21.15.37:0/3697667255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cac0c1110 0x7f8cac0c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f8cab7fe700 1 -- 172.21.15.37:0/3697667255 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8cac06db00 msgr2=0x7f8cac06df70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-12T02:04:29.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f8cab7fe700 1 --2- 172.21.15.37:0/3697667255 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8cac06db00 0x7f8cac06df70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f8cab7fe700 1 -- 172.21.15.37:0/3697667255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cac0c1110 msgr2=0x7f8cac0c1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f8cab7fe700 1 --2- 172.21.15.37:0/3697667255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cac0c1110 0x7f8cac0c1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f8cab7fe700 1 -- 172.21.15.37:0/3697667255 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0c1ac0 con 0x7f8c94003a00 2023-07-12T02:04:29.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.717+0000 7f8cab7fe700 1 --2- 172.21.15.37:0/3697667255 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c94003a00 0x7f8cac16a090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4002230 tx=0x7f8ca4001330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f814559b700 1 --2- 172.21.15.37:0/2463686059 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f812406adb0 0x7f812406d260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f813c006b20 tx=0x7f813c006ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.714+0000 7f8ad0fff700 1 Processor -- start 2023-07-12T02:04:29.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.714+0000 7f8ad0fff700 1 -- start start 2023-07-12T02:04:29.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f8ad0fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8acc0c9970 0x7f8acc1f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f8ad0fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8acc0c9d40 0x7f8acc159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f8ad0fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8acc0cb6e0 0x7f8acc15a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f8ad0fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc0c6cf0 con 0x7f8acc0cb6e0 2023-07-12T02:04:29.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f8ad0fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc0c33c0 con 0x7f8acc0c9d40 2023-07-12T02:04:29.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f8ad0fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc158e20 con 0x7f8acc0c9970 2023-07-12T02:04:29.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.717+0000 7f8ac9d9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8acc0c9d40 0x7f8acc159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.717+0000 7f8ac9d9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8acc0c9d40 0x7f8acc159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:45164/0 (socket says 172.21.15.37:45164) 2023-07-12T02:04:29.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.717+0000 7f8ac9d9b700 1 -- 172.21.15.37:0/1072790669 learned_addr learned my addr 172.21.15.37:0/1072790669 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:29.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7fe372dff700 1 Processor -- start 2023-07-12T02:04:29.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.717+0000 7f8aca59c700 1 --2- 172.21.15.37:0/1072790669 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8acc0c9970 0x7f8acc1f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7f8c93fff700 1 -- 172.21.15.37:0/3697667255 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4006dc0 con 0x7f8c94003a00 2023-07-12T02:04:29.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7f8c93fff700 1 -- 172.21.15.37:0/3697667255 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca4003bc0 con 0x7f8c94003a00 2023-07-12T02:04:29.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7f8c93fff700 1 -- 172.21.15.37:0/3697667255 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca400caa0 con 0x7f8c94003a00 2023-07-12T02:04:29.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7f8cb21ff700 1 -- 172.21.15.37:0/3697667255 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cac06e670 con 0x7f8c94003a00 2023-07-12T02:04:29.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7f8cb21ff700 1 -- 172.21.15.37:0/3697667255 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac0c36a0 con 0x7f8c94003a00 2023-07-12T02:04:29.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7f9ab55ff700 1 -- start start 2023-07-12T02:04:29.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.718+0000 7f9ab55ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ab00b59d0 0x7f9ab01671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.718+0000 7f9ab55ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab00d1790 con 0x7f9ab00d2640 2023-07-12T02:04:29.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.718+0000 7f9ab55ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab00cd950 con 0x7f9ab015c460 2023-07-12T02:04:29.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.718+0000 7f9ab55ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00cedd0 con 0x7f9ab00b59d0 2023-07-12T02:04:29.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7f9aaf7fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ab00b59d0 0x7f9ab01671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7f9aaf7fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ab00b59d0 0x7f9ab01671b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:45674/0 (socket says 172.21.15.37:45674) 2023-07-12T02:04:29.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7f9aaf7fe700 1 -- 172.21.15.37:0/2901902142 learned_addr learned my addr 172.21.15.37:0/2901902142 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:29.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.720+0000 7f9aaf7fe700 1 -- 172.21.15.37:0/2901902142 >> v1:172.21.15.196:6789/0 conn(0x7f9ab015c460 legacy=0x7f9ab00cf1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:04:29.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.720+0000 7f9aaf7fe700 1 -- 172.21.15.37:0/2901902142 >> v1:172.21.15.37:6789/0 conn(0x7f9ab00d2640 legacy=0x7f9ab00cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:29.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.720+0000 7f9aaf7fe700 1 -- 172.21.15.37:0/2901902142 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab00d14b0 con 0x7f9ab00b59d0 2023-07-12T02:04:29.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.720+0000 7f9aaf7fe700 1 --2- 172.21.15.37:0/2901902142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ab00b59d0 0x7f9ab01671b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009e80 tx=0x7f9aa800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afc1e65e06f172a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.718+0000 7f8ac9d9b700 1 -- 172.21.15.37:0/1072790669 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8acc0c9970 msgr2=0x7f8acc1f4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.718+0000 7f8ac9d9b700 1 --2- 172.21.15.37:0/1072790669 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8acc0c9970 0x7f8acc1f4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.718+0000 7f8ac9d9b700 1 -- 172.21.15.37:0/1072790669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8acc0cb6e0 msgr2=0x7f8acc15a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.718+0000 7f8ac9d9b700 1 --2- 172.21.15.37:0/1072790669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8acc0cb6e0 0x7f8acc15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.718+0000 7f8ac9d9b700 1 -- 172.21.15.37:0/1072790669 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac400bc80 con 0x7f8acc0c9d40 2023-07-12T02:04:29.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7f8ac9d9b700 1 --2- 172.21.15.37:0/1072790669 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8acc0c9d40 0x7f8acc159bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8ac400bfa0 tx=0x7f8ac4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7f8abaffd700 1 -- 172.21.15.37:0/1072790669 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4004240 con 0x7f8acc0c9d40 2023-07-12T02:04:29.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7f8abaffd700 1 -- 172.21.15.37:0/1072790669 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac40043a0 con 0x7f8acc0c9d40 2023-07-12T02:04:29.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7f8abaffd700 1 -- 172.21.15.37:0/1072790669 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4004750 con 0x7f8acc0c9d40 2023-07-12T02:04:29.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7f8ad0fff700 1 -- 172.21.15.37:0/1072790669 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8acc158860 con 0x7f8acc0c9d40 2023-07-12T02:04:29.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7f8ad0fff700 1 -- 172.21.15.37:0/1072790669 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8acc0c6980 con 0x7f8acc0c9d40 2023-07-12T02:04:29.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.716+0000 7fe372dff700 1 -- start start 2023-07-12T02:04:29.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.718+0000 7fe372dff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe36c070a80 0x7fe36c0ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.718+0000 7fe372dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36c0ccb70 con 0x7fe36c0adce0 2023-07-12T02:04:29.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.718+0000 7fe372dff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36c165400 con 0x7fe36c160930 2023-07-12T02:04:29.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.718+0000 7fe372dff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36c0ae160 con 0x7fe36c070a80 2023-07-12T02:04:29.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7fe370b9b700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fe36c160930 0x7fe36c0cc390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:56348/0 (socket says 172.21.15.37:56348) 2023-07-12T02:04:29.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7fe370b9b700 1 -- 172.21.15.37:0/456463539 learned_addr learned my addr 172.21.15.37:0/456463539 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:29.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.719+0000 7fe36bfff700 1 --2- 172.21.15.37:0/456463539 >> v2:172.21.15.196:3300/0 conn(0x7fe36c070a80 0x7fe36c0ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.717+0000 7ff5d2dff700 1 Processor -- start 2023-07-12T02:04:29.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.718+0000 7ff5d2dff700 1 -- start start 2023-07-12T02:04:29.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.720+0000 7ff5d2dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5cc0cf5f0 0x7ff5cc0ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.720+0000 7ff5d2dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff5cc0d1230 0x7ff5cc16a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.720+0000 7ff5d2dff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5cc0d2550 con 0x7ff5cc0d0750 2023-07-12T02:04:29.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.720+0000 7ff5d2dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5cc0cfb60 con 0x7ff5cc0d1230 2023-07-12T02:04:29.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.720+0000 7ff5d2dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc0cfe40 con 0x7ff5cc0cf5f0 2023-07-12T02:04:29.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.712+0000 7f80e6ffd700 1 -- 172.21.15.37:0/643231585 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec011830 con 0x7f80f00cf720 2023-07-12T02:04:29.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.712+0000 7f80e6ffd700 1 -- 172.21.15.37:0/643231585 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec011990 con 0x7f80f00cf720 2023-07-12T02:04:29.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.712+0000 7f80e6ffd700 1 -- 172.21.15.37:0/643231585 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec011d20 con 0x7f80f00cf720 2023-07-12T02:04:29.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.714+0000 7f80f83ff700 1 -- 172.21.15.37:0/643231585 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f00ca340 con 0x7f80f00cf720 2023-07-12T02:04:29.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.714+0000 7f80f83ff700 1 -- 172.21.15.37:0/643231585 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f00ca900 con 0x7f80f00cf720 2023-07-12T02:04:29.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.715+0000 7f80f83ff700 1 -- 172.21.15.37:0/643231585 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f80f00cd5e0 con 0x7f80f00cf720 2023-07-12T02:04:29.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.720+0000 7f80e6ffd700 1 -- 172.21.15.37:0/643231585 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f80ec01a400 con 0x7f80f00cf720 2023-07-12T02:04:29.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.721+0000 7fe36bfff700 1 -- 172.21.15.37:0/456463539 >> v1:172.21.15.196:6789/0 conn(0x7fe36c160930 legacy=0x7fe36c0cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.721+0000 7fe36bfff700 1 -- 172.21.15.37:0/456463539 >> v1:172.21.15.37:6789/0 conn(0x7fe36c0adce0 legacy=0x7fe36c06c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:29.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.721+0000 7fe36bfff700 1 -- 172.21.15.37:0/456463539 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c164640 con 0x7fe36c070a80 2023-07-12T02:04:29.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.721+0000 7fe36bfff700 1 --2- 172.21.15.37:0/456463539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe36c070a80 0x7fe36c0ad7a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe3600097c0 tx=0x7fe360009ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac886959ad59fe89 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.720+0000 7f2076ffd700 1 -- 172.21.15.37:0/2114348910 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2080005580 con 0x7f20880c96d0 2023-07-12T02:04:29.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.721+0000 7ff5d0b9b700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7ff5cc0d0750 0x7ff5cc0d0b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:56362/0 (socket says 172.21.15.37:56362) 2023-07-12T02:04:29.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.721+0000 7ff5d0b9b700 1 -- 172.21.15.37:0/2067791705 learned_addr learned my addr 172.21.15.37:0/2067791705 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:29.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.721+0000 7ff5cbfff700 1 --2- 172.21.15.37:0/2067791705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5cc0cf5f0 0x7ff5cc0ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.722+0000 7f8cb21ff700 1 -- 172.21.15.37:0/3697667255 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8cac0cd8a0 con 0x7f8c94003a00 2023-07-12T02:04:29.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.722+0000 7f80e6ffd700 1 --2- 172.21.15.37:0/643231585 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f80d406adb0 0x7f80d406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.722+0000 7f80e6ffd700 1 -- 172.21.15.37:0/643231585 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f80ec089880 con 0x7f80f00cf720 2023-07-12T02:04:29.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.722+0000 7f80e6ffd700 1 --2- 172.21.15.37:0/643231585 >> [v2:172.21.15.37:6824/527039359,v1:172.21.15.37:6825/527039359] conn(0x7f80d4074a80 0x7f80d4076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.722+0000 7f80e6ffd700 1 -- 172.21.15.37:0/643231585 --> [v2:172.21.15.37:6824/527039359,v1:172.21.15.37:6825/527039359] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80d4077580 con 0x7f80d4074a80 2023-07-12T02:04:29.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.722+0000 7f80e6ffd700 1 -- 172.21.15.37:0/643231585 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80ec089c30 con 0x7f80f00cf720 2023-07-12T02:04:29.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.722+0000 7fe36b7fe700 1 -- 172.21.15.37:0/456463539 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360004230 con 0x7fe36c070a80 2023-07-12T02:04:29.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.722+0000 7fe36b7fe700 1 -- 172.21.15.37:0/456463539 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe360004390 con 0x7fe36c070a80 2023-07-12T02:04:29.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.722+0000 7fe36b7fe700 1 -- 172.21.15.37:0/456463539 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3600036a0 con 0x7fe36c070a80 2023-07-12T02:04:29.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.722+0000 7ff5d139c700 1 --2- 172.21.15.37:0/2067791705 >> v2:172.21.15.37:3300/0 conn(0x7ff5cc0d1230 0x7ff5cc16a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.723+0000 7f80f599a700 1 --2- 172.21.15.37:0/643231585 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f80d406adb0 0x7f80d406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.723+0000 7f80f699c700 1 --2- 172.21.15.37:0/643231585 >> [v2:172.21.15.37:6824/527039359,v1:172.21.15.37:6825/527039359] conn(0x7f80d4074a80 0x7f80d4076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.723+0000 7f9aae7fc700 1 -- 172.21.15.37:0/2901902142 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa800e070 con 0x7f9ab00b59d0 2023-07-12T02:04:29.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.723+0000 7f9aae7fc700 1 -- 172.21.15.37:0/2901902142 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa8003a20 con 0x7f9ab00b59d0 2023-07-12T02:04:29.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.723+0000 7f9aae7fc700 1 -- 172.21.15.37:0/2901902142 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8003dd0 con 0x7f9ab00b59d0 2023-07-12T02:04:29.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.723+0000 7ff5cbfff700 1 -- 172.21.15.37:0/2067791705 >> v2:172.21.15.37:3300/0 conn(0x7ff5cc0d1230 msgr2=0x7ff5cc16a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:29.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.723+0000 7ff5cbfff700 1 --2- 172.21.15.37:0/2067791705 >> v2:172.21.15.37:3300/0 conn(0x7ff5cc0d1230 0x7ff5cc16a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.723+0000 7ff5cbfff700 1 -- 172.21.15.37:0/2067791705 >> v1:172.21.15.196:6789/0 conn(0x7ff5cc0d0750 legacy=0x7ff5cc0d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.723+0000 7ff5cbfff700 1 -- 172.21.15.37:0/2067791705 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc0d1f00 con 0x7ff5cc0cf5f0 2023-07-12T02:04:29.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.723+0000 7fe372dff700 1 -- 172.21.15.37:0/456463539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe36c070a80 msgr2=0x7fe36c0ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.723+0000 7fe372dff700 1 --2- 172.21.15.37:0/456463539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe36c070a80 0x7fe36c0ad7a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe3600097c0 tx=0x7fe360009ad0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.723+0000 7fe372dff700 1 -- 172.21.15.37:0/456463539 shutdown_connections 2023-07-12T02:04:29.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.723+0000 7fe372dff700 1 --2- 172.21.15.37:0/456463539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe36c070a80 0x7fe36c0ad7a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.723+0000 7fe372dff700 1 -- 172.21.15.37:0/456463539 >> 172.21.15.37:0/456463539 conn(0x7fe36c0b0390 msgr2=0x7fe36c0b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.723+0000 7ff5cbfff700 1 --2- 172.21.15.37:0/2067791705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5cc0cf5f0 0x7ff5cc0ce5d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009840 tx=0x7ff5b8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=684bbe86e865db40 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.722+0000 7f8ad0fff700 1 -- 172.21.15.37:0/1072790669 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ab0000fc0 con 0x7f8acc0c9d40 2023-07-12T02:04:29.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.724+0000 7ff5cb7fe700 1 -- 172.21.15.37:0/2067791705 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8004230 con 0x7ff5cc0cf5f0 2023-07-12T02:04:29.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.724+0000 7fe372dff700 1 -- 172.21.15.37:0/456463539 shutdown_connections 2023-07-12T02:04:29.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.724+0000 7ff5cb7fe700 1 -- 172.21.15.37:0/2067791705 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b8004390 con 0x7ff5cc0cf5f0 2023-07-12T02:04:29.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.724+0000 7ff5cb7fe700 1 -- 172.21.15.37:0/2067791705 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b80036a0 con 0x7ff5cc0cf5f0 2023-07-12T02:04:29.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.724+0000 7f80f599a700 1 --2- 172.21.15.37:0/643231585 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f80d406adb0 0x7f80d406d260 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f80f00d0ff0 tx=0x7f80e00092c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.724+0000 7f9ab55ff700 1 -- 172.21.15.37:0/2901902142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ab00b59d0 msgr2=0x7f9ab01671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.724+0000 7f9ab55ff700 1 --2- 172.21.15.37:0/2901902142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ab00b59d0 0x7f9ab01671b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009e80 tx=0x7f9aa800b330 comp rx=0 tx=0).stop 2023-07-12T02:04:29.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.724+0000 7f9ab55ff700 1 -- 172.21.15.37:0/2901902142 shutdown_connections 2023-07-12T02:04:29.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.724+0000 7f9ab55ff700 1 --2- 172.21.15.37:0/2901902142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ab00b59d0 0x7f9ab01671b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.724+0000 7f9ab55ff700 1 -- 172.21.15.37:0/2901902142 >> 172.21.15.37:0/2901902142 conn(0x7f9ab0071660 msgr2=0x7f9ab0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.724+0000 7f8abaffd700 1 -- 172.21.15.37:0/1072790669 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8ac401e450 con 0x7f8acc0c9d40 2023-07-12T02:04:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.725+0000 7f80f699c700 1 --2- 172.21.15.37:0/643231585 >> [v2:172.21.15.37:6824/527039359,v1:172.21.15.37:6825/527039359] conn(0x7f80d4074a80 0x7f80d4076eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.725+0000 7ff5d2dff700 1 -- 172.21.15.37:0/2067791705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5cc0cf5f0 msgr2=0x7ff5cc0ce5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.725+0000 7ff5d2dff700 1 --2- 172.21.15.37:0/2067791705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5cc0cf5f0 0x7ff5cc0ce5d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009840 tx=0x7ff5b8009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.726+0000 7f2076ffd700 1 --2- 172.21.15.37:0/2114348910 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f206806adb0 0x7f206806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.726+0000 7f2076ffd700 1 -- 172.21.15.37:0/2114348910 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f208008a190 con 0x7f20880c96d0 2023-07-12T02:04:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.726+0000 7f208659c700 1 --2- 172.21.15.37:0/2114348910 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f206806adb0 0x7f206806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.725+0000 7f8c93fff700 1 -- 172.21.15.37:0/3697667255 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8ca400cc00 con 0x7f8c94003a00 2023-07-12T02:04:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.725+0000 7f8abaffd700 1 --2- 172.21.15.37:0/1072790669 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8aac06adb0 0x7f8aac06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.726+0000 7f8abaffd700 1 -- 172.21.15.37:0/1072790669 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8ac408b1d0 con 0x7f8acc0c9d40 2023-07-12T02:04:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.726+0000 7f8abaffd700 1 --2- 172.21.15.37:0/1072790669 >> [v2:172.21.15.196:6800/3108128182,v1:172.21.15.196:6801/3108128182] conn(0x7f8aac074a00 0x7f8aac076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.726+0000 7f8abaffd700 1 -- 172.21.15.37:0/1072790669 --> [v2:172.21.15.196:6800/3108128182,v1:172.21.15.196:6801/3108128182] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8aac077500 con 0x7f8aac074a00 2023-07-12T02:04:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.726+0000 7f8aca59c700 1 --2- 172.21.15.37:0/1072790669 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8aac06adb0 0x7f8aac06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.725+0000 7ff5d2dff700 1 -- 172.21.15.37:0/2067791705 shutdown_connections 2023-07-12T02:04:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.725+0000 7ff5d2dff700 1 --2- 172.21.15.37:0/2067791705 >> v2:172.21.15.37:3300/0 conn(0x7ff5cc0d1230 0x7ff5cc16a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.725+0000 7ff5d2dff700 1 --2- 172.21.15.37:0/2067791705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5cc0cf5f0 0x7ff5cc0ce5d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.725+0000 7ff5d2dff700 1 -- 172.21.15.37:0/2067791705 >> 172.21.15.37:0/2067791705 conn(0x7ff5cc071660 msgr2=0x7ff5cc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.726+0000 7f2076ffd700 1 --2- 172.21.15.37:0/2114348910 >> [v2:172.21.15.37:6800/4138487872,v1:172.21.15.37:6801/4138487872] conn(0x7f2068074a80 0x7f2068076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.726+0000 7f2076ffd700 1 -- 172.21.15.37:0/2114348910 --> [v2:172.21.15.37:6800/4138487872,v1:172.21.15.37:6801/4138487872] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2068077580 con 0x7f2068074a80 2023-07-12T02:04:29.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.726+0000 7f2076ffd700 1 -- 172.21.15.37:0/2114348910 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f208008a540 con 0x7f20880c96d0 2023-07-12T02:04:29.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.726+0000 7f8abaffd700 1 -- 172.21.15.37:0/1072790669 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ac4055e70 con 0x7f8acc0c9d40 2023-07-12T02:04:29.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.726+0000 7f8c93fff700 1 --2- 172.21.15.37:0/3697667255 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8c9806adb0 0x7f8c9806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.727+0000 7f8c93fff700 1 -- 172.21.15.37:0/3697667255 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8ca408ade0 con 0x7f8c94003a00 2023-07-12T02:04:29.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.727+0000 7f8acad9d700 1 --2- 172.21.15.37:0/1072790669 >> [v2:172.21.15.196:6800/3108128182,v1:172.21.15.196:6801/3108128182] conn(0x7f8aac074a00 0x7f8aac076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.724+0000 7fe372dff700 1 -- 172.21.15.37:0/456463539 wait complete. 2023-07-12T02:04:29.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.727+0000 7fe372dff700 1 Processor -- start 2023-07-12T02:04:29.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.727+0000 7f8c93fff700 1 --2- 172.21.15.37:0/3697667255 >> [v2:172.21.15.37:6808/769438993,v1:172.21.15.37:6809/769438993] conn(0x7f8c98074a80 0x7f8c98076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.727+0000 7f8c93fff700 1 -- 172.21.15.37:0/3697667255 --> [v2:172.21.15.37:6808/769438993,v1:172.21.15.37:6809/769438993] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c98077580 con 0x7f8c98074a80 2023-07-12T02:04:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.727+0000 7f8c93fff700 1 -- 172.21.15.37:0/3697667255 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ca408b190 con 0x7f8c94003a00 2023-07-12T02:04:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.727+0000 7f80e6ffd700 1 -- 172.21.15.37:0/643231585 <== osd.2 v2:172.21.15.37:6824/527039359 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f80d4077580 con 0x7f80d4074a80 2023-07-12T02:04:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.727+0000 7f8caaffd700 1 --2- 172.21.15.37:0/3697667255 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8c9806adb0 0x7f8c9806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.727+0000 7f8aca59c700 1 --2- 172.21.15.37:0/1072790669 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8aac06adb0 0x7f8aac06d260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0001730 tx=0x7f8ac0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.727+0000 7f9ab55ff700 1 -- 172.21.15.37:0/2901902142 shutdown_connections 2023-07-12T02:04:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.728+0000 7ff5d2dff700 1 -- 172.21.15.37:0/2067791705 shutdown_connections 2023-07-12T02:04:29.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.728+0000 7f8acad9d700 1 --2- 172.21.15.37:0/1072790669 >> [v2:172.21.15.196:6800/3108128182,v1:172.21.15.196:6801/3108128182] conn(0x7f8aac074a00 0x7f8aac076e30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.727+0000 7fe372dff700 1 -- start start 2023-07-12T02:04:29.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.728+0000 7f8cabfff700 1 --2- 172.21.15.37:0/3697667255 >> [v2:172.21.15.37:6808/769438993,v1:172.21.15.37:6809/769438993] conn(0x7f8c98074a80 0x7f8c98076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.727+0000 7f9ab55ff700 1 -- 172.21.15.37:0/2901902142 wait complete. 2023-07-12T02:04:29.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.728+0000 7f208659c700 1 --2- 172.21.15.37:0/2114348910 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f206806adb0 0x7f206806d260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2078000c00 tx=0x7f2078014000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.728+0000 7ff5d2dff700 1 -- 172.21.15.37:0/2067791705 wait complete. 2023-07-12T02:04:29.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.729+0000 7f8caaffd700 1 --2- 172.21.15.37:0/3697667255 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8c9806adb0 0x7f8c9806d260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00017a0 tx=0x7f8ca00015b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.729+0000 7fe372dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe36c070a80 0x7fe36c158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.729+0000 7fe372dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe36c0adce0 0x7fe36c0c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.729+0000 7fe372dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe36c160930 0x7fe36c0c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.729+0000 7fe372dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0c2d90 con 0x7fe36c0adce0 2023-07-12T02:04:29.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.729+0000 7fe372dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0c3070 con 0x7fe36c160930 2023-07-12T02:04:29.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.729+0000 7fe372dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0c3350 con 0x7fe36c070a80 2023-07-12T02:04:29.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.729+0000 7f2086d9d700 1 --2- 172.21.15.37:0/2114348910 >> [v2:172.21.15.37:6800/4138487872,v1:172.21.15.37:6801/4138487872] conn(0x7f2068074a80 0x7f2068076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.729+0000 7f8cabfff700 1 --2- 172.21.15.37:0/3697667255 >> [v2:172.21.15.37:6808/769438993,v1:172.21.15.37:6809/769438993] conn(0x7f8c98074a80 0x7f8c98076eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.729+0000 7fe37139c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe36c160930 0x7fe36c0c22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.730+0000 7fe37139c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe36c160930 0x7fe36c0c22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:45192/0 (socket says 172.21.15.37:45192) 2023-07-12T02:04:29.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.730+0000 7fe37139c700 1 -- 172.21.15.37:0/4080920929 learned_addr learned my addr 172.21.15.37:0/4080920929 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:29.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.730+0000 7f2086d9d700 1 --2- 172.21.15.37:0/2114348910 >> [v2:172.21.15.37:6800/4138487872,v1:172.21.15.37:6801/4138487872] conn(0x7f2068074a80 0x7f2068076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.730+0000 7f9ab55ff700 1 Processor -- start 2023-07-12T02:04:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.730+0000 7fe370b9b700 1 --2- 172.21.15.37:0/4080920929 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe36c070a80 0x7fe36c158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.730+0000 7fe37139c700 1 -- 172.21.15.37:0/4080920929 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe36c070a80 msgr2=0x7fe36c158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.730+0000 7fe37139c700 1 --2- 172.21.15.37:0/4080920929 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe36c070a80 0x7fe36c158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.730+0000 7fe37139c700 1 -- 172.21.15.37:0/4080920929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe36c0adce0 msgr2=0x7fe36c0c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.730+0000 7fe37139c700 1 --2- 172.21.15.37:0/4080920929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe36c0adce0 0x7fe36c0c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.730+0000 7fe37139c700 1 -- 172.21.15.37:0/4080920929 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3600094a0 con 0x7fe36c160930 2023-07-12T02:04:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.731+0000 7f8abaffd700 1 -- 172.21.15.37:0/1072790669 <== osd.5 v2:172.21.15.196:6800/3108128182 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8aac077500 con 0x7f8aac074a00 2023-07-12T02:04:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.731+0000 7fe37139c700 1 --2- 172.21.15.37:0/4080920929 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe36c160930 0x7fe36c0c22d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00b990 tx=0x7fe35c00bd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.731+0000 7f8c93fff700 1 -- 172.21.15.37:0/3697667255 <== osd.1 v2:172.21.15.37:6808/769438993 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8c98077580 con 0x7f8c98074a80 2023-07-12T02:04:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.731+0000 7fe3697fa700 1 -- 172.21.15.37:0/4080920929 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c00c9d0 con 0x7fe36c160930 2023-07-12T02:04:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.731+0000 7fe3697fa700 1 -- 172.21.15.37:0/4080920929 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35c00cb30 con 0x7fe36c160930 2023-07-12T02:04:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.731+0000 7fe3697fa700 1 -- 172.21.15.37:0/4080920929 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c014440 con 0x7fe36c160930 2023-07-12T02:04:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.731+0000 7fe372dff700 1 -- 172.21.15.37:0/4080920929 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36c0c3630 con 0x7fe36c160930 2023-07-12T02:04:29.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.732+0000 7fe372dff700 1 -- 172.21.15.37:0/4080920929 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36c0c0dc0 con 0x7fe36c160930 2023-07-12T02:04:29.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.731+0000 7ff5d2dff700 1 Processor -- start 2023-07-12T02:04:29.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.731+0000 7f9ab55ff700 1 -- start start 2023-07-12T02:04:29.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.732+0000 7f2076ffd700 1 -- 172.21.15.37:0/2114348910 <== osd.0 v2:172.21.15.37:6800/4138487872 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2068077580 con 0x7f2068074a80 2023-07-12T02:04:29.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.732+0000 7ff5d2dff700 1 -- start start 2023-07-12T02:04:29.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.733+0000 7ff5d2dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5cc0cf5f0 0x7ff5cc0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.733+0000 7ff5d2dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5cc0d0750 0x7ff5cc160d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.733+0000 7ff5d2dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5cc0d1230 0x7ff5cc1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.733+0000 7ff5d2dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc1612b0 con 0x7ff5cc0d1230 2023-07-12T02:04:29.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.733+0000 7ff5d2dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc161550 con 0x7ff5cc0cf5f0 2023-07-12T02:04:29.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.733+0000 7ff5d2dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc161830 con 0x7ff5cc0d0750 2023-07-12T02:04:29.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.734+0000 7f9ab55ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ab00b59d0 0x7f9ab0152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.734+0000 7f9ab55ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab00d2640 0x7f9ab015b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.734+0000 7f9ab55ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ab015c460 0x7f9ab00b7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.734+0000 7f9ab55ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00c91f0 con 0x7f9ab00d2640 2023-07-12T02:04:29.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.734+0000 7f9ab55ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00c94d0 con 0x7f9ab015c460 2023-07-12T02:04:29.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.734+0000 7f9ab55ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00b1cf0 con 0x7f9ab00b59d0 2023-07-12T02:04:29.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.734+0000 7ff5d0b9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5cc0cf5f0 0x7ff5cc0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.734+0000 7ff5cbfff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5cc0d0750 0x7ff5cc160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.734+0000 7ff5cbfff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5cc0d0750 0x7ff5cc160d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:45704/0 (socket says 172.21.15.37:45704) 2023-07-12T02:04:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.734+0000 7ff5cbfff700 1 -- 172.21.15.37:0/2575917052 learned_addr learned my addr 172.21.15.37:0/2575917052 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.734+0000 7ff5d139c700 1 --2- 172.21.15.37:0/2575917052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5cc0d1230 0x7ff5cc1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.734+0000 7f9aaeffd700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ab00b59d0 0x7f9ab0152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.735+0000 7f9aaeffd700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ab00b59d0 0x7f9ab0152df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:45706/0 (socket says 172.21.15.37:45706) 2023-07-12T02:04:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.735+0000 7f9aaeffd700 1 -- 172.21.15.37:0/1969464122 learned_addr learned my addr 172.21.15.37:0/1969464122 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:29.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.735+0000 7f9aa7fff700 1 --2- 172.21.15.37:0/1969464122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab00d2640 0x7f9ab015b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.735+0000 7f9aaf7fe700 1 --2- 172.21.15.37:0/1969464122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ab015c460 0x7f9ab00b7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.736+0000 7f9aa7fff700 1 -- 172.21.15.37:0/1969464122 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ab00b59d0 msgr2=0x7f9ab0152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.736+0000 7f9aa7fff700 1 --2- 172.21.15.37:0/1969464122 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ab00b59d0 0x7f9ab0152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.735+0000 7ff5d139c700 1 -- 172.21.15.37:0/2575917052 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5cc0d0750 msgr2=0x7ff5cc160d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.735+0000 7ff5d139c700 1 --2- 172.21.15.37:0/2575917052 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5cc0d0750 0x7ff5cc160d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.735+0000 7ff5d139c700 1 -- 172.21.15.37:0/2575917052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5cc0cf5f0 msgr2=0x7ff5cc0cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.735+0000 7ff5d139c700 1 --2- 172.21.15.37:0/2575917052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5cc0cf5f0 0x7ff5cc0cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.735+0000 7ff5d139c700 1 -- 172.21.15.37:0/2575917052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b80094a0 con 0x7ff5cc0d1230 2023-07-12T02:04:29.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.736+0000 7f9aa7fff700 1 -- 172.21.15.37:0/1969464122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ab015c460 msgr2=0x7f9ab00b7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.736+0000 7f9aa7fff700 1 --2- 172.21.15.37:0/1969464122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ab015c460 0x7f9ab00b7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.736+0000 7f9aa7fff700 1 -- 172.21.15.37:0/1969464122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa8009b30 con 0x7f9ab00d2640 2023-07-12T02:04:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.736+0000 7f9aaf7fe700 1 --2- 172.21.15.37:0/1969464122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ab015c460 0x7f9ab00b7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.736+0000 7ff5d139c700 1 --2- 172.21.15.37:0/2575917052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5cc0d1230 0x7ff5cc1585a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4007d90 tx=0x7ff5c400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.736+0000 7f9aa7fff700 1 --2- 172.21.15.37:0/1969464122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab00d2640 0x7f9ab015b5f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800b410 tx=0x7f9a98009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.737+0000 7f9aa77fe700 1 -- 172.21.15.37:0/1969464122 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98011830 con 0x7f9ab00d2640 2023-07-12T02:04:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.737+0000 7f9aa77fe700 1 -- 172.21.15.37:0/1969464122 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a98011990 con 0x7f9ab00d2640 2023-07-12T02:04:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.737+0000 7f9aa77fe700 1 -- 172.21.15.37:0/1969464122 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98011d20 con 0x7f9ab00d2640 2023-07-12T02:04:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.738+0000 7f9ab55ff700 1 -- 172.21.15.37:0/1969464122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab00b1fd0 con 0x7f9ab00d2640 2023-07-12T02:04:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.738+0000 7f9ab55ff700 1 -- 172.21.15.37:0/1969464122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab015bb30 con 0x7f9ab00d2640 2023-07-12T02:04:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.736+0000 7fe372dff700 1 -- 172.21.15.37:0/4080920929 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe34c000fc0 con 0x7fe36c160930 2023-07-12T02:04:29.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.740+0000 7f9ab55ff700 1 -- 172.21.15.37:0/1969464122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ab00cd5e0 con 0x7f9ab00d2640 2023-07-12T02:04:29.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.737+0000 7ff5c97fa700 1 -- 172.21.15.37:0/2575917052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4018070 con 0x7ff5cc0d1230 2023-07-12T02:04:29.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.738+0000 7ff5c97fa700 1 -- 172.21.15.37:0/2575917052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c400ebe0 con 0x7ff5cc0d1230 2023-07-12T02:04:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.738+0000 7ff5c97fa700 1 -- 172.21.15.37:0/2575917052 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4003a20 con 0x7ff5cc0d1230 2023-07-12T02:04:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.741+0000 7ff5d2dff700 1 -- 172.21.15.37:0/2575917052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5cc161b10 con 0x7ff5cc0d1230 2023-07-12T02:04:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.741+0000 7ff5d2dff700 1 -- 172.21.15.37:0/2575917052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5cc158ae0 con 0x7ff5cc0d1230 2023-07-12T02:04:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.739+0000 7fe3697fa700 1 -- 172.21.15.37:0/4080920929 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe35c006d50 con 0x7fe36c160930 2023-07-12T02:04:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.741+0000 7fe3697fa700 1 --2- 172.21.15.37:0/4080920929 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe35806adb0 0x7fe35806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.741+0000 7fe3697fa700 1 -- 172.21.15.37:0/4080920929 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe35c0895c0 con 0x7fe36c160930 2023-07-12T02:04:29.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.741+0000 7fe3697fa700 1 --2- 172.21.15.37:0/4080920929 >> [v2:172.21.15.196:6808/25224914,v1:172.21.15.196:6809/25224914] conn(0x7fe358074a80 0x7fe358076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.741+0000 7fe3697fa700 1 -- 172.21.15.37:0/4080920929 --> [v2:172.21.15.196:6808/25224914,v1:172.21.15.196:6809/25224914] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe358077580 con 0x7fe358074a80 2023-07-12T02:04:29.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.741+0000 7fe3697fa700 1 -- 172.21.15.37:0/4080920929 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe35c089970 con 0x7fe36c160930 2023-07-12T02:04:29.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.742+0000 7fe36bfff700 1 --2- 172.21.15.37:0/4080920929 >> [v2:172.21.15.196:6808/25224914,v1:172.21.15.196:6809/25224914] conn(0x7fe358074a80 0x7fe358076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.742+0000 7ff5d2dff700 1 -- 172.21.15.37:0/2575917052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff5cc0b4800 con 0x7ff5cc0d1230 2023-07-12T02:04:29.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.743+0000 7fe370b9b700 1 --2- 172.21.15.37:0/4080920929 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe35806adb0 0x7fe35806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.743+0000 7f9aa77fe700 1 -- 172.21.15.37:0/1969464122 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a9801a400 con 0x7f9ab00d2640 2023-07-12T02:04:29.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.744+0000 7fe36bfff700 1 --2- 172.21.15.37:0/4080920929 >> [v2:172.21.15.196:6808/25224914,v1:172.21.15.196:6809/25224914] conn(0x7fe358074a80 0x7fe358076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.745+0000 7f9aa77fe700 1 --2- 172.21.15.37:0/1969464122 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9a9006adb0 0x7f9a9006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.745+0000 7f9aa77fe700 1 -- 172.21.15.37:0/1969464122 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9a98089550 con 0x7f9ab00d2640 2023-07-12T02:04:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.746+0000 7f81477ff700 1 -- 172.21.15.37:0/2463686059 --> [v2:172.21.15.37:6810/2081951691,v1:172.21.15.37:6812/2081951691] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f81400adce0 con 0x7f8124074a80 2023-07-12T02:04:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.746+0000 7f9aa77fe700 1 --2- 172.21.15.37:0/1969464122 >> [v2:172.21.15.196:6816/814714896,v1:172.21.15.196:6817/814714896] conn(0x7f9a90074a80 0x7f9a90076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.746+0000 7f9aa77fe700 1 -- 172.21.15.37:0/1969464122 --> [v2:172.21.15.196:6816/814714896,v1:172.21.15.196:6817/814714896] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a90077580 con 0x7f9a90074a80 2023-07-12T02:04:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.746+0000 7f9aa77fe700 1 -- 172.21.15.37:0/1969464122 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a9808bb70 con 0x7f9ab00d2640 2023-07-12T02:04:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.746+0000 7fe370b9b700 1 --2- 172.21.15.37:0/4080920929 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe35806adb0 0x7fe35806d260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe364000f60 tx=0x7fe364007c90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.746+0000 7ff5c97fa700 1 -- 172.21.15.37:0/2575917052 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff5c4003b80 con 0x7ff5cc0d1230 2023-07-12T02:04:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.746+0000 7fe3697fa700 1 -- 172.21.15.37:0/4080920929 <== osd.6 v2:172.21.15.196:6808/25224914 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe358077580 con 0x7fe358074a80 2023-07-12T02:04:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.746+0000 7f8135ffb700 1 -- 172.21.15.37:0/2463686059 <== osd.3 v2:172.21.15.37:6810/2081951691 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f81300117b0 con 0x7f8124074a80 2023-07-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.746+0000 7f9aaeffd700 1 --2- 172.21.15.37:0/1969464122 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9a9006adb0 0x7f9a9006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.747+0000 7f9aaf7fe700 1 --2- 172.21.15.37:0/1969464122 >> [v2:172.21.15.196:6816/814714896,v1:172.21.15.196:6817/814714896] conn(0x7f9a90074a80 0x7f9a90076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.747+0000 7f81477ff700 1 -- 172.21.15.37:0/2463686059 >> [v2:172.21.15.37:6810/2081951691,v1:172.21.15.37:6812/2081951691] conn(0x7f8124074a80 msgr2=0x7f8124076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.747+0000 7f81477ff700 1 --2- 172.21.15.37:0/2463686059 >> [v2:172.21.15.37:6810/2081951691,v1:172.21.15.37:6812/2081951691] conn(0x7f8124074a80 0x7f8124076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.748+0000 7f81477ff700 1 -- 172.21.15.37:0/2463686059 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f812406adb0 msgr2=0x7f812406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.748+0000 7f81477ff700 1 --2- 172.21.15.37:0/2463686059 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f812406adb0 0x7f812406d260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f813c006b20 tx=0x7f813c006ab0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.748+0000 7f81477ff700 1 -- 172.21.15.37:0/2463686059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8140160ab0 msgr2=0x7f814006cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.748+0000 7f81477ff700 1 --2- 172.21.15.37:0/2463686059 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8140160ab0 0x7f814006cf20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f813800cba0 tx=0x7f813800cf60 comp rx=0 tx=0).stop 2023-07-12T02:04:29.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.748+0000 7f8145d9c700 1 -- 172.21.15.37:0/2463686059 reap_dead start 2023-07-12T02:04:29.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.748+0000 7f81477ff700 1 -- 172.21.15.37:0/2463686059 shutdown_connections 2023-07-12T02:04:29.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.748+0000 7f81477ff700 1 -- 172.21.15.37:0/2463686059 >> 172.21.15.37:0/2463686059 conn(0x7f814006abc0 msgr2=0x7f814015d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.748+0000 7f9aaeffd700 1 --2- 172.21.15.37:0/1969464122 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9a9006adb0 0x7f9a9006d260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009ad0 tx=0x7f9aa0009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.748+0000 7ff5c97fa700 1 --2- 172.21.15.37:0/2575917052 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff5b006adb0 0x7ff5b006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.749+0000 7f81477ff700 1 -- 172.21.15.37:0/2463686059 shutdown_connections 2023-07-12T02:04:29.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.749+0000 7f81477ff700 1 -- 172.21.15.37:0/2463686059 wait complete. 2023-07-12T02:04:29.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.749+0000 7ff5c97fa700 1 -- 172.21.15.37:0/2575917052 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff5c408a6d0 con 0x7ff5cc0d1230 2023-07-12T02:04:29.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.749+0000 7ff5c97fa700 1 --2- 172.21.15.37:0/2575917052 >> [v2:172.21.15.196:6824/1327123744,v1:172.21.15.196:6825/1327123744] conn(0x7ff5b0074a80 0x7ff5b0076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:29.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.749+0000 7ff5c97fa700 1 -- 172.21.15.37:0/2575917052 --> [v2:172.21.15.196:6824/1327123744,v1:172.21.15.196:6825/1327123744] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5b0077580 con 0x7ff5b0074a80 2023-07-12T02:04:29.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.749+0000 7ff5c97fa700 1 -- 172.21.15.37:0/2575917052 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5c408aa80 con 0x7ff5cc0d1230 2023-07-12T02:04:29.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.750+0000 7ff5d0b9b700 1 --2- 172.21.15.37:0/2575917052 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff5b006adb0 0x7ff5b006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.750+0000 7f9aaf7fe700 1 --2- 172.21.15.37:0/1969464122 >> [v2:172.21.15.196:6816/814714896,v1:172.21.15.196:6817/814714896] conn(0x7f9a90074a80 0x7f9a90076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.751+0000 7ff5cbfff700 1 --2- 172.21.15.37:0/2575917052 >> [v2:172.21.15.196:6824/1327123744,v1:172.21.15.196:6825/1327123744] conn(0x7ff5b0074a80 0x7ff5b0076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:29.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.752+0000 7f9aa77fe700 1 -- 172.21.15.37:0/1969464122 <== osd.4 v2:172.21.15.196:6816/814714896 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9a90077580 con 0x7f9a90074a80 2023-07-12T02:04:29.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.752+0000 7ff5d0b9b700 1 --2- 172.21.15.37:0/2575917052 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff5b006adb0 0x7ff5b006d260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0001790 tx=0x7ff5c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.753+0000 7ff5cbfff700 1 --2- 172.21.15.37:0/2575917052 >> [v2:172.21.15.196:6824/1327123744,v1:172.21.15.196:6825/1327123744] conn(0x7ff5b0074a80 0x7ff5b0076eb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:29.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.754+0000 7ff5c97fa700 1 -- 172.21.15.37:0/2575917052 <== osd.7 v2:172.21.15.196:6824/1327123744 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff5b0077580 con 0x7ff5b0074a80 2023-07-12T02:04:29.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.758+0000 7f80f83ff700 1 -- 172.21.15.37:0/643231585 --> [v2:172.21.15.37:6824/527039359,v1:172.21.15.37:6825/527039359] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f80f00cd300 con 0x7f80d4074a80 2023-07-12T02:04:29.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.765+0000 7f80e6ffd700 1 -- 172.21.15.37:0/643231585 <== osd.2 v2:172.21.15.37:6824/527039359 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f80e80098f0 con 0x7f80d4074a80 2023-07-12T02:04:29.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.766+0000 7f80f83ff700 1 -- 172.21.15.37:0/643231585 >> [v2:172.21.15.37:6824/527039359,v1:172.21.15.37:6825/527039359] conn(0x7f80d4074a80 msgr2=0x7f80d4076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.766+0000 7f80f83ff700 1 --2- 172.21.15.37:0/643231585 >> [v2:172.21.15.37:6824/527039359,v1:172.21.15.37:6825/527039359] conn(0x7f80d4074a80 0x7f80d4076eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.766+0000 7f80f83ff700 1 -- 172.21.15.37:0/643231585 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f80d406adb0 msgr2=0x7f80d406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.766+0000 7f80f83ff700 1 --2- 172.21.15.37:0/643231585 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f80d406adb0 0x7f80d406d260 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f80f00d0ff0 tx=0x7f80e00092c0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.766+0000 7f80f83ff700 1 -- 172.21.15.37:0/643231585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80f00cf720 msgr2=0x7f80f01505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.766+0000 7f80f83ff700 1 --2- 172.21.15.37:0/643231585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80f00cf720 0x7f80f01505d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00b4a0 tx=0x7f80ec00b860 comp rx=0 tx=0).stop 2023-07-12T02:04:29.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.766+0000 7f80f699c700 1 -- 172.21.15.37:0/643231585 reap_dead start 2023-07-12T02:04:29.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.766+0000 7f8ad0fff700 1 -- 172.21.15.37:0/1072790669 --> [v2:172.21.15.196:6800/3108128182,v1:172.21.15.196:6801/3108128182] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8ab0002d40 con 0x7f8aac074a00 2023-07-12T02:04:29.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.767+0000 7f80f83ff700 1 -- 172.21.15.37:0/643231585 shutdown_connections 2023-07-12T02:04:29.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.767+0000 7f80f83ff700 1 -- 172.21.15.37:0/643231585 >> 172.21.15.37:0/643231585 conn(0x7f80f0071660 msgr2=0x7f80f015ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.768+0000 7f80f83ff700 1 -- 172.21.15.37:0/643231585 shutdown_connections 2023-07-12T02:04:29.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.768+0000 7f80f83ff700 1 -- 172.21.15.37:0/643231585 wait complete. 2023-07-12T02:04:29.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.770+0000 7f208c9ff700 1 -- 172.21.15.37:0/2114348910 --> [v2:172.21.15.37:6800/4138487872,v1:172.21.15.37:6801/4138487872] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f20880ccc50 con 0x7f2068074a80 2023-07-12T02:04:29.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.769+0000 7f8abaffd700 1 -- 172.21.15.37:0/1072790669 <== osd.5 v2:172.21.15.196:6800/3108128182 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8ab0002d40 con 0x7f8aac074a00 2023-07-12T02:04:29.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.770+0000 7f8ad0fff700 1 -- 172.21.15.37:0/1072790669 >> [v2:172.21.15.196:6800/3108128182,v1:172.21.15.196:6801/3108128182] conn(0x7f8aac074a00 msgr2=0x7f8aac076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.770+0000 7f8ad0fff700 1 --2- 172.21.15.37:0/1072790669 >> [v2:172.21.15.196:6800/3108128182,v1:172.21.15.196:6801/3108128182] conn(0x7f8aac074a00 0x7f8aac076e30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.771+0000 7f2076ffd700 1 -- 172.21.15.37:0/2114348910 <== osd.0 v2:172.21.15.37:6800/4138487872 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f207c00b350 con 0x7f2068074a80 2023-07-12T02:04:29.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.771+0000 7f8cb21ff700 1 -- 172.21.15.37:0/3697667255 --> [v2:172.21.15.37:6808/769438993,v1:172.21.15.37:6809/769438993] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8cac0cd5c0 con 0x7f8c98074a80 2023-07-12T02:04:29.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.771+0000 7f8ad0fff700 1 -- 172.21.15.37:0/1072790669 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8aac06adb0 msgr2=0x7f8aac06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.771+0000 7f8ad0fff700 1 --2- 172.21.15.37:0/1072790669 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8aac06adb0 0x7f8aac06d260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0001730 tx=0x7f8ac0009040 comp rx=0 tx=0).stop 2023-07-12T02:04:29.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.771+0000 7f8ad0fff700 1 -- 172.21.15.37:0/1072790669 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8acc0c9d40 msgr2=0x7f8acc159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.771+0000 7f8ad0fff700 1 --2- 172.21.15.37:0/1072790669 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8acc0c9d40 0x7f8acc159bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8ac400bfa0 tx=0x7f8ac4004ad0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.772+0000 7f8acad9d700 1 -- 172.21.15.37:0/1072790669 reap_dead start 2023-07-12T02:04:29.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.772+0000 7f208c9ff700 1 -- 172.21.15.37:0/2114348910 >> [v2:172.21.15.37:6800/4138487872,v1:172.21.15.37:6801/4138487872] conn(0x7f2068074a80 msgr2=0x7f2068076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.772+0000 7f208c9ff700 1 --2- 172.21.15.37:0/2114348910 >> [v2:172.21.15.37:6800/4138487872,v1:172.21.15.37:6801/4138487872] conn(0x7f2068074a80 0x7f2068076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.772+0000 7f208c9ff700 1 -- 172.21.15.37:0/2114348910 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f206806adb0 msgr2=0x7f206806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.772+0000 7f208c9ff700 1 --2- 172.21.15.37:0/2114348910 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f206806adb0 0x7f206806d260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2078000c00 tx=0x7f2078014000 comp rx=0 tx=0).stop 2023-07-12T02:04:29.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.772+0000 7f208c9ff700 1 -- 172.21.15.37:0/2114348910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20880c96d0 msgr2=0x7f208814b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.772+0000 7f208c9ff700 1 --2- 172.21.15.37:0/2114348910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f20880c96d0 0x7f208814b0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f208000d7a0 tx=0x7f208000dab0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.772+0000 7f2086d9d700 1 -- 172.21.15.37:0/2114348910 reap_dead start 2023-07-12T02:04:29.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.772+0000 7f208c9ff700 1 -- 172.21.15.37:0/2114348910 shutdown_connections 2023-07-12T02:04:29.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.772+0000 7f208c9ff700 1 -- 172.21.15.37:0/2114348910 >> 172.21.15.37:0/2114348910 conn(0x7f20880b0390 msgr2=0x7f20880afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.773+0000 7f8ad0fff700 1 -- 172.21.15.37:0/1072790669 shutdown_connections 2023-07-12T02:04:29.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.773+0000 7f8ad0fff700 1 -- 172.21.15.37:0/1072790669 >> 172.21.15.37:0/1072790669 conn(0x7f8acc06abc0 msgr2=0x7f8acc06e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.811 INFO:teuthology.orchestra.run.smithi037.stdout:55834574859 2023-07-12T02:04:29.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-12T02:04:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.776+0000 7f208c9ff700 1 -- 172.21.15.37:0/2114348910 shutdown_connections 2023-07-12T02:04:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.776+0000 7f8ad0fff700 1 -- 172.21.15.37:0/1072790669 shutdown_connections 2023-07-12T02:04:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.776+0000 7f8ad0fff700 1 -- 172.21.15.37:0/1072790669 wait complete. 2023-07-12T02:04:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.776+0000 7f208c9ff700 1 -- 172.21.15.37:0/2114348910 wait complete. 2023-07-12T02:04:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.773+0000 7f8c93fff700 1 -- 172.21.15.37:0/3697667255 <== osd.1 v2:172.21.15.37:6808/769438993 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8c9c009690 con 0x7f8c98074a80 2023-07-12T02:04:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.777+0000 7f8cb21ff700 1 -- 172.21.15.37:0/3697667255 >> [v2:172.21.15.37:6808/769438993,v1:172.21.15.37:6809/769438993] conn(0x7f8c98074a80 msgr2=0x7f8c98076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.777+0000 7f8cb21ff700 1 --2- 172.21.15.37:0/3697667255 >> [v2:172.21.15.37:6808/769438993,v1:172.21.15.37:6809/769438993] conn(0x7f8c98074a80 0x7f8c98076eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.777+0000 7f8cb21ff700 1 -- 172.21.15.37:0/3697667255 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8c9806adb0 msgr2=0x7f8c9806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.777+0000 7f8cb21ff700 1 --2- 172.21.15.37:0/3697667255 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8c9806adb0 0x7f8c9806d260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00017a0 tx=0x7f8ca00015b0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.777+0000 7f8cb21ff700 1 -- 172.21.15.37:0/3697667255 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c94003a00 msgr2=0x7f8cac16a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.777+0000 7f8cb21ff700 1 --2- 172.21.15.37:0/3697667255 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c94003a00 0x7f8cac16a090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4002230 tx=0x7f8ca4001330 comp rx=0 tx=0).stop 2023-07-12T02:04:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.777+0000 7f8cabfff700 1 -- 172.21.15.37:0/3697667255 reap_dead start 2023-07-12T02:04:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.778+0000 7f8cb21ff700 1 -- 172.21.15.37:0/3697667255 shutdown_connections 2023-07-12T02:04:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.778+0000 7f8cb21ff700 1 -- 172.21.15.37:0/3697667255 >> 172.21.15.37:0/3697667255 conn(0x7f8cac06abc0 msgr2=0x7f8cac070240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.778+0000 7f8cb21ff700 1 -- 172.21.15.37:0/3697667255 shutdown_connections 2023-07-12T02:04:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.779+0000 7f8cb21ff700 1 -- 172.21.15.37:0/3697667255 wait complete. 2023-07-12T02:04:29.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.779+0000 7ff5d2dff700 1 -- 172.21.15.37:0/2575917052 --> [v2:172.21.15.196:6824/1327123744,v1:172.21.15.196:6825/1327123744] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff5cc0d21e0 con 0x7ff5b0074a80 2023-07-12T02:04:29.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.780+0000 7fe372dff700 1 -- 172.21.15.37:0/4080920929 --> [v2:172.21.15.196:6808/25224914,v1:172.21.15.196:6809/25224914] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe34c002d40 con 0x7fe358074a80 2023-07-12T02:04:29.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.780+0000 7ff5c97fa700 1 -- 172.21.15.37:0/2575917052 <== osd.7 v2:172.21.15.196:6824/1327123744 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff5b80036a0 con 0x7ff5b0074a80 2023-07-12T02:04:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.780+0000 7fe3697fa700 1 -- 172.21.15.37:0/4080920929 <== osd.6 v2:172.21.15.196:6808/25224914 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe34c002d40 con 0x7fe358074a80 2023-07-12T02:04:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.781+0000 7ff5d2dff700 1 -- 172.21.15.37:0/2575917052 >> [v2:172.21.15.196:6824/1327123744,v1:172.21.15.196:6825/1327123744] conn(0x7ff5b0074a80 msgr2=0x7ff5b0076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.781+0000 7ff5d2dff700 1 --2- 172.21.15.37:0/2575917052 >> [v2:172.21.15.196:6824/1327123744,v1:172.21.15.196:6825/1327123744] conn(0x7ff5b0074a80 0x7ff5b0076eb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.781+0000 7ff5d2dff700 1 -- 172.21.15.37:0/2575917052 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff5b006adb0 msgr2=0x7ff5b006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.781+0000 7ff5d2dff700 1 --2- 172.21.15.37:0/2575917052 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff5b006adb0 0x7ff5b006d260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0001790 tx=0x7ff5c0009040 comp rx=0 tx=0).stop 2023-07-12T02:04:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.781+0000 7ff5d2dff700 1 -- 172.21.15.37:0/2575917052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5cc0d1230 msgr2=0x7ff5cc1585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.781+0000 7ff5d2dff700 1 --2- 172.21.15.37:0/2575917052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5cc0d1230 0x7ff5cc1585a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4007d90 tx=0x7ff5c400e3c0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.781+0000 7ff5d139c700 1 -- 172.21.15.37:0/2575917052 reap_dead start 2023-07-12T02:04:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.782+0000 7fe372dff700 1 -- 172.21.15.37:0/4080920929 >> [v2:172.21.15.196:6808/25224914,v1:172.21.15.196:6809/25224914] conn(0x7fe358074a80 msgr2=0x7fe358076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.782+0000 7fe372dff700 1 --2- 172.21.15.37:0/4080920929 >> [v2:172.21.15.196:6808/25224914,v1:172.21.15.196:6809/25224914] conn(0x7fe358074a80 0x7fe358076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.782+0000 7fe372dff700 1 -- 172.21.15.37:0/4080920929 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe35806adb0 msgr2=0x7fe35806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.782+0000 7fe372dff700 1 --2- 172.21.15.37:0/4080920929 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe35806adb0 0x7fe35806d260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe364000f60 tx=0x7fe364007c90 comp rx=0 tx=0).stop 2023-07-12T02:04:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.782+0000 7fe372dff700 1 -- 172.21.15.37:0/4080920929 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe36c160930 msgr2=0x7fe36c0c22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.782+0000 7fe372dff700 1 --2- 172.21.15.37:0/4080920929 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe36c160930 0x7fe36c0c22d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00b990 tx=0x7fe35c00bd50 comp rx=0 tx=0).stop 2023-07-12T02:04:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.782+0000 7fe37139c700 1 -- 172.21.15.37:0/4080920929 reap_dead start 2023-07-12T02:04:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.782+0000 7ff5d2dff700 1 -- 172.21.15.37:0/2575917052 shutdown_connections 2023-07-12T02:04:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.782+0000 7ff5d2dff700 1 -- 172.21.15.37:0/2575917052 >> 172.21.15.37:0/2575917052 conn(0x7ff5cc071660 msgr2=0x7ff5cc0b5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.782+0000 7fe372dff700 1 -- 172.21.15.37:0/4080920929 shutdown_connections 2023-07-12T02:04:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.782+0000 7fe372dff700 1 -- 172.21.15.37:0/4080920929 >> 172.21.15.37:0/4080920929 conn(0x7fe36c0b0390 msgr2=0x7fe36c06c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.783+0000 7fe372dff700 1 -- 172.21.15.37:0/4080920929 shutdown_connections 2023-07-12T02:04:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.783+0000 7fe372dff700 1 -- 172.21.15.37:0/4080920929 wait complete. 2023-07-12T02:04:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.785+0000 7ff5d2dff700 1 -- 172.21.15.37:0/2575917052 shutdown_connections 2023-07-12T02:04:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.787+0000 7ff5d2dff700 1 -- 172.21.15.37:0/2575917052 wait complete. 2023-07-12T02:04:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.787+0000 7f9ab55ff700 1 -- 172.21.15.37:0/1969464122 --> [v2:172.21.15.196:6816/814714896,v1:172.21.15.196:6817/814714896] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9ab00cd300 con 0x7f9a90074a80 2023-07-12T02:04:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.788+0000 7f9aa77fe700 1 -- 172.21.15.37:0/1969464122 <== osd.4 v2:172.21.15.196:6816/814714896 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9aa8003cb0 con 0x7f9a90074a80 2023-07-12T02:04:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.788+0000 7f9ab55ff700 1 -- 172.21.15.37:0/1969464122 >> [v2:172.21.15.196:6816/814714896,v1:172.21.15.196:6817/814714896] conn(0x7f9a90074a80 msgr2=0x7f9a90076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.788+0000 7f9ab55ff700 1 --2- 172.21.15.37:0/1969464122 >> [v2:172.21.15.196:6816/814714896,v1:172.21.15.196:6817/814714896] conn(0x7f9a90074a80 0x7f9a90076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.788+0000 7f9ab55ff700 1 -- 172.21.15.37:0/1969464122 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9a9006adb0 msgr2=0x7f9a9006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.789+0000 7f9ab55ff700 1 --2- 172.21.15.37:0/1969464122 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9a9006adb0 0x7f9a9006d260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009ad0 tx=0x7f9aa0009210 comp rx=0 tx=0).stop 2023-07-12T02:04:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.789+0000 7f9ab55ff700 1 -- 172.21.15.37:0/1969464122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab00d2640 msgr2=0x7f9ab015b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.789+0000 7f9ab55ff700 1 --2- 172.21.15.37:0/1969464122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab00d2640 0x7f9ab015b5f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800b410 tx=0x7f9a98009f90 comp rx=0 tx=0).stop 2023-07-12T02:04:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.789+0000 7f9aaf7fe700 1 -- 172.21.15.37:0/1969464122 reap_dead start 2023-07-12T02:04:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.789+0000 7f9ab55ff700 1 -- 172.21.15.37:0/1969464122 shutdown_connections 2023-07-12T02:04:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.789+0000 7f9ab55ff700 1 -- 172.21.15.37:0/1969464122 >> 172.21.15.37:0/1969464122 conn(0x7f9ab0071660 msgr2=0x7f9ab01606e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.789+0000 7f9ab55ff700 1 -- 172.21.15.37:0/1969464122 shutdown_connections 2023-07-12T02:04:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:29.789+0000 7f9ab55ff700 1 -- 172.21.15.37:0/1969464122 wait complete. 2023-07-12T02:04:29.825 INFO:teuthology.orchestra.run.smithi037.stdout:55834574859 2023-07-12T02:04:29.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-12T02:04:29.826 INFO:teuthology.orchestra.run.smithi037.stdout:55834574860 2023-07-12T02:04:29.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-12T02:04:29.827 INFO:teuthology.orchestra.run.smithi037.stdout:55834574860 2023-07-12T02:04:29.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-12T02:04:29.828 INFO:teuthology.orchestra.run.smithi037.stdout:55834574859 2023-07-12T02:04:29.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-12T02:04:29.830 INFO:teuthology.orchestra.run.smithi037.stdout:55834574859 2023-07-12T02:04:29.830 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-12T02:04:29.831 INFO:teuthology.orchestra.run.smithi037.stdout:55834574859 2023-07-12T02:04:29.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-12T02:04:29.832 INFO:teuthology.orchestra.run.smithi037.stdout:55834574860 2023-07-12T02:04:29.832 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-12T02:04:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.233+0000 7fd63cdff700 1 Processor -- start 2023-07-12T02:04:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.233+0000 7fd63cdff700 1 -- start start 2023-07-12T02:04:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.235+0000 7fd63cdff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6380c9970 0x7fd6380cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.235+0000 7fd63cdff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6380cb8b0 0x7fd638157d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.235+0000 7fd63cdff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6380cce20 con 0x7fd6380c9d40 2023-07-12T02:04:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.235+0000 7fd63cdff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6380cd100 con 0x7fd6380cb8b0 2023-07-12T02:04:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.235+0000 7fd63cdff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380cd3e0 con 0x7fd6380c9970 2023-07-12T02:04:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.236+0000 7fd63659c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6380c9970 0x7fd6380cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.236+0000 7fd63659c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6380c9970 0x7fd6380cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:45708/0 (socket says 172.21.15.37:45708) 2023-07-12T02:04:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.236+0000 7fd63659c700 1 -- 172.21.15.37:0/2674946183 learned_addr learned my addr 172.21.15.37:0/2674946183 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.237+0000 7fd63659c700 1 -- 172.21.15.37:0/2674946183 >> v2:172.21.15.37:3300/0 conn(0x7fd6380cb8b0 msgr2=0x7fd638157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.237+0000 7fd63659c700 1 --2- 172.21.15.37:0/2674946183 >> v2:172.21.15.37:3300/0 conn(0x7fd6380cb8b0 0x7fd638157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.237+0000 7fd63659c700 1 -- 172.21.15.37:0/2674946183 >> v1:172.21.15.37:6789/0 conn(0x7fd6380c9d40 legacy=0x7fd6380cb1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:04:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.237+0000 7fd63659c700 1 -- 172.21.15.37:0/2674946183 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6380cd6c0 con 0x7fd6380c9970 2023-07-12T02:04:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.238+0000 7fd63659c700 1 --2- 172.21.15.37:0/2674946183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6380c9970 0x7fd6380cdec0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6280088f0 tx=0x7fd62800d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=907ee72a34fbafe6 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.234+0000 7f1ededff700 1 Processor -- start 2023-07-12T02:04:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.234+0000 7f1ededff700 1 -- start start 2023-07-12T02:04:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.236+0000 7f1ededff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1ed80cb8c0 0x7f1ed80ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.236+0000 7f1ededff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed80c1d30 con 0x7f1ed8160ab0 2023-07-12T02:04:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.236+0000 7f1ededff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed80cc840 con 0x7f1ed81606e0 2023-07-12T02:04:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.236+0000 7f1ededff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed80ce670 con 0x7f1ed80cb8c0 2023-07-12T02:04:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.239+0000 7f1edcb9b700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f1ed81606e0 0x7f1ed806c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:56372/0 (socket says 172.21.15.37:56372) 2023-07-12T02:04:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.239+0000 7f1edcb9b700 1 -- 172.21.15.37:0/4073198869 learned_addr learned my addr 172.21.15.37:0/4073198869 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.238+0000 7fd63559a700 1 -- 172.21.15.37:0/2674946183 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628010070 con 0x7fd6380c9970 2023-07-12T02:04:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.239+0000 7fd63559a700 1 -- 172.21.15.37:0/2674946183 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62800da40 con 0x7fd6380c9970 2023-07-12T02:04:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.239+0000 7fd63559a700 1 -- 172.21.15.37:0/2674946183 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62800ddd0 con 0x7fd6380c9970 2023-07-12T02:04:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.240+0000 7fd63cdff700 1 -- 172.21.15.37:0/2674946183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6380c9970 msgr2=0x7fd6380cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.240+0000 7fd63cdff700 1 --2- 172.21.15.37:0/2674946183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6380c9970 0x7fd6380cdec0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6280088f0 tx=0x7fd62800d330 comp rx=0 tx=0).stop 2023-07-12T02:04:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.240+0000 7fd63cdff700 1 -- 172.21.15.37:0/2674946183 shutdown_connections 2023-07-12T02:04:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.240+0000 7fd63cdff700 1 --2- 172.21.15.37:0/2674946183 >> v2:172.21.15.37:3300/0 conn(0x7fd6380cb8b0 0x7fd638157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.240+0000 7fd63cdff700 1 --2- 172.21.15.37:0/2674946183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6380c9970 0x7fd6380cdec0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.240+0000 7fd63cdff700 1 -- 172.21.15.37:0/2674946183 >> 172.21.15.37:0/2674946183 conn(0x7fd63806abc0 msgr2=0x7fd6380b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.240+0000 7f1ed77fe700 1 -- 172.21.15.37:0/4073198869 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662263185 0 0) 0x7f1ed80cc840 con 0x7f1ed81606e0 2023-07-12T02:04:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.240+0000 7f1ed77fe700 1 -- 172.21.15.37:0/4073198869 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ec80035b0 con 0x7f1ed81606e0 2023-07-12T02:04:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.240+0000 7f1edd39c700 1 --2- 172.21.15.37:0/4073198869 >> v2:172.21.15.37:3300/0 conn(0x7f1ed80cb8c0 0x7f1ed80ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.241+0000 7fd63cdff700 1 -- 172.21.15.37:0/2674946183 shutdown_connections 2023-07-12T02:04:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.241+0000 7f1ed77fe700 1 -- 172.21.15.37:0/4073198869 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 751683001 0 0) 0x7f1ec80035b0 con 0x7f1ed81606e0 2023-07-12T02:04:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.241+0000 7f1ed77fe700 1 -- 172.21.15.37:0/4073198869 >> v2:172.21.15.37:3300/0 conn(0x7f1ed80cb8c0 msgr2=0x7f1ed80ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.241+0000 7f1ed77fe700 1 --2- 172.21.15.37:0/4073198869 >> v2:172.21.15.37:3300/0 conn(0x7f1ed80cb8c0 0x7f1ed80ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.241+0000 7f1ed77fe700 1 -- 172.21.15.37:0/4073198869 >> v1:172.21.15.37:6789/0 conn(0x7f1ed8160ab0 legacy=0x7f1ed80cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.241+0000 7f1ed77fe700 1 -- 172.21.15.37:0/4073198869 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed80adc60 con 0x7f1ed81606e0 2023-07-12T02:04:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.241+0000 7f1ed77fe700 1 -- 172.21.15.37:0/4073198869 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7f1ecc001670 con 0x7f1ed81606e0 2023-07-12T02:04:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.241+0000 7f1ed77fe700 1 -- 172.21.15.37:0/4073198869 >> v1:172.21.15.196:6789/0 conn(0x7f1ed81606e0 legacy=0x7f1ed806c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.241+0000 7f1ed77fe700 1 --2- 172.21.15.37:0/4073198869 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ec8003a00 0x7f1ec8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.241+0000 7f1ed77fe700 1 --2- 172.21.15.37:0/4073198869 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ec8004850 0x7f1ec8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.241+0000 7f1ed77fe700 1 --2- 172.21.15.37:0/4073198869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ec8005200 0x7f1ec800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.241+0000 7f1ed77fe700 1 -- 172.21.15.37:0/4073198869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec800c050 con 0x7f1ec8005200 2023-07-12T02:04:30.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.241+0000 7f1ed77fe700 1 -- 172.21.15.37:0/4073198869 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec800c1c0 con 0x7f1ec8004850 2023-07-12T02:04:30.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.241+0000 7f1ed77fe700 1 -- 172.21.15.37:0/4073198869 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec800c380 con 0x7f1ec8003a00 2023-07-12T02:04:30.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.242+0000 7f1edcb9b700 1 --2- 172.21.15.37:0/4073198869 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ec8003a00 0x7f1ec8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.243+0000 7f1edd39c700 1 --2- 172.21.15.37:0/4073198869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ec8005200 0x7f1ec800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.243+0000 7f1ed7fff700 1 --2- 172.21.15.37:0/4073198869 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ec8004850 0x7f1ec8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.241+0000 7fd63cdff700 1 -- 172.21.15.37:0/2674946183 wait complete. 2023-07-12T02:04:30.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.243+0000 7f1edcb9b700 1 -- 172.21.15.37:0/4073198869 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ec8004850 msgr2=0x7f1ec8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:30.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.243+0000 7f1edcb9b700 1 --2- 172.21.15.37:0/4073198869 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ec8004850 0x7f1ec8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.244+0000 7f1edcb9b700 1 -- 172.21.15.37:0/4073198869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ec8005200 msgr2=0x7f1ec800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:30.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.244+0000 7f1edcb9b700 1 --2- 172.21.15.37:0/4073198869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ec8005200 0x7f1ec800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.244+0000 7f1edcb9b700 1 -- 172.21.15.37:0/4073198869 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed80adc60 con 0x7f1ec8003a00 2023-07-12T02:04:30.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.244+0000 7f1edd39c700 1 -- 172.21.15.37:0/4073198869 reap_dead start 2023-07-12T02:04:30.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.244+0000 7fd63cdff700 1 Processor -- start 2023-07-12T02:04:30.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.244+0000 7fd63cdff700 1 -- start start 2023-07-12T02:04:30.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.245+0000 7f1edcb9b700 1 --2- 172.21.15.37:0/4073198869 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ec8003a00 0x7f1ec8003e10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc007fd0 tx=0x7f1ec8005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4899cfc7b2366e server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.246+0000 7fd63cdff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6380c9970 0x7fd6380c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.246+0000 7fd63cdff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6380cb8b0 0x7fd63815a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.246+0000 7fd63cdff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6380c8890 0x7fd63814e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.246+0000 7fd63cdff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63814eb20 con 0x7fd6380cb8b0 2023-07-12T02:04:30.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.246+0000 7fd63cdff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380c7fe0 con 0x7fd6380c9970 2023-07-12T02:04:30.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.246+0000 7fd63cdff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380b1810 con 0x7fd6380c8890 2023-07-12T02:04:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.246+0000 7f1ed77fe700 1 -- 172.21.15.37:0/4073198869 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc007bf0 con 0x7f1ec8003a00 2023-07-12T02:04:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.246+0000 7f1ed77fe700 1 -- 172.21.15.37:0/4073198869 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc00cdf0 con 0x7f1ec8003a00 2023-07-12T02:04:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.246+0000 7f1ed77fe700 1 -- 172.21.15.37:0/4073198869 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc005ba0 con 0x7f1ec8003a00 2023-07-12T02:04:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.247+0000 7f1ededff700 1 -- 172.21.15.37:0/4073198869 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ec8003a00 msgr2=0x7f1ec8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.247+0000 7f1ededff700 1 --2- 172.21.15.37:0/4073198869 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ec8003a00 0x7f1ec8003e10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc007fd0 tx=0x7f1ec8005880 comp rx=0 tx=0).stop 2023-07-12T02:04:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.247+0000 7fd636d9d700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6380c8890 0x7fd63814e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.247+0000 7fd636d9d700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6380c8890 0x7fd63814e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:45726/0 (socket says 172.21.15.37:45726) 2023-07-12T02:04:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.247+0000 7fd636d9d700 1 -- 172.21.15.37:0/4180148716 learned_addr learned my addr 172.21.15.37:0/4180148716 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.247+0000 7fd63659c700 1 --2- 172.21.15.37:0/4180148716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6380c9970 0x7fd6380c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.248+0000 7fd636d9d700 1 -- 172.21.15.37:0/4180148716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6380c9970 msgr2=0x7fd6380c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.248+0000 7fd636d9d700 1 --2- 172.21.15.37:0/4180148716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6380c9970 0x7fd6380c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.248+0000 7fd636d9d700 1 -- 172.21.15.37:0/4180148716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6380cb8b0 msgr2=0x7fd63815a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.248+0000 7fd636d9d700 1 --2- 172.21.15.37:0/4180148716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6380cb8b0 0x7fd63815a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.248+0000 7fd636d9d700 1 -- 172.21.15.37:0/4180148716 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6280085d0 con 0x7fd6380c8890 2023-07-12T02:04:30.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.248+0000 7fd636d9d700 1 --2- 172.21.15.37:0/4180148716 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6380c8890 0x7fd63814e5e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00b440 tx=0x7fd62c00b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.247+0000 7f62071ff700 1 Processor -- start 2023-07-12T02:04:30.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.249+0000 7fd626ffd700 1 -- 172.21.15.37:0/4180148716 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c011830 con 0x7fd6380c8890 2023-07-12T02:04:30.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.249+0000 7fd626ffd700 1 -- 172.21.15.37:0/4180148716 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c011990 con 0x7fd6380c8890 2023-07-12T02:04:30.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.249+0000 7fd626ffd700 1 -- 172.21.15.37:0/4180148716 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c011d40 con 0x7fd6380c8890 2023-07-12T02:04:30.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.250+0000 7fd63cdff700 1 -- 172.21.15.37:0/4180148716 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6380b1af0 con 0x7fd6380c8890 2023-07-12T02:04:30.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.250+0000 7fd63cdff700 1 -- 172.21.15.37:0/4180148716 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6380b20b0 con 0x7fd6380c8890 2023-07-12T02:04:30.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.247+0000 7f62071ff700 1 -- start start 2023-07-12T02:04:30.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.249+0000 7f62071ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f62000c9970 0x7f62000cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.250+0000 7f62071ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62000cce20 con 0x7f62000c9d40 2023-07-12T02:04:30.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.250+0000 7f62071ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62000cd100 con 0x7f62000cb8b0 2023-07-12T02:04:30.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.250+0000 7f62071ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62000cd3e0 con 0x7f62000c9970 2023-07-12T02:04:30.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.251+0000 7fd63cdff700 1 -- 172.21.15.37:0/4180148716 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63804ea60 con 0x7fd6380c8890 2023-07-12T02:04:30.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.251+0000 7f1ededff700 1 -- 172.21.15.37:0/4073198869 shutdown_connections 2023-07-12T02:04:30.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.251+0000 7f1ededff700 1 --2- 172.21.15.37:0/4073198869 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ec8003a00 0x7f1ec8003e10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.251+0000 7f1ededff700 1 -- 172.21.15.37:0/4073198869 >> 172.21.15.37:0/4073198869 conn(0x7f1ed806abc0 msgr2=0x7f1ed80b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:30.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.251+0000 7f1ededff700 1 -- 172.21.15.37:0/4073198869 shutdown_connections 2023-07-12T02:04:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.250+0000 7f6204f9b700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f62000c9970 0x7f62000cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.250+0000 7f6204f9b700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f62000c9970 0x7f62000cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:45240/0 (socket says 172.21.15.37:45240) 2023-07-12T02:04:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.250+0000 7f6204f9b700 1 -- 172.21.15.37:0/920657136 learned_addr learned my addr 172.21.15.37:0/920657136 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.252+0000 7f61ff7fe700 1 -- 172.21.15.37:0/920657136 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186505843 0 0) 0x7f62000cce20 con 0x7f62000c9d40 2023-07-12T02:04:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.252+0000 7f61ff7fe700 1 -- 172.21.15.37:0/920657136 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e80035b0 con 0x7f62000c9d40 2023-07-12T02:04:30.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.252+0000 7f61ff7fe700 1 -- 172.21.15.37:0/920657136 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1065947180 0 0) 0x7f61e80035b0 con 0x7f62000c9d40 2023-07-12T02:04:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.252+0000 7f61ff7fe700 1 -- 172.21.15.37:0/920657136 >> v2:172.21.15.196:3300/0 conn(0x7f62000c9970 msgr2=0x7f62000cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.252+0000 7f61ff7fe700 1 --2- 172.21.15.37:0/920657136 >> v2:172.21.15.196:3300/0 conn(0x7f62000c9970 0x7f62000cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.252+0000 7f61ff7fe700 1 -- 172.21.15.37:0/920657136 >> v1:172.21.15.196:6789/0 conn(0x7f62000cb8b0 legacy=0x7f6200157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.252+0000 7f61ff7fe700 1 -- 172.21.15.37:0/920657136 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62000cd6c0 con 0x7f62000c9d40 2023-07-12T02:04:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.253+0000 7f61ff7fe700 1 -- 172.21.15.37:0/920657136 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7f61f0001670 con 0x7f62000c9d40 2023-07-12T02:04:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.253+0000 7f61ff7fe700 1 -- 172.21.15.37:0/920657136 >> v1:172.21.15.37:6789/0 conn(0x7f62000c9d40 legacy=0x7f62000cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.253+0000 7f61ff7fe700 1 --2- 172.21.15.37:0/920657136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e8003a00 0x7f61e8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.253+0000 7f61ff7fe700 1 --2- 172.21.15.37:0/920657136 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61e8004850 0x7f61e8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.253+0000 7f61ff7fe700 1 --2- 172.21.15.37:0/920657136 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61e8005200 0x7f61e800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.253+0000 7f61ff7fe700 1 -- 172.21.15.37:0/920657136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62000cd3e0 con 0x7f61e8003a00 2023-07-12T02:04:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.253+0000 7f61ff7fe700 1 -- 172.21.15.37:0/920657136 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e800c060 con 0x7f61e8005200 2023-07-12T02:04:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.253+0000 7f61ff7fe700 1 -- 172.21.15.37:0/920657136 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e800c220 con 0x7f61e8004850 2023-07-12T02:04:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.252+0000 7f1ededff700 1 -- 172.21.15.37:0/4073198869 wait complete. 2023-07-12T02:04:30.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.253+0000 7f61fffff700 1 --2- 172.21.15.37:0/920657136 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61e8004850 0x7f61e8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.254+0000 7f46b27ff700 1 Processor -- start 2023-07-12T02:04:30.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.255+0000 7fd626ffd700 1 -- 172.21.15.37:0/4180148716 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd62c01a400 con 0x7fd6380c8890 2023-07-12T02:04:30.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.257+0000 7fd626ffd700 1 --2- 172.21.15.37:0/4180148716 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd61806adb0 0x7fd61806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.254+0000 7f1ededff700 1 Processor -- start 2023-07-12T02:04:30.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.255+0000 7f1ededff700 1 -- start start 2023-07-12T02:04:30.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f1ededff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ec8003a00 0x7f1ed80704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f1ededff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ed80b1690 0x7f1ed814c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f1ededff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ed814a540 0x7f1ed814a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f1ededff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80b27a0 con 0x7f1ed80b1690 2023-07-12T02:04:30.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f1ededff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80b1b90 con 0x7f1ec8003a00 2023-07-12T02:04:30.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f1ededff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80b1e70 con 0x7f1ed814a540 2023-07-12T02:04:30.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.257+0000 7f1edd39c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ed814a540 0x7f1ed814a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.257+0000 7f1edd39c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ed814a540 0x7f1ed814a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:45734/0 (socket says 172.21.15.37:45734) 2023-07-12T02:04:30.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.257+0000 7f1edd39c700 1 -- 172.21.15.37:0/3142909747 learned_addr learned my addr 172.21.15.37:0/3142909747 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:30.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.257+0000 7f1edcb9b700 1 --2- 172.21.15.37:0/3142909747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ec8003a00 0x7f1ed80704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.254+0000 7f46b27ff700 1 -- start start 2023-07-12T02:04:30.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f46b27ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46ac070a80 0x7f46ac0ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f46b27ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46ac0adce0 0x7f46ac06c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f46b27ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ac0ae130 con 0x7f46ac160930 2023-07-12T02:04:30.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f46b27ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ac0ccb70 con 0x7f46ac0adce0 2023-07-12T02:04:30.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f46b27ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac165400 con 0x7f46ac070a80 2023-07-12T02:04:30.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.255+0000 7f620579c700 1 --2- 172.21.15.37:0/920657136 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61e8005200 0x7f61e800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f6204f9b700 1 --2- 172.21.15.37:0/920657136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e8003a00 0x7f61e8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f620579c700 1 -- 172.21.15.37:0/920657136 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61e8004850 msgr2=0x7f61e8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:30.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f620579c700 1 --2- 172.21.15.37:0/920657136 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61e8004850 0x7f61e8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f620579c700 1 -- 172.21.15.37:0/920657136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e8003a00 msgr2=0x7f61e8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:30.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f620579c700 1 --2- 172.21.15.37:0/920657136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e8003a00 0x7f61e8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f620579c700 1 -- 172.21.15.37:0/920657136 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62000cd6c0 con 0x7f61e8005200 2023-07-12T02:04:30.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.256+0000 7f620579c700 1 -- 172.21.15.37:0/920657136 reap_dead start 2023-07-12T02:04:30.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.257+0000 7fd626ffd700 1 -- 172.21.15.37:0/4180148716 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd62c089a20 con 0x7fd6380c8890 2023-07-12T02:04:30.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.258+0000 7f1edd39c700 1 -- 172.21.15.37:0/3142909747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ec8003a00 msgr2=0x7f1ed80704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.258+0000 7f1edd39c700 1 --2- 172.21.15.37:0/3142909747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ec8003a00 0x7f1ed80704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.258+0000 7f1edd39c700 1 -- 172.21.15.37:0/3142909747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ed80b1690 msgr2=0x7f1ed814c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.258+0000 7f1edd39c700 1 --2- 172.21.15.37:0/3142909747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ed80b1690 0x7f1ed814c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.258+0000 7f1edd39c700 1 -- 172.21.15.37:0/3142909747 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed80b2150 con 0x7f1ed814a540 2023-07-12T02:04:30.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.257+0000 7f46ab7fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46ac070a80 0x7f46ac0ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.257+0000 7f46b0d9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46ac0adce0 0x7f46ac06c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.258+0000 7f46ab7fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46ac070a80 0x7f46ac0ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:45742/0 (socket says 172.21.15.37:45742) 2023-07-12T02:04:30.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.258+0000 7f46b0d9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46ac0adce0 0x7f46ac06c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49292/0 (socket says 172.21.15.37:49292) 2023-07-12T02:04:30.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.258+0000 7f46ab7fe700 1 -- 172.21.15.37:0/478592196 learned_addr learned my addr 172.21.15.37:0/478592196 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:30.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.258+0000 7f46b0d9c700 1 -- 172.21.15.37:0/478592196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46ac070a80 msgr2=0x7f46ac0ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:30.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.258+0000 7f46b0d9c700 1 --2- 172.21.15.37:0/478592196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46ac070a80 0x7f46ac0ad7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.258+0000 7f46b0d9c700 1 -- 172.21.15.37:0/478592196 >> v1:172.21.15.37:6789/0 conn(0x7f46ac160930 legacy=0x7f46ac0cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.258+0000 7f46b0d9c700 1 -- 172.21.15.37:0/478592196 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac164640 con 0x7f46ac0adce0 2023-07-12T02:04:30.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.258+0000 7f620579c700 1 --2- 172.21.15.37:0/920657136 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61e8005200 0x7f61e800ba10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f61f4003eb0 tx=0x7f61e8005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4e82bd3798c9bfb server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.258+0000 7f1edd39c700 1 --2- 172.21.15.37:0/3142909747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ed814a540 0x7f1ed814a9c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80b4950 tx=0x7f1ed0011ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.259+0000 7f61ff7fe700 1 -- 172.21.15.37:0/920657136 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4006a60 con 0x7f61e8005200 2023-07-12T02:04:30.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.259+0000 7f61ff7fe700 1 -- 172.21.15.37:0/920657136 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f4006bc0 con 0x7f61e8005200 2023-07-12T02:04:30.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.259+0000 7f61ff7fe700 1 -- 172.21.15.37:0/920657136 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4007020 con 0x7f61e8005200 2023-07-12T02:04:30.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.259+0000 7f46b0d9c700 1 --2- 172.21.15.37:0/478592196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46ac0adce0 0x7f46ac06c340 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f46a0009840 tx=0x7f46a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29c57f742382a82 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.259+0000 7fd63659c700 1 --2- 172.21.15.37:0/4180148716 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd61806adb0 0x7fd61806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.260+0000 7f1ed57fa700 1 -- 172.21.15.37:0/3142909747 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed000e040 con 0x7f1ed814a540 2023-07-12T02:04:30.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.260+0000 7f1ed57fa700 1 -- 172.21.15.37:0/3142909747 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed000f040 con 0x7f1ed814a540 2023-07-12T02:04:30.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.260+0000 7f1ed57fa700 1 -- 172.21.15.37:0/3142909747 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed000f8b0 con 0x7f1ed814a540 2023-07-12T02:04:30.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.260+0000 7f1ededff700 1 -- 172.21.15.37:0/3142909747 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed80b2430 con 0x7f1ed814a540 2023-07-12T02:04:30.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.260+0000 7f62071ff700 1 -- 172.21.15.37:0/920657136 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61e8005200 msgr2=0x7f61e800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.260+0000 7f62071ff700 1 --2- 172.21.15.37:0/920657136 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61e8005200 0x7f61e800ba10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f61f4003eb0 tx=0x7f61e8005880 comp rx=0 tx=0).stop 2023-07-12T02:04:30.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.260+0000 7f62071ff700 1 -- 172.21.15.37:0/920657136 shutdown_connections 2023-07-12T02:04:30.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.260+0000 7f62071ff700 1 --2- 172.21.15.37:0/920657136 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61e8005200 0x7f61e800ba10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.260+0000 7f62071ff700 1 -- 172.21.15.37:0/920657136 >> 172.21.15.37:0/920657136 conn(0x7f620006abc0 msgr2=0x7f62000b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:30.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.260+0000 7f1ededff700 1 -- 172.21.15.37:0/3142909747 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed80709f0 con 0x7f1ed814a540 2023-07-12T02:04:30.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.260+0000 7fd626ffd700 1 -- 172.21.15.37:0/4180148716 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd62c054850 con 0x7fd6380c8890 2023-07-12T02:04:30.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.262+0000 7fd63659c700 1 --2- 172.21.15.37:0/4180148716 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd61806adb0 0x7fd61806d260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd628000c00 tx=0x7fd628012000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.262+0000 7f1ededff700 1 -- 172.21.15.37:0/3142909747 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb80052f0 con 0x7f1ed814a540 2023-07-12T02:04:30.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.260+0000 7f46aaffd700 1 -- 172.21.15.37:0/478592196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0011830 con 0x7f46ac0adce0 2023-07-12T02:04:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.260+0000 7f46aaffd700 1 -- 172.21.15.37:0/478592196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a0011990 con 0x7f46ac0adce0 2023-07-12T02:04:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.260+0000 7f46aaffd700 1 -- 172.21.15.37:0/478592196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0011d00 con 0x7f46ac0adce0 2023-07-12T02:04:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.261+0000 7f46b27ff700 1 -- 172.21.15.37:0/478592196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46ac0adce0 msgr2=0x7f46ac06c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.261+0000 7f46b27ff700 1 --2- 172.21.15.37:0/478592196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46ac0adce0 0x7f46ac06c340 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f46a0009840 tx=0x7f46a0009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.261+0000 7f46b27ff700 1 -- 172.21.15.37:0/478592196 shutdown_connections 2023-07-12T02:04:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.261+0000 7f46b27ff700 1 --2- 172.21.15.37:0/478592196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46ac0adce0 0x7f46ac06c340 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.261+0000 7f46b27ff700 1 --2- 172.21.15.37:0/478592196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46ac070a80 0x7f46ac0ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.261+0000 7f46b27ff700 1 -- 172.21.15.37:0/478592196 >> 172.21.15.37:0/478592196 conn(0x7f46ac0b0390 msgr2=0x7f46ac0b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.262+0000 7f46b27ff700 1 -- 172.21.15.37:0/478592196 shutdown_connections 2023-07-12T02:04:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.261+0000 7f9d273ff700 1 Processor -- start 2023-07-12T02:04:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.261+0000 7f9d273ff700 1 -- start start 2023-07-12T02:04:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.262+0000 7f9d273ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9d20070a80 0x7f9d200ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.262+0000 7f9d273ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9d200adce0 0x7f9d2006c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.262+0000 7f9d273ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d200ccb70 con 0x7f9d20160930 2023-07-12T02:04:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.262+0000 7f9d273ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d200ae160 con 0x7f9d20070a80 2023-07-12T02:04:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.262+0000 7f9d273ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d20165400 con 0x7f9d200adce0 2023-07-12T02:04:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.263+0000 7f9d2599c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9d200adce0 0x7f9d2006c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.263+0000 7f9d2499a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9d20070a80 0x7f9d200ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.263+0000 7f9d2599c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9d200adce0 0x7f9d2006c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:45264/0 (socket says 172.21.15.37:45264) 2023-07-12T02:04:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.263+0000 7f9d2599c700 1 -- 172.21.15.37:0/1893147294 learned_addr learned my addr 172.21.15.37:0/1893147294 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.263+0000 7f9d2499a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9d20070a80 0x7f9d200ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49298/0 (socket says 172.21.15.37:49298) 2023-07-12T02:04:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.264+0000 7f1ed57fa700 1 -- 172.21.15.37:0/3142909747 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ed000fa10 con 0x7f1ed814a540 2023-07-12T02:04:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.262+0000 7f46b27ff700 1 -- 172.21.15.37:0/478592196 wait complete. 2023-07-12T02:04:30.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.264+0000 7f9d2499a700 1 -- 172.21.15.37:0/1893147294 >> v2:172.21.15.196:3300/0 conn(0x7f9d200adce0 msgr2=0x7f9d2006c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:30.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.264+0000 7f9d2499a700 1 --2- 172.21.15.37:0/1893147294 >> v2:172.21.15.196:3300/0 conn(0x7f9d200adce0 0x7f9d2006c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.264+0000 7f9d2499a700 1 -- 172.21.15.37:0/1893147294 >> v1:172.21.15.37:6789/0 conn(0x7f9d20160930 legacy=0x7f9d200cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:30.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.264+0000 7f9d2499a700 1 -- 172.21.15.37:0/1893147294 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d20164640 con 0x7f9d20070a80 2023-07-12T02:04:30.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.264+0000 7f9d2499a700 1 --2- 172.21.15.37:0/1893147294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d20070a80 0x7f9d200ad7a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9d200702d0 tx=0x7f9d1c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f256c11571e59b6e server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.265+0000 7f46b27ff700 1 Processor -- start 2023-07-12T02:04:30.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.265+0000 7f9d13fff700 1 -- 172.21.15.37:0/1893147294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c004230 con 0x7f9d20070a80 2023-07-12T02:04:30.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.265+0000 7f9d13fff700 1 -- 172.21.15.37:0/1893147294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c004390 con 0x7f9d20070a80 2023-07-12T02:04:30.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.265+0000 7f9d13fff700 1 -- 172.21.15.37:0/1893147294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0036a0 con 0x7f9d20070a80 2023-07-12T02:04:30.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.266+0000 7f9d273ff700 1 -- 172.21.15.37:0/1893147294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d20070a80 msgr2=0x7f9d200ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.266+0000 7f9d273ff700 1 --2- 172.21.15.37:0/1893147294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d20070a80 0x7f9d200ad7a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9d200702d0 tx=0x7f9d1c009b20 comp rx=0 tx=0).stop 2023-07-12T02:04:30.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.266+0000 7f1ed57fa700 1 --2- 172.21.15.37:0/3142909747 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1ebc06adb0 0x7f1ebc06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.266+0000 7f1ed57fa700 1 -- 172.21.15.37:0/3142909747 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1ed0089c60 con 0x7f1ed814a540 2023-07-12T02:04:30.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.266+0000 7f9d273ff700 1 -- 172.21.15.37:0/1893147294 shutdown_connections 2023-07-12T02:04:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.266+0000 7f9d273ff700 1 --2- 172.21.15.37:0/1893147294 >> v2:172.21.15.196:3300/0 conn(0x7f9d200adce0 0x7f9d2006c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.266+0000 7f9d273ff700 1 --2- 172.21.15.37:0/1893147294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d20070a80 0x7f9d200ad7a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.266+0000 7f9d273ff700 1 -- 172.21.15.37:0/1893147294 >> 172.21.15.37:0/1893147294 conn(0x7f9d200b0390 msgr2=0x7f9d200b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.266+0000 7f9d273ff700 1 -- 172.21.15.37:0/1893147294 shutdown_connections 2023-07-12T02:04:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.266+0000 7f9d273ff700 1 -- 172.21.15.37:0/1893147294 wait complete. 2023-07-12T02:04:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.267+0000 7f1edcb9b700 1 --2- 172.21.15.37:0/3142909747 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1ebc06adb0 0x7f1ebc06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.267+0000 7f62071ff700 1 -- 172.21.15.37:0/920657136 shutdown_connections 2023-07-12T02:04:30.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.265+0000 7f28079ff700 1 Processor -- start 2023-07-12T02:04:30.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.265+0000 7f28079ff700 1 -- start start 2023-07-12T02:04:30.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.265+0000 7f46b27ff700 1 -- start start 2023-07-12T02:04:30.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.266+0000 7f46b27ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46ac070a80 0x7f46ac14fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.266+0000 7f46b27ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46ac0adce0 0x7f46ac0c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.267+0000 7f46b27ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46ac160930 0x7f46ac0c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.267+0000 7f46b27ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac145a20 con 0x7f46ac160930 2023-07-12T02:04:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.267+0000 7f46b27ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac1361f0 con 0x7f46ac070a80 2023-07-12T02:04:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.267+0000 7f46b27ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac1364d0 con 0x7f46ac0adce0 2023-07-12T02:04:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.267+0000 7f46abfff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46ac070a80 0x7f46ac14fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.267+0000 7f46abfff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46ac070a80 0x7f46ac14fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:45272/0 (socket says 172.21.15.37:45272) 2023-07-12T02:04:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.267+0000 7f46abfff700 1 -- 172.21.15.37:0/1413389111 learned_addr learned my addr 172.21.15.37:0/1413389111 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.267+0000 7f28079ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2800089570 0x7f28000cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.267+0000 7f28079ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f28000cb8a0 0x7f28000ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.267+0000 7f46ab7fe700 1 --2- 172.21.15.37:0/1413389111 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46ac0adce0 0x7f46ac0c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.268+0000 7f28079ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28000ce620 con 0x7f280016c570 2023-07-12T02:04:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.268+0000 7f28079ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2800089e70 con 0x7f28000cb8a0 2023-07-12T02:04:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.268+0000 7f28079ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28000caac0 con 0x7f2800089570 2023-07-12T02:04:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.268+0000 7f280579b700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2800089570 0x7f28000cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.268+0000 7f280579b700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2800089570 0x7f28000cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:45278/0 (socket says 172.21.15.37:45278) 2023-07-12T02:04:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.268+0000 7f280579b700 1 -- 172.21.15.37:0/1358395055 learned_addr learned my addr 172.21.15.37:0/1358395055 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.268+0000 7f2805f9c700 1 --2- 172.21.15.37:0/1358395055 >> v2:172.21.15.37:3300/0 conn(0x7f28000cb8a0 0x7f28000ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.268+0000 7f46abfff700 1 -- 172.21.15.37:0/1413389111 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46ac0adce0 msgr2=0x7f46ac0c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.268+0000 7f46abfff700 1 --2- 172.21.15.37:0/1413389111 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46ac0adce0 0x7f46ac0c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.268+0000 7f46abfff700 1 -- 172.21.15.37:0/1413389111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46ac160930 msgr2=0x7f46ac0c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.268+0000 7f46abfff700 1 --2- 172.21.15.37:0/1413389111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46ac160930 0x7f46ac0c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.268+0000 7f46abfff700 1 -- 172.21.15.37:0/1413389111 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a00094a0 con 0x7f46ac070a80 2023-07-12T02:04:30.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.269+0000 7f1edcb9b700 1 --2- 172.21.15.37:0/3142909747 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1ebc06adb0 0x7f1ebc06d260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc000c00 tx=0x7f1ecc007000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.269+0000 7f46abfff700 1 --2- 172.21.15.37:0/1413389111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46ac070a80 0x7f46ac14fcf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f46a4001ed0 tx=0x7f46a40021e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.267+0000 7f62071ff700 1 -- 172.21.15.37:0/920657136 wait complete. 2023-07-12T02:04:30.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.269+0000 7f2805f9c700 1 -- 172.21.15.37:0/1358395055 >> v2:172.21.15.196:3300/0 conn(0x7f2800089570 msgr2=0x7f28000cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:30.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.269+0000 7f2805f9c700 1 --2- 172.21.15.37:0/1358395055 >> v2:172.21.15.196:3300/0 conn(0x7f2800089570 0x7f28000cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.269+0000 7f2805f9c700 1 -- 172.21.15.37:0/1358395055 >> v1:172.21.15.37:6789/0 conn(0x7f280016c570 legacy=0x7f28000cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:30.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.269+0000 7f2805f9c700 1 -- 172.21.15.37:0/1358395055 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280016c9e0 con 0x7f28000cb8a0 2023-07-12T02:04:30.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.270+0000 7f2805f9c700 1 --2- 172.21.15.37:0/1358395055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28000cb8a0 0x7f28000ce0e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f28000b0dc0 tx=0x7f27f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292c2f2902e84a62 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.269+0000 7f9d273ff700 1 Processor -- start 2023-07-12T02:04:30.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.270+0000 7f9d273ff700 1 -- start start 2023-07-12T02:04:30.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.270+0000 7f1ed57fa700 1 -- 172.21.15.37:0/3142909747 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1ed0054a90 con 0x7f1ed814a540 2023-07-12T02:04:30.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.269+0000 7f46a8ff9700 1 -- 172.21.15.37:0/1413389111 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4003c00 con 0x7f46ac070a80 2023-07-12T02:04:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.269+0000 7f46a8ff9700 1 -- 172.21.15.37:0/1413389111 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a4003d60 con 0x7f46ac070a80 2023-07-12T02:04:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.269+0000 7f46a8ff9700 1 -- 172.21.15.37:0/1413389111 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a400abd0 con 0x7f46ac070a80 2023-07-12T02:04:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.270+0000 7f46b27ff700 1 -- 172.21.15.37:0/1413389111 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac1367b0 con 0x7f46ac070a80 2023-07-12T02:04:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.270+0000 7f46b27ff700 1 -- 172.21.15.37:0/1413389111 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac136d70 con 0x7f46ac070a80 2023-07-12T02:04:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.272+0000 7f46b27ff700 1 -- 172.21.15.37:0/1413389111 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ac04ea60 con 0x7f46ac070a80 2023-07-12T02:04:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.270+0000 7f62071ff700 1 Processor -- start 2023-07-12T02:04:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.271+0000 7f62071ff700 1 -- start start 2023-07-12T02:04:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.272+0000 7f62071ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61e8005200 0x7f6200153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.272+0000 7f62071ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f620015a180 0x7f6200156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.272+0000 7f62071ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f620015a5f0 0x7f6200156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.272+0000 7f62071ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6200159cf0 con 0x7f620015a180 2023-07-12T02:04:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.273+0000 7f62071ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6200154060 con 0x7f620015a5f0 2023-07-12T02:04:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.273+0000 7f62071ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62001593c0 con 0x7f61e8005200 2023-07-12T02:04:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.273+0000 7f6204f9b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61e8005200 0x7f6200153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.273+0000 7f6204f9b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61e8005200 0x7f6200153b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:45776/0 (socket says 172.21.15.37:45776) 2023-07-12T02:04:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.273+0000 7f6204f9b700 1 -- 172.21.15.37:0/2791647169 learned_addr learned my addr 172.21.15.37:0/2791647169 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.273+0000 7f61fffff700 1 --2- 172.21.15.37:0/2791647169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f620015a180 0x7f6200156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.274+0000 7f6204f9b700 1 -- 172.21.15.37:0/2791647169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f620015a5f0 msgr2=0x7f6200156e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-12T02:04:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.274+0000 7f6204f9b700 1 --2- 172.21.15.37:0/2791647169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f620015a5f0 0x7f6200156e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.274+0000 7f6204f9b700 1 -- 172.21.15.37:0/2791647169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f620015a180 msgr2=0x7f6200156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.274+0000 7f6204f9b700 1 --2- 172.21.15.37:0/2791647169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f620015a180 0x7f6200156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.274+0000 7f6204f9b700 1 -- 172.21.15.37:0/2791647169 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62001596a0 con 0x7f61e8005200 2023-07-12T02:04:30.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.271+0000 7f27f7fff700 1 -- 172.21.15.37:0/1358395055 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f800bd90 con 0x7f28000cb8a0 2023-07-12T02:04:30.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.271+0000 7f27f7fff700 1 -- 172.21.15.37:0/1358395055 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f8003a20 con 0x7f28000cb8a0 2023-07-12T02:04:30.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.271+0000 7f27f7fff700 1 -- 172.21.15.37:0/1358395055 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f8003db0 con 0x7f28000cb8a0 2023-07-12T02:04:30.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.272+0000 7f28079ff700 1 -- 172.21.15.37:0/1358395055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28000cb8a0 msgr2=0x7f28000ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.272+0000 7f28079ff700 1 --2- 172.21.15.37:0/1358395055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28000cb8a0 0x7f28000ce0e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f28000b0dc0 tx=0x7f27f800b330 comp rx=0 tx=0).stop 2023-07-12T02:04:30.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.271+0000 7f7d22fff700 1 Processor -- start 2023-07-12T02:04:30.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.272+0000 7f7d22fff700 1 -- start start 2023-07-12T02:04:30.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.274+0000 7f7d22fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d1c0cf5f0 0x7f7d1c0ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.274+0000 7f7d22fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1c0d2550 con 0x7f7d1c0d1230 2023-07-12T02:04:30.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.274+0000 7f7d22fff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1c0cfb60 con 0x7f7d1c0d0750 2023-07-12T02:04:30.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.274+0000 7f7d22fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c0cfe40 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.271+0000 7f9d273ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d20070a80 0x7f9d20151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.271+0000 7f9d273ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d200adce0 0x7f9d200c2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.271+0000 7f9d273ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d20160930 0x7f9d200c3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.271+0000 7f9d273ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200c4790 con 0x7f9d200adce0 2023-07-12T02:04:30.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.271+0000 7f9d273ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200c38b0 con 0x7f9d20160930 2023-07-12T02:04:30.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.271+0000 7f9d273ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200c3b80 con 0x7f9d20070a80 2023-07-12T02:04:30.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.272+0000 7f9d2599c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d20160930 0x7f9d200c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.272+0000 7f9d2599c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d20160930 0x7f9d200c3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:45288/0 (socket says 172.21.15.37:45288) 2023-07-12T02:04:30.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.272+0000 7f9d2599c700 1 -- 172.21.15.37:0/3675301145 learned_addr learned my addr 172.21.15.37:0/3675301145 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:30.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.272+0000 7f9d2499a700 1 --2- 172.21.15.37:0/3675301145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d200adce0 0x7f9d200c2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.273+0000 7f9d2599c700 1 -- 172.21.15.37:0/3675301145 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d20070a80 msgr2=0x7f9d20151070 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-12T02:04:30.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.273+0000 7f9d2599c700 1 --2- 172.21.15.37:0/3675301145 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d20070a80 0x7f9d20151070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.273+0000 7f9d2599c700 1 -- 172.21.15.37:0/3675301145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d200adce0 msgr2=0x7f9d200c2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.273+0000 7f9d2599c700 1 --2- 172.21.15.37:0/3675301145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d200adce0 0x7f9d200c2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.273+0000 7f9d2599c700 1 -- 172.21.15.37:0/3675301145 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c0094a0 con 0x7f9d20160930 2023-07-12T02:04:30.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.273+0000 7f9d2599c700 1 --2- 172.21.15.37:0/3675301145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d20160930 0x7f9d200c3370 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800efc0 tx=0x7f9d1800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.274+0000 7f7d2159c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7d1c0d1230 0x7f7d1c16a290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48670/0 (socket says 172.21.15.37:48670) 2023-07-12T02:04:30.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.274+0000 7f7d2159c700 1 -- 172.21.15.37:0/3694543218 learned_addr learned my addr 172.21.15.37:0/3694543218 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:30.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.275+0000 7f46a8ff9700 1 -- 172.21.15.37:0/1413389111 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f46a400ad30 con 0x7f46ac070a80 2023-07-12T02:04:30.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.274+0000 7f28079ff700 1 -- 172.21.15.37:0/1358395055 shutdown_connections 2023-07-12T02:04:30.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.274+0000 7f28079ff700 1 --2- 172.21.15.37:0/1358395055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28000cb8a0 0x7f28000ce0e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.274+0000 7f28079ff700 1 --2- 172.21.15.37:0/1358395055 >> v2:172.21.15.196:3300/0 conn(0x7f2800089570 0x7f28000cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.274+0000 7f28079ff700 1 -- 172.21.15.37:0/1358395055 >> 172.21.15.37:0/1358395055 conn(0x7f280006abc0 msgr2=0x7f28000b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:30.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.275+0000 7f28079ff700 1 -- 172.21.15.37:0/1358395055 shutdown_connections 2023-07-12T02:04:30.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.275+0000 7f7d1bfff700 1 --2- 172.21.15.37:0/3694543218 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d1c0cf5f0 0x7f7d1c0ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.275+0000 7f7d1b7fe700 1 -- 172.21.15.37:0/3694543218 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894082737 0 0) 0x7f7d1c0d2550 con 0x7f7d1c0d1230 2023-07-12T02:04:30.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.275+0000 7f7d1b7fe700 1 -- 172.21.15.37:0/3694543218 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d040035b0 con 0x7f7d1c0d1230 2023-07-12T02:04:30.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.275+0000 7f7d1bfff700 1 -- 172.21.15.37:0/3694543218 >> v1:172.21.15.196:6789/0 conn(0x7f7d1c0d0750 legacy=0x7f7d1c0d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.275+0000 7f7d1bfff700 1 -- 172.21.15.37:0/3694543218 >> v1:172.21.15.37:6789/0 conn(0x7f7d1c0d1230 legacy=0x7f7d1c16a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.275+0000 7f7d1bfff700 1 -- 172.21.15.37:0/3694543218 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c0d1f00 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.275+0000 7f28079ff700 1 -- 172.21.15.37:0/1358395055 wait complete. 2023-07-12T02:04:30.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.276+0000 7f58c19ff700 1 Processor -- start 2023-07-12T02:04:30.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.276+0000 7f6204f9b700 1 --2- 172.21.15.37:0/2791647169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61e8005200 0x7f6200153b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f61f8008b30 tx=0x7f61f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.276+0000 7f46a8ff9700 1 --2- 172.21.15.37:0/1413389111 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f469806ad30 0x7f469806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.276+0000 7f46a8ff9700 1 -- 172.21.15.37:0/1413389111 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f46a4089ae0 con 0x7f46ac070a80 2023-07-12T02:04:30.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.277+0000 7f46ab7fe700 1 --2- 172.21.15.37:0/1413389111 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f469806ad30 0x7f469806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.276+0000 7f58c19ff700 1 -- start start 2023-07-12T02:04:30.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.277+0000 7f7d1bfff700 1 --2- 172.21.15.37:0/3694543218 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d1c0cf5f0 0x7f7d1c0ce5d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009870 tx=0x7f7d0c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d4186fc7d06a756 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.278+0000 7f7d1b7fe700 1 -- 172.21.15.37:0/3694543218 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c011830 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.278+0000 7f7d1b7fe700 1 -- 172.21.15.37:0/3694543218 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c011990 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.278+0000 7f7d1b7fe700 1 -- 172.21.15.37:0/3694543218 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c011d20 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.278+0000 7f46ab7fe700 1 --2- 172.21.15.37:0/1413389111 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f469806ad30 0x7f469806d1e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f46ac152210 tx=0x7f469c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.279+0000 7f46a8ff9700 1 -- 172.21.15.37:0/1413389111 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f46a4054880 con 0x7f46ac070a80 2023-07-12T02:04:30.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.279+0000 7f7d22fff700 1 -- 172.21.15.37:0/3694543218 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d1c0cf5f0 msgr2=0x7f7d1c0ce5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.279+0000 7f7d22fff700 1 --2- 172.21.15.37:0/3694543218 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d1c0cf5f0 0x7f7d1c0ce5d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009870 tx=0x7f7d0c009b80 comp rx=0 tx=0).stop 2023-07-12T02:04:30.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.278+0000 7f9d11ffb700 1 -- 172.21.15.37:0/3675301145 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18003c20 con 0x7f9d20160930 2023-07-12T02:04:30.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.278+0000 7f9d11ffb700 1 -- 172.21.15.37:0/3675301145 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1800f040 con 0x7f9d20160930 2023-07-12T02:04:30.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.279+0000 7f9d11ffb700 1 -- 172.21.15.37:0/3675301145 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18009e90 con 0x7f9d20160930 2023-07-12T02:04:30.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.279+0000 7f58c19ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f58bc070a80 0x7f58bc0ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.279+0000 7f58c19ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58bc0adce0 0x7f58bc06c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.279+0000 7f58c19ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58bc0ccb70 con 0x7f58bc160930 2023-07-12T02:04:30.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.279+0000 7f58c19ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58bc0ae160 con 0x7f58bc0adce0 2023-07-12T02:04:30.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.279+0000 7f58c19ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58bc165400 con 0x7f58bc070a80 2023-07-12T02:04:30.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.278+0000 7f28079ff700 1 Processor -- start 2023-07-12T02:04:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.278+0000 7f28079ff700 1 -- start start 2023-07-12T02:04:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.279+0000 7f9d273ff700 1 -- 172.21.15.37:0/3675301145 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d200c3e60 con 0x7f9d20160930 2023-07-12T02:04:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.279+0000 7f9d273ff700 1 -- 172.21.15.37:0/3675301145 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d200c4420 con 0x7f9d20160930 2023-07-12T02:04:30.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.280+0000 7f58bb7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58bc0adce0 0x7f58bc06c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.280+0000 7f58bb7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58bc0adce0 0x7f58bc06c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49344/0 (socket says 172.21.15.37:49344) 2023-07-12T02:04:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.280+0000 7f58bb7fe700 1 -- 172.21.15.37:0/141050513 learned_addr learned my addr 172.21.15.37:0/141050513 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.280+0000 7f58ba7fc700 1 --2- 172.21.15.37:0/141050513 >> v2:172.21.15.196:3300/0 conn(0x7f58bc070a80 0x7f58bc0ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.281+0000 7f58bb7fe700 1 -- 172.21.15.37:0/141050513 >> v2:172.21.15.196:3300/0 conn(0x7f58bc070a80 msgr2=0x7f58bc0ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.281+0000 7f58bb7fe700 1 --2- 172.21.15.37:0/141050513 >> v2:172.21.15.196:3300/0 conn(0x7f58bc070a80 0x7f58bc0ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.281+0000 7f58bb7fe700 1 -- 172.21.15.37:0/141050513 >> v1:172.21.15.196:6789/0 conn(0x7f58bc160930 legacy=0x7f58bc0cc390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-12T02:04:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.281+0000 7f58bb7fe700 1 -- 172.21.15.37:0/141050513 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc164640 con 0x7f58bc0adce0 2023-07-12T02:04:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.279+0000 7f61fd7fa700 1 -- 172.21.15.37:0/2791647169 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f801c070 con 0x7f61e8005200 2023-07-12T02:04:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.280+0000 7f61fd7fa700 1 -- 172.21.15.37:0/2791647169 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f8011040 con 0x7f61e8005200 2023-07-12T02:04:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.280+0000 7f61fd7fa700 1 -- 172.21.15.37:0/2791647169 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8010040 con 0x7f61e8005200 2023-07-12T02:04:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.281+0000 7f62071ff700 1 -- 172.21.15.37:0/2791647169 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6200159980 con 0x7f61e8005200 2023-07-12T02:04:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.281+0000 7f62071ff700 1 -- 172.21.15.37:0/2791647169 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62001f7010 con 0x7f61e8005200 2023-07-12T02:04:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.281+0000 7f7d22fff700 1 -- 172.21.15.37:0/3694543218 shutdown_connections 2023-07-12T02:04:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.281+0000 7f7d22fff700 1 --2- 172.21.15.37:0/3694543218 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d1c0cf5f0 0x7f7d1c0ce5d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.281+0000 7f7d22fff700 1 -- 172.21.15.37:0/3694543218 >> 172.21.15.37:0/3694543218 conn(0x7f7d1c071660 msgr2=0x7f7d1c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:30.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.280+0000 7f28079ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2800089570 0x7f28001ff300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.280+0000 7f28079ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28000cb8a0 0x7f28001f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.280+0000 7f28079ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f280016c570 0x7f28001f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.280+0000 7f28079ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000b46c0 con 0x7f280016c570 2023-07-12T02:04:30.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.280+0000 7f28079ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000b3620 con 0x7f28000cb8a0 2023-07-12T02:04:30.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.280+0000 7f28079ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28000b3900 con 0x7f2800089570 2023-07-12T02:04:30.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.282+0000 7f58bb7fe700 1 --2- 172.21.15.37:0/141050513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58bc0adce0 0x7f58bc06c340 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f58bc06fd50 tx=0x7f58ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c7c074c53bf356 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.282+0000 7f58b9ffb700 1 -- 172.21.15.37:0/141050513 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac004230 con 0x7f58bc0adce0 2023-07-12T02:04:30.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.283+0000 7f7d22fff700 1 -- 172.21.15.37:0/3694543218 shutdown_connections 2023-07-12T02:04:30.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.283+0000 7f58b9ffb700 1 -- 172.21.15.37:0/141050513 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ac004390 con 0x7f58bc0adce0 2023-07-12T02:04:30.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.283+0000 7f58b9ffb700 1 -- 172.21.15.37:0/141050513 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0036a0 con 0x7f58bc0adce0 2023-07-12T02:04:30.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.282+0000 7f2804f9a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28000cb8a0 0x7f28001f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.282+0000 7f2804f9a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28000cb8a0 0x7f28001f3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:45312/0 (socket says 172.21.15.37:45312) 2023-07-12T02:04:30.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.282+0000 7f2804f9a700 1 -- 172.21.15.37:0/1946182957 learned_addr learned my addr 172.21.15.37:0/1946182957 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:30.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.282+0000 7f280579b700 1 --2- 172.21.15.37:0/1946182957 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2800089570 0x7f28001ff300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.283+0000 7f2805f9c700 1 --2- 172.21.15.37:0/1946182957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f280016c570 0x7f28001f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.283+0000 7f9d11ffb700 1 -- 172.21.15.37:0/3675301145 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9d1800c930 con 0x7f9d20160930 2023-07-12T02:04:30.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.283+0000 7f2804f9a700 1 -- 172.21.15.37:0/1946182957 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2800089570 msgr2=0x7f28001ff300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.283+0000 7f2804f9a700 1 --2- 172.21.15.37:0/1946182957 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2800089570 0x7f28001ff300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.283+0000 7f2804f9a700 1 -- 172.21.15.37:0/1946182957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f280016c570 msgr2=0x7f28001f42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.283+0000 7f2804f9a700 1 --2- 172.21.15.37:0/1946182957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f280016c570 0x7f28001f42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.283+0000 7f2804f9a700 1 -- 172.21.15.37:0/1946182957 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f8009a70 con 0x7f28000cb8a0 2023-07-12T02:04:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.283+0000 7f2804f9a700 1 --2- 172.21.15.37:0/1946182957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28000cb8a0 0x7f28001f3db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f27f000b470 tx=0x7f27f000b780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.283+0000 7f7d22fff700 1 -- 172.21.15.37:0/3694543218 wait complete. 2023-07-12T02:04:30.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.284+0000 7f27f5ffb700 1 -- 172.21.15.37:0/1946182957 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0011830 con 0x7f28000cb8a0 2023-07-12T02:04:30.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.284+0000 7f27f5ffb700 1 -- 172.21.15.37:0/1946182957 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f00119b0 con 0x7f28000cb8a0 2023-07-12T02:04:30.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.284+0000 7f27f5ffb700 1 -- 172.21.15.37:0/1946182957 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0011d60 con 0x7f28000cb8a0 2023-07-12T02:04:30.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.284+0000 7f28079ff700 1 -- 172.21.15.37:0/1946182957 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28000b3be0 con 0x7f28000cb8a0 2023-07-12T02:04:30.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.284+0000 7f28079ff700 1 -- 172.21.15.37:0/1946182957 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28000b41a0 con 0x7f28000cb8a0 2023-07-12T02:04:30.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.285+0000 7f28079ff700 1 -- 172.21.15.37:0/1946182957 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28000b4390 con 0x7f28000cb8a0 2023-07-12T02:04:30.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.286+0000 7f7d22fff700 1 Processor -- start 2023-07-12T02:04:30.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.286+0000 7f7d22fff700 1 -- start start 2023-07-12T02:04:30.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.287+0000 7f58c19ff700 1 -- 172.21.15.37:0/141050513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58bc0adce0 msgr2=0x7f58bc06c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.287+0000 7f58c19ff700 1 --2- 172.21.15.37:0/141050513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58bc0adce0 0x7f58bc06c340 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f58bc06fd50 tx=0x7f58ac009bd0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.283+0000 7f62071ff700 1 -- 172.21.15.37:0/2791647169 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6200159b10 con 0x7f61e8005200 2023-07-12T02:04:30.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.286+0000 7f61fd7fa700 1 -- 172.21.15.37:0/2791647169 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f61f8018480 con 0x7f61e8005200 2023-07-12T02:04:30.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.287+0000 7f58c19ff700 1 -- 172.21.15.37:0/141050513 shutdown_connections 2023-07-12T02:04:30.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.287+0000 7f58c19ff700 1 --2- 172.21.15.37:0/141050513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58bc0adce0 0x7f58bc06c340 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.287+0000 7f58c19ff700 1 --2- 172.21.15.37:0/141050513 >> v2:172.21.15.196:3300/0 conn(0x7f58bc070a80 0x7f58bc0ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.287+0000 7f58c19ff700 1 -- 172.21.15.37:0/141050513 >> 172.21.15.37:0/141050513 conn(0x7f58bc0b0390 msgr2=0x7f58bc0b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:30.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.287+0000 7f7d22fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d1c0cf5f0 0x7f7d1c0cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.287+0000 7f7d22fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d1c0d0750 0x7f7d1c15e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.287+0000 7f7d22fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d1c0d1230 0x7f7d1c15ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.287+0000 7f7d22fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c0c9520 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.287+0000 7f7d22fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c0ca790 con 0x7f7d1c0d1230 2023-07-12T02:04:30.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.287+0000 7f7d22fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c0caa70 con 0x7f7d1c0d0750 2023-07-12T02:04:30.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.288+0000 7f61fd7fa700 1 --2- 172.21.15.37:0/2791647169 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f61ec06adb0 0x7f61ec06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.288+0000 7f7d20d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d1c0cf5f0 0x7f7d1c0cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.288+0000 7f7d2159c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d1c0d1230 0x7f7d1c15ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.288+0000 7f7d20d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d1c0cf5f0 0x7f7d1c0cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49366/0 (socket says 172.21.15.37:49366) 2023-07-12T02:04:30.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.288+0000 7f7d20d9b700 1 -- 172.21.15.37:0/2199785627 learned_addr learned my addr 172.21.15.37:0/2199785627 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:30.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.283+0000 7f9d273ff700 1 -- 172.21.15.37:0/3675301145 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d20066ac0 con 0x7f9d20160930 2023-07-12T02:04:30.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.288+0000 7f58c19ff700 1 -- 172.21.15.37:0/141050513 shutdown_connections 2023-07-12T02:04:30.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.288+0000 7f61fd7fa700 1 -- 172.21.15.37:0/2791647169 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f61f8089dc0 con 0x7f61e8005200 2023-07-12T02:04:30.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.289+0000 7f7d20d9b700 1 -- 172.21.15.37:0/2199785627 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d1c0d0750 msgr2=0x7f7d1c15e9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-12T02:04:30.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.289+0000 7f61fffff700 1 --2- 172.21.15.37:0/2791647169 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f61ec06adb0 0x7f61ec06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.289+0000 7f7d1bfff700 1 --2- 172.21.15.37:0/2199785627 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d1c0d0750 0x7f7d1c15e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.289+0000 7f7d20d9b700 1 --2- 172.21.15.37:0/2199785627 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d1c0d0750 0x7f7d1c15e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.289+0000 7f7d20d9b700 1 -- 172.21.15.37:0/2199785627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d1c0d1230 msgr2=0x7f7d1c15ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.289+0000 7f7d20d9b700 1 --2- 172.21.15.37:0/2199785627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d1c0d1230 0x7f7d1c15ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.289+0000 7f7d20d9b700 1 -- 172.21.15.37:0/2199785627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c0094a0 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.289+0000 7f58c19ff700 1 -- 172.21.15.37:0/141050513 wait complete. 2023-07-12T02:04:30.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.290+0000 7f7d2159c700 1 --2- 172.21.15.37:0/2199785627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d1c0d1230 0x7f7d1c15ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:04:30.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.290+0000 7f7d1bfff700 1 --2- 172.21.15.37:0/2199785627 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d1c0d0750 0x7f7d1c15e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:30.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.290+0000 7f7d20d9b700 1 --2- 172.21.15.37:0/2199785627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d1c0cf5f0 0x7f7d1c0cb270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400cbd0 tx=0x7f7d1400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.290+0000 7f61fffff700 1 --2- 172.21.15.37:0/2791647169 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f61ec06adb0 0x7f61ec06d260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f62001e4650 tx=0x7f61f0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.289+0000 7f27f5ffb700 1 -- 172.21.15.37:0/1946182957 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f27f001a400 con 0x7f28000cb8a0 2023-07-12T02:04:30.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.291+0000 7f9d11ffb700 1 --2- 172.21.15.37:0/3675301145 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9d0406adb0 0x7f9d0406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.291+0000 7f9d11ffb700 1 -- 172.21.15.37:0/3675301145 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9d18089b70 con 0x7f9d20160930 2023-07-12T02:04:30.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.291+0000 7f58c19ff700 1 Processor -- start 2023-07-12T02:04:30.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.291+0000 7f7d197fa700 1 -- 172.21.15.37:0/2199785627 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14003c00 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.291+0000 7f7d197fa700 1 -- 172.21.15.37:0/2199785627 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d14003d60 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.291+0000 7f7d197fa700 1 -- 172.21.15.37:0/2199785627 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1400ab40 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.292+0000 7f7d22fff700 1 -- 172.21.15.37:0/2199785627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1c0cad50 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.292+0000 7f7d22fff700 1 -- 172.21.15.37:0/2199785627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1c0c97c0 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.292+0000 7f61fd7fa700 1 -- 172.21.15.37:0/2791647169 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f61f8054bf0 con 0x7f61e8005200 2023-07-12T02:04:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.291+0000 7f27f5ffb700 1 --2- 172.21.15.37:0/1946182957 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f27e406adb0 0x7f27e406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.292+0000 7f27f5ffb700 1 -- 172.21.15.37:0/1946182957 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f27f0089d10 con 0x7f28000cb8a0 2023-07-12T02:04:30.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.293+0000 7f280579b700 1 --2- 172.21.15.37:0/1946182957 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f27e406adb0 0x7f27e406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.293+0000 7f27f5ffb700 1 -- 172.21.15.37:0/1946182957 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f27f0054ab0 con 0x7f28000cb8a0 2023-07-12T02:04:30.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.292+0000 7f58c19ff700 1 -- start start 2023-07-12T02:04:30.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.293+0000 7f58c19ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58bc070a80 0x7f58bc153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.293+0000 7f58c19ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58bc0adce0 0x7f58bc157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.293+0000 7f58c19ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58bc160930 0x7f58bc162ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.293+0000 7f58c19ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc158670 con 0x7f58bc0adce0 2023-07-12T02:04:30.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.293+0000 7f58c19ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc158950 con 0x7f58bc070a80 2023-07-12T02:04:30.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.293+0000 7f58c19ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0b2980 con 0x7f58bc160930 2023-07-12T02:04:30.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.294+0000 7f58baffd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58bc070a80 0x7f58bc153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.294+0000 7f58baffd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58bc070a80 0x7f58bc153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:45340/0 (socket says 172.21.15.37:45340) 2023-07-12T02:04:30.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.294+0000 7f58baffd700 1 -- 172.21.15.37:0/1166326529 learned_addr learned my addr 172.21.15.37:0/1166326529 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.294+0000 7f7d22fff700 1 -- 172.21.15.37:0/2199785627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1c0caf70 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.295+0000 7f58ba7fc700 1 --2- 172.21.15.37:0/1166326529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58bc0adce0 0x7f58bc157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.295+0000 7f9d2519b700 1 --2- 172.21.15.37:0/3675301145 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9d0406adb0 0x7f9d0406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.295+0000 7f58bb7fe700 1 --2- 172.21.15.37:0/1166326529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58bc160930 0x7f58bc162ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.295+0000 7f58ba7fc700 1 -- 172.21.15.37:0/1166326529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58bc160930 msgr2=0x7f58bc162ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.295+0000 7f58ba7fc700 1 --2- 172.21.15.37:0/1166326529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58bc160930 0x7f58bc162ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.295+0000 7f58ba7fc700 1 -- 172.21.15.37:0/1166326529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58bc070a80 msgr2=0x7f58bc153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.295+0000 7f58ba7fc700 1 --2- 172.21.15.37:0/1166326529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58bc070a80 0x7f58bc153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.295+0000 7f58ba7fc700 1 -- 172.21.15.37:0/1166326529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac009550 con 0x7f58bc0adce0 2023-07-12T02:04:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.296+0000 7f58baffd700 1 --2- 172.21.15.37:0/1166326529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58bc070a80 0x7f58bc153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.296+0000 7f58ba7fc700 1 --2- 172.21.15.37:0/1166326529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58bc0adce0 0x7f58bc157db0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f58b000c7c0 tx=0x7f58b000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.296+0000 7f7d197fa700 1 -- 172.21.15.37:0/2199785627 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7d1400aca0 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.297+0000 7f280579b700 1 --2- 172.21.15.37:0/1946182957 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f27e406adb0 0x7f27e406d260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0099d0 tx=0x7f27fc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.297+0000 7f9d11ffb700 1 -- 172.21.15.37:0/3675301145 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9d20066ac0 con 0x7f9d20160930 2023-07-12T02:04:30.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.298+0000 7f7d197fa700 1 --2- 172.21.15.37:0/2199785627 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7d0806adb0 0x7f7d0806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.298+0000 7f7d197fa700 1 -- 172.21.15.37:0/2199785627 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7d140897a0 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.298+0000 7f9d2519b700 1 --2- 172.21.15.37:0/3675301145 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9d0406adb0 0x7f9d0406d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9d14001590 tx=0x7f9d14007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.298+0000 7f7d1bfff700 1 --2- 172.21.15.37:0/2199785627 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7d0806adb0 0x7f7d0806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.300+0000 7f7d1bfff700 1 --2- 172.21.15.37:0/2199785627 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7d0806adb0 0x7f7d0806d260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0b4640 tx=0x7f7d0c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.308+0000 7f7d197fa700 1 -- 172.21.15.37:0/2199785627 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7d140545d0 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.308+0000 7f58a3fff700 1 -- 172.21.15.37:0/1166326529 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b0011800 con 0x7f58bc0adce0 2023-07-12T02:04:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.308+0000 7f58a3fff700 1 -- 172.21.15.37:0/1166326529 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b0011960 con 0x7f58bc0adce0 2023-07-12T02:04:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.308+0000 7f58a3fff700 1 -- 172.21.15.37:0/1166326529 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b0011d10 con 0x7f58bc0adce0 2023-07-12T02:04:30.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.309+0000 7f58c19ff700 1 -- 172.21.15.37:0/1166326529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58bc0b2c60 con 0x7f58bc0adce0 2023-07-12T02:04:30.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.309+0000 7f58c19ff700 1 -- 172.21.15.37:0/1166326529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc1545f0 con 0x7f58bc0adce0 2023-07-12T02:04:30.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.313+0000 7f58c19ff700 1 -- 172.21.15.37:0/1166326529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58bc0b2e80 con 0x7f58bc0adce0 2023-07-12T02:04:30.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.320+0000 7f58a3fff700 1 -- 172.21.15.37:0/1166326529 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f58b0018360 con 0x7f58bc0adce0 2023-07-12T02:04:30.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.321+0000 7f58a3fff700 1 --2- 172.21.15.37:0/1166326529 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f58a806adb0 0x7f58a806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:30.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.321+0000 7f58a3fff700 1 -- 172.21.15.37:0/1166326529 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f58b0089360 con 0x7f58bc0adce0 2023-07-12T02:04:30.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.326+0000 7f58baffd700 1 --2- 172.21.15.37:0/1166326529 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f58a806adb0 0x7f58a806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:30.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.326+0000 7f58a3fff700 1 -- 172.21.15.37:0/1166326529 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f58b0054100 con 0x7f58bc0adce0 2023-07-12T02:04:30.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.334+0000 7f58baffd700 1 --2- 172.21.15.37:0/1166326529 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f58a806adb0 0x7f58a806d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f58b40073c0 tx=0x7f58b4009630 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:30.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.734+0000 7fd63cdff700 1 -- 172.21.15.37:0/4180148716 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd6380cbf90 con 0x7fd6380c8890 2023-07-12T02:04:30.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.735+0000 7f1ededff700 1 -- 172.21.15.37:0/3142909747 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1eb80055a0 con 0x7f1ed814a540 2023-07-12T02:04:30.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.735+0000 7f1ed57fa700 1 -- 172.21.15.37:0/3142909747 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ed00580b0 con 0x7f1ed814a540 2023-07-12T02:04:30.740 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2023-07-12T02:04:30.741 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2023-07-12T02:04:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.737+0000 7fd626ffd700 1 -- 172.21.15.37:0/4180148716 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd62c057e70 con 0x7fd6380c8890 2023-07-12T02:04:30.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.738+0000 7f46b27ff700 1 -- 172.21.15.37:0/1413389111 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f46ac0ae130 con 0x7f46ac070a80 2023-07-12T02:04:30.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.739+0000 7f46a8ff9700 1 -- 172.21.15.37:0/1413389111 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f46ac0ae130 con 0x7f46ac070a80 2023-07-12T02:04:30.743 INFO:teuthology.orchestra.run.smithi037.stdout:55834574859 2023-07-12T02:04:30.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.740+0000 7f1ededff700 1 -- 172.21.15.37:0/3142909747 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1ebc06adb0 msgr2=0x7f1ebc06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.740+0000 7f1ededff700 1 --2- 172.21.15.37:0/3142909747 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1ebc06adb0 0x7f1ebc06d260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc000c00 tx=0x7f1ecc007000 comp rx=0 tx=0).stop 2023-07-12T02:04:30.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.740+0000 7f1ededff700 1 -- 172.21.15.37:0/3142909747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ed814a540 msgr2=0x7f1ed814a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.740+0000 7f1ededff700 1 --2- 172.21.15.37:0/3142909747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ed814a540 0x7f1ed814a9c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80b4950 tx=0x7f1ed0011ed0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.740+0000 7f1ededff700 1 -- 172.21.15.37:0/3142909747 shutdown_connections 2023-07-12T02:04:30.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.740+0000 7f1ededff700 1 --2- 172.21.15.37:0/3142909747 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1ebc06adb0 0x7f1ebc06d260 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.740+0000 7f1ededff700 1 --2- 172.21.15.37:0/3142909747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ed814a540 0x7f1ed814a9c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.740+0000 7f1ededff700 1 --2- 172.21.15.37:0/3142909747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ec8003a00 0x7f1ed80704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.740+0000 7f1ededff700 1 --2- 172.21.15.37:0/3142909747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ed80b1690 0x7f1ed814c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.740+0000 7f1ededff700 1 -- 172.21.15.37:0/3142909747 >> 172.21.15.37:0/3142909747 conn(0x7f1ed806abc0 msgr2=0x7f1ed815bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:30.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.741+0000 7f1ededff700 1 -- 172.21.15.37:0/3142909747 shutdown_connections 2023-07-12T02:04:30.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.741+0000 7f1ededff700 1 -- 172.21.15.37:0/3142909747 wait complete. 2023-07-12T02:04:30.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.742+0000 7fd63cdff700 1 -- 172.21.15.37:0/4180148716 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd61806adb0 msgr2=0x7fd61806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.742+0000 7fd63cdff700 1 --2- 172.21.15.37:0/4180148716 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd61806adb0 0x7fd61806d260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd628000c00 tx=0x7fd628012000 comp rx=0 tx=0).stop 2023-07-12T02:04:30.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.742+0000 7fd63cdff700 1 -- 172.21.15.37:0/4180148716 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6380c8890 msgr2=0x7fd63814e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.742+0000 7fd63cdff700 1 --2- 172.21.15.37:0/4180148716 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6380c8890 0x7fd63814e5e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00b440 tx=0x7fd62c00b800 comp rx=0 tx=0).stop 2023-07-12T02:04:30.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7fd63cdff700 1 -- 172.21.15.37:0/4180148716 shutdown_connections 2023-07-12T02:04:30.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7fd63cdff700 1 --2- 172.21.15.37:0/4180148716 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd61806adb0 0x7fd61806d260 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7fd63cdff700 1 --2- 172.21.15.37:0/4180148716 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6380c8890 0x7fd63814e5e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7fd63cdff700 1 --2- 172.21.15.37:0/4180148716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6380c9970 0x7fd6380c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7fd63cdff700 1 --2- 172.21.15.37:0/4180148716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6380cb8b0 0x7fd63815a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7fd63cdff700 1 -- 172.21.15.37:0/4180148716 >> 172.21.15.37:0/4180148716 conn(0x7fd63806abc0 msgr2=0x7fd6380aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:30.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7f46b27ff700 1 -- 172.21.15.37:0/1413389111 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f469806ad30 msgr2=0x7f469806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7f46b27ff700 1 --2- 172.21.15.37:0/1413389111 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f469806ad30 0x7f469806d1e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f46ac152210 tx=0x7f469c008040 comp rx=0 tx=0).stop 2023-07-12T02:04:30.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7f46b27ff700 1 -- 172.21.15.37:0/1413389111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46ac070a80 msgr2=0x7f46ac14fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7f46b27ff700 1 --2- 172.21.15.37:0/1413389111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46ac070a80 0x7f46ac14fcf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f46a4001ed0 tx=0x7f46a40021e0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7f46b27ff700 1 -- 172.21.15.37:0/1413389111 shutdown_connections 2023-07-12T02:04:30.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7f46b27ff700 1 --2- 172.21.15.37:0/1413389111 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f469806ad30 0x7f469806d1e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7f46b27ff700 1 --2- 172.21.15.37:0/1413389111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46ac160930 0x7f46ac0c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7f46b27ff700 1 --2- 172.21.15.37:0/1413389111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46ac070a80 0x7f46ac14fcf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7f46b27ff700 1 --2- 172.21.15.37:0/1413389111 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46ac0adce0 0x7f46ac0c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7f46b27ff700 1 -- 172.21.15.37:0/1413389111 >> 172.21.15.37:0/1413389111 conn(0x7f46ac0b0390 msgr2=0x7f46ac152be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:30.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.743+0000 7f46b27ff700 1 -- 172.21.15.37:0/1413389111 shutdown_connections 2023-07-12T02:04:30.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.744+0000 7f46b27ff700 1 -- 172.21.15.37:0/1413389111 wait complete. 2023-07-12T02:04:30.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.744+0000 7fd63cdff700 1 -- 172.21.15.37:0/4180148716 shutdown_connections 2023-07-12T02:04:30.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.744+0000 7fd63cdff700 1 -- 172.21.15.37:0/4180148716 wait complete. 2023-07-12T02:04:30.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.749+0000 7f62071ff700 1 -- 172.21.15.37:0/2791647169 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f620004ea60 con 0x7f61e8005200 2023-07-12T02:04:30.757 INFO:teuthology.orchestra.run.smithi037.stdout:55834574859 2023-07-12T02:04:30.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.750+0000 7f61fd7fa700 1 -- 172.21.15.37:0/2791647169 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f61f8058210 con 0x7f61e8005200 2023-07-12T02:04:30.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.754+0000 7f62071ff700 1 -- 172.21.15.37:0/2791647169 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f61ec06adb0 msgr2=0x7f61ec06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.754+0000 7f62071ff700 1 --2- 172.21.15.37:0/2791647169 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f61ec06adb0 0x7f61ec06d260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f62001e4650 tx=0x7f61f0009040 comp rx=0 tx=0).stop 2023-07-12T02:04:30.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.754+0000 7f62071ff700 1 -- 172.21.15.37:0/2791647169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61e8005200 msgr2=0x7f6200153b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.754+0000 7f62071ff700 1 --2- 172.21.15.37:0/2791647169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61e8005200 0x7f6200153b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f61f8008b30 tx=0x7f61f800b330 comp rx=0 tx=0).stop 2023-07-12T02:04:30.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.756+0000 7f62071ff700 1 -- 172.21.15.37:0/2791647169 shutdown_connections 2023-07-12T02:04:30.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.756+0000 7f62071ff700 1 --2- 172.21.15.37:0/2791647169 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f61ec06adb0 0x7f61ec06d260 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.756+0000 7f62071ff700 1 --2- 172.21.15.37:0/2791647169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f620015a5f0 0x7f6200156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.756+0000 7f62071ff700 1 --2- 172.21.15.37:0/2791647169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61e8005200 0x7f6200153b20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.756+0000 7f62071ff700 1 --2- 172.21.15.37:0/2791647169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f620015a180 0x7f6200156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.756+0000 7f62071ff700 1 -- 172.21.15.37:0/2791647169 >> 172.21.15.37:0/2791647169 conn(0x7f620006abc0 msgr2=0x7f62000afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:30.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.757+0000 7f62071ff700 1 -- 172.21.15.37:0/2791647169 shutdown_connections 2023-07-12T02:04:30.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.757+0000 7f62071ff700 1 -- 172.21.15.37:0/2791647169 wait complete. 2023-07-12T02:04:30.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.759+0000 7f28079ff700 1 -- 172.21.15.37:0/1946182957 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f280004ea60 con 0x7f28000cb8a0 2023-07-12T02:04:30.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.762+0000 7f27f5ffb700 1 -- 172.21.15.37:0/1946182957 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27f00580d0 con 0x7f28000cb8a0 2023-07-12T02:04:30.766 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2023-07-12T02:04:30.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.763+0000 7f9d273ff700 1 -- 172.21.15.37:0/3675301145 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9d20066ac0 con 0x7f9d20160930 2023-07-12T02:04:30.771 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2023-07-12T02:04:30.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.764+0000 7f9d11ffb700 1 -- 172.21.15.37:0/3675301145 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d20066ac0 con 0x7f9d20160930 2023-07-12T02:04:30.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.768+0000 7f9d273ff700 1 -- 172.21.15.37:0/3675301145 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9d0406adb0 msgr2=0x7f9d0406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.768+0000 7f9d273ff700 1 --2- 172.21.15.37:0/3675301145 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9d0406adb0 0x7f9d0406d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9d14001590 tx=0x7f9d14007a20 comp rx=0 tx=0).stop 2023-07-12T02:04:30.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.768+0000 7f9d273ff700 1 -- 172.21.15.37:0/3675301145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d20160930 msgr2=0x7f9d200c3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.768+0000 7f9d273ff700 1 --2- 172.21.15.37:0/3675301145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d20160930 0x7f9d200c3370 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800efc0 tx=0x7f9d1800c3a0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.768+0000 7f9d273ff700 1 -- 172.21.15.37:0/3675301145 shutdown_connections 2023-07-12T02:04:30.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.768+0000 7f9d273ff700 1 --2- 172.21.15.37:0/3675301145 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9d0406adb0 0x7f9d0406d260 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.768+0000 7f9d273ff700 1 --2- 172.21.15.37:0/3675301145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d20160930 0x7f9d200c3370 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.768+0000 7f9d273ff700 1 --2- 172.21.15.37:0/3675301145 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d20070a80 0x7f9d20151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.768+0000 7f9d273ff700 1 --2- 172.21.15.37:0/3675301145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d200adce0 0x7f9d200c2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.768+0000 7f9d273ff700 1 -- 172.21.15.37:0/3675301145 >> 172.21.15.37:0/3675301145 conn(0x7f9d200b0390 msgr2=0x7f9d2014f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.768+0000 7f9d273ff700 1 -- 172.21.15.37:0/3675301145 shutdown_connections 2023-07-12T02:04:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.769+0000 7f9d273ff700 1 -- 172.21.15.37:0/3675301145 wait complete. 2023-07-12T02:04:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.770+0000 7f28079ff700 1 -- 172.21.15.37:0/1946182957 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f27e406adb0 msgr2=0x7f27e406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.770+0000 7f28079ff700 1 --2- 172.21.15.37:0/1946182957 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f27e406adb0 0x7f27e406d260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0099d0 tx=0x7f27fc008040 comp rx=0 tx=0).stop 2023-07-12T02:04:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.770+0000 7f28079ff700 1 -- 172.21.15.37:0/1946182957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28000cb8a0 msgr2=0x7f28001f3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.770+0000 7f28079ff700 1 --2- 172.21.15.37:0/1946182957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28000cb8a0 0x7f28001f3db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f27f000b470 tx=0x7f27f000b780 comp rx=0 tx=0).stop 2023-07-12T02:04:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.771+0000 7f28079ff700 1 -- 172.21.15.37:0/1946182957 shutdown_connections 2023-07-12T02:04:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.771+0000 7f28079ff700 1 --2- 172.21.15.37:0/1946182957 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f27e406adb0 0x7f27e406d260 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.771+0000 7f28079ff700 1 --2- 172.21.15.37:0/1946182957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f280016c570 0x7f28001f42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.771+0000 7f28079ff700 1 --2- 172.21.15.37:0/1946182957 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2800089570 0x7f28001ff300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.771+0000 7f28079ff700 1 --2- 172.21.15.37:0/1946182957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28000cb8a0 0x7f28001f3db0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.771+0000 7f28079ff700 1 -- 172.21.15.37:0/1946182957 >> 172.21.15.37:0/1946182957 conn(0x7f280006abc0 msgr2=0x7f28000acf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.771+0000 7f28079ff700 1 -- 172.21.15.37:0/1946182957 shutdown_connections 2023-07-12T02:04:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.773+0000 7f28079ff700 1 -- 172.21.15.37:0/1946182957 wait complete. 2023-07-12T02:04:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.773+0000 7f7d22fff700 1 -- 172.21.15.37:0/2199785627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7d1c04ea60 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.773+0000 7f7d197fa700 1 -- 172.21.15.37:0/2199785627 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d14057bf0 con 0x7f7d1c0cf5f0 2023-07-12T02:04:30.780 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2023-07-12T02:04:30.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2023-07-12T02:04:30.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.1 2023-07-12T02:04:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.777+0000 7f7d22fff700 1 -- 172.21.15.37:0/2199785627 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7d0806adb0 msgr2=0x7f7d0806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.777+0000 7f7d22fff700 1 --2- 172.21.15.37:0/2199785627 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7d0806adb0 0x7f7d0806d260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0b4640 tx=0x7f7d0c008030 comp rx=0 tx=0).stop 2023-07-12T02:04:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.777+0000 7f7d22fff700 1 -- 172.21.15.37:0/2199785627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d1c0cf5f0 msgr2=0x7f7d1c0cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.777+0000 7f7d22fff700 1 --2- 172.21.15.37:0/2199785627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d1c0cf5f0 0x7f7d1c0cb270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400cbd0 tx=0x7f7d1400cee0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.777+0000 7f7d22fff700 1 -- 172.21.15.37:0/2199785627 shutdown_connections 2023-07-12T02:04:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.777+0000 7f7d22fff700 1 --2- 172.21.15.37:0/2199785627 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7d0806adb0 0x7f7d0806d260 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.777+0000 7f7d22fff700 1 --2- 172.21.15.37:0/2199785627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d1c0cf5f0 0x7f7d1c0cb270 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.777+0000 7f7d22fff700 1 --2- 172.21.15.37:0/2199785627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d1c0d1230 0x7f7d1c15ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.777+0000 7f7d22fff700 1 --2- 172.21.15.37:0/2199785627 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d1c0d0750 0x7f7d1c15e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.777+0000 7f7d22fff700 1 -- 172.21.15.37:0/2199785627 >> 172.21.15.37:0/2199785627 conn(0x7f7d1c071660 msgr2=0x7f7d1c0d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.777+0000 7f7d22fff700 1 -- 172.21.15.37:0/2199785627 shutdown_connections 2023-07-12T02:04:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.777+0000 7f7d22fff700 1 -- 172.21.15.37:0/2199785627 wait complete. 2023-07-12T02:04:30.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2023-07-12T02:04:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.785+0000 7f58c19ff700 1 -- 172.21.15.37:0/1166326529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f58bc1548d0 con 0x7f58bc0adce0 2023-07-12T02:04:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.786+0000 7f58a3fff700 1 -- 172.21.15.37:0/1166326529 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f58b0057720 con 0x7f58bc0adce0 2023-07-12T02:04:30.789 INFO:teuthology.orchestra.run.smithi037.stdout:55834574859 2023-07-12T02:04:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.789+0000 7f58c19ff700 1 -- 172.21.15.37:0/1166326529 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f58a806adb0 msgr2=0x7f58a806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.789+0000 7f58c19ff700 1 --2- 172.21.15.37:0/1166326529 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f58a806adb0 0x7f58a806d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f58b40073c0 tx=0x7f58b4009630 comp rx=0 tx=0).stop 2023-07-12T02:04:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.789+0000 7f58c19ff700 1 -- 172.21.15.37:0/1166326529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58bc0adce0 msgr2=0x7f58bc157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.789+0000 7f58c19ff700 1 --2- 172.21.15.37:0/1166326529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58bc0adce0 0x7f58bc157db0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f58b000c7c0 tx=0x7f58b000cb80 comp rx=0 tx=0).stop 2023-07-12T02:04:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.789+0000 7f58c19ff700 1 -- 172.21.15.37:0/1166326529 shutdown_connections 2023-07-12T02:04:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.789+0000 7f58c19ff700 1 --2- 172.21.15.37:0/1166326529 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f58a806adb0 0x7f58a806d260 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.789+0000 7f58c19ff700 1 --2- 172.21.15.37:0/1166326529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58bc160930 0x7f58bc162ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.789+0000 7f58c19ff700 1 --2- 172.21.15.37:0/1166326529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58bc070a80 0x7f58bc153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.789+0000 7f58c19ff700 1 --2- 172.21.15.37:0/1166326529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58bc0adce0 0x7f58bc157db0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.789+0000 7f58c19ff700 1 -- 172.21.15.37:0/1166326529 >> 172.21.15.37:0/1166326529 conn(0x7f58bc0b0390 msgr2=0x7f58bc0af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.789+0000 7f58c19ff700 1 -- 172.21.15.37:0/1166326529 shutdown_connections 2023-07-12T02:04:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:30.789+0000 7f58c19ff700 1 -- 172.21.15.37:0/1166326529 wait complete. 2023-07-12T02:04:30.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.6 2023-07-12T02:04:30.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2023-07-12T02:04:30.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2023-07-12T02:04:30.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2023-07-12T02:04:30.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.4 2023-07-12T02:04:31.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-12T02:04:31.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-12T02:04:31.785 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-12T02:04:31.797 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-12T02:04:31.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-12T02:04:31.804 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-12T02:04:31.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-12T02:04:31.815 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-12T02:04:32.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.111+0000 7f06dc1ff700 1 Processor -- start 2023-07-12T02:04:32.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.111+0000 7f06dc1ff700 1 -- start start 2023-07-12T02:04:32.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.113+0000 7f06dc1ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f06d40cb8a0 0x7f06d40cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.113+0000 7f06dc1ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06d4089570 0x7f06d40ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.113+0000 7f06dc1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d40ce620 con 0x7f06d416c7e0 2023-07-12T02:04:32.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.113+0000 7f06dc1ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d4089e70 con 0x7f06d4089570 2023-07-12T02:04:32.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.113+0000 7f06dc1ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d40caac0 con 0x7f06d40cb8a0 2023-07-12T02:04:32.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.114+0000 7f06da79c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06d4089570 0x7f06d40ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.114+0000 7f06da79c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06d4089570 0x7f06d40ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35256/0 (socket says 172.21.15.37:35256) 2023-07-12T02:04:32.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.114+0000 7f06da79c700 1 -- 172.21.15.37:0/1533069740 learned_addr learned my addr 172.21.15.37:0/1533069740 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:32.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.115+0000 7f06da79c700 1 -- 172.21.15.37:0/1533069740 >> v2:172.21.15.196:3300/0 conn(0x7f06d40cb8a0 msgr2=0x7f06d40cda10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-12T02:04:32.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.115+0000 7f06da79c700 1 --2- 172.21.15.37:0/1533069740 >> v2:172.21.15.196:3300/0 conn(0x7f06d40cb8a0 0x7f06d40cda10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.115+0000 7f06da79c700 1 -- 172.21.15.37:0/1533069740 >> v1:172.21.15.37:6789/0 conn(0x7f06d416c7e0 legacy=0x7f06d40cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:32.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.115+0000 7f06da79c700 1 -- 172.21.15.37:0/1533069740 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d40cc970 con 0x7f06d4089570 2023-07-12T02:04:32.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.116+0000 7f06da79c700 1 --2- 172.21.15.37:0/1533069740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d4089570 0x7f06d40ce0e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f06d40ca730 tx=0x7f06c4009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b82ccb9029d0c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.117+0000 7f06d8f99700 1 -- 172.21.15.37:0/1533069740 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4019a60 con 0x7f06d4089570 2023-07-12T02:04:32.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.117+0000 7f06d8f99700 1 -- 172.21.15.37:0/1533069740 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c4019bc0 con 0x7f06d4089570 2023-07-12T02:04:32.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.117+0000 7f06d8f99700 1 -- 172.21.15.37:0/1533069740 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4004020 con 0x7f06d4089570 2023-07-12T02:04:32.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.118+0000 7f5e639ff700 1 Processor -- start 2023-07-12T02:04:32.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.118+0000 7f06dc1ff700 1 -- 172.21.15.37:0/1533069740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d4089570 msgr2=0x7f06d40ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.118+0000 7f06dc1ff700 1 --2- 172.21.15.37:0/1533069740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d4089570 0x7f06d40ce0e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f06d40ca730 tx=0x7f06c4009360 comp rx=0 tx=0).stop 2023-07-12T02:04:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.119+0000 7f06dc1ff700 1 -- 172.21.15.37:0/1533069740 shutdown_connections 2023-07-12T02:04:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.119+0000 7f06dc1ff700 1 --2- 172.21.15.37:0/1533069740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d4089570 0x7f06d40ce0e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.119+0000 7f06dc1ff700 1 --2- 172.21.15.37:0/1533069740 >> v2:172.21.15.196:3300/0 conn(0x7f06d40cb8a0 0x7f06d40cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.119+0000 7f06dc1ff700 1 -- 172.21.15.37:0/1533069740 >> 172.21.15.37:0/1533069740 conn(0x7f06d406abc0 msgr2=0x7f06d40b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:32.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.118+0000 7f5e639ff700 1 -- start start 2023-07-12T02:04:32.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.120+0000 7f5e639ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5e5c0b0aa0 0x7f5e5c0cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.121+0000 7f5e6179b700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5e5c0b0aa0 0x7f5e5c0cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.121+0000 7f5e6179b700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5e5c0b0aa0 0x7f5e5c0cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:43218/0 (socket says 172.21.15.37:43218) 2023-07-12T02:04:32.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.121+0000 7f5e639ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e5c0c9d80 0x7f5e5c0cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.121+0000 7f5e639ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5c0cce20 con 0x7f5e5c0c98e0 2023-07-12T02:04:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.121+0000 7f5e639ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5c0cd100 con 0x7f5e5c0c9d80 2023-07-12T02:04:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.121+0000 7f5e639ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5c0cd3e0 con 0x7f5e5c0b0aa0 2023-07-12T02:04:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.121+0000 7f5e6179b700 1 -- 172.21.15.37:0/1794491283 learned_addr learned my addr 172.21.15.37:0/1794491283 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.122+0000 7f5e61f9c700 1 --2- 172.21.15.37:0/1794491283 >> v2:172.21.15.37:3300/0 conn(0x7f5e5c0c9d80 0x7f5e5c0cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.123+0000 7f5e61f9c700 1 -- 172.21.15.37:0/1794491283 >> v2:172.21.15.196:3300/0 conn(0x7f5e5c0b0aa0 msgr2=0x7f5e5c0cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:32.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.123+0000 7f5e61f9c700 1 --2- 172.21.15.37:0/1794491283 >> v2:172.21.15.196:3300/0 conn(0x7f5e5c0b0aa0 0x7f5e5c0cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.123+0000 7f5e61f9c700 1 -- 172.21.15.37:0/1794491283 >> v1:172.21.15.196:6789/0 conn(0x7f5e5c0c98e0 legacy=0x7f5e5c0cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:32.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.123+0000 7f5e61f9c700 1 -- 172.21.15.37:0/1794491283 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c0cd6c0 con 0x7f5e5c0c9d80 2023-07-12T02:04:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.124+0000 7f5e61f9c700 1 --2- 172.21.15.37:0/1794491283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c0c9d80 0x7f5e5c0cb8b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0cc560 tx=0x7f5e4c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1306b879f211ef server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.122+0000 7f06dc1ff700 1 -- 172.21.15.37:0/1533069740 shutdown_connections 2023-07-12T02:04:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.122+0000 7f06dc1ff700 1 -- 172.21.15.37:0/1533069740 wait complete. 2023-07-12T02:04:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.125+0000 7f06dc1ff700 1 Processor -- start 2023-07-12T02:04:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.126+0000 7f06dc1ff700 1 -- start start 2023-07-12T02:04:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.126+0000 7f5e53fff700 1 -- 172.21.15.37:0/1794491283 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c004230 con 0x7f5e5c0c9d80 2023-07-12T02:04:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.126+0000 7f5e53fff700 1 -- 172.21.15.37:0/1794491283 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c004390 con 0x7f5e5c0c9d80 2023-07-12T02:04:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.126+0000 7f5e53fff700 1 -- 172.21.15.37:0/1794491283 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0036a0 con 0x7f5e5c0c9d80 2023-07-12T02:04:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.127+0000 7f5e639ff700 1 -- 172.21.15.37:0/1794491283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c0c9d80 msgr2=0x7f5e5c0cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.127+0000 7f5e639ff700 1 --2- 172.21.15.37:0/1794491283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c0c9d80 0x7f5e5c0cb8b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0cc560 tx=0x7f5e4c009b20 comp rx=0 tx=0).stop 2023-07-12T02:04:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.128+0000 7f5e639ff700 1 -- 172.21.15.37:0/1794491283 shutdown_connections 2023-07-12T02:04:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.128+0000 7f5e639ff700 1 --2- 172.21.15.37:0/1794491283 >> v2:172.21.15.196:3300/0 conn(0x7f5e5c0b0aa0 0x7f5e5c0cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.128+0000 7f5e639ff700 1 --2- 172.21.15.37:0/1794491283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c0c9d80 0x7f5e5c0cb8b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.128+0000 7f5e639ff700 1 -- 172.21.15.37:0/1794491283 >> 172.21.15.37:0/1794491283 conn(0x7f5e5c06abc0 msgr2=0x7f5e5c0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.129+0000 7f5e639ff700 1 -- 172.21.15.37:0/1794491283 shutdown_connections 2023-07-12T02:04:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.128+0000 7f06dc1ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06d4089570 0x7f06d40b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.128+0000 7f06dc1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d40cb8a0 0x7f06d4201c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.128+0000 7f06dc1ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f06d416c7e0 0x7f06d4202150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.129+0000 7f06dc1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40c6260 con 0x7f06d40cb8a0 2023-07-12T02:04:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.129+0000 7f06dc1ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40c86e0 con 0x7f06d4089570 2023-07-12T02:04:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.129+0000 7f06dc1ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40c3e90 con 0x7f06d416c7e0 2023-07-12T02:04:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.129+0000 7f06d9f9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06d4089570 0x7f06d40b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.130+0000 7f06da79c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f06d416c7e0 0x7f06d4202150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.130+0000 7f06d9f9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06d4089570 0x7f06d40b1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:43234/0 (socket says 172.21.15.37:43234) 2023-07-12T02:04:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.130+0000 7f06d9f9b700 1 -- 172.21.15.37:0/610105691 learned_addr learned my addr 172.21.15.37:0/610105691 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.131+0000 7f06d979a700 1 --2- 172.21.15.37:0/610105691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d40cb8a0 0x7f06d4201c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.129+0000 7f5e639ff700 1 -- 172.21.15.37:0/1794491283 wait complete. 2023-07-12T02:04:32.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.132+0000 7f5e639ff700 1 Processor -- start 2023-07-12T02:04:32.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.132+0000 7f06d979a700 1 -- 172.21.15.37:0/610105691 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f06d416c7e0 msgr2=0x7f06d4202150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.132+0000 7f06d979a700 1 --2- 172.21.15.37:0/610105691 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f06d416c7e0 0x7f06d4202150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.132+0000 7f06d979a700 1 -- 172.21.15.37:0/610105691 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06d4089570 msgr2=0x7f06d40b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.132+0000 7f06d979a700 1 --2- 172.21.15.37:0/610105691 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06d4089570 0x7f06d40b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.132+0000 7f06d979a700 1 -- 172.21.15.37:0/610105691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c400a6f0 con 0x7f06d40cb8a0 2023-07-12T02:04:32.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.132+0000 7f06d979a700 1 --2- 172.21.15.37:0/610105691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d40cb8a0 0x7f06d4201c10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f06d40cbcd0 tx=0x7f06d000b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.132+0000 7f5e639ff700 1 -- start start 2023-07-12T02:04:32.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.134+0000 7f5e639ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e5c0b0aa0 0x7f5e5c1f6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.134+0000 7f5e639ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c0c98e0 0x7f5e5c161e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.134+0000 7f5e639ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5e5c0c9d80 0x7f5e5c1612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.134+0000 7f5e639ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c161810 con 0x7f5e5c0c98e0 2023-07-12T02:04:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.134+0000 7f5e639ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0c8370 con 0x7f5e5c0b0aa0 2023-07-12T02:04:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.134+0000 7f5e639ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c1f6e90 con 0x7f5e5c0c9d80 2023-07-12T02:04:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.138+0000 7f5e6179b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e5c0b0aa0 0x7f5e5c1f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.135+0000 7f06ca7fc700 1 -- 172.21.15.37:0/610105691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0011830 con 0x7f06d40cb8a0 2023-07-12T02:04:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.135+0000 7f06ca7fc700 1 -- 172.21.15.37:0/610105691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d0011990 con 0x7f06d40cb8a0 2023-07-12T02:04:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.135+0000 7f06ca7fc700 1 -- 172.21.15.37:0/610105691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0011d00 con 0x7f06d40cb8a0 2023-07-12T02:04:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.135+0000 7f06dc1ff700 1 -- 172.21.15.37:0/610105691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d40c4170 con 0x7f06d40cb8a0 2023-07-12T02:04:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.135+0000 7f06dc1ff700 1 -- 172.21.15.37:0/610105691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d40c4730 con 0x7f06d40cb8a0 2023-07-12T02:04:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.138+0000 7f5e6179b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e5c0b0aa0 0x7f5e5c1f6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:43246/0 (socket says 172.21.15.37:43246) 2023-07-12T02:04:32.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.138+0000 7f5e6179b700 1 -- 172.21.15.37:0/1146244353 learned_addr learned my addr 172.21.15.37:0/1146244353 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:32.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.138+0000 7f06dc1ff700 1 -- 172.21.15.37:0/610105691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06bc0052f0 con 0x7f06d40cb8a0 2023-07-12T02:04:32.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.139+0000 7f5e60f9a700 1 --2- 172.21.15.37:0/1146244353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c0c98e0 0x7f5e5c161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.139+0000 7f5e6179b700 1 -- 172.21.15.37:0/1146244353 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5e5c0c9d80 msgr2=0x7f5e5c1612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.139+0000 7f5e6179b700 1 --2- 172.21.15.37:0/1146244353 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5e5c0c9d80 0x7f5e5c1612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.139+0000 7f5e6179b700 1 -- 172.21.15.37:0/1146244353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c0c98e0 msgr2=0x7f5e5c161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.139+0000 7f5e6179b700 1 --2- 172.21.15.37:0/1146244353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c0c98e0 0x7f5e5c161e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.139+0000 7f5e6179b700 1 -- 172.21.15.37:0/1146244353 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c0094a0 con 0x7f5e5c0b0aa0 2023-07-12T02:04:32.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.141+0000 7f5e6179b700 1 --2- 172.21.15.37:0/1146244353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e5c0b0aa0 0x7f5e5c1f6860 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800e910 tx=0x7f5e5800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.141+0000 7f5e51ffb700 1 -- 172.21.15.37:0/1146244353 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580096a0 con 0x7f5e5c0b0aa0 2023-07-12T02:04:32.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.141+0000 7f5e51ffb700 1 -- 172.21.15.37:0/1146244353 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5800c850 con 0x7f5e5c0b0aa0 2023-07-12T02:04:32.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.141+0000 7f5e51ffb700 1 -- 172.21.15.37:0/1146244353 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5800cc00 con 0x7f5e5c0b0aa0 2023-07-12T02:04:32.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.141+0000 7f5e639ff700 1 -- 172.21.15.37:0/1146244353 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5c1f7170 con 0x7f5e5c0b0aa0 2023-07-12T02:04:32.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.141+0000 7f5e639ff700 1 -- 172.21.15.37:0/1146244353 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5c159a40 con 0x7f5e5c0b0aa0 2023-07-12T02:04:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.143+0000 7f06ca7fc700 1 -- 172.21.15.37:0/610105691 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06d001a400 con 0x7f06d40cb8a0 2023-07-12T02:04:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.145+0000 7f06ca7fc700 1 --2- 172.21.15.37:0/610105691 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f06b806adb0 0x7f06b806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.145+0000 7f06ca7fc700 1 -- 172.21.15.37:0/610105691 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f06d00895f0 con 0x7f06d40cb8a0 2023-07-12T02:04:32.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.148+0000 7f06d9f9b700 1 --2- 172.21.15.37:0/610105691 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f06b806adb0 0x7f06b806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.149+0000 7f06d9f9b700 1 --2- 172.21.15.37:0/610105691 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f06b806adb0 0x7f06b806d260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00e250 tx=0x7f06cc00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.146+0000 7f5e639ff700 1 -- 172.21.15.37:0/1146244353 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5c159c60 con 0x7f5e5c0b0aa0 2023-07-12T02:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.154+0000 7f5e51ffb700 1 -- 172.21.15.37:0/1146244353 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e5800cd60 con 0x7f5e5c0b0aa0 2023-07-12T02:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.156+0000 7f5e51ffb700 1 --2- 172.21.15.37:0/1146244353 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5e4006adb0 0x7f5e4006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.156+0000 7f5e51ffb700 1 -- 172.21.15.37:0/1146244353 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e58089940 con 0x7f5e5c0b0aa0 2023-07-12T02:04:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.156+0000 7f5e51ffb700 1 -- 172.21.15.37:0/1146244353 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5e580b5400 con 0x7f5e5c0b0aa0 2023-07-12T02:04:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.158+0000 7f5e60f9a700 1 --2- 172.21.15.37:0/1146244353 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5e4006adb0 0x7f5e4006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.159+0000 7f5e60f9a700 1 --2- 172.21.15.37:0/1146244353 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5e4006adb0 0x7f5e4006d260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0b03a0 tx=0x7f5e54009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.154+0000 7f06ca7fc700 1 -- 172.21.15.37:0/610105691 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f06d0054390 con 0x7f06d40cb8a0 2023-07-12T02:04:32.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.200+0000 7f8b585ff700 1 Processor -- start 2023-07-12T02:04:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.200+0000 7f8b585ff700 1 -- start start 2023-07-12T02:04:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.203+0000 7f8b585ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b500c9970 0x7f8b500cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.203+0000 7f8b585ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b500cb8b0 0x7f8b50157d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.203+0000 7f8b585ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b500cce20 con 0x7f8b500c9d40 2023-07-12T02:04:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.203+0000 7f8b585ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b500cd100 con 0x7f8b500cb8b0 2023-07-12T02:04:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.203+0000 7f8b585ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b500cd3e0 con 0x7f8b500c9970 2023-07-12T02:04:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.204+0000 7f8b5639b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b500c9970 0x7f8b500cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.204+0000 7f8b5639b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b500c9970 0x7f8b500cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:59460/0 (socket says 172.21.15.37:59460) 2023-07-12T02:04:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.204+0000 7f8b5639b700 1 -- 172.21.15.37:0/1126547978 learned_addr learned my addr 172.21.15.37:0/1126547978 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.205+0000 7f8b5639b700 1 -- 172.21.15.37:0/1126547978 >> v2:172.21.15.37:3300/0 conn(0x7f8b500cb8b0 msgr2=0x7f8b50157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.205+0000 7f8b5639b700 1 --2- 172.21.15.37:0/1126547978 >> v2:172.21.15.37:3300/0 conn(0x7f8b500cb8b0 0x7f8b50157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.205+0000 7f8b5639b700 1 -- 172.21.15.37:0/1126547978 >> v1:172.21.15.37:6789/0 conn(0x7f8b500c9d40 legacy=0x7f8b500cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.205+0000 7f8b5639b700 1 -- 172.21.15.37:0/1126547978 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b500cd6c0 con 0x7f8b500c9970 2023-07-12T02:04:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.206+0000 7f8b5639b700 1 --2- 172.21.15.37:0/1126547978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b500c9970 0x7f8b500cdec0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800d370 tx=0x7f8b4800d680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82c052ffb6130e04 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.206+0000 7f8b55399700 1 -- 172.21.15.37:0/1126547978 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48010070 con 0x7f8b500c9970 2023-07-12T02:04:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.207+0000 7f8b55399700 1 -- 172.21.15.37:0/1126547978 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4800dcd0 con 0x7f8b500c9970 2023-07-12T02:04:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.207+0000 7f8b55399700 1 -- 172.21.15.37:0/1126547978 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48007d50 con 0x7f8b500c9970 2023-07-12T02:04:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.207+0000 7f8b585ff700 1 -- 172.21.15.37:0/1126547978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b500c9970 msgr2=0x7f8b500cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.208+0000 7f8b585ff700 1 --2- 172.21.15.37:0/1126547978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b500c9970 0x7f8b500cdec0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800d370 tx=0x7f8b4800d680 comp rx=0 tx=0).stop 2023-07-12T02:04:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.208+0000 7f8b585ff700 1 -- 172.21.15.37:0/1126547978 shutdown_connections 2023-07-12T02:04:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.208+0000 7f8b585ff700 1 --2- 172.21.15.37:0/1126547978 >> v2:172.21.15.37:3300/0 conn(0x7f8b500cb8b0 0x7f8b50157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.208+0000 7f8b585ff700 1 --2- 172.21.15.37:0/1126547978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b500c9970 0x7f8b500cdec0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.208+0000 7f8b585ff700 1 -- 172.21.15.37:0/1126547978 >> 172.21.15.37:0/1126547978 conn(0x7f8b5006abc0 msgr2=0x7f8b500b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:32.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.208+0000 7f8b585ff700 1 -- 172.21.15.37:0/1126547978 shutdown_connections 2023-07-12T02:04:32.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.209+0000 7f8b585ff700 1 -- 172.21.15.37:0/1126547978 wait complete. 2023-07-12T02:04:32.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.211+0000 7f8b585ff700 1 Processor -- start 2023-07-12T02:04:32.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.212+0000 7f8b585ff700 1 -- start start 2023-07-12T02:04:32.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.213+0000 7f8b585ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b500c9970 0x7f8b5014bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.213+0000 7f8b585ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b500c9d40 0x7f8b500c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.213+0000 7f8b585ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b500cb8b0 0x7f8b500c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.213+0000 7f8b585ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5014c150 con 0x7f8b500cb8b0 2023-07-12T02:04:32.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.213+0000 7f8b585ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5014c330 con 0x7f8b500c9970 2023-07-12T02:04:32.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.213+0000 7f8b585ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b500b08a0 con 0x7f8b500c9d40 2023-07-12T02:04:32.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.214+0000 7f8b55b9a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b500c9d40 0x7f8b500c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.214+0000 7f8b55b9a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b500c9d40 0x7f8b500c35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:59466/0 (socket says 172.21.15.37:59466) 2023-07-12T02:04:32.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.214+0000 7f8b55b9a700 1 -- 172.21.15.37:0/2805426896 learned_addr learned my addr 172.21.15.37:0/2805426896 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:32.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.215+0000 7f8b56b9c700 1 --2- 172.21.15.37:0/2805426896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b500cb8b0 0x7f8b500c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.215+0000 7f8b5639b700 1 --2- 172.21.15.37:0/2805426896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b500c9970 0x7f8b5014bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.216+0000 7f8b55b9a700 1 -- 172.21.15.37:0/2805426896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b500c9970 msgr2=0x7f8b5014bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.216+0000 7f8b55b9a700 1 --2- 172.21.15.37:0/2805426896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b500c9970 0x7f8b5014bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.216+0000 7f8b55b9a700 1 -- 172.21.15.37:0/2805426896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b500cb8b0 msgr2=0x7f8b500c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.216+0000 7f8b55b9a700 1 --2- 172.21.15.37:0/2805426896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b500cb8b0 0x7f8b500c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.216+0000 7f8b55b9a700 1 -- 172.21.15.37:0/2805426896 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4800d050 con 0x7f8b500c9d40 2023-07-12T02:04:32.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.217+0000 7f8b55b9a700 1 --2- 172.21.15.37:0/2805426896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b500c9d40 0x7f8b500c35e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00c4a0 tx=0x7f8b4c00c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.218+0000 7f8b46ffd700 1 -- 172.21.15.37:0/2805426896 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c0054e0 con 0x7f8b500c9d40 2023-07-12T02:04:32.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.218+0000 7f8b46ffd700 1 -- 172.21.15.37:0/2805426896 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4c003680 con 0x7f8b500c9d40 2023-07-12T02:04:32.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.218+0000 7f8b46ffd700 1 -- 172.21.15.37:0/2805426896 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c003a30 con 0x7f8b500c9d40 2023-07-12T02:04:32.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.218+0000 7f8b585ff700 1 -- 172.21.15.37:0/2805426896 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b500b2a40 con 0x7f8b500c9d40 2023-07-12T02:04:32.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.218+0000 7f8b585ff700 1 -- 172.21.15.37:0/2805426896 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b500b3000 con 0x7f8b500c9d40 2023-07-12T02:04:32.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.217+0000 7f2f0d5ff700 1 Processor -- start 2023-07-12T02:04:32.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.217+0000 7f2f0d5ff700 1 -- start start 2023-07-12T02:04:32.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.219+0000 7f2f0d5ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2f081583d0 0x7f2f080cc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.219+0000 7f2f0d5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f0815ca40 0x7f2f080c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.220+0000 7f2f0d5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080ad710 0x7f2f080adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.220+0000 7f2f0d5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f080ae0d0 con 0x7f2f0815ca40 2023-07-12T02:04:32.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.220+0000 7f2f0d5ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f080ccf30 con 0x7f2f081583d0 2023-07-12T02:04:32.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.220+0000 7f2f0d5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0806c7e0 con 0x7f2f080ad710 2023-07-12T02:04:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.220+0000 7f2f06ffd700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2f081583d0 0x7f2f080cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.220+0000 7f2f06ffd700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2f081583d0 0x7f2f080cc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:43268/0 (socket says 172.21.15.37:43268) 2023-07-12T02:04:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.220+0000 7f2f06ffd700 1 -- 172.21.15.37:0/1340990405 learned_addr learned my addr 172.21.15.37:0/1340990405 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.221+0000 7f2f06ffd700 1 -- 172.21.15.37:0/1340990405 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080ad710 msgr2=0x7f2f080adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.221+0000 7f2f06ffd700 1 --2- 172.21.15.37:0/1340990405 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080ad710 0x7f2f080adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.221+0000 7f2f06ffd700 1 -- 172.21.15.37:0/1340990405 >> v2:172.21.15.37:3300/0 conn(0x7f2f0815ca40 msgr2=0x7f2f080c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.221+0000 7f2f06ffd700 1 --2- 172.21.15.37:0/1340990405 >> v2:172.21.15.37:3300/0 conn(0x7f2f0815ca40 0x7f2f080c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.221+0000 7f2f06ffd700 1 -- 172.21.15.37:0/1340990405 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f080c9350 con 0x7f2f081583d0 2023-07-12T02:04:32.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.222+0000 7f2f06ffd700 1 --2- 172.21.15.37:0/1340990405 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f081583d0 0x7f2f080cc390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0098f0 tx=0x7f2efc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e332aa769a2c7a server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.222+0000 7f2f05ffb700 1 -- 172.21.15.37:0/1340990405 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00b860 con 0x7f2f081583d0 2023-07-12T02:04:32.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.222+0000 7f2f05ffb700 1 -- 172.21.15.37:0/1340990405 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc00b9c0 con 0x7f2f081583d0 2023-07-12T02:04:32.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.222+0000 7f2f05ffb700 1 -- 172.21.15.37:0/1340990405 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00bd50 con 0x7f2f081583d0 2023-07-12T02:04:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.223+0000 7f8b585ff700 1 -- 172.21.15.37:0/2805426896 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b380052f0 con 0x7f8b500c9d40 2023-07-12T02:04:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.224+0000 7f2f0d5ff700 1 -- 172.21.15.37:0/1340990405 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f081583d0 msgr2=0x7f2f080cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.224+0000 7f2f0d5ff700 1 --2- 172.21.15.37:0/1340990405 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f081583d0 0x7f2f080cc390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0098f0 tx=0x7f2efc009c00 comp rx=0 tx=0).stop 2023-07-12T02:04:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.224+0000 7f8b46ffd700 1 -- 172.21.15.37:0/2805426896 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b4c003b90 con 0x7f8b500c9d40 2023-07-12T02:04:32.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.225+0000 7f8b46ffd700 1 --2- 172.21.15.37:0/2805426896 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b3406ade0 0x7f8b3406d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.226+0000 7f8b46ffd700 1 -- 172.21.15.37:0/2805426896 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8b4c088ba0 con 0x7f8b500c9d40 2023-07-12T02:04:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.226+0000 7f2f0d5ff700 1 -- 172.21.15.37:0/1340990405 shutdown_connections 2023-07-12T02:04:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.226+0000 7f2f0d5ff700 1 --2- 172.21.15.37:0/1340990405 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080ad710 0x7f2f080adb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.226+0000 7f2f0d5ff700 1 --2- 172.21.15.37:0/1340990405 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f081583d0 0x7f2f080cc390 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.226+0000 7f2f0d5ff700 1 --2- 172.21.15.37:0/1340990405 >> v2:172.21.15.37:3300/0 conn(0x7f2f0815ca40 0x7f2f080c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.226+0000 7f2f0d5ff700 1 -- 172.21.15.37:0/1340990405 >> 172.21.15.37:0/1340990405 conn(0x7f2f080b0390 msgr2=0x7f2f080b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:32.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.226+0000 7f8b5639b700 1 --2- 172.21.15.37:0/2805426896 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b3406ade0 0x7f8b3406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.227+0000 7f8b5639b700 1 --2- 172.21.15.37:0/2805426896 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b3406ade0 0x7f8b3406d290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8b48000f80 tx=0x7f8b48012000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.228+0000 7f76423ff700 1 Processor -- start 2023-07-12T02:04:32.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.226+0000 7f2f0d5ff700 1 -- 172.21.15.37:0/1340990405 shutdown_connections 2023-07-12T02:04:32.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.226+0000 7f2f0d5ff700 1 -- 172.21.15.37:0/1340990405 wait complete. 2023-07-12T02:04:32.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.229+0000 7f2f0d5ff700 1 Processor -- start 2023-07-12T02:04:32.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.229+0000 7f76423ff700 1 -- start start 2023-07-12T02:04:32.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.230+0000 7f2f0d5ff700 1 -- start start 2023-07-12T02:04:32.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.230+0000 7f8b46ffd700 1 -- 172.21.15.37:0/2805426896 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8b4c0539d0 con 0x7f8b500c9d40 2023-07-12T02:04:32.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.231+0000 7f76423ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f763c0b0aa0 0x7f763c0cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.231+0000 7f76423ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f763c0c9700 0x7f763c0c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.232+0000 7f76423ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f763c0cb1a0 0x7f763c0cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.232+0000 7f76423ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763c0ca0e0 con 0x7f763c0c9700 2023-07-12T02:04:32.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.232+0000 7f76423ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763c0cd100 con 0x7f763c0b0aa0 2023-07-12T02:04:32.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.232+0000 7f76423ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0cd3e0 con 0x7f763c0cb1a0 2023-07-12T02:04:32.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.231+0000 7f2f0d5ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f080ad710 0x7f2f081f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.231+0000 7f2f0d5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f081583d0 0x7f2f081fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.231+0000 7f2f0d5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f0815ca40 0x7f2f0815df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.231+0000 7f2f0d5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f080cba50 con 0x7f2f081583d0 2023-07-12T02:04:32.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.231+0000 7f2f0d5ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f081fab70 con 0x7f2f080ad710 2023-07-12T02:04:32.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.231+0000 7f2f0d5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f080cb0b0 con 0x7f2f0815ca40 2023-07-12T02:04:32.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.232+0000 7f2f06ffd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f080ad710 0x7f2f081f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.232+0000 7f2f06ffd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f080ad710 0x7f2f081f9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:43288/0 (socket says 172.21.15.37:43288) 2023-07-12T02:04:32.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.232+0000 7f2f06ffd700 1 -- 172.21.15.37:0/3166292585 learned_addr learned my addr 172.21.15.37:0/3166292585 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:32.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.232+0000 7f2f077fe700 1 --2- 172.21.15.37:0/3166292585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f0815ca40 0x7f2f0815df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.233+0000 7f2f06ffd700 1 -- 172.21.15.37:0/3166292585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f0815ca40 msgr2=0x7f2f0815df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.233+0000 7f2f06ffd700 1 --2- 172.21.15.37:0/3166292585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f0815ca40 0x7f2f0815df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.233+0000 7f2f06ffd700 1 -- 172.21.15.37:0/3166292585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f081583d0 msgr2=0x7f2f081fa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.233+0000 7f2f06ffd700 1 --2- 172.21.15.37:0/3166292585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f081583d0 0x7f2f081fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.233+0000 7f2f06ffd700 1 -- 172.21.15.37:0/3166292585 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc009550 con 0x7f2f080ad710 2023-07-12T02:04:32.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.233+0000 7f2f06ffd700 1 --2- 172.21.15.37:0/3166292585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f080ad710 0x7f2f081f9c60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2f080ae210 tx=0x7f2efc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.224+0000 7f9ac67ff700 1 Processor -- start 2023-07-12T02:04:32.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.225+0000 7f9ac67ff700 1 -- start start 2023-07-12T02:04:32.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.227+0000 7f9ac67ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9ac01606e0 0x7f9ac00ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.227+0000 7f9ac67ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ac00ad710 0x7f9ac00cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.227+0000 7f9ac67ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac00c1d30 con 0x7f9ac0160ab0 2023-07-12T02:04:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.227+0000 7f9ac67ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac00ce670 con 0x7f9ac00ad710 2023-07-12T02:04:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.227+0000 7f9ac67ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac00cc840 con 0x7f9ac01606e0 2023-07-12T02:04:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.228+0000 7f9abffff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9ac01606e0 0x7f9ac00ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.228+0000 7f9abffff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9ac01606e0 0x7f9ac00ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:43272/0 (socket says 172.21.15.37:43272) 2023-07-12T02:04:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.228+0000 7f9abffff700 1 -- 172.21.15.37:0/2635950507 learned_addr learned my addr 172.21.15.37:0/2635950507 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.228+0000 7f9ac4d9c700 1 --2- 172.21.15.37:0/2635950507 >> v2:172.21.15.37:3300/0 conn(0x7f9ac00ad710 0x7f9ac00cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.229+0000 7f9ac4d9c700 1 -- 172.21.15.37:0/2635950507 >> v2:172.21.15.196:3300/0 conn(0x7f9ac01606e0 msgr2=0x7f9ac00ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.229+0000 7f9ac4d9c700 1 --2- 172.21.15.37:0/2635950507 >> v2:172.21.15.196:3300/0 conn(0x7f9ac01606e0 0x7f9ac00ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.229+0000 7f9ac4d9c700 1 -- 172.21.15.37:0/2635950507 >> v1:172.21.15.37:6789/0 conn(0x7f9ac0160ab0 legacy=0x7f9ac006c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.229+0000 7f9ac4d9c700 1 -- 172.21.15.37:0/2635950507 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac00adc60 con 0x7f9ac00ad710 2023-07-12T02:04:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.229+0000 7f9ac4d9c700 1 --2- 172.21.15.37:0/2635950507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac00ad710 0x7f9ac00cb1b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009840 tx=0x7f9ab4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daef38b4b32e7462 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.230+0000 7f9abeffd700 1 -- 172.21.15.37:0/2635950507 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4011830 con 0x7f9ac00ad710 2023-07-12T02:04:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.230+0000 7f9abeffd700 1 -- 172.21.15.37:0/2635950507 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab4011990 con 0x7f9ac00ad710 2023-07-12T02:04:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.230+0000 7f9abeffd700 1 -- 172.21.15.37:0/2635950507 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4011d00 con 0x7f9ac00ad710 2023-07-12T02:04:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.231+0000 7f9ac67ff700 1 -- 172.21.15.37:0/2635950507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac00ad710 msgr2=0x7f9ac00cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.231+0000 7f9ac67ff700 1 --2- 172.21.15.37:0/2635950507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac00ad710 0x7f9ac00cb1b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009840 tx=0x7f9ab4009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.231+0000 7f9ac67ff700 1 -- 172.21.15.37:0/2635950507 shutdown_connections 2023-07-12T02:04:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.231+0000 7f9ac67ff700 1 --2- 172.21.15.37:0/2635950507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac00ad710 0x7f9ac00cb1b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.231+0000 7f9ac67ff700 1 --2- 172.21.15.37:0/2635950507 >> v2:172.21.15.196:3300/0 conn(0x7f9ac01606e0 0x7f9ac00ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.231+0000 7f9ac67ff700 1 -- 172.21.15.37:0/2635950507 >> 172.21.15.37:0/2635950507 conn(0x7f9ac006abc0 msgr2=0x7f9ac00b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.233+0000 7f9ac67ff700 1 -- 172.21.15.37:0/2635950507 shutdown_connections 2023-07-12T02:04:32.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.234+0000 7f9ac67ff700 1 -- 172.21.15.37:0/2635950507 wait complete. 2023-07-12T02:04:32.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.234+0000 7f764099c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f763c0cb1a0 0x7f763c0cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.234+0000 7f764099c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f763c0cb1a0 0x7f763c0cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:59476/0 (socket says 172.21.15.37:59476) 2023-07-12T02:04:32.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.234+0000 7f764099c700 1 -- 172.21.15.37:0/2175393132 learned_addr learned my addr 172.21.15.37:0/2175393132 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:32.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.234+0000 7f2ef77fe700 1 -- 172.21.15.37:0/3166292585 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0038a0 con 0x7f2f080ad710 2023-07-12T02:04:32.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.234+0000 7f2ef77fe700 1 -- 172.21.15.37:0/3166292585 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc01d040 con 0x7f2f080ad710 2023-07-12T02:04:32.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.234+0000 7f2ef77fe700 1 -- 172.21.15.37:0/3166292585 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc003c60 con 0x7f2f080ad710 2023-07-12T02:04:32.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.234+0000 7f2f0d5ff700 1 -- 172.21.15.37:0/3166292585 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f080cb390 con 0x7f2f080ad710 2023-07-12T02:04:32.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.234+0000 7f2f0d5ff700 1 -- 172.21.15.37:0/3166292585 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f080cbe70 con 0x7f2f080ad710 2023-07-12T02:04:32.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.236+0000 7f2f0d5ff700 1 -- 172.21.15.37:0/3166292585 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0815f3a0 con 0x7f2f080ad710 2023-07-12T02:04:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.236+0000 7f9ac67ff700 1 Processor -- start 2023-07-12T02:04:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.237+0000 7fbd141ff700 1 Processor -- start 2023-07-12T02:04:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.238+0000 7f909ebff700 1 Processor -- start 2023-07-12T02:04:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.238+0000 7fbd141ff700 1 -- start start 2023-07-12T02:04:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.237+0000 7f9ac67ff700 1 -- start start 2023-07-12T02:04:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.238+0000 7f9ac67ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac00ad710 0x7f9ac00b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.238+0000 7f9ac67ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ac01606e0 0x7f9ac0152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.238+0000 7f9ac67ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ac0160ab0 0x7f9ac015d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.238+0000 7f9ac67ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac00af150 con 0x7f9ac00ad710 2023-07-12T02:04:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.238+0000 7f9ac67ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac0156620 con 0x7f9ac01606e0 2023-07-12T02:04:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.238+0000 7f9ac67ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac0156190 con 0x7f9ac0160ab0 2023-07-12T02:04:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.239+0000 7f9ac4d9c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ac0160ab0 0x7f9ac015d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.239+0000 7f9abffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac00ad710 0x7f9ac00b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.239+0000 7f9abffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac00ad710 0x7f9ac00b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35362/0 (socket says 172.21.15.37:35362) 2023-07-12T02:04:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.239+0000 7f9abffff700 1 -- 172.21.15.37:0/4233324029 learned_addr learned my addr 172.21.15.37:0/4233324029 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.239+0000 7f9abf7fe700 1 --2- 172.21.15.37:0/4233324029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ac01606e0 0x7f9ac0152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.238+0000 7f909ebff700 1 -- start start 2023-07-12T02:04:32.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.236+0000 7f764099c700 1 -- 172.21.15.37:0/2175393132 >> v2:172.21.15.196:3300/0 conn(0x7f763c0b0aa0 msgr2=0x7f763c0cdec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-12T02:04:32.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.236+0000 7f764099c700 1 --2- 172.21.15.37:0/2175393132 >> v2:172.21.15.196:3300/0 conn(0x7f763c0b0aa0 0x7f763c0cdec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.236+0000 7f764099c700 1 -- 172.21.15.37:0/2175393132 >> v2:172.21.15.37:3300/0 conn(0x7f763c0c9700 msgr2=0x7f763c0c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:32.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.236+0000 7f764099c700 1 --2- 172.21.15.37:0/2175393132 >> v2:172.21.15.37:3300/0 conn(0x7f763c0c9700 0x7f763c0c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.236+0000 7f764099c700 1 -- 172.21.15.37:0/2175393132 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c0cd6c0 con 0x7f763c0cb1a0 2023-07-12T02:04:32.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.237+0000 7f764099c700 1 --2- 172.21.15.37:0/2175393132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f763c0cb1a0 0x7f763c0cb620 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f763c0cc560 tx=0x7f762c009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f677a8b67a026df server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.239+0000 7f763affd700 1 -- 172.21.15.37:0/2175393132 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c00b870 con 0x7f763c0cb1a0 2023-07-12T02:04:32.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.239+0000 7f763affd700 1 -- 172.21.15.37:0/2175393132 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c00b9d0 con 0x7f763c0cb1a0 2023-07-12T02:04:32.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.239+0000 7f763affd700 1 -- 172.21.15.37:0/2175393132 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c00bd60 con 0x7f763c0cb1a0 2023-07-12T02:04:32.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.240+0000 7f9abf7fe700 1 -- 172.21.15.37:0/4233324029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ac0160ab0 msgr2=0x7f9ac015d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.240+0000 7f9abf7fe700 1 --2- 172.21.15.37:0/4233324029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ac0160ab0 0x7f9ac015d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.240+0000 7f9abf7fe700 1 -- 172.21.15.37:0/4233324029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac00ad710 msgr2=0x7f9ac00b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.240+0000 7f9abf7fe700 1 --2- 172.21.15.37:0/4233324029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac00ad710 0x7f9ac00b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.240+0000 7f9abf7fe700 1 -- 172.21.15.37:0/4233324029 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab40094a0 con 0x7f9ac01606e0 2023-07-12T02:04:32.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.240+0000 7f9ac4d9c700 1 --2- 172.21.15.37:0/4233324029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ac0160ab0 0x7f9ac015d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:04:32.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.241+0000 7f9abf7fe700 1 --2- 172.21.15.37:0/4233324029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ac01606e0 0x7f9ac0152d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0000f60 tx=0x7f9ab000c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.240+0000 7f2ef77fe700 1 -- 172.21.15.37:0/3166292585 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2efc018400 con 0x7f2f080ad710 2023-07-12T02:04:32.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.241+0000 7f2ef77fe700 1 --2- 172.21.15.37:0/3166292585 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2eec06ad80 0x7f2eec06d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.241+0000 7f2ef77fe700 1 -- 172.21.15.37:0/3166292585 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2efc08abf0 con 0x7f2f080ad710 2023-07-12T02:04:32.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.243+0000 7f2f067fc700 1 --2- 172.21.15.37:0/3166292585 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2eec06ad80 0x7f2eec06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.243+0000 7f2ef77fe700 1 -- 172.21.15.37:0/3166292585 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2efc055a20 con 0x7f2f080ad710 2023-07-12T02:04:32.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.241+0000 7f76423ff700 1 -- 172.21.15.37:0/2175393132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f763c0cb1a0 msgr2=0x7f763c0cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.241+0000 7f76423ff700 1 --2- 172.21.15.37:0/2175393132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f763c0cb1a0 0x7f763c0cb620 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f763c0cc560 tx=0x7f762c009bd0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.241+0000 7fbd141ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbd0c0adeb0 0x7fbd0c16b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.241+0000 7fbd141ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0c0ccb70 con 0x7fbd0c070a80 2023-07-12T02:04:32.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.241+0000 7fbd141ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0c165400 con 0x7fbd0c160930 2023-07-12T02:04:32.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.241+0000 7fbd141ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c164640 con 0x7fbd0c0adeb0 2023-07-12T02:04:32.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.242+0000 7fbd11f9b700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fbd0c160930 0x7fbd0c0cc390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:54624/0 (socket says 172.21.15.37:54624) 2023-07-12T02:04:32.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.242+0000 7fbd11f9b700 1 -- 172.21.15.37:0/3370066642 learned_addr learned my addr 172.21.15.37:0/3370066642 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:32.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.242+0000 7f9abcff9700 1 -- 172.21.15.37:0/4233324029 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00052d0 con 0x7f9ac01606e0 2023-07-12T02:04:32.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.242+0000 7f9abcff9700 1 -- 172.21.15.37:0/4233324029 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab0005430 con 0x7f9ac01606e0 2023-07-12T02:04:32.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.242+0000 7f9abcff9700 1 -- 172.21.15.37:0/4233324029 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00038c0 con 0x7f9ac01606e0 2023-07-12T02:04:32.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.242+0000 7f9ac67ff700 1 -- 172.21.15.37:0/4233324029 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac0155860 con 0x7f9ac01606e0 2023-07-12T02:04:32.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.241+0000 7f909ebff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9098160930 0x7f9098070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.241+0000 7f909ebff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90980cc390 0x7f90980ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.241+0000 7f909ebff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90980ccb70 con 0x7f90980adce0 2023-07-12T02:04:32.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.241+0000 7f909ebff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90980ae160 con 0x7f90980cc390 2023-07-12T02:04:32.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.241+0000 7f909ebff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9098165400 con 0x7f9098160930 2023-07-12T02:04:32.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.243+0000 7fbd1279c700 1 --2- 172.21.15.37:0/3370066642 >> v2:172.21.15.37:3300/0 conn(0x7fbd0c0adeb0 0x7fbd0c16b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.242+0000 7f9ac67ff700 1 -- 172.21.15.37:0/4233324029 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac0155e20 con 0x7f9ac01606e0 2023-07-12T02:04:32.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.244+0000 7fbd10f99700 1 -- 172.21.15.37:0/3370066642 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391854568 0 0) 0x7fbd0c165400 con 0x7fbd0c160930 2023-07-12T02:04:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.244+0000 7fbd10f99700 1 -- 172.21.15.37:0/3370066642 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcf40035b0 con 0x7fbd0c160930 2023-07-12T02:04:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.244+0000 7f909c99b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9098160930 0x7f9098070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.244+0000 7f909c99b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9098160930 0x7f9098070a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:59492/0 (socket says 172.21.15.37:59492) 2023-07-12T02:04:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.244+0000 7f909c99b700 1 -- 172.21.15.37:0/1184256476 learned_addr learned my addr 172.21.15.37:0/1184256476 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:32.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.244+0000 7f76423ff700 1 -- 172.21.15.37:0/2175393132 shutdown_connections 2023-07-12T02:04:32.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.244+0000 7f76423ff700 1 --2- 172.21.15.37:0/2175393132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f763c0cb1a0 0x7f763c0cb620 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.244+0000 7f76423ff700 1 --2- 172.21.15.37:0/2175393132 >> v2:172.21.15.196:3300/0 conn(0x7f763c0b0aa0 0x7f763c0cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.244+0000 7f76423ff700 1 --2- 172.21.15.37:0/2175393132 >> v2:172.21.15.37:3300/0 conn(0x7f763c0c9700 0x7f763c0c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.244+0000 7f76423ff700 1 -- 172.21.15.37:0/2175393132 >> 172.21.15.37:0/2175393132 conn(0x7f763c06abc0 msgr2=0x7f763c0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:32.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.245+0000 7fbd1279c700 1 -- 172.21.15.37:0/3370066642 >> v1:172.21.15.196:6789/0 conn(0x7fbd0c160930 legacy=0x7fbd0c0cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.245+0000 7fbd1279c700 1 -- 172.21.15.37:0/3370066642 >> v1:172.21.15.37:6789/0 conn(0x7fbd0c070a80 legacy=0x7fbd0c0ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.245+0000 7fbd1279c700 1 -- 172.21.15.37:0/3370066642 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c164920 con 0x7fbd0c0adeb0 2023-07-12T02:04:32.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.244+0000 7f9ac67ff700 1 -- 172.21.15.37:0/4233324029 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac004ea60 con 0x7f9ac01606e0 2023-07-12T02:04:32.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.245+0000 7f909c99b700 1 -- 172.21.15.37:0/1184256476 >> v2:172.21.15.37:3300/0 conn(0x7f90980cc390 msgr2=0x7f90980ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.245+0000 7f909c99b700 1 --2- 172.21.15.37:0/1184256476 >> v2:172.21.15.37:3300/0 conn(0x7f90980cc390 0x7f90980ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.245+0000 7f909c99b700 1 -- 172.21.15.37:0/1184256476 >> v1:172.21.15.37:6789/0 conn(0x7f90980adce0 legacy=0x7f9098069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.245+0000 7f909c99b700 1 -- 172.21.15.37:0/1184256476 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9098164640 con 0x7f9098160930 2023-07-12T02:04:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.245+0000 7f76423ff700 1 -- 172.21.15.37:0/2175393132 shutdown_connections 2023-07-12T02:04:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.245+0000 7f909c99b700 1 --2- 172.21.15.37:0/1184256476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9098160930 0x7f9098070a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f908c0098f0 tx=0x7f908c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e347191f146bdb3a server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.246+0000 7fbd1279c700 1 --2- 172.21.15.37:0/3370066642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c0adeb0 0x7fbd0c16b840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc009d90 tx=0x7fbcfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87510180913186fd server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.246+0000 7f90977fe700 1 -- 172.21.15.37:0/1184256476 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c004230 con 0x7f9098160930 2023-07-12T02:04:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.246+0000 7f90977fe700 1 -- 172.21.15.37:0/1184256476 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c004390 con 0x7f9098160930 2023-07-12T02:04:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.246+0000 7f90977fe700 1 -- 172.21.15.37:0/1184256476 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c0036a0 con 0x7f9098160930 2023-07-12T02:04:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.246+0000 7f76423ff700 1 -- 172.21.15.37:0/2175393132 wait complete. 2023-07-12T02:04:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.246+0000 7fbd10f99700 1 -- 172.21.15.37:0/3370066642 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc00e070 con 0x7fbd0c0adeb0 2023-07-12T02:04:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.246+0000 7fbd10f99700 1 -- 172.21.15.37:0/3370066642 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcfc00bb20 con 0x7fbd0c0adeb0 2023-07-12T02:04:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.246+0000 7fbd10f99700 1 -- 172.21.15.37:0/3370066642 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc012430 con 0x7fbd0c0adeb0 2023-07-12T02:04:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.247+0000 7fbd141ff700 1 -- 172.21.15.37:0/3370066642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c0adeb0 msgr2=0x7fbd0c16b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.247+0000 7fbd141ff700 1 --2- 172.21.15.37:0/3370066642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c0adeb0 0x7fbd0c16b840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc009d90 tx=0x7fbcfc00b330 comp rx=0 tx=0).stop 2023-07-12T02:04:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.248+0000 7fbd141ff700 1 -- 172.21.15.37:0/3370066642 shutdown_connections 2023-07-12T02:04:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.248+0000 7fbd141ff700 1 --2- 172.21.15.37:0/3370066642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c0adeb0 0x7fbd0c16b840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.248+0000 7fbd141ff700 1 -- 172.21.15.37:0/3370066642 >> 172.21.15.37:0/3370066642 conn(0x7fbd0c0b0390 msgr2=0x7fbd0c0b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.246+0000 7f9abcff9700 1 -- 172.21.15.37:0/4233324029 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9ab0003a20 con 0x7f9ac01606e0 2023-07-12T02:04:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.247+0000 7f909ebff700 1 -- 172.21.15.37:0/1184256476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9098160930 msgr2=0x7f9098070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.247+0000 7f909ebff700 1 --2- 172.21.15.37:0/1184256476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9098160930 0x7f9098070a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f908c0098f0 tx=0x7f908c009c00 comp rx=0 tx=0).stop 2023-07-12T02:04:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.248+0000 7f909ebff700 1 -- 172.21.15.37:0/1184256476 shutdown_connections 2023-07-12T02:04:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.248+0000 7f909ebff700 1 --2- 172.21.15.37:0/1184256476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9098160930 0x7f9098070a80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.248+0000 7f909ebff700 1 --2- 172.21.15.37:0/1184256476 >> v2:172.21.15.37:3300/0 conn(0x7f90980cc390 0x7f90980ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.248+0000 7f909ebff700 1 -- 172.21.15.37:0/1184256476 >> 172.21.15.37:0/1184256476 conn(0x7f90980b0390 msgr2=0x7f90980b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.244+0000 7f2f067fc700 1 --2- 172.21.15.37:0/3166292585 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2eec06ad80 0x7f2eec06d230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80097b0 tx=0x7f2ef8006d20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.248+0000 7f76423ff700 1 Processor -- start 2023-07-12T02:04:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.248+0000 7f9abcff9700 1 --2- 172.21.15.37:0/4233324029 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9aac06adb0 0x7f9aac06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.248+0000 7f9abcff9700 1 -- 172.21.15.37:0/4233324029 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9ab0088660 con 0x7f9ac01606e0 2023-07-12T02:04:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.249+0000 7f909ebff700 1 -- 172.21.15.37:0/1184256476 shutdown_connections 2023-07-12T02:04:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.249+0000 7f76423ff700 1 -- start start 2023-07-12T02:04:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.249+0000 7f9abffff700 1 --2- 172.21.15.37:0/4233324029 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9aac06adb0 0x7f9aac06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.250+0000 7f76423ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f763c0b0aa0 0x7f763c159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.250+0000 7f76423ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f763c0c9700 0x7f763c14a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.250+0000 7f76423ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f763c0cb1a0 0x7f763c0c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.250+0000 7f76423ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c1498a0 con 0x7f763c0cb1a0 2023-07-12T02:04:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.250+0000 7f76423ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c149b80 con 0x7f763c0c9700 2023-07-12T02:04:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.250+0000 7f76423ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c149e60 con 0x7f763c0b0aa0 2023-07-12T02:04:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.251+0000 7f763bfff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f763c0b0aa0 0x7f763c159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.251+0000 7f763bfff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f763c0b0aa0 0x7f763c159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:59498/0 (socket says 172.21.15.37:59498) 2023-07-12T02:04:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.251+0000 7f763bfff700 1 -- 172.21.15.37:0/2301334991 learned_addr learned my addr 172.21.15.37:0/2301334991 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.251+0000 7f763b7fe700 1 --2- 172.21.15.37:0/2301334991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f763c0c9700 0x7f763c14a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.251+0000 7f764099c700 1 --2- 172.21.15.37:0/2301334991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f763c0cb1a0 0x7f763c0c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.252+0000 7f763bfff700 1 -- 172.21.15.37:0/2301334991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f763c0c9700 msgr2=0x7f763c14a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.252+0000 7f763bfff700 1 --2- 172.21.15.37:0/2301334991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f763c0c9700 0x7f763c14a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.252+0000 7f763bfff700 1 -- 172.21.15.37:0/2301334991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f763c0cb1a0 msgr2=0x7f763c0c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.252+0000 7f763bfff700 1 --2- 172.21.15.37:0/2301334991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f763c0cb1a0 0x7f763c0c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.252+0000 7f763bfff700 1 -- 172.21.15.37:0/2301334991 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c009550 con 0x7f763c0b0aa0 2023-07-12T02:04:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.252+0000 7fbd141ff700 1 -- 172.21.15.37:0/3370066642 shutdown_connections 2023-07-12T02:04:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.252+0000 7f9abcff9700 1 -- 172.21.15.37:0/4233324029 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9ab00534b0 con 0x7f9ac01606e0 2023-07-12T02:04:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.252+0000 7f9abffff700 1 --2- 172.21.15.37:0/4233324029 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9aac06adb0 0x7f9aac06d260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80093e0 tx=0x7f9ab8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.252+0000 7f763bfff700 1 --2- 172.21.15.37:0/2301334991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f763c0b0aa0 0x7f763c159440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f763000b550 tx=0x7f763000b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.249+0000 7f909ebff700 1 -- 172.21.15.37:0/1184256476 wait complete. 2023-07-12T02:04:32.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.253+0000 7f7638ff9700 1 -- 172.21.15.37:0/2301334991 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630011830 con 0x7f763c0b0aa0 2023-07-12T02:04:32.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.253+0000 7f7638ff9700 1 -- 172.21.15.37:0/2301334991 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76300119b0 con 0x7f763c0b0aa0 2023-07-12T02:04:32.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.253+0000 7f7638ff9700 1 -- 172.21.15.37:0/2301334991 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630011d60 con 0x7f763c0b0aa0 2023-07-12T02:04:32.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.253+0000 7f76423ff700 1 -- 172.21.15.37:0/2301334991 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763c14a140 con 0x7f763c0b0aa0 2023-07-12T02:04:32.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.253+0000 7f909ebff700 1 Processor -- start 2023-07-12T02:04:32.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.253+0000 7f76423ff700 1 -- 172.21.15.37:0/2301334991 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763c159a20 con 0x7f763c0b0aa0 2023-07-12T02:04:32.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.253+0000 7f909ebff700 1 -- start start 2023-07-12T02:04:32.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.252+0000 7fbd141ff700 1 -- 172.21.15.37:0/3370066642 wait complete. 2023-07-12T02:04:32.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.255+0000 7fbd141ff700 1 Processor -- start 2023-07-12T02:04:32.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.255+0000 7fbd141ff700 1 -- start start 2023-07-12T02:04:32.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.256+0000 7f909ebff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90980adce0 0x7f90980c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.256+0000 7f909ebff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9098160930 0x7f9098163cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.256+0000 7f909ebff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909815d370 0x7f909815f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.256+0000 7f909ebff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90980c56a0 con 0x7f90980adce0 2023-07-12T02:04:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.256+0000 7f909ebff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9098164230 con 0x7f909815d370 2023-07-12T02:04:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.256+0000 7f909ebff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9098160d00 con 0x7f9098160930 2023-07-12T02:04:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.257+0000 7f7638ff9700 1 -- 172.21.15.37:0/2301334991 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f763001a400 con 0x7f763c0b0aa0 2023-07-12T02:04:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.257+0000 7f909d19c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909815d370 0x7f909815f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.258+0000 7f909c99b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90980adce0 0x7f90980c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.258+0000 7f909d19c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909815d370 0x7f909815f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:43318/0 (socket says 172.21.15.37:43318) 2023-07-12T02:04:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.258+0000 7f909c99b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90980adce0 0x7f90980c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35404/0 (socket says 172.21.15.37:35404) 2023-07-12T02:04:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.258+0000 7f909d19c700 1 -- 172.21.15.37:0/3287926594 learned_addr learned my addr 172.21.15.37:0/3287926594 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:32.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.258+0000 7f7638ff9700 1 --2- 172.21.15.37:0/2301334991 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f762806adb0 0x7f762806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.259+0000 7f7638ff9700 1 -- 172.21.15.37:0/2301334991 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7630089700 con 0x7f763c0b0aa0 2023-07-12T02:04:32.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.257+0000 7fbd141ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd0c070a80 0x7fbd0c1576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.257+0000 7fbd141ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c0adeb0 0x7fbd0c1fe640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.257+0000 7fbd141ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd0c160930 0x7fbd0c202240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.257+0000 7fbd141ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c1feb80 con 0x7fbd0c0adeb0 2023-07-12T02:04:32.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.257+0000 7fbd141ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c202cc0 con 0x7fbd0c070a80 2023-07-12T02:04:32.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.257+0000 7fbd141ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c202fa0 con 0x7fbd0c160930 2023-07-12T02:04:32.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.258+0000 7f9097fff700 1 --2- 172.21.15.37:0/3287926594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9098160930 0x7f9098163cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.258+0000 7f909d19c700 1 -- 172.21.15.37:0/3287926594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9098160930 msgr2=0x7f9098163cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.258+0000 7f909d19c700 1 --2- 172.21.15.37:0/3287926594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9098160930 0x7f9098163cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.258+0000 7f909d19c700 1 -- 172.21.15.37:0/3287926594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90980adce0 msgr2=0x7f90980c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.258+0000 7f909d19c700 1 --2- 172.21.15.37:0/3287926594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90980adce0 0x7f90980c50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.258+0000 7f909d19c700 1 -- 172.21.15.37:0/3287926594 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c009550 con 0x7f909815d370 2023-07-12T02:04:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.260+0000 7f763b7fe700 1 --2- 172.21.15.37:0/2301334991 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f762806adb0 0x7f762806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.259+0000 7f76423ff700 1 -- 172.21.15.37:0/2301334991 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761c0052f0 con 0x7f763c0b0aa0 2023-07-12T02:04:32.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.260+0000 7fbd11f9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd0c070a80 0x7fbd0c1576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.260+0000 7fbd11f9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd0c070a80 0x7fbd0c1576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:43332/0 (socket says 172.21.15.37:43332) 2023-07-12T02:04:32.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.260+0000 7fbd11f9b700 1 -- 172.21.15.37:0/3783302118 learned_addr learned my addr 172.21.15.37:0/3783302118 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:32.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.259+0000 7f909d19c700 1 --2- 172.21.15.37:0/3287926594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909815d370 0x7f909815f220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f909000b990 tx=0x7f909000bca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.260+0000 7f90957fa700 1 -- 172.21.15.37:0/3287926594 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909000c930 con 0x7f909815d370 2023-07-12T02:04:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.260+0000 7f90957fa700 1 -- 172.21.15.37:0/3287926594 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909000ca90 con 0x7f909815d370 2023-07-12T02:04:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.260+0000 7f90957fa700 1 -- 172.21.15.37:0/3287926594 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909000ce40 con 0x7f909815d370 2023-07-12T02:04:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.260+0000 7f909ebff700 1 -- 172.21.15.37:0/3287926594 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90981618b0 con 0x7f909815d370 2023-07-12T02:04:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.260+0000 7f909ebff700 1 -- 172.21.15.37:0/3287926594 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9098160f50 con 0x7f909815d370 2023-07-12T02:04:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.261+0000 7fbd1279c700 1 --2- 172.21.15.37:0/3783302118 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd0c160930 0x7fbd0c202240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.261+0000 7fbd1179a700 1 --2- 172.21.15.37:0/3783302118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c0adeb0 0x7fbd0c1fe640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.261+0000 7fbd11f9b700 1 -- 172.21.15.37:0/3783302118 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd0c160930 msgr2=0x7fbd0c202240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.261+0000 7fbd11f9b700 1 --2- 172.21.15.37:0/3783302118 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd0c160930 0x7fbd0c202240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.261+0000 7fbd11f9b700 1 -- 172.21.15.37:0/3783302118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c0adeb0 msgr2=0x7fbd0c1fe640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.261+0000 7fbd11f9b700 1 --2- 172.21.15.37:0/3783302118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c0adeb0 0x7fbd0c1fe640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.261+0000 7fbd11f9b700 1 -- 172.21.15.37:0/3783302118 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcfc009a70 con 0x7fbd0c070a80 2023-07-12T02:04:32.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.264+0000 7f763b7fe700 1 --2- 172.21.15.37:0/2301334991 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f762806adb0 0x7f762806d260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f763c157640 tx=0x7f763400d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.265+0000 7f7638ff9700 1 -- 172.21.15.37:0/2301334991 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7630054530 con 0x7f763c0b0aa0 2023-07-12T02:04:32.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.264+0000 7f909ebff700 1 -- 172.21.15.37:0/3287926594 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90780052f0 con 0x7f909815d370 2023-07-12T02:04:32.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.264+0000 7f90957fa700 1 -- 172.21.15.37:0/3287926594 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9090006d50 con 0x7f909815d370 2023-07-12T02:04:32.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.261+0000 7fbd11f9b700 1 --2- 172.21.15.37:0/3783302118 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd0c070a80 0x7fbd0c1576c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000c700 tx=0x7fbd0000cac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.262+0000 7fbd0a7fc700 1 -- 172.21.15.37:0/3783302118 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00005d70 con 0x7fbd0c070a80 2023-07-12T02:04:32.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.262+0000 7fbd0a7fc700 1 -- 172.21.15.37:0/3783302118 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd000070d0 con 0x7fbd0c070a80 2023-07-12T02:04:32.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.262+0000 7fbd0a7fc700 1 -- 172.21.15.37:0/3783302118 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00007460 con 0x7fbd0c070a80 2023-07-12T02:04:32.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.262+0000 7fbd141ff700 1 -- 172.21.15.37:0/3783302118 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0c15ab20 con 0x7fbd0c070a80 2023-07-12T02:04:32.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.262+0000 7fbd141ff700 1 -- 172.21.15.37:0/3783302118 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0c15b0e0 con 0x7fbd0c070a80 2023-07-12T02:04:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.266+0000 7fbd0a7fc700 1 -- 172.21.15.37:0/3783302118 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd000075c0 con 0x7fbd0c070a80 2023-07-12T02:04:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.267+0000 7fbd141ff700 1 -- 172.21.15.37:0/3783302118 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcec0052f0 con 0x7fbd0c070a80 2023-07-12T02:04:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.266+0000 7f90957fa700 1 --2- 172.21.15.37:0/3287926594 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f907c06adb0 0x7f907c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.267+0000 7f90957fa700 1 -- 172.21.15.37:0/3287926594 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9090089210 con 0x7f909815d370 2023-07-12T02:04:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.268+0000 7f909c99b700 1 --2- 172.21.15.37:0/3287926594 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f907c06adb0 0x7f907c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.268+0000 7fbd0a7fc700 1 --2- 172.21.15.37:0/3783302118 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbcf806adb0 0x7fbcf806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.268+0000 7fbd0a7fc700 1 -- 172.21.15.37:0/3783302118 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbd00088da0 con 0x7fbd0c070a80 2023-07-12T02:04:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.269+0000 7fbd1179a700 1 --2- 172.21.15.37:0/3783302118 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbcf806adb0 0x7fbcf806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:32.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.269+0000 7f909c99b700 1 --2- 172.21.15.37:0/3287926594 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f907c06adb0 0x7f907c06d260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f908c000c00 tx=0x7f908c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.270+0000 7f90957fa700 1 -- 172.21.15.37:0/3287926594 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9090053fc0 con 0x7f909815d370 2023-07-12T02:04:32.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.270+0000 7fbd1179a700 1 --2- 172.21.15.37:0/3783302118 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbcf806adb0 0x7fbcf806d260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c15c490 tx=0x7fbd04009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:32.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.275+0000 7fbd0a7fc700 1 -- 172.21.15.37:0/3783302118 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbd00053b50 con 0x7fbd0c070a80 2023-07-12T02:04:32.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.619+0000 7f06dc1ff700 1 -- 172.21.15.37:0/610105691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f06bc0055a0 con 0x7f06d40cb8a0 2023-07-12T02:04:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.619+0000 7f5e639ff700 1 -- 172.21.15.37:0/1146244353 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5e5c04ea60 con 0x7f5e5c0b0aa0 2023-07-12T02:04:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.620+0000 7f06ca7fc700 1 -- 172.21.15.37:0/610105691 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f06d0011e60 con 0x7f06d40cb8a0 2023-07-12T02:04:32.624 INFO:teuthology.orchestra.run.smithi037.stdout:55834574860 2023-07-12T02:04:32.627 INFO:teuthology.orchestra.run.smithi037.stdout:55834574859 2023-07-12T02:04:32.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.621+0000 7f5e51ffb700 1 -- 172.21.15.37:0/1146244353 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e58021070 con 0x7f5e5c0b0aa0 2023-07-12T02:04:32.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.624+0000 7f5e639ff700 1 -- 172.21.15.37:0/1146244353 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5e4006adb0 msgr2=0x7f5e4006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.624+0000 7f5e639ff700 1 --2- 172.21.15.37:0/1146244353 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5e4006adb0 0x7f5e4006d260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0b03a0 tx=0x7f5e54009040 comp rx=0 tx=0).stop 2023-07-12T02:04:32.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.624+0000 7f5e639ff700 1 -- 172.21.15.37:0/1146244353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e5c0b0aa0 msgr2=0x7f5e5c1f6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.624+0000 7f5e639ff700 1 --2- 172.21.15.37:0/1146244353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e5c0b0aa0 0x7f5e5c1f6860 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800e910 tx=0x7f5e5800ecd0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.625+0000 7f5e639ff700 1 -- 172.21.15.37:0/1146244353 shutdown_connections 2023-07-12T02:04:32.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.625+0000 7f5e639ff700 1 --2- 172.21.15.37:0/1146244353 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5e4006adb0 0x7f5e4006d260 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.625+0000 7f5e639ff700 1 --2- 172.21.15.37:0/1146244353 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5e5c0c9d80 0x7f5e5c1612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.625+0000 7f5e639ff700 1 --2- 172.21.15.37:0/1146244353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e5c0b0aa0 0x7f5e5c1f6860 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.625+0000 7f5e639ff700 1 --2- 172.21.15.37:0/1146244353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c0c98e0 0x7f5e5c161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.625+0000 7f5e639ff700 1 -- 172.21.15.37:0/1146244353 >> 172.21.15.37:0/1146244353 conn(0x7f5e5c06abc0 msgr2=0x7f5e5c15abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:32.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.625+0000 7f5e639ff700 1 -- 172.21.15.37:0/1146244353 shutdown_connections 2023-07-12T02:04:32.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.625+0000 7f5e639ff700 1 -- 172.21.15.37:0/1146244353 wait complete. 2023-07-12T02:04:32.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.625+0000 7f06dc1ff700 1 -- 172.21.15.37:0/610105691 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f06b806adb0 msgr2=0x7f06b806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.625+0000 7f06dc1ff700 1 --2- 172.21.15.37:0/610105691 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f06b806adb0 0x7f06b806d260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00e250 tx=0x7f06cc00b040 comp rx=0 tx=0).stop 2023-07-12T02:04:32.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.625+0000 7f06dc1ff700 1 -- 172.21.15.37:0/610105691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d40cb8a0 msgr2=0x7f06d4201c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.625+0000 7f06dc1ff700 1 --2- 172.21.15.37:0/610105691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d40cb8a0 0x7f06d4201c10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f06d40cbcd0 tx=0x7f06d000b750 comp rx=0 tx=0).stop 2023-07-12T02:04:32.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.626+0000 7f06dc1ff700 1 -- 172.21.15.37:0/610105691 shutdown_connections 2023-07-12T02:04:32.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.626+0000 7f06dc1ff700 1 --2- 172.21.15.37:0/610105691 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f06b806adb0 0x7f06b806d260 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.626+0000 7f06dc1ff700 1 --2- 172.21.15.37:0/610105691 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f06d416c7e0 0x7f06d4202150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.626+0000 7f06dc1ff700 1 --2- 172.21.15.37:0/610105691 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06d4089570 0x7f06d40b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.626+0000 7f06dc1ff700 1 --2- 172.21.15.37:0/610105691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d40cb8a0 0x7f06d4201c10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.626+0000 7f06dc1ff700 1 -- 172.21.15.37:0/610105691 >> 172.21.15.37:0/610105691 conn(0x7f06d406abc0 msgr2=0x7f06d406c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:32.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.626+0000 7f06dc1ff700 1 -- 172.21.15.37:0/610105691 shutdown_connections 2023-07-12T02:04:32.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.627+0000 7f06dc1ff700 1 -- 172.21.15.37:0/610105691 wait complete. 2023-07-12T02:04:32.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2023-07-12T02:04:32.660 DEBUG:teuthology.parallel:result is None 2023-07-12T02:04:32.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.1 2023-07-12T02:04:32.662 DEBUG:teuthology.parallel:result is None 2023-07-12T02:04:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.675+0000 7f8b585ff700 1 -- 172.21.15.37:0/2805426896 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8b380055a0 con 0x7f8b500c9d40 2023-07-12T02:04:32.680 INFO:teuthology.orchestra.run.smithi037.stdout:55834574859 2023-07-12T02:04:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.676+0000 7f8b46ffd700 1 -- 172.21.15.37:0/2805426896 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b4c056ff0 con 0x7f8b500c9d40 2023-07-12T02:04:32.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.678+0000 7f8b585ff700 1 -- 172.21.15.37:0/2805426896 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b3406ade0 msgr2=0x7f8b3406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.678+0000 7f8b585ff700 1 --2- 172.21.15.37:0/2805426896 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b3406ade0 0x7f8b3406d290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8b48000f80 tx=0x7f8b48012000 comp rx=0 tx=0).stop 2023-07-12T02:04:32.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.678+0000 7f8b585ff700 1 -- 172.21.15.37:0/2805426896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b500c9d40 msgr2=0x7f8b500c35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.678+0000 7f8b585ff700 1 --2- 172.21.15.37:0/2805426896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b500c9d40 0x7f8b500c35e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00c4a0 tx=0x7f8b4c00c7b0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.679+0000 7f8b585ff700 1 -- 172.21.15.37:0/2805426896 shutdown_connections 2023-07-12T02:04:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.679+0000 7f8b585ff700 1 --2- 172.21.15.37:0/2805426896 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b3406ade0 0x7f8b3406d290 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.679+0000 7f8b585ff700 1 --2- 172.21.15.37:0/2805426896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b500cb8b0 0x7f8b500c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.679+0000 7f8b585ff700 1 --2- 172.21.15.37:0/2805426896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b500c9970 0x7f8b5014bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.679+0000 7f8b585ff700 1 --2- 172.21.15.37:0/2805426896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b500c9d40 0x7f8b500c35e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.679+0000 7f8b585ff700 1 -- 172.21.15.37:0/2805426896 >> 172.21.15.37:0/2805426896 conn(0x7f8b5006abc0 msgr2=0x7f8b5015bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.679+0000 7f8b585ff700 1 -- 172.21.15.37:0/2805426896 shutdown_connections 2023-07-12T02:04:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.679+0000 7f8b585ff700 1 -- 172.21.15.37:0/2805426896 wait complete. 2023-07-12T02:04:32.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2023-07-12T02:04:32.701 DEBUG:teuthology.parallel:result is None 2023-07-12T02:04:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.704+0000 7f2f0d5ff700 1 -- 172.21.15.37:0/3166292585 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2f0815f3a0 con 0x7f2f080ad710 2023-07-12T02:04:32.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.704+0000 7f2ef77fe700 1 -- 172.21.15.37:0/3166292585 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2f0815f3a0 con 0x7f2f080ad710 2023-07-12T02:04:32.708 INFO:teuthology.orchestra.run.smithi037.stdout:55834574860 2023-07-12T02:04:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.708+0000 7f2f0d5ff700 1 -- 172.21.15.37:0/3166292585 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2eec06ad80 msgr2=0x7f2eec06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.708+0000 7f2f0d5ff700 1 --2- 172.21.15.37:0/3166292585 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2eec06ad80 0x7f2eec06d230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80097b0 tx=0x7f2ef8006d20 comp rx=0 tx=0).stop 2023-07-12T02:04:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.708+0000 7f2f0d5ff700 1 -- 172.21.15.37:0/3166292585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f080ad710 msgr2=0x7f2f081f9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.708+0000 7f2f0d5ff700 1 --2- 172.21.15.37:0/3166292585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f080ad710 0x7f2f081f9c60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2f080ae210 tx=0x7f2efc004750 comp rx=0 tx=0).stop 2023-07-12T02:04:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.708+0000 7f2f0d5ff700 1 -- 172.21.15.37:0/3166292585 shutdown_connections 2023-07-12T02:04:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.708+0000 7f2f0d5ff700 1 --2- 172.21.15.37:0/3166292585 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2eec06ad80 0x7f2eec06d230 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.708+0000 7f2f0d5ff700 1 --2- 172.21.15.37:0/3166292585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f0815ca40 0x7f2f0815df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.708+0000 7f2f0d5ff700 1 --2- 172.21.15.37:0/3166292585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f080ad710 0x7f2f081f9c60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.708+0000 7f2f0d5ff700 1 --2- 172.21.15.37:0/3166292585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f081583d0 0x7f2f081fa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.708+0000 7f2f0d5ff700 1 -- 172.21.15.37:0/3166292585 >> 172.21.15.37:0/3166292585 conn(0x7f2f080b0390 msgr2=0x7f2f080afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:32.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.708+0000 7f2f0d5ff700 1 -- 172.21.15.37:0/3166292585 shutdown_connections 2023-07-12T02:04:32.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.708+0000 7f2f0d5ff700 1 -- 172.21.15.37:0/3166292585 wait complete. 2023-07-12T02:04:32.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.708+0000 7fbd141ff700 1 -- 172.21.15.37:0/3783302118 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbcec0055a0 con 0x7fbd0c070a80 2023-07-12T02:04:32.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.709+0000 7fbd0a7fc700 1 -- 172.21.15.37:0/3783302118 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd00057170 con 0x7fbd0c070a80 2023-07-12T02:04:32.715 INFO:teuthology.orchestra.run.smithi037.stdout:55834574859 2023-07-12T02:04:32.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.711+0000 7f76423ff700 1 -- 172.21.15.37:0/2301334991 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f761c0055a0 con 0x7f763c0b0aa0 2023-07-12T02:04:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.711+0000 7fbd141ff700 1 -- 172.21.15.37:0/3783302118 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbcf806adb0 msgr2=0x7fbcf806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.711+0000 7fbd141ff700 1 --2- 172.21.15.37:0/3783302118 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbcf806adb0 0x7fbcf806d260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c15c490 tx=0x7fbd04009040 comp rx=0 tx=0).stop 2023-07-12T02:04:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.711+0000 7fbd141ff700 1 -- 172.21.15.37:0/3783302118 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd0c070a80 msgr2=0x7fbd0c1576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.711+0000 7fbd141ff700 1 --2- 172.21.15.37:0/3783302118 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd0c070a80 0x7fbd0c1576c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000c700 tx=0x7fbd0000cac0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.712+0000 7fbd141ff700 1 -- 172.21.15.37:0/3783302118 shutdown_connections 2023-07-12T02:04:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.712+0000 7fbd141ff700 1 --2- 172.21.15.37:0/3783302118 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbcf806adb0 0x7fbcf806d260 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.712+0000 7fbd141ff700 1 --2- 172.21.15.37:0/3783302118 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd0c160930 0x7fbd0c202240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.712+0000 7fbd141ff700 1 --2- 172.21.15.37:0/3783302118 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd0c070a80 0x7fbd0c1576c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.712+0000 7fbd141ff700 1 --2- 172.21.15.37:0/3783302118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c0adeb0 0x7fbd0c1fe640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.712+0000 7fbd141ff700 1 -- 172.21.15.37:0/3783302118 >> 172.21.15.37:0/3783302118 conn(0x7fbd0c0b0390 msgr2=0x7fbd0c0b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.712+0000 7fbd141ff700 1 -- 172.21.15.37:0/3783302118 shutdown_connections 2023-07-12T02:04:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.712+0000 7fbd141ff700 1 -- 172.21.15.37:0/3783302118 wait complete. 2023-07-12T02:04:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.712+0000 7f7638ff9700 1 -- 172.21.15.37:0/2301334991 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7630015070 con 0x7f763c0b0aa0 2023-07-12T02:04:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:55834574859 2023-07-12T02:04:32.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.715+0000 7f9ac67ff700 1 -- 172.21.15.37:0/4233324029 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9ac00c1d30 con 0x7f9ac01606e0 2023-07-12T02:04:32.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.716+0000 7f76423ff700 1 -- 172.21.15.37:0/2301334991 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f762806adb0 msgr2=0x7f762806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.716+0000 7f76423ff700 1 --2- 172.21.15.37:0/2301334991 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f762806adb0 0x7f762806d260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f763c157640 tx=0x7f763400d040 comp rx=0 tx=0).stop 2023-07-12T02:04:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.716+0000 7f76423ff700 1 -- 172.21.15.37:0/2301334991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f763c0b0aa0 msgr2=0x7f763c159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.716+0000 7f76423ff700 1 --2- 172.21.15.37:0/2301334991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f763c0b0aa0 0x7f763c159440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f763000b550 tx=0x7f763000b860 comp rx=0 tx=0).stop 2023-07-12T02:04:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.716+0000 7f76423ff700 1 -- 172.21.15.37:0/2301334991 shutdown_connections 2023-07-12T02:04:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.716+0000 7f76423ff700 1 --2- 172.21.15.37:0/2301334991 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f762806adb0 0x7f762806d260 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.716+0000 7f76423ff700 1 --2- 172.21.15.37:0/2301334991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f763c0cb1a0 0x7f763c0c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.716+0000 7f76423ff700 1 --2- 172.21.15.37:0/2301334991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f763c0b0aa0 0x7f763c159440 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.716+0000 7f76423ff700 1 --2- 172.21.15.37:0/2301334991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f763c0c9700 0x7f763c14a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.716+0000 7f76423ff700 1 -- 172.21.15.37:0/2301334991 >> 172.21.15.37:0/2301334991 conn(0x7f763c06abc0 msgr2=0x7f763c06e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:32.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.716+0000 7f9abcff9700 1 -- 172.21.15.37:0/4233324029 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ac00c1d30 con 0x7f9ac01606e0 2023-07-12T02:04:32.721 INFO:teuthology.orchestra.run.smithi037.stdout:55834574859 2023-07-12T02:04:32.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.716+0000 7f76423ff700 1 -- 172.21.15.37:0/2301334991 shutdown_connections 2023-07-12T02:04:32.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.717+0000 7f76423ff700 1 -- 172.21.15.37:0/2301334991 wait complete. 2023-07-12T02:04:32.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.719+0000 7f9ac67ff700 1 -- 172.21.15.37:0/4233324029 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9aac06adb0 msgr2=0x7f9aac06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.719+0000 7f9ac67ff700 1 --2- 172.21.15.37:0/4233324029 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9aac06adb0 0x7f9aac06d260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80093e0 tx=0x7f9ab8009040 comp rx=0 tx=0).stop 2023-07-12T02:04:32.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.719+0000 7f9ac67ff700 1 -- 172.21.15.37:0/4233324029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ac01606e0 msgr2=0x7f9ac0152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.719+0000 7f9ac67ff700 1 --2- 172.21.15.37:0/4233324029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ac01606e0 0x7f9ac0152d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0000f60 tx=0x7f9ab000c6e0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.719+0000 7f9ac67ff700 1 -- 172.21.15.37:0/4233324029 shutdown_connections 2023-07-12T02:04:32.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.719+0000 7f9ac67ff700 1 --2- 172.21.15.37:0/4233324029 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9aac06adb0 0x7f9aac06d260 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.719+0000 7f9ac67ff700 1 --2- 172.21.15.37:0/4233324029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac00ad710 0x7f9ac00b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.719+0000 7f9ac67ff700 1 --2- 172.21.15.37:0/4233324029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ac0160ab0 0x7f9ac015d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.719+0000 7f9ac67ff700 1 --2- 172.21.15.37:0/4233324029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ac01606e0 0x7f9ac0152d80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.719+0000 7f9ac67ff700 1 -- 172.21.15.37:0/4233324029 >> 172.21.15.37:0/4233324029 conn(0x7f9ac006abc0 msgr2=0x7f9ac00cd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:32.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.720+0000 7f9ac67ff700 1 -- 172.21.15.37:0/4233324029 shutdown_connections 2023-07-12T02:04:32.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.720+0000 7f9ac67ff700 1 -- 172.21.15.37:0/4233324029 wait complete. 2023-07-12T02:04:32.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.733+0000 7f909ebff700 1 -- 172.21.15.37:0/3287926594 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f90780055a0 con 0x7f909815d370 2023-07-12T02:04:32.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.733+0000 7f90957fa700 1 -- 172.21.15.37:0/3287926594 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90900575e0 con 0x7f909815d370 2023-07-12T02:04:32.737 INFO:teuthology.orchestra.run.smithi037.stdout:55834574860 2023-07-12T02:04:32.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2023-07-12T02:04:32.739 DEBUG:teuthology.parallel:result is None 2023-07-12T02:04:32.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.736+0000 7f909ebff700 1 -- 172.21.15.37:0/3287926594 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f907c06adb0 msgr2=0x7f907c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.736+0000 7f909ebff700 1 --2- 172.21.15.37:0/3287926594 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f907c06adb0 0x7f907c06d260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f908c000c00 tx=0x7f908c008030 comp rx=0 tx=0).stop 2023-07-12T02:04:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.736+0000 7f909ebff700 1 -- 172.21.15.37:0/3287926594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909815d370 msgr2=0x7f909815f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.736+0000 7f909ebff700 1 --2- 172.21.15.37:0/3287926594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909815d370 0x7f909815f220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f909000b990 tx=0x7f909000bca0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.736+0000 7f909ebff700 1 -- 172.21.15.37:0/3287926594 shutdown_connections 2023-07-12T02:04:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.736+0000 7f909ebff700 1 --2- 172.21.15.37:0/3287926594 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f907c06adb0 0x7f907c06d260 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.736+0000 7f909ebff700 1 --2- 172.21.15.37:0/3287926594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90980adce0 0x7f90980c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.736+0000 7f909ebff700 1 --2- 172.21.15.37:0/3287926594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909815d370 0x7f909815f220 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.736+0000 7f909ebff700 1 --2- 172.21.15.37:0/3287926594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9098160930 0x7f9098163cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.736+0000 7f909ebff700 1 -- 172.21.15.37:0/3287926594 >> 172.21.15.37:0/3287926594 conn(0x7f90980b0390 msgr2=0x7f90980af770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:32.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.736+0000 7f909ebff700 1 -- 172.21.15.37:0/3287926594 shutdown_connections 2023-07-12T02:04:32.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.736+0000 7f909ebff700 1 -- 172.21.15.37:0/3287926594 wait complete. 2023-07-12T02:04:32.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2023-07-12T02:04:32.745 DEBUG:teuthology.parallel:result is None 2023-07-12T02:04:32.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2023-07-12T02:04:32.748 DEBUG:teuthology.parallel:result is None 2023-07-12T02:04:32.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.6 2023-07-12T02:04:32.749 DEBUG:teuthology.parallel:result is None 2023-07-12T02:04:32.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.4 2023-07-12T02:04:32.759 DEBUG:teuthology.parallel:result is None 2023-07-12T02:04:32.760 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-12T02:04:32.760 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-12T02:04:32.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.996+0000 7fe1dc1ff700 1 Processor -- start 2023-07-12T02:04:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.996+0000 7fe1dc1ff700 1 -- start start 2023-07-12T02:04:33.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.997+0000 7fe1dc1ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1d415c460 0x7fe1d40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.997+0000 7fe1dc1ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1d40d2640 0x7fe1d40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.997+0000 7fe1dc1ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe1d40cf720 0x7fe1d40cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.997+0000 7fe1dc1ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d40cedd0 con 0x7fe1d415c460 2023-07-12T02:04:33.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.997+0000 7fe1dc1ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d40d1790 con 0x7fe1d40cf720 2023-07-12T02:04:33.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.997+0000 7fe1dc1ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d40cd950 con 0x7fe1d40d2640 2023-07-12T02:04:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.998+0000 7fe1d9f9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1d415c460 0x7fe1d40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.998+0000 7fe1d9f9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1d415c460 0x7fe1d40b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35420/0 (socket says 172.21.15.37:35420) 2023-07-12T02:04:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.998+0000 7fe1d9f9b700 1 -- 172.21.15.37:0/3133078282 learned_addr learned my addr 172.21.15.37:0/3133078282 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.998+0000 7fe1d979a700 1 --2- 172.21.15.37:0/3133078282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1d40d2640 0x7fe1d40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.998+0000 7fe1da79c700 1 --2- 172.21.15.37:0/3133078282 >> v2:172.21.15.196:3300/0 conn(0x7fe1d40cf720 0x7fe1d40cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.998+0000 7fe1d9f9b700 1 -- 172.21.15.37:0/3133078282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1d40d2640 msgr2=0x7fe1d40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:33.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.998+0000 7fe1d9f9b700 1 --2- 172.21.15.37:0/3133078282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1d40d2640 0x7fe1d40cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.998+0000 7fe1d9f9b700 1 -- 172.21.15.37:0/3133078282 >> v2:172.21.15.196:3300/0 conn(0x7fe1d40cf720 msgr2=0x7fe1d40cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:33.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.998+0000 7fe1d9f9b700 1 --2- 172.21.15.37:0/3133078282 >> v2:172.21.15.196:3300/0 conn(0x7fe1d40cf720 0x7fe1d40cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.998+0000 7fe1d9f9b700 1 -- 172.21.15.37:0/3133078282 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d40d14b0 con 0x7fe1d415c460 2023-07-12T02:04:33.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.998+0000 7fe1d9f9b700 1 --2- 172.21.15.37:0/3133078282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1d415c460 0x7fe1d40b59d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe1d408bf90 tx=0x7fe1d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9650d8dfd25bb67b server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:33.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.999+0000 7fe1d8f99700 1 -- 172.21.15.37:0/3133078282 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000b870 con 0x7fe1d415c460 2023-07-12T02:04:33.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.999+0000 7fe1d8f99700 1 -- 172.21.15.37:0/3133078282 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d000b9d0 con 0x7fe1d415c460 2023-07-12T02:04:33.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.999+0000 7fe1d8f99700 1 -- 172.21.15.37:0/3133078282 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000bd60 con 0x7fe1d415c460 2023-07-12T02:04:33.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.999+0000 7fe1dc1ff700 1 -- 172.21.15.37:0/3133078282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1d415c460 msgr2=0x7fe1d40b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:33.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.999+0000 7fe1dc1ff700 1 --2- 172.21.15.37:0/3133078282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1d415c460 0x7fe1d40b59d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe1d408bf90 tx=0x7fe1d0009bd0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.999+0000 7fe1dc1ff700 1 -- 172.21.15.37:0/3133078282 shutdown_connections 2023-07-12T02:04:33.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.999+0000 7fe1dc1ff700 1 --2- 172.21.15.37:0/3133078282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1d415c460 0x7fe1d40b59d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.999+0000 7fe1dc1ff700 1 --2- 172.21.15.37:0/3133078282 >> v2:172.21.15.196:3300/0 conn(0x7fe1d40cf720 0x7fe1d40cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.999+0000 7fe1dc1ff700 1 --2- 172.21.15.37:0/3133078282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1d40d2640 0x7fe1d40cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.999+0000 7fe1dc1ff700 1 -- 172.21.15.37:0/3133078282 >> 172.21.15.37:0/3133078282 conn(0x7fe1d4071660 msgr2=0x7fe1d4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:33.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.999+0000 7fe1dc1ff700 1 -- 172.21.15.37:0/3133078282 shutdown_connections 2023-07-12T02:04:33.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:32.999+0000 7fe1dc1ff700 1 -- 172.21.15.37:0/3133078282 wait complete. 2023-07-12T02:04:33.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.001+0000 7fe1dc1ff700 1 Processor -- start 2023-07-12T02:04:33.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.001+0000 7fe1dc1ff700 1 -- start start 2023-07-12T02:04:33.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.002+0000 7fe1dc1ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1d40cf720 0x7fe1d4153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.002+0000 7fe1dc1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1d40d2640 0x7fe1d40b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.002+0000 7fe1dc1ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1d415c460 0x7fe1d40b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.002+0000 7fe1dc1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d41e6130 con 0x7fe1d40d2640 2023-07-12T02:04:33.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.002+0000 7fe1dc1ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d41e6670 con 0x7fe1d415c460 2023-07-12T02:04:33.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.002+0000 7fe1dc1ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d41e6950 con 0x7fe1d40cf720 2023-07-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.002+0000 7fe1d979a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1d40d2640 0x7fe1d40b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.002+0000 7fe1d979a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1d40d2640 0x7fe1d40b6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35424/0 (socket says 172.21.15.37:35424) 2023-07-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.002+0000 7fe1d979a700 1 -- 172.21.15.37:0/904547242 learned_addr learned my addr 172.21.15.37:0/904547242 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.003+0000 7fe1d9f9b700 1 --2- 172.21.15.37:0/904547242 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1d40cf720 0x7fe1d4153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.003+0000 7fe1da79c700 1 --2- 172.21.15.37:0/904547242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1d415c460 0x7fe1d40b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.003+0000 7fe1d979a700 1 -- 172.21.15.37:0/904547242 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1d40cf720 msgr2=0x7fe1d4153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:33.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.003+0000 7fe1d979a700 1 --2- 172.21.15.37:0/904547242 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1d40cf720 0x7fe1d4153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.003+0000 7fe1d979a700 1 -- 172.21.15.37:0/904547242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1d415c460 msgr2=0x7fe1d40b7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.003+0000 7fe1d979a700 1 --2- 172.21.15.37:0/904547242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1d415c460 0x7fe1d40b7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.003+0000 7fe1d979a700 1 -- 172.21.15.37:0/904547242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d0009550 con 0x7fe1d40d2640 2023-07-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.003+0000 7fe1da79c700 1 --2- 172.21.15.37:0/904547242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1d415c460 0x7fe1d40b7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.003+0000 7fe1d979a700 1 --2- 172.21.15.37:0/904547242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1d40d2640 0x7fe1d40b6c40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400d800 tx=0x7fe1c400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.003+0000 7fe1ca7fc700 1 -- 172.21.15.37:0/904547242 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40125f0 con 0x7fe1d40d2640 2023-07-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.003+0000 7fe1ca7fc700 1 -- 172.21.15.37:0/904547242 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c4012750 con 0x7fe1d40d2640 2023-07-12T02:04:33.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.003+0000 7fe1ca7fc700 1 -- 172.21.15.37:0/904547242 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4012b00 con 0x7fe1d40d2640 2023-07-12T02:04:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.003+0000 7fe1dc1ff700 1 -- 172.21.15.37:0/904547242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d41e5d50 con 0x7fe1d40d2640 2023-07-12T02:04:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.004+0000 7fe1dc1ff700 1 -- 172.21.15.37:0/904547242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d4158340 con 0x7fe1d40d2640 2023-07-12T02:04:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.004+0000 7fe1dc1ff700 1 -- 172.21.15.37:0/904547242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d41e5ee0 con 0x7fe1d40d2640 2023-07-12T02:04:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.006+0000 7fe1ca7fc700 1 -- 172.21.15.37:0/904547242 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe1c4012c60 con 0x7fe1d40d2640 2023-07-12T02:04:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.007+0000 7fe1ca7fc700 1 --2- 172.21.15.37:0/904547242 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe1b806ace0 0x7fe1b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.007+0000 7fe1ca7fc700 1 -- 172.21.15.37:0/904547242 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe1c4089b40 con 0x7fe1d40d2640 2023-07-12T02:04:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.007+0000 7fe1d9f9b700 1 --2- 172.21.15.37:0/904547242 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe1b806ace0 0x7fe1b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.008+0000 7fe1d9f9b700 1 --2- 172.21.15.37:0/904547242 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe1b806ace0 0x7fe1b806d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0014040 tx=0x7fe1d0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:33.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.011+0000 7fe1ca7fc700 1 -- 172.21.15.37:0/904547242 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe1c4054860 con 0x7fe1d40d2640 2023-07-12T02:04:33.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.213+0000 7fe1dc1ff700 1 -- 172.21.15.37:0/904547242 --> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1d40cd5e0 con 0x7fe1b806ace0 2023-07-12T02:04:33.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.224+0000 7fe1ca7fc700 1 -- 172.21.15.37:0/904547242 <== mgr.4099 v2:172.21.15.196:6832/3490435896 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367348 (secure 0 0 0) 0x7fe1d000bb40 con 0x7fe1b806ace0 2023-07-12T02:04:33.231 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:33.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.228+0000 7fe1dc1ff700 1 -- 172.21.15.37:0/904547242 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe1b806ace0 msgr2=0x7fe1b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.228+0000 7fe1dc1ff700 1 --2- 172.21.15.37:0/904547242 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe1b806ace0 0x7fe1b806d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0014040 tx=0x7fe1d0008030 comp rx=0 tx=0).stop 2023-07-12T02:04:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.228+0000 7fe1dc1ff700 1 -- 172.21.15.37:0/904547242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1d40d2640 msgr2=0x7fe1d40b6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.228+0000 7fe1dc1ff700 1 --2- 172.21.15.37:0/904547242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1d40d2640 0x7fe1d40b6c40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400d800 tx=0x7fe1c400db10 comp rx=0 tx=0).stop 2023-07-12T02:04:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.228+0000 7fe1dc1ff700 1 -- 172.21.15.37:0/904547242 shutdown_connections 2023-07-12T02:04:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.228+0000 7fe1dc1ff700 1 --2- 172.21.15.37:0/904547242 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe1b806ace0 0x7fe1b806d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.228+0000 7fe1dc1ff700 1 --2- 172.21.15.37:0/904547242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1d415c460 0x7fe1d40b7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.228+0000 7fe1dc1ff700 1 --2- 172.21.15.37:0/904547242 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1d40cf720 0x7fe1d4153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.228+0000 7fe1dc1ff700 1 --2- 172.21.15.37:0/904547242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1d40d2640 0x7fe1d40b6c40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.228+0000 7fe1dc1ff700 1 -- 172.21.15.37:0/904547242 >> 172.21.15.37:0/904547242 conn(0x7fe1d4071660 msgr2=0x7fe1d415fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.229+0000 7fe1dc1ff700 1 -- 172.21.15.37:0/904547242 shutdown_connections 2023-07-12T02:04:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.229+0000 7fe1dc1ff700 1 -- 172.21.15.37:0/904547242 wait complete. 2023-07-12T02:04:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-12T02:04:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2023-07-12T02:04:31.353559+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219684,"kb_used_data":3492,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755036,"statfs":{"total":773094113280,"available":772869156864,"internally_reserved":0,"allocated":3575808,"data_stored":2148109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003962"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173964+0000","last_change":"2023-07-12T02:03:58.150799+0000","last_active":"2023-07-12T02:04:03.173964+0000","last_peered":"2023-07-12T02:04:03.173964+0000","last_clean":"2023-07-12T02:04:03.173964+0000","last_became_active":"2023-07-12T02:03:58.150302+0000","last_became_peered":"2023-07-12T02:03:58.150302+0000","last_unstale":"2023-07-12T02:04:03.173964+0000","last_undegraded":"2023-07-12T02:04:03.173964+0000","last_fullsized":"2023-07-12T02:04:03.173964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:34:50.094079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707297+0000","last_change":"2023-07-12T02:03:58.167958+0000","last_active":"2023-07-12T02:04:03.707297+0000","last_peered":"2023-07-12T02:04:03.707297+0000","last_clean":"2023-07-12T02:04:03.707297+0000","last_became_active":"2023-07-12T02:03:58.167409+0000","last_became_peered":"2023-07-12T02:03:58.167409+0000","last_unstale":"2023-07-12T02:04:03.707297+0000","last_undegraded":"2023-07-12T02:04:03.707297+0000","last_fullsized":"2023-07-12T02:04:03.707297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:15:21.392894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174114+0000","last_change":"2023-07-12T02:03:58.158253+0000","last_active":"2023-07-12T02:04:03.174114+0000","last_peered":"2023-07-12T02:04:03.174114+0000","last_clean":"2023-07-12T02:04:03.174114+0000","last_became_active":"2023-07-12T02:03:58.158005+0000","last_became_peered":"2023-07-12T02:03:58.158005+0000","last_unstale":"2023-07-12T02:04:03.174114+0000","last_undegraded":"2023-07-12T02:04:03.174114+0000","last_fullsized":"2023-07-12T02:04:03.174114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:07:16.216455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707579+0000","last_change":"2023-07-12T02:03:58.155943+0000","last_active":"2023-07-12T02:04:03.707579+0000","last_peered":"2023-07-12T02:04:03.707579+0000","last_clean":"2023-07-12T02:04:03.707579+0000","last_became_active":"2023-07-12T02:03:58.155672+0000","last_became_peered":"2023-07-12T02:03:58.155672+0000","last_unstale":"2023-07-12T02:04:03.707579+0000","last_undegraded":"2023-07-12T02:04:03.707579+0000","last_fullsized":"2023-07-12T02:04:03.707579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:59:41.793818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172594+0000","last_change":"2023-07-12T02:03:58.163745+0000","last_active":"2023-07-12T02:04:03.172594+0000","last_peered":"2023-07-12T02:04:03.172594+0000","last_clean":"2023-07-12T02:04:03.172594+0000","last_became_active":"2023-07-12T02:03:58.163198+0000","last_became_peered":"2023-07-12T02:03:58.163198+0000","last_unstale":"2023-07-12T02:04:03.172594+0000","last_undegraded":"2023-07-12T02:04:03.172594+0000","last_fullsized":"2023-07-12T02:04:03.172594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:29.024675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173684+0000","last_change":"2023-07-12T02:03:58.160380+0000","last_active":"2023-07-12T02:04:03.173684+0000","last_peered":"2023-07-12T02:04:03.173684+0000","last_clean":"2023-07-12T02:04:03.173684+0000","last_became_active":"2023-07-12T02:03:58.160102+0000","last_became_peered":"2023-07-12T02:03:58.160102+0000","last_unstale":"2023-07-12T02:04:03.173684+0000","last_undegraded":"2023-07-12T02:04:03.173684+0000","last_fullsized":"2023-07-12T02:04:03.173684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:08:29.661400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589781+0000","last_change":"2023-07-12T02:03:58.153608+0000","last_active":"2023-07-12T02:04:03.589781+0000","last_peered":"2023-07-12T02:04:03.589781+0000","last_clean":"2023-07-12T02:04:03.589781+0000","last_became_active":"2023-07-12T02:03:58.153320+0000","last_became_peered":"2023-07-12T02:03:58.153320+0000","last_unstale":"2023-07-12T02:04:03.589781+0000","last_undegraded":"2023-07-12T02:04:03.589781+0000","last_fullsized":"2023-07-12T02:04:03.589781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:37.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706388+0000","last_change":"2023-07-12T02:03:58.157485+0000","last_active":"2023-07-12T02:04:03.706388+0000","last_peered":"2023-07-12T02:04:03.706388+0000","last_clean":"2023-07-12T02:04:03.706388+0000","last_became_active":"2023-07-12T02:03:58.157195+0000","last_became_peered":"2023-07-12T02:03:58.157195+0000","last_unstale":"2023-07-12T02:04:03.706388+0000","last_undegraded":"2023-07-12T02:04:03.706388+0000","last_fullsized":"2023-07-12T02:04:03.706388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:52.656557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171917+0000","last_change":"2023-07-12T02:03:58.162632+0000","last_active":"2023-07-12T02:04:03.171917+0000","last_peered":"2023-07-12T02:04:03.171917+0000","last_clean":"2023-07-12T02:04:03.171917+0000","last_became_active":"2023-07-12T02:03:58.162344+0000","last_became_peered":"2023-07-12T02:03:58.162344+0000","last_unstale":"2023-07-12T02:04:03.171917+0000","last_undegraded":"2023-07-12T02:04:03.171917+0000","last_fullsized":"2023-07-12T02:04:03.171917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:39.957211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707756+0000","last_change":"2023-07-12T02:03:58.165129+0000","last_active":"2023-07-12T02:04:03.707756+0000","last_peered":"2023-07-12T02:04:03.707756+0000","last_clean":"2023-07-12T02:04:03.707756+0000","last_became_active":"2023-07-12T02:03:58.164826+0000","last_became_peered":"2023-07-12T02:03:58.164826+0000","last_unstale":"2023-07-12T02:04:03.707756+0000","last_undegraded":"2023-07-12T02:04:03.707756+0000","last_fullsized":"2023-07-12T02:04:03.707756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:30:44.777286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174276+0000","last_change":"2023-07-12T02:03:58.167779+0000","last_active":"2023-07-12T02:04:03.174276+0000","last_peered":"2023-07-12T02:04:03.174276+0000","last_clean":"2023-07-12T02:04:03.174276+0000","last_became_active":"2023-07-12T02:03:58.167405+0000","last_became_peered":"2023-07-12T02:03:58.167405+0000","last_unstale":"2023-07-12T02:04:03.174276+0000","last_undegraded":"2023-07-12T02:04:03.174276+0000","last_fullsized":"2023-07-12T02:04:03.174276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:05:20.293113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173473+0000","last_change":"2023-07-12T02:03:58.140088+0000","last_active":"2023-07-12T02:04:03.173473+0000","last_peered":"2023-07-12T02:04:03.173473+0000","last_clean":"2023-07-12T02:04:03.173473+0000","last_became_active":"2023-07-12T02:03:58.139727+0000","last_became_peered":"2023-07-12T02:03:58.139727+0000","last_unstale":"2023-07-12T02:04:03.173473+0000","last_undegraded":"2023-07-12T02:04:03.173473+0000","last_fullsized":"2023-07-12T02:04:03.173473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:50.799195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173642+0000","last_change":"2023-07-12T02:03:58.152355+0000","last_active":"2023-07-12T02:04:03.173642+0000","last_peered":"2023-07-12T02:04:03.173642+0000","last_clean":"2023-07-12T02:04:03.173642+0000","last_became_active":"2023-07-12T02:03:58.151997+0000","last_became_peered":"2023-07-12T02:03:58.151997+0000","last_unstale":"2023-07-12T02:04:03.173642+0000","last_undegraded":"2023-07-12T02:04:03.173642+0000","last_fullsized":"2023-07-12T02:04:03.173642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:50:47.044125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706694+0000","last_change":"2023-07-12T02:03:58.155958+0000","last_active":"2023-07-12T02:04:03.706694+0000","last_peered":"2023-07-12T02:04:03.706694+0000","last_clean":"2023-07-12T02:04:03.706694+0000","last_became_active":"2023-07-12T02:03:58.155646+0000","last_became_peered":"2023-07-12T02:03:58.155646+0000","last_unstale":"2023-07-12T02:04:03.706694+0000","last_undegraded":"2023-07-12T02:04:03.706694+0000","last_fullsized":"2023-07-12T02:04:03.706694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:04:36.999164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589619+0000","last_change":"2023-07-12T02:03:58.162352+0000","last_active":"2023-07-12T02:04:03.589619+0000","last_peered":"2023-07-12T02:04:03.589619+0000","last_clean":"2023-07-12T02:04:03.589619+0000","last_became_active":"2023-07-12T02:03:58.162011+0000","last_became_peered":"2023-07-12T02:03:58.162011+0000","last_unstale":"2023-07-12T02:04:03.589619+0000","last_undegraded":"2023-07-12T02:04:03.589619+0000","last_fullsized":"2023-07-12T02:04:03.589619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:04:36.999164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173236+0000","last_change":"2023-07-12T02:03:58.162838+0000","last_active":"2023-07-12T02:04:03.173236+0000","last_peered":"2023-07-12T02:04:03.173236+0000","last_clean":"2023-07-12T02:04:03.173236+0000","last_became_active":"2023-07-12T02:03:58.162528+0000","last_became_peered":"2023-07-12T02:03:58.162528+0000","last_unstale":"2023-07-12T02:04:03.173236+0000","last_undegraded":"2023-07-12T02:04:03.173236+0000","last_fullsized":"2023-07-12T02:04:03.173236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:42:38.629324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172071+0000","last_change":"2023-07-12T02:03:58.162549+0000","last_active":"2023-07-12T02:04:03.172071+0000","last_peered":"2023-07-12T02:04:03.172071+0000","last_clean":"2023-07-12T02:04:03.172071+0000","last_became_active":"2023-07-12T02:03:58.161983+0000","last_became_peered":"2023-07-12T02:03:58.161983+0000","last_unstale":"2023-07-12T02:04:03.172071+0000","last_undegraded":"2023-07-12T02:04:03.172071+0000","last_fullsized":"2023-07-12T02:04:03.172071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:37.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174066+0000","last_change":"2023-07-12T02:03:58.140088+0000","last_active":"2023-07-12T02:04:03.174066+0000","last_peered":"2023-07-12T02:04:03.174066+0000","last_clean":"2023-07-12T02:04:03.174066+0000","last_became_active":"2023-07-12T02:03:58.139825+0000","last_became_peered":"2023-07-12T02:03:58.139825+0000","last_unstale":"2023-07-12T02:04:03.174066+0000","last_undegraded":"2023-07-12T02:04:03.174066+0000","last_fullsized":"2023-07-12T02:04:03.174066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:22:57.380427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173781+0000","last_change":"2023-07-12T02:03:58.149388+0000","last_active":"2023-07-12T02:04:03.173781+0000","last_peered":"2023-07-12T02:04:03.173781+0000","last_clean":"2023-07-12T02:04:03.173781+0000","last_became_active":"2023-07-12T02:03:58.149009+0000","last_became_peered":"2023-07-12T02:03:58.149009+0000","last_unstale":"2023-07-12T02:04:03.173781+0000","last_undegraded":"2023-07-12T02:04:03.173781+0000","last_fullsized":"2023-07-12T02:04:03.173781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:18:25.150845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173690+0000","last_change":"2023-07-12T02:03:58.144677+0000","last_active":"2023-07-12T02:04:03.173690+0000","last_peered":"2023-07-12T02:04:03.173690+0000","last_clean":"2023-07-12T02:04:03.173690+0000","last_became_active":"2023-07-12T02:03:58.144365+0000","last_became_peered":"2023-07-12T02:03:58.144365+0000","last_unstale":"2023-07-12T02:04:03.173690+0000","last_undegraded":"2023-07-12T02:04:03.173690+0000","last_fullsized":"2023-07-12T02:04:03.173690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:46:02.333414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590198+0000","last_change":"2023-07-12T02:03:58.156054+0000","last_active":"2023-07-12T02:04:03.590198+0000","last_peered":"2023-07-12T02:04:03.590198+0000","last_clean":"2023-07-12T02:04:03.590198+0000","last_became_active":"2023-07-12T02:03:58.155755+0000","last_became_peered":"2023-07-12T02:03:58.155755+0000","last_unstale":"2023-07-12T02:04:03.590198+0000","last_undegraded":"2023-07-12T02:04:03.590198+0000","last_fullsized":"2023-07-12T02:04:03.590198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:37:27.430690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171482+0000","last_change":"2023-07-12T02:03:58.169838+0000","last_active":"2023-07-12T02:04:03.171482+0000","last_peered":"2023-07-12T02:04:03.171482+0000","last_clean":"2023-07-12T02:04:03.171482+0000","last_became_active":"2023-07-12T02:03:58.169574+0000","last_became_peered":"2023-07-12T02:03:58.169574+0000","last_unstale":"2023-07-12T02:04:03.171482+0000","last_undegraded":"2023-07-12T02:04:03.171482+0000","last_fullsized":"2023-07-12T02:04:03.171482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:03:49.584323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706395+0000","last_change":"2023-07-12T02:03:58.158643+0000","last_active":"2023-07-12T02:04:03.706395+0000","last_peered":"2023-07-12T02:04:03.706395+0000","last_clean":"2023-07-12T02:04:03.706395+0000","last_became_active":"2023-07-12T02:03:58.158228+0000","last_became_peered":"2023-07-12T02:03:58.158228+0000","last_unstale":"2023-07-12T02:04:03.706395+0000","last_undegraded":"2023-07-12T02:04:03.706395+0000","last_fullsized":"2023-07-12T02:04:03.706395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:15:21.392894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589781+0000","last_change":"2023-07-12T02:03:58.155246+0000","last_active":"2023-07-12T02:04:03.589781+0000","last_peered":"2023-07-12T02:04:03.589781+0000","last_clean":"2023-07-12T02:04:03.589781+0000","last_became_active":"2023-07-12T02:03:58.154842+0000","last_became_peered":"2023-07-12T02:03:58.154842+0000","last_unstale":"2023-07-12T02:04:03.589781+0000","last_undegraded":"2023-07-12T02:04:03.589781+0000","last_fullsized":"2023-07-12T02:04:03.589781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:52.156977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706732+0000","last_change":"2023-07-12T02:03:58.167506+0000","last_active":"2023-07-12T02:04:03.706732+0000","last_peered":"2023-07-12T02:04:03.706732+0000","last_clean":"2023-07-12T02:04:03.706732+0000","last_became_active":"2023-07-12T02:03:58.166701+0000","last_became_peered":"2023-07-12T02:03:58.166701+0000","last_unstale":"2023-07-12T02:04:03.706732+0000","last_undegraded":"2023-07-12T02:04:03.706732+0000","last_fullsized":"2023-07-12T02:04:03.706732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:03:49.584323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706759+0000","last_change":"2023-07-12T02:03:58.164411+0000","last_active":"2023-07-12T02:04:03.706759+0000","last_peered":"2023-07-12T02:04:03.706759+0000","last_clean":"2023-07-12T02:04:03.706759+0000","last_became_active":"2023-07-12T02:03:58.164136+0000","last_became_peered":"2023-07-12T02:03:58.164136+0000","last_unstale":"2023-07-12T02:04:03.706759+0000","last_undegraded":"2023-07-12T02:04:03.706759+0000","last_fullsized":"2023-07-12T02:04:03.706759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:40:41.452100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707500+0000","last_change":"2023-07-12T02:03:58.158327+0000","last_active":"2023-07-12T02:04:03.707500+0000","last_peered":"2023-07-12T02:04:03.707500+0000","last_clean":"2023-07-12T02:04:03.707500+0000","last_became_active":"2023-07-12T02:03:58.158038+0000","last_became_peered":"2023-07-12T02:03:58.158038+0000","last_unstale":"2023-07-12T02:04:03.707500+0000","last_undegraded":"2023-07-12T02:04:03.707500+0000","last_fullsized":"2023-07-12T02:04:03.707500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:37:27.430690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174072+0000","last_change":"2023-07-12T02:04:02.205882+0000","last_active":"2023-07-12T02:04:03.174072+0000","last_peered":"2023-07-12T02:04:03.174072+0000","last_clean":"2023-07-12T02:04:03.174072+0000","last_became_active":"2023-07-12T02:04:02.205422+0000","last_became_peered":"2023-07-12T02:04:02.205422+0000","last_unstale":"2023-07-12T02:04:03.174072+0000","last_undegraded":"2023-07-12T02:04:03.174072+0000","last_fullsized":"2023-07-12T02:04:03.174072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:00:06.567816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173559+0000","last_change":"2023-07-12T02:03:57.132659+0000","last_active":"2023-07-12T02:04:03.173559+0000","last_peered":"2023-07-12T02:04:03.173559+0000","last_clean":"2023-07-12T02:04:03.173559+0000","last_became_active":"2023-07-12T02:03:57.132296+0000","last_became_peered":"2023-07-12T02:03:57.132296+0000","last_unstale":"2023-07-12T02:04:03.173559+0000","last_undegraded":"2023-07-12T02:04:03.173559+0000","last_fullsized":"2023-07-12T02:04:03.173559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:13:18.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706776+0000","last_change":"2023-07-12T02:03:58.168189+0000","last_active":"2023-07-12T02:04:03.706776+0000","last_peered":"2023-07-12T02:04:03.706776+0000","last_clean":"2023-07-12T02:04:03.706776+0000","last_became_active":"2023-07-12T02:03:58.167837+0000","last_became_peered":"2023-07-12T02:03:58.167837+0000","last_unstale":"2023-07-12T02:04:03.706776+0000","last_undegraded":"2023-07-12T02:04:03.706776+0000","last_fullsized":"2023-07-12T02:04:03.706776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:37:27.430690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.708053+0000","last_change":"2023-07-12T02:04:02.192589+0000","last_active":"2023-07-12T02:04:03.708053+0000","last_peered":"2023-07-12T02:04:03.708053+0000","last_clean":"2023-07-12T02:04:03.708053+0000","last_became_active":"2023-07-12T02:04:02.192078+0000","last_became_peered":"2023-07-12T02:04:02.192078+0000","last_unstale":"2023-07-12T02:04:03.708053+0000","last_undegraded":"2023-07-12T02:04:03.708053+0000","last_fullsized":"2023-07-12T02:04:03.708053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:13:11.653857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706270+0000","last_change":"2023-07-12T02:03:57.137950+0000","last_active":"2023-07-12T02:04:03.706270+0000","last_peered":"2023-07-12T02:04:03.706270+0000","last_clean":"2023-07-12T02:04:03.706270+0000","last_became_active":"2023-07-12T02:03:57.137512+0000","last_became_peered":"2023-07-12T02:03:57.137512+0000","last_unstale":"2023-07-12T02:04:03.706270+0000","last_undegraded":"2023-07-12T02:04:03.706270+0000","last_fullsized":"2023-07-12T02:04:03.706270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:23:19.169613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172604+0000","last_change":"2023-07-12T02:03:58.161489+0000","last_active":"2023-07-12T02:04:03.172604+0000","last_peered":"2023-07-12T02:04:03.172604+0000","last_clean":"2023-07-12T02:04:03.172604+0000","last_became_active":"2023-07-12T02:03:58.161146+0000","last_became_peered":"2023-07-12T02:03:58.161146+0000","last_unstale":"2023-07-12T02:04:03.172604+0000","last_undegraded":"2023-07-12T02:04:03.172604+0000","last_fullsized":"2023-07-12T02:04:03.172604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:30:44.777286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172742+0000","last_change":"2023-07-12T02:04:02.199897+0000","last_active":"2023-07-12T02:04:03.172742+0000","last_peered":"2023-07-12T02:04:03.172742+0000","last_clean":"2023-07-12T02:04:03.172742+0000","last_became_active":"2023-07-12T02:04:02.198813+0000","last_became_peered":"2023-07-12T02:04:02.198813+0000","last_unstale":"2023-07-12T02:04:03.172742+0000","last_undegraded":"2023-07-12T02:04:03.172742+0000","last_fullsized":"2023-07-12T02:04:03.172742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:12.327958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706246+0000","last_change":"2023-07-12T02:03:57.150630+0000","last_active":"2023-07-12T02:04:03.706246+0000","last_peered":"2023-07-12T02:04:03.706246+0000","last_clean":"2023-07-12T02:04:03.706246+0000","last_became_active":"2023-07-12T02:03:57.150342+0000","last_became_peered":"2023-07-12T02:03:57.150342+0000","last_unstale":"2023-07-12T02:04:03.706246+0000","last_undegraded":"2023-07-12T02:04:03.706246+0000","last_fullsized":"2023-07-12T02:04:03.706246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:44:57.891756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.708148+0000","last_change":"2023-07-12T02:03:58.151183+0000","last_active":"2023-07-12T02:04:03.708148+0000","last_peered":"2023-07-12T02:04:03.708148+0000","last_clean":"2023-07-12T02:04:03.708148+0000","last_became_active":"2023-07-12T02:03:58.150257+0000","last_became_peered":"2023-07-12T02:03:58.150257+0000","last_unstale":"2023-07-12T02:04:03.708148+0000","last_undegraded":"2023-07-12T02:04:03.708148+0000","last_fullsized":"2023-07-12T02:04:03.708148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:59:55.615077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707354+0000","last_change":"2023-07-12T02:04:02.193315+0000","last_active":"2023-07-12T02:04:03.707354+0000","last_peered":"2023-07-12T02:04:03.707354+0000","last_clean":"2023-07-12T02:04:03.707354+0000","last_became_active":"2023-07-12T02:04:02.192915+0000","last_became_peered":"2023-07-12T02:04:02.192915+0000","last_unstale":"2023-07-12T02:04:03.707354+0000","last_undegraded":"2023-07-12T02:04:03.707354+0000","last_fullsized":"2023-07-12T02:04:03.707354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:48:36.242589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172114+0000","last_change":"2023-07-12T02:03:57.147980+0000","last_active":"2023-07-12T02:04:03.172114+0000","last_peered":"2023-07-12T02:04:03.172114+0000","last_clean":"2023-07-12T02:04:03.172114+0000","last_became_active":"2023-07-12T02:03:57.147701+0000","last_became_peered":"2023-07-12T02:03:57.147701+0000","last_unstale":"2023-07-12T02:04:03.172114+0000","last_undegraded":"2023-07-12T02:04:03.172114+0000","last_fullsized":"2023-07-12T02:04:03.172114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:20.831039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706124+0000","last_change":"2023-07-12T02:03:58.162466+0000","last_active":"2023-07-12T02:04:03.706124+0000","last_peered":"2023-07-12T02:04:03.706124+0000","last_clean":"2023-07-12T02:04:03.706124+0000","last_became_active":"2023-07-12T02:03:58.162232+0000","last_became_peered":"2023-07-12T02:03:58.162232+0000","last_unstale":"2023-07-12T02:04:03.706124+0000","last_undegraded":"2023-07-12T02:04:03.706124+0000","last_fullsized":"2023-07-12T02:04:03.706124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:52.156977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589544+0000","last_change":"2023-07-12T02:04:02.199601+0000","last_active":"2023-07-12T02:04:03.589544+0000","last_peered":"2023-07-12T02:04:03.589544+0000","last_clean":"2023-07-12T02:04:03.589544+0000","last_became_active":"2023-07-12T02:04:02.199218+0000","last_became_peered":"2023-07-12T02:04:02.199218+0000","last_unstale":"2023-07-12T02:04:03.589544+0000","last_undegraded":"2023-07-12T02:04:03.589544+0000","last_fullsized":"2023-07-12T02:04:03.589544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:56.700790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707513+0000","last_change":"2023-07-12T02:03:57.144471+0000","last_active":"2023-07-12T02:04:03.707513+0000","last_peered":"2023-07-12T02:04:03.707513+0000","last_clean":"2023-07-12T02:04:03.707513+0000","last_became_active":"2023-07-12T02:03:57.144183+0000","last_became_peered":"2023-07-12T02:03:57.144183+0000","last_unstale":"2023-07-12T02:04:03.707513+0000","last_undegraded":"2023-07-12T02:04:03.707513+0000","last_fullsized":"2023-07-12T02:04:03.707513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:28.017520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706261+0000","last_change":"2023-07-12T02:03:58.155253+0000","last_active":"2023-07-12T02:04:03.706261+0000","last_peered":"2023-07-12T02:04:03.706261+0000","last_clean":"2023-07-12T02:04:03.706261+0000","last_became_active":"2023-07-12T02:03:58.154981+0000","last_became_peered":"2023-07-12T02:03:58.154981+0000","last_unstale":"2023-07-12T02:04:03.706261+0000","last_undegraded":"2023-07-12T02:04:03.706261+0000","last_fullsized":"2023-07-12T02:04:03.706261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:05.243878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707342+0000","last_change":"2023-07-12T02:04:02.199311+0000","last_active":"2023-07-12T02:04:03.707342+0000","last_peered":"2023-07-12T02:04:03.707342+0000","last_clean":"2023-07-12T02:04:03.707342+0000","last_became_active":"2023-07-12T02:04:02.198883+0000","last_became_peered":"2023-07-12T02:04:02.198883+0000","last_unstale":"2023-07-12T02:04:03.707342+0000","last_undegraded":"2023-07-12T02:04:03.707342+0000","last_fullsized":"2023-07-12T02:04:03.707342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:19:55.666369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590314+0000","last_change":"2023-07-12T02:03:57.150937+0000","last_active":"2023-07-12T02:04:03.590314+0000","last_peered":"2023-07-12T02:04:03.590314+0000","last_clean":"2023-07-12T02:04:03.590314+0000","last_became_active":"2023-07-12T02:03:57.150617+0000","last_became_peered":"2023-07-12T02:03:57.150617+0000","last_unstale":"2023-07-12T02:04:03.590314+0000","last_undegraded":"2023-07-12T02:04:03.590314+0000","last_fullsized":"2023-07-12T02:04:03.590314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:07.276570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707832+0000","last_change":"2023-07-12T02:03:58.160889+0000","last_active":"2023-07-12T02:04:03.707832+0000","last_peered":"2023-07-12T02:04:03.707832+0000","last_clean":"2023-07-12T02:04:03.707832+0000","last_became_active":"2023-07-12T02:03:58.160594+0000","last_became_peered":"2023-07-12T02:03:58.160594+0000","last_unstale":"2023-07-12T02:04:03.707832+0000","last_undegraded":"2023-07-12T02:04:03.707832+0000","last_fullsized":"2023-07-12T02:04:03.707832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:05.243878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707549+0000","last_change":"2023-07-12T02:04:02.191342+0000","last_active":"2023-07-12T02:04:03.707549+0000","last_peered":"2023-07-12T02:04:03.707549+0000","last_clean":"2023-07-12T02:04:03.707549+0000","last_became_active":"2023-07-12T02:04:02.190277+0000","last_became_peered":"2023-07-12T02:04:02.190277+0000","last_unstale":"2023-07-12T02:04:03.707549+0000","last_undegraded":"2023-07-12T02:04:03.707549+0000","last_fullsized":"2023-07-12T02:04:03.707549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:56.201209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:16.744060+0000","last_change":"2023-07-12T02:03:57.141317+0000","last_active":"2023-07-12T02:04:16.744060+0000","last_peered":"2023-07-12T02:04:16.744060+0000","last_clean":"2023-07-12T02:04:16.744060+0000","last_became_active":"2023-07-12T02:03:57.140668+0000","last_became_peered":"2023-07-12T02:03:57.140668+0000","last_unstale":"2023-07-12T02:04:16.744060+0000","last_undegraded":"2023-07-12T02:04:16.744060+0000","last_fullsized":"2023-07-12T02:04:16.744060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:26:13.420313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173616+0000","last_change":"2023-07-12T02:03:58.147529+0000","last_active":"2023-07-12T02:04:03.173616+0000","last_peered":"2023-07-12T02:04:03.173616+0000","last_clean":"2023-07-12T02:04:03.173616+0000","last_became_active":"2023-07-12T02:03:58.147226+0000","last_became_peered":"2023-07-12T02:03:58.147226+0000","last_unstale":"2023-07-12T02:04:03.173616+0000","last_undegraded":"2023-07-12T02:04:03.173616+0000","last_fullsized":"2023-07-12T02:04:03.173616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:41:34.175917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707746+0000","last_change":"2023-07-12T02:04:02.199731+0000","last_active":"2023-07-12T02:04:03.707746+0000","last_peered":"2023-07-12T02:04:03.707746+0000","last_clean":"2023-07-12T02:04:03.707746+0000","last_became_active":"2023-07-12T02:04:02.199360+0000","last_became_peered":"2023-07-12T02:04:02.199360+0000","last_unstale":"2023-07-12T02:04:03.707746+0000","last_undegraded":"2023-07-12T02:04:03.707746+0000","last_fullsized":"2023-07-12T02:04:03.707746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:09:51.362187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590031+0000","last_change":"2023-07-12T02:03:57.146809+0000","last_active":"2023-07-12T02:04:03.590031+0000","last_peered":"2023-07-12T02:04:03.590031+0000","last_clean":"2023-07-12T02:04:03.590031+0000","last_became_active":"2023-07-12T02:03:57.146430+0000","last_became_peered":"2023-07-12T02:03:57.146430+0000","last_unstale":"2023-07-12T02:04:03.590031+0000","last_undegraded":"2023-07-12T02:04:03.590031+0000","last_fullsized":"2023-07-12T02:04:03.590031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:04.236723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707769+0000","last_change":"2023-07-12T02:03:58.152748+0000","last_active":"2023-07-12T02:04:03.707769+0000","last_peered":"2023-07-12T02:04:03.707769+0000","last_clean":"2023-07-12T02:04:03.707769+0000","last_became_active":"2023-07-12T02:03:58.152426+0000","last_became_peered":"2023-07-12T02:03:58.152426+0000","last_unstale":"2023-07-12T02:04:03.707769+0000","last_undegraded":"2023-07-12T02:04:03.707769+0000","last_fullsized":"2023-07-12T02:04:03.707769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:04:26.740269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707577+0000","last_change":"2023-07-12T02:04:02.192398+0000","last_active":"2023-07-12T02:04:03.707577+0000","last_peered":"2023-07-12T02:04:03.707577+0000","last_clean":"2023-07-12T02:04:03.707577+0000","last_became_active":"2023-07-12T02:04:02.191940+0000","last_became_peered":"2023-07-12T02:04:02.191940+0000","last_unstale":"2023-07-12T02:04:03.707577+0000","last_undegraded":"2023-07-12T02:04:03.707577+0000","last_fullsized":"2023-07-12T02:04:03.707577+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:22.171422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171647+0000","last_change":"2023-07-12T02:03:57.146620+0000","last_active":"2023-07-12T02:04:03.171647+0000","last_peered":"2023-07-12T02:04:03.171647+0000","last_clean":"2023-07-12T02:04:03.171647+0000","last_became_active":"2023-07-12T02:03:57.144751+0000","last_became_peered":"2023-07-12T02:03:57.144751+0000","last_unstale":"2023-07-12T02:04:03.171647+0000","last_undegraded":"2023-07-12T02:04:03.171647+0000","last_fullsized":"2023-07-12T02:04:03.171647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:40:40.444944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707376+0000","last_change":"2023-07-12T02:03:58.158785+0000","last_active":"2023-07-12T02:04:03.707376+0000","last_peered":"2023-07-12T02:04:03.707376+0000","last_clean":"2023-07-12T02:04:03.707376+0000","last_became_active":"2023-07-12T02:03:58.158476+0000","last_became_peered":"2023-07-12T02:03:58.158476+0000","last_unstale":"2023-07-12T02:04:03.707376+0000","last_undegraded":"2023-07-12T02:04:03.707376+0000","last_fullsized":"2023-07-12T02:04:03.707376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:58:17.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707289+0000","last_change":"2023-07-12T02:04:02.198903+0000","last_active":"2023-07-12T02:04:03.707289+0000","last_peered":"2023-07-12T02:04:03.707289+0000","last_clean":"2023-07-12T02:04:03.707289+0000","last_became_active":"2023-07-12T02:04:02.198445+0000","last_became_peered":"2023-07-12T02:04:02.198445+0000","last_unstale":"2023-07-12T02:04:03.707289+0000","last_undegraded":"2023-07-12T02:04:03.707289+0000","last_fullsized":"2023-07-12T02:04:03.707289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:09:51.362187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589697+0000","last_change":"2023-07-12T02:03:57.143073+0000","last_active":"2023-07-12T02:04:03.589697+0000","last_peered":"2023-07-12T02:04:03.589697+0000","last_clean":"2023-07-12T02:04:03.589697+0000","last_became_active":"2023-07-12T02:03:57.142805+0000","last_became_peered":"2023-07-12T02:03:57.142805+0000","last_unstale":"2023-07-12T02:04:03.589697+0000","last_undegraded":"2023-07-12T02:04:03.589697+0000","last_fullsized":"2023-07-12T02:04:03.589697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:38.950056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172309+0000","last_change":"2023-07-12T02:03:58.161612+0000","last_active":"2023-07-12T02:04:03.172309+0000","last_peered":"2023-07-12T02:04:03.172309+0000","last_clean":"2023-07-12T02:04:03.172309+0000","last_became_active":"2023-07-12T02:03:58.161329+0000","last_became_peered":"2023-07-12T02:03:58.161329+0000","last_unstale":"2023-07-12T02:04:03.172309+0000","last_undegraded":"2023-07-12T02:04:03.172309+0000","last_fullsized":"2023-07-12T02:04:03.172309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:58:17.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707911+0000","last_change":"2023-07-12T02:04:02.201466+0000","last_active":"2023-07-12T02:04:03.707911+0000","last_peered":"2023-07-12T02:04:03.707911+0000","last_clean":"2023-07-12T02:04:03.707911+0000","last_became_active":"2023-07-12T02:04:02.200829+0000","last_became_peered":"2023-07-12T02:04:02.200829+0000","last_unstale":"2023-07-12T02:04:03.707911+0000","last_undegraded":"2023-07-12T02:04:03.707911+0000","last_fullsized":"2023-07-12T02:04:03.707911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:38:34.209015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706866+0000","last_change":"2023-07-12T02:03:57.151484+0000","last_active":"2023-07-12T02:04:03.706866+0000","last_peered":"2023-07-12T02:04:03.706866+0000","last_clean":"2023-07-12T02:04:03.706866+0000","last_became_active":"2023-07-12T02:03:57.151265+0000","last_became_peered":"2023-07-12T02:03:57.151265+0000","last_unstale":"2023-07-12T02:04:03.706866+0000","last_undegraded":"2023-07-12T02:04:03.706866+0000","last_fullsized":"2023-07-12T02:04:03.706866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:20:54.377849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707483+0000","last_change":"2023-07-12T02:03:58.155235+0000","last_active":"2023-07-12T02:04:03.707483+0000","last_peered":"2023-07-12T02:04:03.707483+0000","last_clean":"2023-07-12T02:04:03.707483+0000","last_became_active":"2023-07-12T02:03:58.154930+0000","last_became_peered":"2023-07-12T02:03:58.154930+0000","last_unstale":"2023-07-12T02:04:03.707483+0000","last_undegraded":"2023-07-12T02:04:03.707483+0000","last_fullsized":"2023-07-12T02:04:03.707483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:49:27.944683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589908+0000","last_change":"2023-07-12T02:04:02.192401+0000","last_active":"2023-07-12T02:04:03.589908+0000","last_peered":"2023-07-12T02:04:03.589908+0000","last_clean":"2023-07-12T02:04:03.589908+0000","last_became_active":"2023-07-12T02:04:02.191970+0000","last_became_peered":"2023-07-12T02:04:02.191970+0000","last_unstale":"2023-07-12T02:04:03.589908+0000","last_undegraded":"2023-07-12T02:04:03.589908+0000","last_fullsized":"2023-07-12T02:04:03.589908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:45:02.943144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590605+0000","last_change":"2023-07-12T02:03:57.147171+0000","last_active":"2023-07-12T02:04:03.590605+0000","last_peered":"2023-07-12T02:04:03.590605+0000","last_clean":"2023-07-12T02:04:03.590605+0000","last_became_active":"2023-07-12T02:03:57.146834+0000","last_became_peered":"2023-07-12T02:03:57.146834+0000","last_unstale":"2023-07-12T02:04:03.590605+0000","last_undegraded":"2023-07-12T02:04:03.590605+0000","last_fullsized":"2023-07-12T02:04:03.590605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:19:50.614981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706300+0000","last_change":"2023-07-12T02:03:58.158172+0000","last_active":"2023-07-12T02:04:03.706300+0000","last_peered":"2023-07-12T02:04:03.706300+0000","last_clean":"2023-07-12T02:04:03.706300+0000","last_became_active":"2023-07-12T02:03:58.157899+0000","last_became_peered":"2023-07-12T02:03:58.157899+0000","last_unstale":"2023-07-12T02:04:03.706300+0000","last_undegraded":"2023-07-12T02:04:03.706300+0000","last_fullsized":"2023-07-12T02:04:03.706300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:40:41.452100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173071+0000","last_change":"2023-07-12T02:04:02.204856+0000","last_active":"2023-07-12T02:04:03.173071+0000","last_peered":"2023-07-12T02:04:03.173071+0000","last_clean":"2023-07-12T02:04:03.173071+0000","last_became_active":"2023-07-12T02:04:02.204417+0000","last_became_peered":"2023-07-12T02:04:02.204417+0000","last_unstale":"2023-07-12T02:04:03.173071+0000","last_undegraded":"2023-07-12T02:04:03.173071+0000","last_fullsized":"2023-07-12T02:04:03.173071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:48:27.384109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590285+0000","last_change":"2023-07-12T02:03:57.146813+0000","last_active":"2023-07-12T02:04:03.590285+0000","last_peered":"2023-07-12T02:04:03.590285+0000","last_clean":"2023-07-12T02:04:03.590285+0000","last_became_active":"2023-07-12T02:03:57.146386+0000","last_became_peered":"2023-07-12T02:03:57.146386+0000","last_unstale":"2023-07-12T02:04:03.590285+0000","last_undegraded":"2023-07-12T02:04:03.590285+0000","last_fullsized":"2023-07-12T02:04:03.590285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:28.017520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173036+0000","last_change":"2023-07-12T02:03:58.150492+0000","last_active":"2023-07-12T02:04:03.173036+0000","last_peered":"2023-07-12T02:04:03.173036+0000","last_clean":"2023-07-12T02:04:03.173036+0000","last_became_active":"2023-07-12T02:03:58.150197+0000","last_became_peered":"2023-07-12T02:03:58.150197+0000","last_unstale":"2023-07-12T02:04:03.173036+0000","last_undegraded":"2023-07-12T02:04:03.173036+0000","last_fullsized":"2023-07-12T02:04:03.173036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:58:53.219351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173480+0000","last_change":"2023-07-12T02:04:02.208486+0000","last_active":"2023-07-12T02:04:03.173480+0000","last_peered":"2023-07-12T02:04:03.173480+0000","last_clean":"2023-07-12T02:04:03.173480+0000","last_became_active":"2023-07-12T02:04:02.207988+0000","last_became_peered":"2023-07-12T02:04:02.207988+0000","last_unstale":"2023-07-12T02:04:03.173480+0000","last_undegraded":"2023-07-12T02:04:03.173480+0000","last_fullsized":"2023-07-12T02:04:03.173480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:35:12.462957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590458+0000","last_change":"2023-07-12T02:03:57.147092+0000","last_active":"2023-07-12T02:04:03.590458+0000","last_peered":"2023-07-12T02:04:03.590458+0000","last_clean":"2023-07-12T02:04:03.590458+0000","last_became_active":"2023-07-12T02:03:57.146801+0000","last_became_peered":"2023-07-12T02:03:57.146801+0000","last_unstale":"2023-07-12T02:04:03.590458+0000","last_undegraded":"2023-07-12T02:04:03.590458+0000","last_fullsized":"2023-07-12T02:04:03.590458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:09:46.310799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707708+0000","last_change":"2023-07-12T02:03:58.168581+0000","last_active":"2023-07-12T02:04:03.707708+0000","last_peered":"2023-07-12T02:04:03.707708+0000","last_clean":"2023-07-12T02:04:03.707708+0000","last_became_active":"2023-07-12T02:03:58.168315+0000","last_became_peered":"2023-07-12T02:03:58.168315+0000","last_unstale":"2023-07-12T02:04:03.707708+0000","last_undegraded":"2023-07-12T02:04:03.707708+0000","last_fullsized":"2023-07-12T02:04:03.707708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:58:16.528209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173461+0000","last_change":"2023-07-12T02:04:02.193052+0000","last_active":"2023-07-12T02:04:03.173461+0000","last_peered":"2023-07-12T02:04:03.173461+0000","last_clean":"2023-07-12T02:04:03.173461+0000","last_became_active":"2023-07-12T02:04:02.192566+0000","last_became_peered":"2023-07-12T02:04:02.192566+0000","last_unstale":"2023-07-12T02:04:03.173461+0000","last_undegraded":"2023-07-12T02:04:03.173461+0000","last_fullsized":"2023-07-12T02:04:03.173461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:14:44.922812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706990+0000","last_change":"2023-07-12T02:03:57.140828+0000","last_active":"2023-07-12T02:04:03.706990+0000","last_peered":"2023-07-12T02:04:03.706990+0000","last_clean":"2023-07-12T02:04:03.706990+0000","last_became_active":"2023-07-12T02:03:57.140464+0000","last_became_peered":"2023-07-12T02:03:57.140464+0000","last_unstale":"2023-07-12T02:04:03.706990+0000","last_undegraded":"2023-07-12T02:04:03.706990+0000","last_fullsized":"2023-07-12T02:04:03.706990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:20.831039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172247+0000","last_change":"2023-07-12T02:03:58.169131+0000","last_active":"2023-07-12T02:04:03.172247+0000","last_peered":"2023-07-12T02:04:03.172247+0000","last_clean":"2023-07-12T02:04:03.172247+0000","last_became_active":"2023-07-12T02:03:58.168799+0000","last_became_peered":"2023-07-12T02:03:58.168799+0000","last_unstale":"2023-07-12T02:04:03.172247+0000","last_undegraded":"2023-07-12T02:04:03.172247+0000","last_fullsized":"2023-07-12T02:04:03.172247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:44:58.898911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173850+0000","last_change":"2023-07-12T02:04:02.190747+0000","last_active":"2023-07-12T02:04:03.173850+0000","last_peered":"2023-07-12T02:04:03.173850+0000","last_clean":"2023-07-12T02:04:03.173850+0000","last_became_active":"2023-07-12T02:04:02.190302+0000","last_became_peered":"2023-07-12T02:04:02.190302+0000","last_unstale":"2023-07-12T02:04:03.173850+0000","last_undegraded":"2023-07-12T02:04:03.173850+0000","last_fullsized":"2023-07-12T02:04:03.173850+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:33:37.078500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706960+0000","last_change":"2023-07-12T02:03:57.146313+0000","last_active":"2023-07-12T02:04:03.706960+0000","last_peered":"2023-07-12T02:04:03.706960+0000","last_clean":"2023-07-12T02:04:03.706960+0000","last_became_active":"2023-07-12T02:03:57.146009+0000","last_became_peered":"2023-07-12T02:03:57.146009+0000","last_unstale":"2023-07-12T02:04:03.706960+0000","last_undegraded":"2023-07-12T02:04:03.706960+0000","last_fullsized":"2023-07-12T02:04:03.706960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:07.276570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173066+0000","last_change":"2023-07-12T02:03:58.152369+0000","last_active":"2023-07-12T02:04:03.173066+0000","last_peered":"2023-07-12T02:04:03.173066+0000","last_clean":"2023-07-12T02:04:03.173066+0000","last_became_active":"2023-07-12T02:03:58.152135+0000","last_became_peered":"2023-07-12T02:03:58.152135+0000","last_unstale":"2023-07-12T02:04:03.173066+0000","last_undegraded":"2023-07-12T02:04:03.173066+0000","last_fullsized":"2023-07-12T02:04:03.173066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:50:41.194014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706141+0000","last_change":"2023-07-12T02:04:02.197112+0000","last_active":"2023-07-12T02:04:03.706141+0000","last_peered":"2023-07-12T02:04:03.706141+0000","last_clean":"2023-07-12T02:04:03.706141+0000","last_became_active":"2023-07-12T02:04:02.196690+0000","last_became_peered":"2023-07-12T02:04:02.196690+0000","last_unstale":"2023-07-12T02:04:03.706141+0000","last_undegraded":"2023-07-12T02:04:03.706141+0000","last_fullsized":"2023-07-12T02:04:03.706141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:13:26.428845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707558+0000","last_change":"2023-07-12T02:03:57.142419+0000","last_active":"2023-07-12T02:04:03.707558+0000","last_peered":"2023-07-12T02:04:03.707558+0000","last_clean":"2023-07-12T02:04:03.707558+0000","last_became_active":"2023-07-12T02:03:57.142100+0000","last_became_peered":"2023-07-12T02:03:57.142100+0000","last_unstale":"2023-07-12T02:04:03.707558+0000","last_undegraded":"2023-07-12T02:04:03.707558+0000","last_fullsized":"2023-07-12T02:04:03.707558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:56:37.546908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173901+0000","last_change":"2023-07-12T02:03:58.139451+0000","last_active":"2023-07-12T02:04:03.173901+0000","last_peered":"2023-07-12T02:04:03.173901+0000","last_clean":"2023-07-12T02:04:03.173901+0000","last_became_active":"2023-07-12T02:03:58.139177+0000","last_became_peered":"2023-07-12T02:03:58.139177+0000","last_unstale":"2023-07-12T02:04:03.173901+0000","last_undegraded":"2023-07-12T02:04:03.173901+0000","last_fullsized":"2023-07-12T02:04:03.173901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:55:54.389650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707633+0000","last_change":"2023-07-12T02:04:02.195542+0000","last_active":"2023-07-12T02:04:03.707633+0000","last_peered":"2023-07-12T02:04:03.707633+0000","last_clean":"2023-07-12T02:04:03.707633+0000","last_became_active":"2023-07-12T02:04:02.195110+0000","last_became_peered":"2023-07-12T02:04:02.195110+0000","last_unstale":"2023-07-12T02:04:03.707633+0000","last_undegraded":"2023-07-12T02:04:03.707633+0000","last_fullsized":"2023-07-12T02:04:03.707633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:12.327958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172725+0000","last_change":"2023-07-12T02:03:57.139384+0000","last_active":"2023-07-12T02:04:03.172725+0000","last_peered":"2023-07-12T02:04:03.172725+0000","last_clean":"2023-07-12T02:04:03.172725+0000","last_became_active":"2023-07-12T02:03:57.139029+0000","last_became_peered":"2023-07-12T02:03:57.139029+0000","last_unstale":"2023-07-12T02:04:03.172725+0000","last_undegraded":"2023-07-12T02:04:03.172725+0000","last_fullsized":"2023-07-12T02:04:03.172725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:49:26.937527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174239+0000","last_change":"2023-07-12T02:03:58.147472+0000","last_active":"2023-07-12T02:04:03.174239+0000","last_peered":"2023-07-12T02:04:03.174239+0000","last_clean":"2023-07-12T02:04:03.174239+0000","last_became_active":"2023-07-12T02:03:58.147122+0000","last_became_peered":"2023-07-12T02:03:58.147122+0000","last_unstale":"2023-07-12T02:04:03.174239+0000","last_undegraded":"2023-07-12T02:04:03.174239+0000","last_fullsized":"2023-07-12T02:04:03.174239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:01:36.223649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174157+0000","last_change":"2023-07-12T02:04:02.198219+0000","last_active":"2023-07-12T02:04:03.174157+0000","last_peered":"2023-07-12T02:04:03.174157+0000","last_clean":"2023-07-12T02:04:03.174157+0000","last_became_active":"2023-07-12T02:04:02.197795+0000","last_became_peered":"2023-07-12T02:04:02.197795+0000","last_unstale":"2023-07-12T02:04:03.174157+0000","last_undegraded":"2023-07-12T02:04:03.174157+0000","last_fullsized":"2023-07-12T02:04:03.174157+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:34:25.707588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706092+0000","last_change":"2023-07-12T02:03:57.135818+0000","last_active":"2023-07-12T02:04:03.706092+0000","last_peered":"2023-07-12T02:04:03.706092+0000","last_clean":"2023-07-12T02:04:03.706092+0000","last_became_active":"2023-07-12T02:03:57.135457+0000","last_became_peered":"2023-07-12T02:03:57.135457+0000","last_unstale":"2023-07-12T02:04:03.706092+0000","last_undegraded":"2023-07-12T02:04:03.706092+0000","last_fullsized":"2023-07-12T02:04:03.706092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:20.831039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706991+0000","last_change":"2023-07-12T02:03:58.167298+0000","last_active":"2023-07-12T02:04:03.706991+0000","last_peered":"2023-07-12T02:04:03.706991+0000","last_clean":"2023-07-12T02:04:03.706991+0000","last_became_active":"2023-07-12T02:03:58.166301+0000","last_became_peered":"2023-07-12T02:03:58.166301+0000","last_unstale":"2023-07-12T02:04:03.706991+0000","last_undegraded":"2023-07-12T02:04:03.706991+0000","last_fullsized":"2023-07-12T02:04:03.706991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:37.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171935+0000","last_change":"2023-07-12T02:04:02.200517+0000","last_active":"2023-07-12T02:04:03.171935+0000","last_peered":"2023-07-12T02:04:03.171935+0000","last_clean":"2023-07-12T02:04:03.171935+0000","last_became_active":"2023-07-12T02:04:02.200076+0000","last_became_peered":"2023-07-12T02:04:02.200076+0000","last_unstale":"2023-07-12T02:04:03.171935+0000","last_undegraded":"2023-07-12T02:04:03.171935+0000","last_fullsized":"2023-07-12T02:04:03.171935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:15:25.437127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706448+0000","last_change":"2023-07-12T02:03:52.304302+0000","last_active":"2023-07-12T02:04:03.706448+0000","last_peered":"2023-07-12T02:04:03.706448+0000","last_clean":"2023-07-12T02:04:03.706448+0000","last_became_active":"2023-07-12T02:03:52.303905+0000","last_became_peered":"2023-07-12T02:03:52.303905+0000","last_unstale":"2023-07-12T02:04:03.706448+0000","last_undegraded":"2023-07-12T02:04:03.706448+0000","last_fullsized":"2023-07-12T02:04:03.706448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:06.990537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707239+0000","last_change":"2023-07-12T02:03:57.141396+0000","last_active":"2023-07-12T02:04:03.707239+0000","last_peered":"2023-07-12T02:04:03.707239+0000","last_clean":"2023-07-12T02:04:03.707239+0000","last_became_active":"2023-07-12T02:03:57.141107+0000","last_became_peered":"2023-07-12T02:03:57.141107+0000","last_unstale":"2023-07-12T02:04:03.707239+0000","last_undegraded":"2023-07-12T02:04:03.707239+0000","last_fullsized":"2023-07-12T02:04:03.707239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:04.236723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707745+0000","last_change":"2023-07-12T02:03:58.159883+0000","last_active":"2023-07-12T02:04:03.707745+0000","last_peered":"2023-07-12T02:04:03.707745+0000","last_clean":"2023-07-12T02:04:03.707745+0000","last_became_active":"2023-07-12T02:03:58.159572+0000","last_became_peered":"2023-07-12T02:03:58.159572+0000","last_unstale":"2023-07-12T02:04:03.707745+0000","last_undegraded":"2023-07-12T02:04:03.707745+0000","last_fullsized":"2023-07-12T02:04:03.707745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:44:58.898911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171927+0000","last_change":"2023-07-12T02:04:02.205064+0000","last_active":"2023-07-12T02:04:03.171927+0000","last_peered":"2023-07-12T02:04:03.171927+0000","last_clean":"2023-07-12T02:04:03.171927+0000","last_became_active":"2023-07-12T02:04:02.204597+0000","last_became_peered":"2023-07-12T02:04:02.204597+0000","last_unstale":"2023-07-12T02:04:03.171927+0000","last_undegraded":"2023-07-12T02:04:03.171927+0000","last_fullsized":"2023-07-12T02:04:03.171927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:04:41.043396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706758+0000","last_change":"2023-07-12T02:03:51.909547+0000","last_active":"2023-07-12T02:04:03.706758+0000","last_peered":"2023-07-12T02:04:03.706758+0000","last_clean":"2023-07-12T02:04:03.706758+0000","last_became_active":"2023-07-12T02:03:51.909159+0000","last_became_peered":"2023-07-12T02:03:51.909159+0000","last_unstale":"2023-07-12T02:04:03.706758+0000","last_undegraded":"2023-07-12T02:04:03.706758+0000","last_fullsized":"2023-07-12T02:04:03.706758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:33.734016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173368+0000","last_change":"2023-07-12T02:03:57.150988+0000","last_active":"2023-07-12T02:04:03.173368+0000","last_peered":"2023-07-12T02:04:03.173368+0000","last_clean":"2023-07-12T02:04:03.173368+0000","last_became_active":"2023-07-12T02:03:57.150659+0000","last_became_peered":"2023-07-12T02:03:57.150659+0000","last_unstale":"2023-07-12T02:04:03.173368+0000","last_undegraded":"2023-07-12T02:04:03.173368+0000","last_fullsized":"2023-07-12T02:04:03.173368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:07:48.765025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706282+0000","last_change":"2023-07-12T02:03:58.163335+0000","last_active":"2023-07-12T02:04:03.706282+0000","last_peered":"2023-07-12T02:04:03.706282+0000","last_clean":"2023-07-12T02:04:03.706282+0000","last_became_active":"2023-07-12T02:03:58.163047+0000","last_became_peered":"2023-07-12T02:03:58.163047+0000","last_unstale":"2023-07-12T02:04:03.706282+0000","last_undegraded":"2023-07-12T02:04:03.706282+0000","last_fullsized":"2023-07-12T02:04:03.706282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:53:40.589737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174096+0000","last_change":"2023-07-12T02:04:02.191793+0000","last_active":"2023-07-12T02:04:03.174096+0000","last_peered":"2023-07-12T02:04:03.174096+0000","last_clean":"2023-07-12T02:04:03.174096+0000","last_became_active":"2023-07-12T02:04:02.191370+0000","last_became_peered":"2023-07-12T02:04:02.191370+0000","last_unstale":"2023-07-12T02:04:03.174096+0000","last_undegraded":"2023-07-12T02:04:03.174096+0000","last_fullsized":"2023-07-12T02:04:03.174096+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:49:03.729087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173175+0000","last_change":"2023-07-12T02:03:51.904989+0000","last_active":"2023-07-12T02:04:03.173175+0000","last_peered":"2023-07-12T02:04:03.173175+0000","last_clean":"2023-07-12T02:04:03.173175+0000","last_became_active":"2023-07-12T02:03:51.904497+0000","last_became_peered":"2023-07-12T02:03:51.904497+0000","last_unstale":"2023-07-12T02:04:03.173175+0000","last_undegraded":"2023-07-12T02:04:03.173175+0000","last_fullsized":"2023-07-12T02:04:03.173175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:51:27.688647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706336+0000","last_change":"2023-07-12T02:03:57.141921+0000","last_active":"2023-07-12T02:04:03.706336+0000","last_peered":"2023-07-12T02:04:03.706336+0000","last_clean":"2023-07-12T02:04:03.706336+0000","last_became_active":"2023-07-12T02:03:57.141617+0000","last_became_peered":"2023-07-12T02:03:57.141617+0000","last_unstale":"2023-07-12T02:04:03.706336+0000","last_undegraded":"2023-07-12T02:04:03.706336+0000","last_fullsized":"2023-07-12T02:04:03.706336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:57:56.465849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706855+0000","last_change":"2023-07-12T02:03:58.167642+0000","last_active":"2023-07-12T02:04:03.706855+0000","last_peered":"2023-07-12T02:04:03.706855+0000","last_clean":"2023-07-12T02:04:03.706855+0000","last_became_active":"2023-07-12T02:03:58.166984+0000","last_became_peered":"2023-07-12T02:03:58.166984+0000","last_unstale":"2023-07-12T02:04:03.706855+0000","last_undegraded":"2023-07-12T02:04:03.706855+0000","last_fullsized":"2023-07-12T02:04:03.706855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:52.656557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589980+0000","last_change":"2023-07-12T02:04:02.198255+0000","last_active":"2023-07-12T02:04:03.589980+0000","last_peered":"2023-07-12T02:04:03.589980+0000","last_clean":"2023-07-12T02:04:03.589980+0000","last_became_active":"2023-07-12T02:04:02.197843+0000","last_became_peered":"2023-07-12T02:04:02.197843+0000","last_unstale":"2023-07-12T02:04:03.589980+0000","last_undegraded":"2023-07-12T02:04:03.589980+0000","last_fullsized":"2023-07-12T02:04:03.589980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:58:21.161390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707028+0000","last_change":"2023-07-12T02:03:51.909324+0000","last_active":"2023-07-12T02:04:03.707028+0000","last_peered":"2023-07-12T02:04:03.707028+0000","last_clean":"2023-07-12T02:04:03.707028+0000","last_became_active":"2023-07-12T02:03:51.908982+0000","last_became_peered":"2023-07-12T02:03:51.908982+0000","last_unstale":"2023-07-12T02:04:03.707028+0000","last_undegraded":"2023-07-12T02:04:03.707028+0000","last_fullsized":"2023-07-12T02:04:03.707028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:31.138300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589719+0000","last_change":"2023-07-12T02:03:44.783225+0000","last_active":"2023-07-12T02:04:03.589719+0000","last_peered":"2023-07-12T02:04:03.589719+0000","last_clean":"2023-07-12T02:04:03.589719+0000","last_became_active":"2023-07-12T02:03:44.782048+0000","last_became_peered":"2023-07-12T02:03:44.782048+0000","last_unstale":"2023-07-12T02:04:03.589719+0000","last_undegraded":"2023-07-12T02:04:03.589719+0000","last_fullsized":"2023-07-12T02:04:03.589719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:43.565472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:43.565472+0000","last_clean_scrub_stamp":"2023-07-12T02:03:43.565472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:08.293722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707366+0000","last_change":"2023-07-12T02:03:57.139490+0000","last_active":"2023-07-12T02:04:03.707366+0000","last_peered":"2023-07-12T02:04:03.707366+0000","last_clean":"2023-07-12T02:04:03.707366+0000","last_became_active":"2023-07-12T02:03:57.139072+0000","last_became_peered":"2023-07-12T02:03:57.139072+0000","last_unstale":"2023-07-12T02:04:03.707366+0000","last_undegraded":"2023-07-12T02:04:03.707366+0000","last_fullsized":"2023-07-12T02:04:03.707366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:38:29.157627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707565+0000","last_change":"2023-07-12T02:03:58.154809+0000","last_active":"2023-07-12T02:04:03.707565+0000","last_peered":"2023-07-12T02:04:03.707565+0000","last_clean":"2023-07-12T02:04:03.707565+0000","last_became_active":"2023-07-12T02:03:58.154559+0000","last_became_peered":"2023-07-12T02:03:58.154559+0000","last_unstale":"2023-07-12T02:04:03.707565+0000","last_undegraded":"2023-07-12T02:04:03.707565+0000","last_fullsized":"2023-07-12T02:04:03.707565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:46:33.480535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707383+0000","last_change":"2023-07-12T02:04:02.197503+0000","last_active":"2023-07-12T02:04:03.707383+0000","last_peered":"2023-07-12T02:04:03.707383+0000","last_clean":"2023-07-12T02:04:03.707383+0000","last_became_active":"2023-07-12T02:04:02.197064+0000","last_became_peered":"2023-07-12T02:04:02.197064+0000","last_unstale":"2023-07-12T02:04:03.707383+0000","last_undegraded":"2023-07-12T02:04:03.707383+0000","last_fullsized":"2023-07-12T02:04:03.707383+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:18.923707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590089+0000","last_change":"2023-07-12T02:03:51.909395+0000","last_active":"2023-07-12T02:04:03.590089+0000","last_peered":"2023-07-12T02:04:03.590089+0000","last_clean":"2023-07-12T02:04:03.590089+0000","last_became_active":"2023-07-12T02:03:51.909125+0000","last_became_peered":"2023-07-12T02:03:51.909125+0000","last_unstale":"2023-07-12T02:04:03.590089+0000","last_undegraded":"2023-07-12T02:04:03.590089+0000","last_fullsized":"2023-07-12T02:04:03.590089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:15:15.169698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171436+0000","last_change":"2023-07-12T02:03:57.150059+0000","last_active":"2023-07-12T02:04:03.171436+0000","last_peered":"2023-07-12T02:04:03.171436+0000","last_clean":"2023-07-12T02:04:03.171436+0000","last_became_active":"2023-07-12T02:03:57.149751+0000","last_became_peered":"2023-07-12T02:03:57.149751+0000","last_unstale":"2023-07-12T02:04:03.171436+0000","last_undegraded":"2023-07-12T02:04:03.171436+0000","last_fullsized":"2023-07-12T02:04:03.171436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:53:41.149722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172171+0000","last_change":"2023-07-12T02:03:58.168413+0000","last_active":"2023-07-12T02:04:03.172171+0000","last_peered":"2023-07-12T02:04:03.172171+0000","last_clean":"2023-07-12T02:04:03.172171+0000","last_became_active":"2023-07-12T02:03:58.168106+0000","last_became_peered":"2023-07-12T02:03:58.168106+0000","last_unstale":"2023-07-12T02:04:03.172171+0000","last_undegraded":"2023-07-12T02:04:03.172171+0000","last_fullsized":"2023-07-12T02:04:03.172171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:52.156977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707401+0000","last_change":"2023-07-12T02:04:02.197727+0000","last_active":"2023-07-12T02:04:03.707401+0000","last_peered":"2023-07-12T02:04:03.707401+0000","last_clean":"2023-07-12T02:04:03.707401+0000","last_became_active":"2023-07-12T02:04:02.197340+0000","last_became_peered":"2023-07-12T02:04:02.197340+0000","last_unstale":"2023-07-12T02:04:03.707401+0000","last_undegraded":"2023-07-12T02:04:03.707401+0000","last_fullsized":"2023-07-12T02:04:03.707401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:01:54.191121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590364+0000","last_change":"2023-07-12T02:03:52.304880+0000","last_active":"2023-07-12T02:04:03.590364+0000","last_peered":"2023-07-12T02:04:03.590364+0000","last_clean":"2023-07-12T02:04:03.590364+0000","last_became_active":"2023-07-12T02:03:52.304598+0000","last_became_peered":"2023-07-12T02:03:52.304598+0000","last_unstale":"2023-07-12T02:04:03.590364+0000","last_undegraded":"2023-07-12T02:04:03.590364+0000","last_fullsized":"2023-07-12T02:04:03.590364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:30:38.554090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706579+0000","last_change":"2023-07-12T02:03:57.134671+0000","last_active":"2023-07-12T02:04:03.706579+0000","last_peered":"2023-07-12T02:04:03.706579+0000","last_clean":"2023-07-12T02:04:03.706579+0000","last_became_active":"2023-07-12T02:03:57.134319+0000","last_became_peered":"2023-07-12T02:03:57.134319+0000","last_unstale":"2023-07-12T02:04:03.706579+0000","last_undegraded":"2023-07-12T02:04:03.706579+0000","last_fullsized":"2023-07-12T02:04:03.706579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:21.026700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172428+0000","last_change":"2023-07-12T02:03:58.158643+0000","last_active":"2023-07-12T02:04:03.172428+0000","last_peered":"2023-07-12T02:04:03.172428+0000","last_clean":"2023-07-12T02:04:03.172428+0000","last_became_active":"2023-07-12T02:03:58.158356+0000","last_became_peered":"2023-07-12T02:03:58.158356+0000","last_unstale":"2023-07-12T02:04:03.172428+0000","last_undegraded":"2023-07-12T02:04:03.172428+0000","last_fullsized":"2023-07-12T02:04:03.172428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:37:27.430690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173232+0000","last_change":"2023-07-12T02:04:02.198751+0000","last_active":"2023-07-12T02:04:03.173232+0000","last_peered":"2023-07-12T02:04:03.173232+0000","last_clean":"2023-07-12T02:04:03.173232+0000","last_became_active":"2023-07-12T02:04:02.198369+0000","last_became_peered":"2023-07-12T02:04:02.198369+0000","last_unstale":"2023-07-12T02:04:03.173232+0000","last_undegraded":"2023-07-12T02:04:03.173232+0000","last_fullsized":"2023-07-12T02:04:03.173232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:36:39.188205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707404+0000","last_change":"2023-07-12T02:03:57.140454+0000","last_active":"2023-07-12T02:04:03.707404+0000","last_peered":"2023-07-12T02:04:03.707404+0000","last_clean":"2023-07-12T02:04:03.707404+0000","last_became_active":"2023-07-12T02:03:57.140085+0000","last_became_peered":"2023-07-12T02:03:57.140085+0000","last_unstale":"2023-07-12T02:04:03.707404+0000","last_undegraded":"2023-07-12T02:04:03.707404+0000","last_fullsized":"2023-07-12T02:04:03.707404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:31:40.528381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706901+0000","last_change":"2023-07-12T02:03:51.906406+0000","last_active":"2023-07-12T02:04:03.706901+0000","last_peered":"2023-07-12T02:04:03.706901+0000","last_clean":"2023-07-12T02:04:03.706901+0000","last_became_active":"2023-07-12T02:03:51.905875+0000","last_became_peered":"2023-07-12T02:03:51.905875+0000","last_unstale":"2023-07-12T02:04:03.706901+0000","last_undegraded":"2023-07-12T02:04:03.706901+0000","last_fullsized":"2023-07-12T02:04:03.706901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:33.734016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.705982+0000","last_change":"2023-07-12T02:03:58.156488+0000","last_active":"2023-07-12T02:04:03.705982+0000","last_peered":"2023-07-12T02:04:03.705982+0000","last_clean":"2023-07-12T02:04:03.705982+0000","last_became_active":"2023-07-12T02:03:58.155960+0000","last_became_peered":"2023-07-12T02:03:58.155960+0000","last_unstale":"2023-07-12T02:04:03.705982+0000","last_undegraded":"2023-07-12T02:04:03.705982+0000","last_fullsized":"2023-07-12T02:04:03.705982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:37.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.705926+0000","last_change":"2023-07-12T02:04:02.198638+0000","last_active":"2023-07-12T02:04:03.705926+0000","last_peered":"2023-07-12T02:04:03.705926+0000","last_clean":"2023-07-12T02:04:03.705926+0000","last_became_active":"2023-07-12T02:04:02.198244+0000","last_became_peered":"2023-07-12T02:04:02.198244+0000","last_unstale":"2023-07-12T02:04:03.705926+0000","last_undegraded":"2023-07-12T02:04:03.705926+0000","last_fullsized":"2023-07-12T02:04:03.705926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:44.001444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.708048+0000","last_change":"2023-07-12T02:03:51.908137+0000","last_active":"2023-07-12T02:04:03.708048+0000","last_peered":"2023-07-12T02:04:03.708048+0000","last_clean":"2023-07-12T02:04:03.708048+0000","last_became_active":"2023-07-12T02:03:51.907900+0000","last_became_peered":"2023-07-12T02:03:51.907900+0000","last_unstale":"2023-07-12T02:04:03.708048+0000","last_undegraded":"2023-07-12T02:04:03.708048+0000","last_fullsized":"2023-07-12T02:04:03.708048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:04:38.301609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171901+0000","last_change":"2023-07-12T02:03:57.148723+0000","last_active":"2023-07-12T02:04:03.171901+0000","last_peered":"2023-07-12T02:04:03.171901+0000","last_clean":"2023-07-12T02:04:03.171901+0000","last_became_active":"2023-07-12T02:03:57.148402+0000","last_became_peered":"2023-07-12T02:03:57.148402+0000","last_unstale":"2023-07-12T02:04:03.171901+0000","last_undegraded":"2023-07-12T02:04:03.171901+0000","last_fullsized":"2023-07-12T02:04:03.171901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:51.649402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172813+0000","last_change":"2023-07-12T02:03:58.146752+0000","last_active":"2023-07-12T02:04:03.172813+0000","last_peered":"2023-07-12T02:04:03.172813+0000","last_clean":"2023-07-12T02:04:03.172813+0000","last_became_active":"2023-07-12T02:03:58.146475+0000","last_became_peered":"2023-07-12T02:03:58.146475+0000","last_unstale":"2023-07-12T02:04:03.172813+0000","last_undegraded":"2023-07-12T02:04:03.172813+0000","last_fullsized":"2023-07-12T02:04:03.172813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:18.127189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707349+0000","last_change":"2023-07-12T02:04:02.197112+0000","last_active":"2023-07-12T02:04:03.707349+0000","last_peered":"2023-07-12T02:04:03.707349+0000","last_clean":"2023-07-12T02:04:03.707349+0000","last_became_active":"2023-07-12T02:04:02.196665+0000","last_became_peered":"2023-07-12T02:04:02.196665+0000","last_unstale":"2023-07-12T02:04:03.707349+0000","last_undegraded":"2023-07-12T02:04:03.707349+0000","last_fullsized":"2023-07-12T02:04:03.707349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:25.882427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172383+0000","last_change":"2023-07-12T02:03:57.149946+0000","last_active":"2023-07-12T02:04:03.172383+0000","last_peered":"2023-07-12T02:04:03.172383+0000","last_clean":"2023-07-12T02:04:03.172383+0000","last_became_active":"2023-07-12T02:03:57.149707+0000","last_became_peered":"2023-07-12T02:03:57.149707+0000","last_unstale":"2023-07-12T02:04:03.172383+0000","last_undegraded":"2023-07-12T02:04:03.172383+0000","last_fullsized":"2023-07-12T02:04:03.172383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:13.872319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173635+0000","last_change":"2023-07-12T02:03:58.153412+0000","last_active":"2023-07-12T02:04:03.173635+0000","last_peered":"2023-07-12T02:04:03.173635+0000","last_clean":"2023-07-12T02:04:03.173635+0000","last_became_active":"2023-07-12T02:03:58.153116+0000","last_became_peered":"2023-07-12T02:03:58.153116+0000","last_unstale":"2023-07-12T02:04:03.173635+0000","last_undegraded":"2023-07-12T02:04:03.173635+0000","last_fullsized":"2023-07-12T02:04:03.173635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:37:03.495726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590052+0000","last_change":"2023-07-12T02:04:02.192659+0000","last_active":"2023-07-12T02:04:03.590052+0000","last_peered":"2023-07-12T02:04:03.590052+0000","last_clean":"2023-07-12T02:04:03.590052+0000","last_became_active":"2023-07-12T02:04:02.192139+0000","last_became_peered":"2023-07-12T02:04:02.192139+0000","last_unstale":"2023-07-12T02:04:03.590052+0000","last_undegraded":"2023-07-12T02:04:03.590052+0000","last_fullsized":"2023-07-12T02:04:03.590052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:18.923707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707093+0000","last_change":"2023-07-12T02:03:57.140042+0000","last_active":"2023-07-12T02:04:03.707093+0000","last_peered":"2023-07-12T02:04:03.707093+0000","last_clean":"2023-07-12T02:04:03.707093+0000","last_became_active":"2023-07-12T02:03:57.139652+0000","last_became_peered":"2023-07-12T02:03:57.139652+0000","last_unstale":"2023-07-12T02:04:03.707093+0000","last_undegraded":"2023-07-12T02:04:03.707093+0000","last_fullsized":"2023-07-12T02:04:03.707093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:51.149821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173207+0000","last_change":"2023-07-12T02:03:58.152883+0000","last_active":"2023-07-12T02:04:03.173207+0000","last_peered":"2023-07-12T02:04:03.173207+0000","last_clean":"2023-07-12T02:04:03.173207+0000","last_became_active":"2023-07-12T02:03:58.152591+0000","last_became_peered":"2023-07-12T02:03:58.152591+0000","last_unstale":"2023-07-12T02:04:03.173207+0000","last_undegraded":"2023-07-12T02:04:03.173207+0000","last_fullsized":"2023-07-12T02:04:03.173207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:07:57.297802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707002+0000","last_change":"2023-07-12T02:04:02.198913+0000","last_active":"2023-07-12T02:04:03.707002+0000","last_peered":"2023-07-12T02:04:03.707002+0000","last_clean":"2023-07-12T02:04:03.707002+0000","last_became_active":"2023-07-12T02:04:02.198553+0000","last_became_peered":"2023-07-12T02:04:02.198553+0000","last_unstale":"2023-07-12T02:04:03.707002+0000","last_undegraded":"2023-07-12T02:04:03.707002+0000","last_fullsized":"2023-07-12T02:04:03.707002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:45:02.943144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707838+0000","last_change":"2023-07-12T02:03:57.136048+0000","last_active":"2023-07-12T02:04:03.707838+0000","last_peered":"2023-07-12T02:04:03.707838+0000","last_clean":"2023-07-12T02:04:03.707838+0000","last_became_active":"2023-07-12T02:03:57.135728+0000","last_became_peered":"2023-07-12T02:03:57.135728+0000","last_unstale":"2023-07-12T02:04:03.707838+0000","last_undegraded":"2023-07-12T02:04:03.707838+0000","last_fullsized":"2023-07-12T02:04:03.707838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:19:50.614981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172897+0000","last_change":"2023-07-12T02:03:58.151134+0000","last_active":"2023-07-12T02:04:03.172897+0000","last_peered":"2023-07-12T02:04:03.172897+0000","last_clean":"2023-07-12T02:04:03.172897+0000","last_became_active":"2023-07-12T02:03:58.150880+0000","last_became_peered":"2023-07-12T02:03:58.150880+0000","last_unstale":"2023-07-12T02:04:03.172897+0000","last_undegraded":"2023-07-12T02:04:03.172897+0000","last_fullsized":"2023-07-12T02:04:03.172897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:04:26.740269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172701+0000","last_change":"2023-07-12T02:04:02.195039+0000","last_active":"2023-07-12T02:04:03.172701+0000","last_peered":"2023-07-12T02:04:03.172701+0000","last_clean":"2023-07-12T02:04:03.172701+0000","last_became_active":"2023-07-12T02:04:02.194199+0000","last_became_peered":"2023-07-12T02:04:02.194199+0000","last_unstale":"2023-07-12T02:04:03.172701+0000","last_undegraded":"2023-07-12T02:04:03.172701+0000","last_fullsized":"2023-07-12T02:04:03.172701+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:31:45.579769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706482+0000","last_change":"2023-07-12T02:03:57.135710+0000","last_active":"2023-07-12T02:04:03.706482+0000","last_peered":"2023-07-12T02:04:03.706482+0000","last_clean":"2023-07-12T02:04:03.706482+0000","last_became_active":"2023-07-12T02:03:57.135435+0000","last_became_peered":"2023-07-12T02:03:57.135435+0000","last_unstale":"2023-07-12T02:04:03.706482+0000","last_undegraded":"2023-07-12T02:04:03.706482+0000","last_fullsized":"2023-07-12T02:04:03.706482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:58:16.110002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706668+0000","last_change":"2023-07-12T02:03:58.150539+0000","last_active":"2023-07-12T02:04:03.706668+0000","last_peered":"2023-07-12T02:04:03.706668+0000","last_clean":"2023-07-12T02:04:03.706668+0000","last_became_active":"2023-07-12T02:03:58.150195+0000","last_became_peered":"2023-07-12T02:03:58.150195+0000","last_unstale":"2023-07-12T02:04:03.706668+0000","last_undegraded":"2023-07-12T02:04:03.706668+0000","last_fullsized":"2023-07-12T02:04:03.706668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:14.879474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706643+0000","last_change":"2023-07-12T02:04:02.198230+0000","last_active":"2023-07-12T02:04:03.706643+0000","last_peered":"2023-07-12T02:04:03.706643+0000","last_clean":"2023-07-12T02:04:03.706643+0000","last_became_active":"2023-07-12T02:04:02.197796+0000","last_became_peered":"2023-07-12T02:04:02.197796+0000","last_unstale":"2023-07-12T02:04:03.706643+0000","last_undegraded":"2023-07-12T02:04:03.706643+0000","last_fullsized":"2023-07-12T02:04:03.706643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:53:46.201110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172259+0000","last_change":"2023-07-12T02:03:57.148075+0000","last_active":"2023-07-12T02:04:03.172259+0000","last_peered":"2023-07-12T02:04:03.172259+0000","last_clean":"2023-07-12T02:04:03.172259+0000","last_became_active":"2023-07-12T02:03:57.147809+0000","last_became_peered":"2023-07-12T02:03:57.147809+0000","last_unstale":"2023-07-12T02:04:03.172259+0000","last_undegraded":"2023-07-12T02:04:03.172259+0000","last_fullsized":"2023-07-12T02:04:03.172259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:04.236723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173070+0000","last_change":"2023-07-12T02:03:58.146147+0000","last_active":"2023-07-12T02:04:03.173070+0000","last_peered":"2023-07-12T02:04:03.173070+0000","last_clean":"2023-07-12T02:04:03.173070+0000","last_became_active":"2023-07-12T02:03:58.145855+0000","last_became_peered":"2023-07-12T02:03:58.145855+0000","last_unstale":"2023-07-12T02:04:03.173070+0000","last_undegraded":"2023-07-12T02:04:03.173070+0000","last_fullsized":"2023-07-12T02:04:03.173070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:54:10.220081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706812+0000","last_change":"2023-07-12T02:03:58.165263+0000","last_active":"2023-07-12T02:04:03.706812+0000","last_peered":"2023-07-12T02:04:03.706812+0000","last_clean":"2023-07-12T02:04:03.706812+0000","last_became_active":"2023-07-12T02:03:58.164980+0000","last_became_peered":"2023-07-12T02:03:58.164980+0000","last_unstale":"2023-07-12T02:04:03.706812+0000","last_undegraded":"2023-07-12T02:04:03.706812+0000","last_fullsized":"2023-07-12T02:04:03.706812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:30:32.214383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706936+0000","last_change":"2023-07-12T02:03:58.166005+0000","last_active":"2023-07-12T02:04:03.706936+0000","last_peered":"2023-07-12T02:04:03.706936+0000","last_clean":"2023-07-12T02:04:03.706936+0000","last_became_active":"2023-07-12T02:03:58.165718+0000","last_became_peered":"2023-07-12T02:03:58.165718+0000","last_unstale":"2023-07-12T02:04:03.706936+0000","last_undegraded":"2023-07-12T02:04:03.706936+0000","last_fullsized":"2023-07-12T02:04:03.706936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:29.024675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173193+0000","last_change":"2023-07-12T02:03:58.145894+0000","last_active":"2023-07-12T02:04:03.173193+0000","last_peered":"2023-07-12T02:04:03.173193+0000","last_clean":"2023-07-12T02:04:03.173193+0000","last_became_active":"2023-07-12T02:03:58.145442+0000","last_became_peered":"2023-07-12T02:03:58.145442+0000","last_unstale":"2023-07-12T02:04:03.173193+0000","last_undegraded":"2023-07-12T02:04:03.173193+0000","last_fullsized":"2023-07-12T02:04:03.173193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:52:53.582391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707166+0000","last_change":"2023-07-12T02:03:58.156685+0000","last_active":"2023-07-12T02:04:03.707166+0000","last_peered":"2023-07-12T02:04:03.707166+0000","last_clean":"2023-07-12T02:04:03.707166+0000","last_became_active":"2023-07-12T02:03:58.156127+0000","last_became_peered":"2023-07-12T02:03:58.156127+0000","last_unstale":"2023-07-12T02:04:03.707166+0000","last_undegraded":"2023-07-12T02:04:03.707166+0000","last_fullsized":"2023-07-12T02:04:03.707166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:30:44.777286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706873+0000","last_change":"2023-07-12T02:03:58.159307+0000","last_active":"2023-07-12T02:04:03.706873+0000","last_peered":"2023-07-12T02:04:03.706873+0000","last_clean":"2023-07-12T02:04:03.706873+0000","last_became_active":"2023-07-12T02:03:58.158898+0000","last_became_peered":"2023-07-12T02:03:58.158898+0000","last_unstale":"2023-07-12T02:04:03.706873+0000","last_undegraded":"2023-07-12T02:04:03.706873+0000","last_fullsized":"2023-07-12T02:04:03.706873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:04:36.999164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":884736,"data_stored":709832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.113}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.911}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2109999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.839}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-12T02:04:33.258 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-12T02:04:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.486+0000 7fa5915ff700 1 Processor -- start 2023-07-12T02:04:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.487+0000 7fa5915ff700 1 -- start start 2023-07-12T02:04:33.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.488+0000 7fa5915ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa58c15c460 0x7fa58c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.488+0000 7fa5915ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa58c0cf8f0 0x7fa58c15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.488+0000 7fa5915ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58c0d1790 con 0x7fa58c0d2640 2023-07-12T02:04:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.488+0000 7fa5915ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa58c0cedd0 con 0x7fa58c0cf8f0 2023-07-12T02:04:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.488+0000 7fa5915ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c0cd950 con 0x7fa58c15c460 2023-07-12T02:04:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.488+0000 7fa58affd700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa58c15c460 0x7fa58c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.489+0000 7fa58b7fe700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa58c0cf8f0 0x7fa58c15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.489+0000 7fa58a7fc700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fa58c0d2640 0x7fa58c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:54632/0 (socket says 172.21.15.37:54632) 2023-07-12T02:04:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.489+0000 7fa58a7fc700 1 -- 172.21.15.37:0/4172434627 learned_addr learned my addr 172.21.15.37:0/4172434627 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.489+0000 7fa58b7fe700 1 -- 172.21.15.37:0/4172434627 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa58c15c460 msgr2=0x7fa58c0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.489+0000 7fa58b7fe700 1 --2- 172.21.15.37:0/4172434627 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa58c15c460 0x7fa58c0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.489+0000 7fa58b7fe700 1 -- 172.21.15.37:0/4172434627 >> v1:172.21.15.196:6789/0 conn(0x7fa58c0d2640 legacy=0x7fa58c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.489+0000 7fa58b7fe700 1 -- 172.21.15.37:0/4172434627 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c0d14b0 con 0x7fa58c0cf8f0 2023-07-12T02:04:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.489+0000 7fa58b7fe700 1 --2- 172.21.15.37:0/4172434627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa58c0cf8f0 0x7fa58c15fe20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa584009d90 tx=0x7fa58400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc469d288ed7f585 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:33.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.490+0000 7fa589ffb700 1 -- 172.21.15.37:0/4172434627 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58400e070 con 0x7fa58c0cf8f0 2023-07-12T02:04:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.490+0000 7fa589ffb700 1 -- 172.21.15.37:0/4172434627 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58400bb20 con 0x7fa58c0cf8f0 2023-07-12T02:04:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.490+0000 7fa589ffb700 1 -- 172.21.15.37:0/4172434627 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa584012430 con 0x7fa58c0cf8f0 2023-07-12T02:04:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.490+0000 7fa5915ff700 1 -- 172.21.15.37:0/4172434627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa58c0cf8f0 msgr2=0x7fa58c15fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.490+0000 7fa5915ff700 1 --2- 172.21.15.37:0/4172434627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa58c0cf8f0 0x7fa58c15fe20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa584009d90 tx=0x7fa58400b330 comp rx=0 tx=0).stop 2023-07-12T02:04:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.490+0000 7fa5915ff700 1 -- 172.21.15.37:0/4172434627 shutdown_connections 2023-07-12T02:04:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.490+0000 7fa5915ff700 1 --2- 172.21.15.37:0/4172434627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa58c0cf8f0 0x7fa58c15fe20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.490+0000 7fa5915ff700 1 --2- 172.21.15.37:0/4172434627 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa58c15c460 0x7fa58c0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.490+0000 7fa5915ff700 1 -- 172.21.15.37:0/4172434627 >> 172.21.15.37:0/4172434627 conn(0x7fa58c071660 msgr2=0x7fa58c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.490+0000 7fa5915ff700 1 -- 172.21.15.37:0/4172434627 shutdown_connections 2023-07-12T02:04:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.490+0000 7fa5915ff700 1 -- 172.21.15.37:0/4172434627 wait complete. 2023-07-12T02:04:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.492+0000 7fa5915ff700 1 Processor -- start 2023-07-12T02:04:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.492+0000 7fa5915ff700 1 -- start start 2023-07-12T02:04:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.493+0000 7fa5915ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c0cf8f0 0x7fa58c0ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.493+0000 7fa5915ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa58c0d2640 0x7fa58c144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.493+0000 7fa5915ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa58c15c460 0x7fa58c1446b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.493+0000 7fa5915ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c0c8140 con 0x7fa58c0cf8f0 2023-07-12T02:04:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.493+0000 7fa5915ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c0ca710 con 0x7fa58c0d2640 2023-07-12T02:04:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.493+0000 7fa5915ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c1426b0 con 0x7fa58c15c460 2023-07-12T02:04:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.494+0000 7fa58affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c0cf8f0 0x7fa58c0ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.494+0000 7fa58affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c0cf8f0 0x7fa58c0ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35428/0 (socket says 172.21.15.37:35428) 2023-07-12T02:04:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.494+0000 7fa58affd700 1 -- 172.21.15.37:0/3101246111 learned_addr learned my addr 172.21.15.37:0/3101246111 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.494+0000 7fa58b7fe700 1 --2- 172.21.15.37:0/3101246111 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa58c15c460 0x7fa58c1446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.494+0000 7fa58a7fc700 1 --2- 172.21.15.37:0/3101246111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa58c0d2640 0x7fa58c144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.494+0000 7fa58affd700 1 -- 172.21.15.37:0/3101246111 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa58c15c460 msgr2=0x7fa58c1446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.494+0000 7fa58affd700 1 --2- 172.21.15.37:0/3101246111 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa58c15c460 0x7fa58c1446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.494+0000 7fa58affd700 1 -- 172.21.15.37:0/3101246111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa58c0d2640 msgr2=0x7fa58c144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.494+0000 7fa58affd700 1 --2- 172.21.15.37:0/3101246111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa58c0d2640 0x7fa58c144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.494+0000 7fa58affd700 1 -- 172.21.15.37:0/3101246111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa584009a70 con 0x7fa58c0cf8f0 2023-07-12T02:04:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.494+0000 7fa58affd700 1 --2- 172.21.15.37:0/3101246111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c0cf8f0 0x7fa58c0ca1d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00e9b0 tx=0x7fa57c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.495+0000 7fa5737fe700 1 -- 172.21.15.37:0/3101246111 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c009710 con 0x7fa58c0cf8f0 2023-07-12T02:04:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.495+0000 7fa5737fe700 1 -- 172.21.15.37:0/3101246111 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c00ee50 con 0x7fa58c0cf8f0 2023-07-12T02:04:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.495+0000 7fa5737fe700 1 -- 172.21.15.37:0/3101246111 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c00ca50 con 0x7fa58c0cf8f0 2023-07-12T02:04:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.495+0000 7fa5915ff700 1 -- 172.21.15.37:0/3101246111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58c15bc80 con 0x7fa58c0cf8f0 2023-07-12T02:04:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.495+0000 7fa5915ff700 1 -- 172.21.15.37:0/3101246111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58c0c7a80 con 0x7fa58c0cf8f0 2023-07-12T02:04:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.496+0000 7fa5915ff700 1 -- 172.21.15.37:0/3101246111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58c04ea60 con 0x7fa58c0cf8f0 2023-07-12T02:04:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.497+0000 7fa5737fe700 1 -- 172.21.15.37:0/3101246111 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa57c00cbb0 con 0x7fa58c0cf8f0 2023-07-12T02:04:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.498+0000 7fa5737fe700 1 --2- 172.21.15.37:0/3101246111 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa57806ace0 0x7fa57806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.498+0000 7fa5737fe700 1 -- 172.21.15.37:0/3101246111 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa57c0897a0 con 0x7fa58c0cf8f0 2023-07-12T02:04:33.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.498+0000 7fa58a7fc700 1 --2- 172.21.15.37:0/3101246111 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa57806ace0 0x7fa57806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.499+0000 7fa58a7fc700 1 --2- 172.21.15.37:0/3101246111 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa57806ace0 0x7fa57806d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0cf5e0 tx=0x7fa580009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:33.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.502+0000 7fa5737fe700 1 -- 172.21.15.37:0/3101246111 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa57c057fe0 con 0x7fa58c0cf8f0 2023-07-12T02:04:33.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.701+0000 7fa5915ff700 1 -- 172.21.15.37:0/3101246111 --> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa58c0cd5e0 con 0x7fa57806ace0 2023-07-12T02:04:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.713+0000 7fa5737fe700 1 -- 172.21.15.37:0/3101246111 <== mgr.4099 v2:172.21.15.196:6832/3490435896 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367383 (secure 0 0 0) 0x7fa580001ce0 con 0x7fa57806ace0 2023-07-12T02:04:33.720 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.717+0000 7fa5915ff700 1 -- 172.21.15.37:0/3101246111 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa57806ace0 msgr2=0x7fa57806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.717+0000 7fa5915ff700 1 --2- 172.21.15.37:0/3101246111 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa57806ace0 0x7fa57806d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0cf5e0 tx=0x7fa580009040 comp rx=0 tx=0).stop 2023-07-12T02:04:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.717+0000 7fa5915ff700 1 -- 172.21.15.37:0/3101246111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c0cf8f0 msgr2=0x7fa58c0ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.717+0000 7fa5915ff700 1 --2- 172.21.15.37:0/3101246111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c0cf8f0 0x7fa58c0ca1d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00e9b0 tx=0x7fa57c00ecc0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.717+0000 7fa5915ff700 1 -- 172.21.15.37:0/3101246111 shutdown_connections 2023-07-12T02:04:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.717+0000 7fa5915ff700 1 --2- 172.21.15.37:0/3101246111 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa57806ace0 0x7fa57806d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.717+0000 7fa5915ff700 1 --2- 172.21.15.37:0/3101246111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c0cf8f0 0x7fa58c0ca1d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.717+0000 7fa5915ff700 1 --2- 172.21.15.37:0/3101246111 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa58c15c460 0x7fa58c1446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.717+0000 7fa5915ff700 1 --2- 172.21.15.37:0/3101246111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa58c0d2640 0x7fa58c144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.717+0000 7fa5915ff700 1 -- 172.21.15.37:0/3101246111 >> 172.21.15.37:0/3101246111 conn(0x7fa58c071660 msgr2=0x7fa58c06b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.717+0000 7fa5915ff700 1 -- 172.21.15.37:0/3101246111 shutdown_connections 2023-07-12T02:04:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.717+0000 7fa5915ff700 1 -- 172.21.15.37:0/3101246111 wait complete. 2023-07-12T02:04:33.724 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-12T02:04:33.739 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2023-07-12T02:04:33.354295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219684,"kb_used_data":3492,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755036,"statfs":{"total":773094113280,"available":772869156864,"internally_reserved":0,"allocated":3575808,"data_stored":2148109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003969"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173964+0000","last_change":"2023-07-12T02:03:58.150799+0000","last_active":"2023-07-12T02:04:03.173964+0000","last_peered":"2023-07-12T02:04:03.173964+0000","last_clean":"2023-07-12T02:04:03.173964+0000","last_became_active":"2023-07-12T02:03:58.150302+0000","last_became_peered":"2023-07-12T02:03:58.150302+0000","last_unstale":"2023-07-12T02:04:03.173964+0000","last_undegraded":"2023-07-12T02:04:03.173964+0000","last_fullsized":"2023-07-12T02:04:03.173964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:34:50.094079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707297+0000","last_change":"2023-07-12T02:03:58.167958+0000","last_active":"2023-07-12T02:04:03.707297+0000","last_peered":"2023-07-12T02:04:03.707297+0000","last_clean":"2023-07-12T02:04:03.707297+0000","last_became_active":"2023-07-12T02:03:58.167409+0000","last_became_peered":"2023-07-12T02:03:58.167409+0000","last_unstale":"2023-07-12T02:04:03.707297+0000","last_undegraded":"2023-07-12T02:04:03.707297+0000","last_fullsized":"2023-07-12T02:04:03.707297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:15:21.392894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174114+0000","last_change":"2023-07-12T02:03:58.158253+0000","last_active":"2023-07-12T02:04:03.174114+0000","last_peered":"2023-07-12T02:04:03.174114+0000","last_clean":"2023-07-12T02:04:03.174114+0000","last_became_active":"2023-07-12T02:03:58.158005+0000","last_became_peered":"2023-07-12T02:03:58.158005+0000","last_unstale":"2023-07-12T02:04:03.174114+0000","last_undegraded":"2023-07-12T02:04:03.174114+0000","last_fullsized":"2023-07-12T02:04:03.174114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:07:16.216455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707579+0000","last_change":"2023-07-12T02:03:58.155943+0000","last_active":"2023-07-12T02:04:03.707579+0000","last_peered":"2023-07-12T02:04:03.707579+0000","last_clean":"2023-07-12T02:04:03.707579+0000","last_became_active":"2023-07-12T02:03:58.155672+0000","last_became_peered":"2023-07-12T02:03:58.155672+0000","last_unstale":"2023-07-12T02:04:03.707579+0000","last_undegraded":"2023-07-12T02:04:03.707579+0000","last_fullsized":"2023-07-12T02:04:03.707579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:59:41.793818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172594+0000","last_change":"2023-07-12T02:03:58.163745+0000","last_active":"2023-07-12T02:04:03.172594+0000","last_peered":"2023-07-12T02:04:03.172594+0000","last_clean":"2023-07-12T02:04:03.172594+0000","last_became_active":"2023-07-12T02:03:58.163198+0000","last_became_peered":"2023-07-12T02:03:58.163198+0000","last_unstale":"2023-07-12T02:04:03.172594+0000","last_undegraded":"2023-07-12T02:04:03.172594+0000","last_fullsized":"2023-07-12T02:04:03.172594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:29.024675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173684+0000","last_change":"2023-07-12T02:03:58.160380+0000","last_active":"2023-07-12T02:04:03.173684+0000","last_peered":"2023-07-12T02:04:03.173684+0000","last_clean":"2023-07-12T02:04:03.173684+0000","last_became_active":"2023-07-12T02:03:58.160102+0000","last_became_peered":"2023-07-12T02:03:58.160102+0000","last_unstale":"2023-07-12T02:04:03.173684+0000","last_undegraded":"2023-07-12T02:04:03.173684+0000","last_fullsized":"2023-07-12T02:04:03.173684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:08:29.661400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589781+0000","last_change":"2023-07-12T02:03:58.153608+0000","last_active":"2023-07-12T02:04:03.589781+0000","last_peered":"2023-07-12T02:04:03.589781+0000","last_clean":"2023-07-12T02:04:03.589781+0000","last_became_active":"2023-07-12T02:03:58.153320+0000","last_became_peered":"2023-07-12T02:03:58.153320+0000","last_unstale":"2023-07-12T02:04:03.589781+0000","last_undegraded":"2023-07-12T02:04:03.589781+0000","last_fullsized":"2023-07-12T02:04:03.589781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:37.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706388+0000","last_change":"2023-07-12T02:03:58.157485+0000","last_active":"2023-07-12T02:04:03.706388+0000","last_peered":"2023-07-12T02:04:03.706388+0000","last_clean":"2023-07-12T02:04:03.706388+0000","last_became_active":"2023-07-12T02:03:58.157195+0000","last_became_peered":"2023-07-12T02:03:58.157195+0000","last_unstale":"2023-07-12T02:04:03.706388+0000","last_undegraded":"2023-07-12T02:04:03.706388+0000","last_fullsized":"2023-07-12T02:04:03.706388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:52.656557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171917+0000","last_change":"2023-07-12T02:03:58.162632+0000","last_active":"2023-07-12T02:04:03.171917+0000","last_peered":"2023-07-12T02:04:03.171917+0000","last_clean":"2023-07-12T02:04:03.171917+0000","last_became_active":"2023-07-12T02:03:58.162344+0000","last_became_peered":"2023-07-12T02:03:58.162344+0000","last_unstale":"2023-07-12T02:04:03.171917+0000","last_undegraded":"2023-07-12T02:04:03.171917+0000","last_fullsized":"2023-07-12T02:04:03.171917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:39.957211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707756+0000","last_change":"2023-07-12T02:03:58.165129+0000","last_active":"2023-07-12T02:04:03.707756+0000","last_peered":"2023-07-12T02:04:03.707756+0000","last_clean":"2023-07-12T02:04:03.707756+0000","last_became_active":"2023-07-12T02:03:58.164826+0000","last_became_peered":"2023-07-12T02:03:58.164826+0000","last_unstale":"2023-07-12T02:04:03.707756+0000","last_undegraded":"2023-07-12T02:04:03.707756+0000","last_fullsized":"2023-07-12T02:04:03.707756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:30:44.777286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174276+0000","last_change":"2023-07-12T02:03:58.167779+0000","last_active":"2023-07-12T02:04:03.174276+0000","last_peered":"2023-07-12T02:04:03.174276+0000","last_clean":"2023-07-12T02:04:03.174276+0000","last_became_active":"2023-07-12T02:03:58.167405+0000","last_became_peered":"2023-07-12T02:03:58.167405+0000","last_unstale":"2023-07-12T02:04:03.174276+0000","last_undegraded":"2023-07-12T02:04:03.174276+0000","last_fullsized":"2023-07-12T02:04:03.174276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:05:20.293113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173473+0000","last_change":"2023-07-12T02:03:58.140088+0000","last_active":"2023-07-12T02:04:03.173473+0000","last_peered":"2023-07-12T02:04:03.173473+0000","last_clean":"2023-07-12T02:04:03.173473+0000","last_became_active":"2023-07-12T02:03:58.139727+0000","last_became_peered":"2023-07-12T02:03:58.139727+0000","last_unstale":"2023-07-12T02:04:03.173473+0000","last_undegraded":"2023-07-12T02:04:03.173473+0000","last_fullsized":"2023-07-12T02:04:03.173473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:50.799195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173642+0000","last_change":"2023-07-12T02:03:58.152355+0000","last_active":"2023-07-12T02:04:03.173642+0000","last_peered":"2023-07-12T02:04:03.173642+0000","last_clean":"2023-07-12T02:04:03.173642+0000","last_became_active":"2023-07-12T02:03:58.151997+0000","last_became_peered":"2023-07-12T02:03:58.151997+0000","last_unstale":"2023-07-12T02:04:03.173642+0000","last_undegraded":"2023-07-12T02:04:03.173642+0000","last_fullsized":"2023-07-12T02:04:03.173642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:50:47.044125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706694+0000","last_change":"2023-07-12T02:03:58.155958+0000","last_active":"2023-07-12T02:04:03.706694+0000","last_peered":"2023-07-12T02:04:03.706694+0000","last_clean":"2023-07-12T02:04:03.706694+0000","last_became_active":"2023-07-12T02:03:58.155646+0000","last_became_peered":"2023-07-12T02:03:58.155646+0000","last_unstale":"2023-07-12T02:04:03.706694+0000","last_undegraded":"2023-07-12T02:04:03.706694+0000","last_fullsized":"2023-07-12T02:04:03.706694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:04:36.999164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589619+0000","last_change":"2023-07-12T02:03:58.162352+0000","last_active":"2023-07-12T02:04:03.589619+0000","last_peered":"2023-07-12T02:04:03.589619+0000","last_clean":"2023-07-12T02:04:03.589619+0000","last_became_active":"2023-07-12T02:03:58.162011+0000","last_became_peered":"2023-07-12T02:03:58.162011+0000","last_unstale":"2023-07-12T02:04:03.589619+0000","last_undegraded":"2023-07-12T02:04:03.589619+0000","last_fullsized":"2023-07-12T02:04:03.589619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:04:36.999164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173236+0000","last_change":"2023-07-12T02:03:58.162838+0000","last_active":"2023-07-12T02:04:03.173236+0000","last_peered":"2023-07-12T02:04:03.173236+0000","last_clean":"2023-07-12T02:04:03.173236+0000","last_became_active":"2023-07-12T02:03:58.162528+0000","last_became_peered":"2023-07-12T02:03:58.162528+0000","last_unstale":"2023-07-12T02:04:03.173236+0000","last_undegraded":"2023-07-12T02:04:03.173236+0000","last_fullsized":"2023-07-12T02:04:03.173236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:42:38.629324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172071+0000","last_change":"2023-07-12T02:03:58.162549+0000","last_active":"2023-07-12T02:04:03.172071+0000","last_peered":"2023-07-12T02:04:03.172071+0000","last_clean":"2023-07-12T02:04:03.172071+0000","last_became_active":"2023-07-12T02:03:58.161983+0000","last_became_peered":"2023-07-12T02:03:58.161983+0000","last_unstale":"2023-07-12T02:04:03.172071+0000","last_undegraded":"2023-07-12T02:04:03.172071+0000","last_fullsized":"2023-07-12T02:04:03.172071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:37.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174066+0000","last_change":"2023-07-12T02:03:58.140088+0000","last_active":"2023-07-12T02:04:03.174066+0000","last_peered":"2023-07-12T02:04:03.174066+0000","last_clean":"2023-07-12T02:04:03.174066+0000","last_became_active":"2023-07-12T02:03:58.139825+0000","last_became_peered":"2023-07-12T02:03:58.139825+0000","last_unstale":"2023-07-12T02:04:03.174066+0000","last_undegraded":"2023-07-12T02:04:03.174066+0000","last_fullsized":"2023-07-12T02:04:03.174066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:22:57.380427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173781+0000","last_change":"2023-07-12T02:03:58.149388+0000","last_active":"2023-07-12T02:04:03.173781+0000","last_peered":"2023-07-12T02:04:03.173781+0000","last_clean":"2023-07-12T02:04:03.173781+0000","last_became_active":"2023-07-12T02:03:58.149009+0000","last_became_peered":"2023-07-12T02:03:58.149009+0000","last_unstale":"2023-07-12T02:04:03.173781+0000","last_undegraded":"2023-07-12T02:04:03.173781+0000","last_fullsized":"2023-07-12T02:04:03.173781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:18:25.150845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173690+0000","last_change":"2023-07-12T02:03:58.144677+0000","last_active":"2023-07-12T02:04:03.173690+0000","last_peered":"2023-07-12T02:04:03.173690+0000","last_clean":"2023-07-12T02:04:03.173690+0000","last_became_active":"2023-07-12T02:03:58.144365+0000","last_became_peered":"2023-07-12T02:03:58.144365+0000","last_unstale":"2023-07-12T02:04:03.173690+0000","last_undegraded":"2023-07-12T02:04:03.173690+0000","last_fullsized":"2023-07-12T02:04:03.173690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:46:02.333414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590198+0000","last_change":"2023-07-12T02:03:58.156054+0000","last_active":"2023-07-12T02:04:03.590198+0000","last_peered":"2023-07-12T02:04:03.590198+0000","last_clean":"2023-07-12T02:04:03.590198+0000","last_became_active":"2023-07-12T02:03:58.155755+0000","last_became_peered":"2023-07-12T02:03:58.155755+0000","last_unstale":"2023-07-12T02:04:03.590198+0000","last_undegraded":"2023-07-12T02:04:03.590198+0000","last_fullsized":"2023-07-12T02:04:03.590198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:37:27.430690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171482+0000","last_change":"2023-07-12T02:03:58.169838+0000","last_active":"2023-07-12T02:04:03.171482+0000","last_peered":"2023-07-12T02:04:03.171482+0000","last_clean":"2023-07-12T02:04:03.171482+0000","last_became_active":"2023-07-12T02:03:58.169574+0000","last_became_peered":"2023-07-12T02:03:58.169574+0000","last_unstale":"2023-07-12T02:04:03.171482+0000","last_undegraded":"2023-07-12T02:04:03.171482+0000","last_fullsized":"2023-07-12T02:04:03.171482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:03:49.584323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706395+0000","last_change":"2023-07-12T02:03:58.158643+0000","last_active":"2023-07-12T02:04:03.706395+0000","last_peered":"2023-07-12T02:04:03.706395+0000","last_clean":"2023-07-12T02:04:03.706395+0000","last_became_active":"2023-07-12T02:03:58.158228+0000","last_became_peered":"2023-07-12T02:03:58.158228+0000","last_unstale":"2023-07-12T02:04:03.706395+0000","last_undegraded":"2023-07-12T02:04:03.706395+0000","last_fullsized":"2023-07-12T02:04:03.706395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:15:21.392894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589781+0000","last_change":"2023-07-12T02:03:58.155246+0000","last_active":"2023-07-12T02:04:03.589781+0000","last_peered":"2023-07-12T02:04:03.589781+0000","last_clean":"2023-07-12T02:04:03.589781+0000","last_became_active":"2023-07-12T02:03:58.154842+0000","last_became_peered":"2023-07-12T02:03:58.154842+0000","last_unstale":"2023-07-12T02:04:03.589781+0000","last_undegraded":"2023-07-12T02:04:03.589781+0000","last_fullsized":"2023-07-12T02:04:03.589781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:52.156977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706732+0000","last_change":"2023-07-12T02:03:58.167506+0000","last_active":"2023-07-12T02:04:03.706732+0000","last_peered":"2023-07-12T02:04:03.706732+0000","last_clean":"2023-07-12T02:04:03.706732+0000","last_became_active":"2023-07-12T02:03:58.166701+0000","last_became_peered":"2023-07-12T02:03:58.166701+0000","last_unstale":"2023-07-12T02:04:03.706732+0000","last_undegraded":"2023-07-12T02:04:03.706732+0000","last_fullsized":"2023-07-12T02:04:03.706732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:03:49.584323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706759+0000","last_change":"2023-07-12T02:03:58.164411+0000","last_active":"2023-07-12T02:04:03.706759+0000","last_peered":"2023-07-12T02:04:03.706759+0000","last_clean":"2023-07-12T02:04:03.706759+0000","last_became_active":"2023-07-12T02:03:58.164136+0000","last_became_peered":"2023-07-12T02:03:58.164136+0000","last_unstale":"2023-07-12T02:04:03.706759+0000","last_undegraded":"2023-07-12T02:04:03.706759+0000","last_fullsized":"2023-07-12T02:04:03.706759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:40:41.452100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707500+0000","last_change":"2023-07-12T02:03:58.158327+0000","last_active":"2023-07-12T02:04:03.707500+0000","last_peered":"2023-07-12T02:04:03.707500+0000","last_clean":"2023-07-12T02:04:03.707500+0000","last_became_active":"2023-07-12T02:03:58.158038+0000","last_became_peered":"2023-07-12T02:03:58.158038+0000","last_unstale":"2023-07-12T02:04:03.707500+0000","last_undegraded":"2023-07-12T02:04:03.707500+0000","last_fullsized":"2023-07-12T02:04:03.707500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:37:27.430690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174072+0000","last_change":"2023-07-12T02:04:02.205882+0000","last_active":"2023-07-12T02:04:03.174072+0000","last_peered":"2023-07-12T02:04:03.174072+0000","last_clean":"2023-07-12T02:04:03.174072+0000","last_became_active":"2023-07-12T02:04:02.205422+0000","last_became_peered":"2023-07-12T02:04:02.205422+0000","last_unstale":"2023-07-12T02:04:03.174072+0000","last_undegraded":"2023-07-12T02:04:03.174072+0000","last_fullsized":"2023-07-12T02:04:03.174072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:00:06.567816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173559+0000","last_change":"2023-07-12T02:03:57.132659+0000","last_active":"2023-07-12T02:04:03.173559+0000","last_peered":"2023-07-12T02:04:03.173559+0000","last_clean":"2023-07-12T02:04:03.173559+0000","last_became_active":"2023-07-12T02:03:57.132296+0000","last_became_peered":"2023-07-12T02:03:57.132296+0000","last_unstale":"2023-07-12T02:04:03.173559+0000","last_undegraded":"2023-07-12T02:04:03.173559+0000","last_fullsized":"2023-07-12T02:04:03.173559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:13:18.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706776+0000","last_change":"2023-07-12T02:03:58.168189+0000","last_active":"2023-07-12T02:04:03.706776+0000","last_peered":"2023-07-12T02:04:03.706776+0000","last_clean":"2023-07-12T02:04:03.706776+0000","last_became_active":"2023-07-12T02:03:58.167837+0000","last_became_peered":"2023-07-12T02:03:58.167837+0000","last_unstale":"2023-07-12T02:04:03.706776+0000","last_undegraded":"2023-07-12T02:04:03.706776+0000","last_fullsized":"2023-07-12T02:04:03.706776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:37:27.430690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.708053+0000","last_change":"2023-07-12T02:04:02.192589+0000","last_active":"2023-07-12T02:04:03.708053+0000","last_peered":"2023-07-12T02:04:03.708053+0000","last_clean":"2023-07-12T02:04:03.708053+0000","last_became_active":"2023-07-12T02:04:02.192078+0000","last_became_peered":"2023-07-12T02:04:02.192078+0000","last_unstale":"2023-07-12T02:04:03.708053+0000","last_undegraded":"2023-07-12T02:04:03.708053+0000","last_fullsized":"2023-07-12T02:04:03.708053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:13:11.653857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706270+0000","last_change":"2023-07-12T02:03:57.137950+0000","last_active":"2023-07-12T02:04:03.706270+0000","last_peered":"2023-07-12T02:04:03.706270+0000","last_clean":"2023-07-12T02:04:03.706270+0000","last_became_active":"2023-07-12T02:03:57.137512+0000","last_became_peered":"2023-07-12T02:03:57.137512+0000","last_unstale":"2023-07-12T02:04:03.706270+0000","last_undegraded":"2023-07-12T02:04:03.706270+0000","last_fullsized":"2023-07-12T02:04:03.706270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:23:19.169613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172604+0000","last_change":"2023-07-12T02:03:58.161489+0000","last_active":"2023-07-12T02:04:03.172604+0000","last_peered":"2023-07-12T02:04:03.172604+0000","last_clean":"2023-07-12T02:04:03.172604+0000","last_became_active":"2023-07-12T02:03:58.161146+0000","last_became_peered":"2023-07-12T02:03:58.161146+0000","last_unstale":"2023-07-12T02:04:03.172604+0000","last_undegraded":"2023-07-12T02:04:03.172604+0000","last_fullsized":"2023-07-12T02:04:03.172604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:30:44.777286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172742+0000","last_change":"2023-07-12T02:04:02.199897+0000","last_active":"2023-07-12T02:04:03.172742+0000","last_peered":"2023-07-12T02:04:03.172742+0000","last_clean":"2023-07-12T02:04:03.172742+0000","last_became_active":"2023-07-12T02:04:02.198813+0000","last_became_peered":"2023-07-12T02:04:02.198813+0000","last_unstale":"2023-07-12T02:04:03.172742+0000","last_undegraded":"2023-07-12T02:04:03.172742+0000","last_fullsized":"2023-07-12T02:04:03.172742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:12.327958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706246+0000","last_change":"2023-07-12T02:03:57.150630+0000","last_active":"2023-07-12T02:04:03.706246+0000","last_peered":"2023-07-12T02:04:03.706246+0000","last_clean":"2023-07-12T02:04:03.706246+0000","last_became_active":"2023-07-12T02:03:57.150342+0000","last_became_peered":"2023-07-12T02:03:57.150342+0000","last_unstale":"2023-07-12T02:04:03.706246+0000","last_undegraded":"2023-07-12T02:04:03.706246+0000","last_fullsized":"2023-07-12T02:04:03.706246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:44:57.891756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.708148+0000","last_change":"2023-07-12T02:03:58.151183+0000","last_active":"2023-07-12T02:04:03.708148+0000","last_peered":"2023-07-12T02:04:03.708148+0000","last_clean":"2023-07-12T02:04:03.708148+0000","last_became_active":"2023-07-12T02:03:58.150257+0000","last_became_peered":"2023-07-12T02:03:58.150257+0000","last_unstale":"2023-07-12T02:04:03.708148+0000","last_undegraded":"2023-07-12T02:04:03.708148+0000","last_fullsized":"2023-07-12T02:04:03.708148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:59:55.615077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707354+0000","last_change":"2023-07-12T02:04:02.193315+0000","last_active":"2023-07-12T02:04:03.707354+0000","last_peered":"2023-07-12T02:04:03.707354+0000","last_clean":"2023-07-12T02:04:03.707354+0000","last_became_active":"2023-07-12T02:04:02.192915+0000","last_became_peered":"2023-07-12T02:04:02.192915+0000","last_unstale":"2023-07-12T02:04:03.707354+0000","last_undegraded":"2023-07-12T02:04:03.707354+0000","last_fullsized":"2023-07-12T02:04:03.707354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:48:36.242589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172114+0000","last_change":"2023-07-12T02:03:57.147980+0000","last_active":"2023-07-12T02:04:03.172114+0000","last_peered":"2023-07-12T02:04:03.172114+0000","last_clean":"2023-07-12T02:04:03.172114+0000","last_became_active":"2023-07-12T02:03:57.147701+0000","last_became_peered":"2023-07-12T02:03:57.147701+0000","last_unstale":"2023-07-12T02:04:03.172114+0000","last_undegraded":"2023-07-12T02:04:03.172114+0000","last_fullsized":"2023-07-12T02:04:03.172114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:20.831039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706124+0000","last_change":"2023-07-12T02:03:58.162466+0000","last_active":"2023-07-12T02:04:03.706124+0000","last_peered":"2023-07-12T02:04:03.706124+0000","last_clean":"2023-07-12T02:04:03.706124+0000","last_became_active":"2023-07-12T02:03:58.162232+0000","last_became_peered":"2023-07-12T02:03:58.162232+0000","last_unstale":"2023-07-12T02:04:03.706124+0000","last_undegraded":"2023-07-12T02:04:03.706124+0000","last_fullsized":"2023-07-12T02:04:03.706124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:52.156977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589544+0000","last_change":"2023-07-12T02:04:02.199601+0000","last_active":"2023-07-12T02:04:03.589544+0000","last_peered":"2023-07-12T02:04:03.589544+0000","last_clean":"2023-07-12T02:04:03.589544+0000","last_became_active":"2023-07-12T02:04:02.199218+0000","last_became_peered":"2023-07-12T02:04:02.199218+0000","last_unstale":"2023-07-12T02:04:03.589544+0000","last_undegraded":"2023-07-12T02:04:03.589544+0000","last_fullsized":"2023-07-12T02:04:03.589544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:56.700790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707513+0000","last_change":"2023-07-12T02:03:57.144471+0000","last_active":"2023-07-12T02:04:03.707513+0000","last_peered":"2023-07-12T02:04:03.707513+0000","last_clean":"2023-07-12T02:04:03.707513+0000","last_became_active":"2023-07-12T02:03:57.144183+0000","last_became_peered":"2023-07-12T02:03:57.144183+0000","last_unstale":"2023-07-12T02:04:03.707513+0000","last_undegraded":"2023-07-12T02:04:03.707513+0000","last_fullsized":"2023-07-12T02:04:03.707513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:28.017520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706261+0000","last_change":"2023-07-12T02:03:58.155253+0000","last_active":"2023-07-12T02:04:03.706261+0000","last_peered":"2023-07-12T02:04:03.706261+0000","last_clean":"2023-07-12T02:04:03.706261+0000","last_became_active":"2023-07-12T02:03:58.154981+0000","last_became_peered":"2023-07-12T02:03:58.154981+0000","last_unstale":"2023-07-12T02:04:03.706261+0000","last_undegraded":"2023-07-12T02:04:03.706261+0000","last_fullsized":"2023-07-12T02:04:03.706261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:05.243878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707342+0000","last_change":"2023-07-12T02:04:02.199311+0000","last_active":"2023-07-12T02:04:03.707342+0000","last_peered":"2023-07-12T02:04:03.707342+0000","last_clean":"2023-07-12T02:04:03.707342+0000","last_became_active":"2023-07-12T02:04:02.198883+0000","last_became_peered":"2023-07-12T02:04:02.198883+0000","last_unstale":"2023-07-12T02:04:03.707342+0000","last_undegraded":"2023-07-12T02:04:03.707342+0000","last_fullsized":"2023-07-12T02:04:03.707342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:19:55.666369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590314+0000","last_change":"2023-07-12T02:03:57.150937+0000","last_active":"2023-07-12T02:04:03.590314+0000","last_peered":"2023-07-12T02:04:03.590314+0000","last_clean":"2023-07-12T02:04:03.590314+0000","last_became_active":"2023-07-12T02:03:57.150617+0000","last_became_peered":"2023-07-12T02:03:57.150617+0000","last_unstale":"2023-07-12T02:04:03.590314+0000","last_undegraded":"2023-07-12T02:04:03.590314+0000","last_fullsized":"2023-07-12T02:04:03.590314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:07.276570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707832+0000","last_change":"2023-07-12T02:03:58.160889+0000","last_active":"2023-07-12T02:04:03.707832+0000","last_peered":"2023-07-12T02:04:03.707832+0000","last_clean":"2023-07-12T02:04:03.707832+0000","last_became_active":"2023-07-12T02:03:58.160594+0000","last_became_peered":"2023-07-12T02:03:58.160594+0000","last_unstale":"2023-07-12T02:04:03.707832+0000","last_undegraded":"2023-07-12T02:04:03.707832+0000","last_fullsized":"2023-07-12T02:04:03.707832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:05.243878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707549+0000","last_change":"2023-07-12T02:04:02.191342+0000","last_active":"2023-07-12T02:04:03.707549+0000","last_peered":"2023-07-12T02:04:03.707549+0000","last_clean":"2023-07-12T02:04:03.707549+0000","last_became_active":"2023-07-12T02:04:02.190277+0000","last_became_peered":"2023-07-12T02:04:02.190277+0000","last_unstale":"2023-07-12T02:04:03.707549+0000","last_undegraded":"2023-07-12T02:04:03.707549+0000","last_fullsized":"2023-07-12T02:04:03.707549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:56.201209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:16.744060+0000","last_change":"2023-07-12T02:03:57.141317+0000","last_active":"2023-07-12T02:04:16.744060+0000","last_peered":"2023-07-12T02:04:16.744060+0000","last_clean":"2023-07-12T02:04:16.744060+0000","last_became_active":"2023-07-12T02:03:57.140668+0000","last_became_peered":"2023-07-12T02:03:57.140668+0000","last_unstale":"2023-07-12T02:04:16.744060+0000","last_undegraded":"2023-07-12T02:04:16.744060+0000","last_fullsized":"2023-07-12T02:04:16.744060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:26:13.420313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173616+0000","last_change":"2023-07-12T02:03:58.147529+0000","last_active":"2023-07-12T02:04:03.173616+0000","last_peered":"2023-07-12T02:04:03.173616+0000","last_clean":"2023-07-12T02:04:03.173616+0000","last_became_active":"2023-07-12T02:03:58.147226+0000","last_became_peered":"2023-07-12T02:03:58.147226+0000","last_unstale":"2023-07-12T02:04:03.173616+0000","last_undegraded":"2023-07-12T02:04:03.173616+0000","last_fullsized":"2023-07-12T02:04:03.173616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:41:34.175917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707746+0000","last_change":"2023-07-12T02:04:02.199731+0000","last_active":"2023-07-12T02:04:03.707746+0000","last_peered":"2023-07-12T02:04:03.707746+0000","last_clean":"2023-07-12T02:04:03.707746+0000","last_became_active":"2023-07-12T02:04:02.199360+0000","last_became_peered":"2023-07-12T02:04:02.199360+0000","last_unstale":"2023-07-12T02:04:03.707746+0000","last_undegraded":"2023-07-12T02:04:03.707746+0000","last_fullsized":"2023-07-12T02:04:03.707746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:09:51.362187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590031+0000","last_change":"2023-07-12T02:03:57.146809+0000","last_active":"2023-07-12T02:04:03.590031+0000","last_peered":"2023-07-12T02:04:03.590031+0000","last_clean":"2023-07-12T02:04:03.590031+0000","last_became_active":"2023-07-12T02:03:57.146430+0000","last_became_peered":"2023-07-12T02:03:57.146430+0000","last_unstale":"2023-07-12T02:04:03.590031+0000","last_undegraded":"2023-07-12T02:04:03.590031+0000","last_fullsized":"2023-07-12T02:04:03.590031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:04.236723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707769+0000","last_change":"2023-07-12T02:03:58.152748+0000","last_active":"2023-07-12T02:04:03.707769+0000","last_peered":"2023-07-12T02:04:03.707769+0000","last_clean":"2023-07-12T02:04:03.707769+0000","last_became_active":"2023-07-12T02:03:58.152426+0000","last_became_peered":"2023-07-12T02:03:58.152426+0000","last_unstale":"2023-07-12T02:04:03.707769+0000","last_undegraded":"2023-07-12T02:04:03.707769+0000","last_fullsized":"2023-07-12T02:04:03.707769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:04:26.740269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707577+0000","last_change":"2023-07-12T02:04:02.192398+0000","last_active":"2023-07-12T02:04:03.707577+0000","last_peered":"2023-07-12T02:04:03.707577+0000","last_clean":"2023-07-12T02:04:03.707577+0000","last_became_active":"2023-07-12T02:04:02.191940+0000","last_became_peered":"2023-07-12T02:04:02.191940+0000","last_unstale":"2023-07-12T02:04:03.707577+0000","last_undegraded":"2023-07-12T02:04:03.707577+0000","last_fullsized":"2023-07-12T02:04:03.707577+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:22.171422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171647+0000","last_change":"2023-07-12T02:03:57.146620+0000","last_active":"2023-07-12T02:04:03.171647+0000","last_peered":"2023-07-12T02:04:03.171647+0000","last_clean":"2023-07-12T02:04:03.171647+0000","last_became_active":"2023-07-12T02:03:57.144751+0000","last_became_peered":"2023-07-12T02:03:57.144751+0000","last_unstale":"2023-07-12T02:04:03.171647+0000","last_undegraded":"2023-07-12T02:04:03.171647+0000","last_fullsized":"2023-07-12T02:04:03.171647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:40:40.444944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707376+0000","last_change":"2023-07-12T02:03:58.158785+0000","last_active":"2023-07-12T02:04:03.707376+0000","last_peered":"2023-07-12T02:04:03.707376+0000","last_clean":"2023-07-12T02:04:03.707376+0000","last_became_active":"2023-07-12T02:03:58.158476+0000","last_became_peered":"2023-07-12T02:03:58.158476+0000","last_unstale":"2023-07-12T02:04:03.707376+0000","last_undegraded":"2023-07-12T02:04:03.707376+0000","last_fullsized":"2023-07-12T02:04:03.707376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:58:17.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707289+0000","last_change":"2023-07-12T02:04:02.198903+0000","last_active":"2023-07-12T02:04:03.707289+0000","last_peered":"2023-07-12T02:04:03.707289+0000","last_clean":"2023-07-12T02:04:03.707289+0000","last_became_active":"2023-07-12T02:04:02.198445+0000","last_became_peered":"2023-07-12T02:04:02.198445+0000","last_unstale":"2023-07-12T02:04:03.707289+0000","last_undegraded":"2023-07-12T02:04:03.707289+0000","last_fullsized":"2023-07-12T02:04:03.707289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:09:51.362187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589697+0000","last_change":"2023-07-12T02:03:57.143073+0000","last_active":"2023-07-12T02:04:03.589697+0000","last_peered":"2023-07-12T02:04:03.589697+0000","last_clean":"2023-07-12T02:04:03.589697+0000","last_became_active":"2023-07-12T02:03:57.142805+0000","last_became_peered":"2023-07-12T02:03:57.142805+0000","last_unstale":"2023-07-12T02:04:03.589697+0000","last_undegraded":"2023-07-12T02:04:03.589697+0000","last_fullsized":"2023-07-12T02:04:03.589697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:38.950056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172309+0000","last_change":"2023-07-12T02:03:58.161612+0000","last_active":"2023-07-12T02:04:03.172309+0000","last_peered":"2023-07-12T02:04:03.172309+0000","last_clean":"2023-07-12T02:04:03.172309+0000","last_became_active":"2023-07-12T02:03:58.161329+0000","last_became_peered":"2023-07-12T02:03:58.161329+0000","last_unstale":"2023-07-12T02:04:03.172309+0000","last_undegraded":"2023-07-12T02:04:03.172309+0000","last_fullsized":"2023-07-12T02:04:03.172309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:58:17.117158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707911+0000","last_change":"2023-07-12T02:04:02.201466+0000","last_active":"2023-07-12T02:04:03.707911+0000","last_peered":"2023-07-12T02:04:03.707911+0000","last_clean":"2023-07-12T02:04:03.707911+0000","last_became_active":"2023-07-12T02:04:02.200829+0000","last_became_peered":"2023-07-12T02:04:02.200829+0000","last_unstale":"2023-07-12T02:04:03.707911+0000","last_undegraded":"2023-07-12T02:04:03.707911+0000","last_fullsized":"2023-07-12T02:04:03.707911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:38:34.209015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706866+0000","last_change":"2023-07-12T02:03:57.151484+0000","last_active":"2023-07-12T02:04:03.706866+0000","last_peered":"2023-07-12T02:04:03.706866+0000","last_clean":"2023-07-12T02:04:03.706866+0000","last_became_active":"2023-07-12T02:03:57.151265+0000","last_became_peered":"2023-07-12T02:03:57.151265+0000","last_unstale":"2023-07-12T02:04:03.706866+0000","last_undegraded":"2023-07-12T02:04:03.706866+0000","last_fullsized":"2023-07-12T02:04:03.706866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:20:54.377849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707483+0000","last_change":"2023-07-12T02:03:58.155235+0000","last_active":"2023-07-12T02:04:03.707483+0000","last_peered":"2023-07-12T02:04:03.707483+0000","last_clean":"2023-07-12T02:04:03.707483+0000","last_became_active":"2023-07-12T02:03:58.154930+0000","last_became_peered":"2023-07-12T02:03:58.154930+0000","last_unstale":"2023-07-12T02:04:03.707483+0000","last_undegraded":"2023-07-12T02:04:03.707483+0000","last_fullsized":"2023-07-12T02:04:03.707483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:49:27.944683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589908+0000","last_change":"2023-07-12T02:04:02.192401+0000","last_active":"2023-07-12T02:04:03.589908+0000","last_peered":"2023-07-12T02:04:03.589908+0000","last_clean":"2023-07-12T02:04:03.589908+0000","last_became_active":"2023-07-12T02:04:02.191970+0000","last_became_peered":"2023-07-12T02:04:02.191970+0000","last_unstale":"2023-07-12T02:04:03.589908+0000","last_undegraded":"2023-07-12T02:04:03.589908+0000","last_fullsized":"2023-07-12T02:04:03.589908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:45:02.943144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590605+0000","last_change":"2023-07-12T02:03:57.147171+0000","last_active":"2023-07-12T02:04:03.590605+0000","last_peered":"2023-07-12T02:04:03.590605+0000","last_clean":"2023-07-12T02:04:03.590605+0000","last_became_active":"2023-07-12T02:03:57.146834+0000","last_became_peered":"2023-07-12T02:03:57.146834+0000","last_unstale":"2023-07-12T02:04:03.590605+0000","last_undegraded":"2023-07-12T02:04:03.590605+0000","last_fullsized":"2023-07-12T02:04:03.590605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:19:50.614981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706300+0000","last_change":"2023-07-12T02:03:58.158172+0000","last_active":"2023-07-12T02:04:03.706300+0000","last_peered":"2023-07-12T02:04:03.706300+0000","last_clean":"2023-07-12T02:04:03.706300+0000","last_became_active":"2023-07-12T02:03:58.157899+0000","last_became_peered":"2023-07-12T02:03:58.157899+0000","last_unstale":"2023-07-12T02:04:03.706300+0000","last_undegraded":"2023-07-12T02:04:03.706300+0000","last_fullsized":"2023-07-12T02:04:03.706300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:40:41.452100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173071+0000","last_change":"2023-07-12T02:04:02.204856+0000","last_active":"2023-07-12T02:04:03.173071+0000","last_peered":"2023-07-12T02:04:03.173071+0000","last_clean":"2023-07-12T02:04:03.173071+0000","last_became_active":"2023-07-12T02:04:02.204417+0000","last_became_peered":"2023-07-12T02:04:02.204417+0000","last_unstale":"2023-07-12T02:04:03.173071+0000","last_undegraded":"2023-07-12T02:04:03.173071+0000","last_fullsized":"2023-07-12T02:04:03.173071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:48:27.384109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590285+0000","last_change":"2023-07-12T02:03:57.146813+0000","last_active":"2023-07-12T02:04:03.590285+0000","last_peered":"2023-07-12T02:04:03.590285+0000","last_clean":"2023-07-12T02:04:03.590285+0000","last_became_active":"2023-07-12T02:03:57.146386+0000","last_became_peered":"2023-07-12T02:03:57.146386+0000","last_unstale":"2023-07-12T02:04:03.590285+0000","last_undegraded":"2023-07-12T02:04:03.590285+0000","last_fullsized":"2023-07-12T02:04:03.590285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:28.017520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173036+0000","last_change":"2023-07-12T02:03:58.150492+0000","last_active":"2023-07-12T02:04:03.173036+0000","last_peered":"2023-07-12T02:04:03.173036+0000","last_clean":"2023-07-12T02:04:03.173036+0000","last_became_active":"2023-07-12T02:03:58.150197+0000","last_became_peered":"2023-07-12T02:03:58.150197+0000","last_unstale":"2023-07-12T02:04:03.173036+0000","last_undegraded":"2023-07-12T02:04:03.173036+0000","last_fullsized":"2023-07-12T02:04:03.173036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:58:53.219351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173480+0000","last_change":"2023-07-12T02:04:02.208486+0000","last_active":"2023-07-12T02:04:03.173480+0000","last_peered":"2023-07-12T02:04:03.173480+0000","last_clean":"2023-07-12T02:04:03.173480+0000","last_became_active":"2023-07-12T02:04:02.207988+0000","last_became_peered":"2023-07-12T02:04:02.207988+0000","last_unstale":"2023-07-12T02:04:03.173480+0000","last_undegraded":"2023-07-12T02:04:03.173480+0000","last_fullsized":"2023-07-12T02:04:03.173480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:35:12.462957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590458+0000","last_change":"2023-07-12T02:03:57.147092+0000","last_active":"2023-07-12T02:04:03.590458+0000","last_peered":"2023-07-12T02:04:03.590458+0000","last_clean":"2023-07-12T02:04:03.590458+0000","last_became_active":"2023-07-12T02:03:57.146801+0000","last_became_peered":"2023-07-12T02:03:57.146801+0000","last_unstale":"2023-07-12T02:04:03.590458+0000","last_undegraded":"2023-07-12T02:04:03.590458+0000","last_fullsized":"2023-07-12T02:04:03.590458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:09:46.310799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707708+0000","last_change":"2023-07-12T02:03:58.168581+0000","last_active":"2023-07-12T02:04:03.707708+0000","last_peered":"2023-07-12T02:04:03.707708+0000","last_clean":"2023-07-12T02:04:03.707708+0000","last_became_active":"2023-07-12T02:03:58.168315+0000","last_became_peered":"2023-07-12T02:03:58.168315+0000","last_unstale":"2023-07-12T02:04:03.707708+0000","last_undegraded":"2023-07-12T02:04:03.707708+0000","last_fullsized":"2023-07-12T02:04:03.707708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:58:16.528209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173461+0000","last_change":"2023-07-12T02:04:02.193052+0000","last_active":"2023-07-12T02:04:03.173461+0000","last_peered":"2023-07-12T02:04:03.173461+0000","last_clean":"2023-07-12T02:04:03.173461+0000","last_became_active":"2023-07-12T02:04:02.192566+0000","last_became_peered":"2023-07-12T02:04:02.192566+0000","last_unstale":"2023-07-12T02:04:03.173461+0000","last_undegraded":"2023-07-12T02:04:03.173461+0000","last_fullsized":"2023-07-12T02:04:03.173461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:14:44.922812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706990+0000","last_change":"2023-07-12T02:03:57.140828+0000","last_active":"2023-07-12T02:04:03.706990+0000","last_peered":"2023-07-12T02:04:03.706990+0000","last_clean":"2023-07-12T02:04:03.706990+0000","last_became_active":"2023-07-12T02:03:57.140464+0000","last_became_peered":"2023-07-12T02:03:57.140464+0000","last_unstale":"2023-07-12T02:04:03.706990+0000","last_undegraded":"2023-07-12T02:04:03.706990+0000","last_fullsized":"2023-07-12T02:04:03.706990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:20.831039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172247+0000","last_change":"2023-07-12T02:03:58.169131+0000","last_active":"2023-07-12T02:04:03.172247+0000","last_peered":"2023-07-12T02:04:03.172247+0000","last_clean":"2023-07-12T02:04:03.172247+0000","last_became_active":"2023-07-12T02:03:58.168799+0000","last_became_peered":"2023-07-12T02:03:58.168799+0000","last_unstale":"2023-07-12T02:04:03.172247+0000","last_undegraded":"2023-07-12T02:04:03.172247+0000","last_fullsized":"2023-07-12T02:04:03.172247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:44:58.898911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173850+0000","last_change":"2023-07-12T02:04:02.190747+0000","last_active":"2023-07-12T02:04:03.173850+0000","last_peered":"2023-07-12T02:04:03.173850+0000","last_clean":"2023-07-12T02:04:03.173850+0000","last_became_active":"2023-07-12T02:04:02.190302+0000","last_became_peered":"2023-07-12T02:04:02.190302+0000","last_unstale":"2023-07-12T02:04:03.173850+0000","last_undegraded":"2023-07-12T02:04:03.173850+0000","last_fullsized":"2023-07-12T02:04:03.173850+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:33:37.078500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706960+0000","last_change":"2023-07-12T02:03:57.146313+0000","last_active":"2023-07-12T02:04:03.706960+0000","last_peered":"2023-07-12T02:04:03.706960+0000","last_clean":"2023-07-12T02:04:03.706960+0000","last_became_active":"2023-07-12T02:03:57.146009+0000","last_became_peered":"2023-07-12T02:03:57.146009+0000","last_unstale":"2023-07-12T02:04:03.706960+0000","last_undegraded":"2023-07-12T02:04:03.706960+0000","last_fullsized":"2023-07-12T02:04:03.706960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:07.276570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173066+0000","last_change":"2023-07-12T02:03:58.152369+0000","last_active":"2023-07-12T02:04:03.173066+0000","last_peered":"2023-07-12T02:04:03.173066+0000","last_clean":"2023-07-12T02:04:03.173066+0000","last_became_active":"2023-07-12T02:03:58.152135+0000","last_became_peered":"2023-07-12T02:03:58.152135+0000","last_unstale":"2023-07-12T02:04:03.173066+0000","last_undegraded":"2023-07-12T02:04:03.173066+0000","last_fullsized":"2023-07-12T02:04:03.173066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:50:41.194014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706141+0000","last_change":"2023-07-12T02:04:02.197112+0000","last_active":"2023-07-12T02:04:03.706141+0000","last_peered":"2023-07-12T02:04:03.706141+0000","last_clean":"2023-07-12T02:04:03.706141+0000","last_became_active":"2023-07-12T02:04:02.196690+0000","last_became_peered":"2023-07-12T02:04:02.196690+0000","last_unstale":"2023-07-12T02:04:03.706141+0000","last_undegraded":"2023-07-12T02:04:03.706141+0000","last_fullsized":"2023-07-12T02:04:03.706141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:13:26.428845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707558+0000","last_change":"2023-07-12T02:03:57.142419+0000","last_active":"2023-07-12T02:04:03.707558+0000","last_peered":"2023-07-12T02:04:03.707558+0000","last_clean":"2023-07-12T02:04:03.707558+0000","last_became_active":"2023-07-12T02:03:57.142100+0000","last_became_peered":"2023-07-12T02:03:57.142100+0000","last_unstale":"2023-07-12T02:04:03.707558+0000","last_undegraded":"2023-07-12T02:04:03.707558+0000","last_fullsized":"2023-07-12T02:04:03.707558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:56:37.546908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173901+0000","last_change":"2023-07-12T02:03:58.139451+0000","last_active":"2023-07-12T02:04:03.173901+0000","last_peered":"2023-07-12T02:04:03.173901+0000","last_clean":"2023-07-12T02:04:03.173901+0000","last_became_active":"2023-07-12T02:03:58.139177+0000","last_became_peered":"2023-07-12T02:03:58.139177+0000","last_unstale":"2023-07-12T02:04:03.173901+0000","last_undegraded":"2023-07-12T02:04:03.173901+0000","last_fullsized":"2023-07-12T02:04:03.173901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:55:54.389650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707633+0000","last_change":"2023-07-12T02:04:02.195542+0000","last_active":"2023-07-12T02:04:03.707633+0000","last_peered":"2023-07-12T02:04:03.707633+0000","last_clean":"2023-07-12T02:04:03.707633+0000","last_became_active":"2023-07-12T02:04:02.195110+0000","last_became_peered":"2023-07-12T02:04:02.195110+0000","last_unstale":"2023-07-12T02:04:03.707633+0000","last_undegraded":"2023-07-12T02:04:03.707633+0000","last_fullsized":"2023-07-12T02:04:03.707633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:12.327958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172725+0000","last_change":"2023-07-12T02:03:57.139384+0000","last_active":"2023-07-12T02:04:03.172725+0000","last_peered":"2023-07-12T02:04:03.172725+0000","last_clean":"2023-07-12T02:04:03.172725+0000","last_became_active":"2023-07-12T02:03:57.139029+0000","last_became_peered":"2023-07-12T02:03:57.139029+0000","last_unstale":"2023-07-12T02:04:03.172725+0000","last_undegraded":"2023-07-12T02:04:03.172725+0000","last_fullsized":"2023-07-12T02:04:03.172725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:49:26.937527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174239+0000","last_change":"2023-07-12T02:03:58.147472+0000","last_active":"2023-07-12T02:04:03.174239+0000","last_peered":"2023-07-12T02:04:03.174239+0000","last_clean":"2023-07-12T02:04:03.174239+0000","last_became_active":"2023-07-12T02:03:58.147122+0000","last_became_peered":"2023-07-12T02:03:58.147122+0000","last_unstale":"2023-07-12T02:04:03.174239+0000","last_undegraded":"2023-07-12T02:04:03.174239+0000","last_fullsized":"2023-07-12T02:04:03.174239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:01:36.223649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174157+0000","last_change":"2023-07-12T02:04:02.198219+0000","last_active":"2023-07-12T02:04:03.174157+0000","last_peered":"2023-07-12T02:04:03.174157+0000","last_clean":"2023-07-12T02:04:03.174157+0000","last_became_active":"2023-07-12T02:04:02.197795+0000","last_became_peered":"2023-07-12T02:04:02.197795+0000","last_unstale":"2023-07-12T02:04:03.174157+0000","last_undegraded":"2023-07-12T02:04:03.174157+0000","last_fullsized":"2023-07-12T02:04:03.174157+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:34:25.707588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706092+0000","last_change":"2023-07-12T02:03:57.135818+0000","last_active":"2023-07-12T02:04:03.706092+0000","last_peered":"2023-07-12T02:04:03.706092+0000","last_clean":"2023-07-12T02:04:03.706092+0000","last_became_active":"2023-07-12T02:03:57.135457+0000","last_became_peered":"2023-07-12T02:03:57.135457+0000","last_unstale":"2023-07-12T02:04:03.706092+0000","last_undegraded":"2023-07-12T02:04:03.706092+0000","last_fullsized":"2023-07-12T02:04:03.706092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:20.831039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706991+0000","last_change":"2023-07-12T02:03:58.167298+0000","last_active":"2023-07-12T02:04:03.706991+0000","last_peered":"2023-07-12T02:04:03.706991+0000","last_clean":"2023-07-12T02:04:03.706991+0000","last_became_active":"2023-07-12T02:03:58.166301+0000","last_became_peered":"2023-07-12T02:03:58.166301+0000","last_unstale":"2023-07-12T02:04:03.706991+0000","last_undegraded":"2023-07-12T02:04:03.706991+0000","last_fullsized":"2023-07-12T02:04:03.706991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:37.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171935+0000","last_change":"2023-07-12T02:04:02.200517+0000","last_active":"2023-07-12T02:04:03.171935+0000","last_peered":"2023-07-12T02:04:03.171935+0000","last_clean":"2023-07-12T02:04:03.171935+0000","last_became_active":"2023-07-12T02:04:02.200076+0000","last_became_peered":"2023-07-12T02:04:02.200076+0000","last_unstale":"2023-07-12T02:04:03.171935+0000","last_undegraded":"2023-07-12T02:04:03.171935+0000","last_fullsized":"2023-07-12T02:04:03.171935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:15:25.437127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706448+0000","last_change":"2023-07-12T02:03:52.304302+0000","last_active":"2023-07-12T02:04:03.706448+0000","last_peered":"2023-07-12T02:04:03.706448+0000","last_clean":"2023-07-12T02:04:03.706448+0000","last_became_active":"2023-07-12T02:03:52.303905+0000","last_became_peered":"2023-07-12T02:03:52.303905+0000","last_unstale":"2023-07-12T02:04:03.706448+0000","last_undegraded":"2023-07-12T02:04:03.706448+0000","last_fullsized":"2023-07-12T02:04:03.706448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:21:06.990537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707239+0000","last_change":"2023-07-12T02:03:57.141396+0000","last_active":"2023-07-12T02:04:03.707239+0000","last_peered":"2023-07-12T02:04:03.707239+0000","last_clean":"2023-07-12T02:04:03.707239+0000","last_became_active":"2023-07-12T02:03:57.141107+0000","last_became_peered":"2023-07-12T02:03:57.141107+0000","last_unstale":"2023-07-12T02:04:03.707239+0000","last_undegraded":"2023-07-12T02:04:03.707239+0000","last_fullsized":"2023-07-12T02:04:03.707239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:04.236723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707745+0000","last_change":"2023-07-12T02:03:58.159883+0000","last_active":"2023-07-12T02:04:03.707745+0000","last_peered":"2023-07-12T02:04:03.707745+0000","last_clean":"2023-07-12T02:04:03.707745+0000","last_became_active":"2023-07-12T02:03:58.159572+0000","last_became_peered":"2023-07-12T02:03:58.159572+0000","last_unstale":"2023-07-12T02:04:03.707745+0000","last_undegraded":"2023-07-12T02:04:03.707745+0000","last_fullsized":"2023-07-12T02:04:03.707745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:44:58.898911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171927+0000","last_change":"2023-07-12T02:04:02.205064+0000","last_active":"2023-07-12T02:04:03.171927+0000","last_peered":"2023-07-12T02:04:03.171927+0000","last_clean":"2023-07-12T02:04:03.171927+0000","last_became_active":"2023-07-12T02:04:02.204597+0000","last_became_peered":"2023-07-12T02:04:02.204597+0000","last_unstale":"2023-07-12T02:04:03.171927+0000","last_undegraded":"2023-07-12T02:04:03.171927+0000","last_fullsized":"2023-07-12T02:04:03.171927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:04:41.043396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706758+0000","last_change":"2023-07-12T02:03:51.909547+0000","last_active":"2023-07-12T02:04:03.706758+0000","last_peered":"2023-07-12T02:04:03.706758+0000","last_clean":"2023-07-12T02:04:03.706758+0000","last_became_active":"2023-07-12T02:03:51.909159+0000","last_became_peered":"2023-07-12T02:03:51.909159+0000","last_unstale":"2023-07-12T02:04:03.706758+0000","last_undegraded":"2023-07-12T02:04:03.706758+0000","last_fullsized":"2023-07-12T02:04:03.706758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:33.734016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173368+0000","last_change":"2023-07-12T02:03:57.150988+0000","last_active":"2023-07-12T02:04:03.173368+0000","last_peered":"2023-07-12T02:04:03.173368+0000","last_clean":"2023-07-12T02:04:03.173368+0000","last_became_active":"2023-07-12T02:03:57.150659+0000","last_became_peered":"2023-07-12T02:03:57.150659+0000","last_unstale":"2023-07-12T02:04:03.173368+0000","last_undegraded":"2023-07-12T02:04:03.173368+0000","last_fullsized":"2023-07-12T02:04:03.173368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:07:48.765025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706282+0000","last_change":"2023-07-12T02:03:58.163335+0000","last_active":"2023-07-12T02:04:03.706282+0000","last_peered":"2023-07-12T02:04:03.706282+0000","last_clean":"2023-07-12T02:04:03.706282+0000","last_became_active":"2023-07-12T02:03:58.163047+0000","last_became_peered":"2023-07-12T02:03:58.163047+0000","last_unstale":"2023-07-12T02:04:03.706282+0000","last_undegraded":"2023-07-12T02:04:03.706282+0000","last_fullsized":"2023-07-12T02:04:03.706282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:53:40.589737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.174096+0000","last_change":"2023-07-12T02:04:02.191793+0000","last_active":"2023-07-12T02:04:03.174096+0000","last_peered":"2023-07-12T02:04:03.174096+0000","last_clean":"2023-07-12T02:04:03.174096+0000","last_became_active":"2023-07-12T02:04:02.191370+0000","last_became_peered":"2023-07-12T02:04:02.191370+0000","last_unstale":"2023-07-12T02:04:03.174096+0000","last_undegraded":"2023-07-12T02:04:03.174096+0000","last_fullsized":"2023-07-12T02:04:03.174096+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:49:03.729087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173175+0000","last_change":"2023-07-12T02:03:51.904989+0000","last_active":"2023-07-12T02:04:03.173175+0000","last_peered":"2023-07-12T02:04:03.173175+0000","last_clean":"2023-07-12T02:04:03.173175+0000","last_became_active":"2023-07-12T02:03:51.904497+0000","last_became_peered":"2023-07-12T02:03:51.904497+0000","last_unstale":"2023-07-12T02:04:03.173175+0000","last_undegraded":"2023-07-12T02:04:03.173175+0000","last_fullsized":"2023-07-12T02:04:03.173175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:51:27.688647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706336+0000","last_change":"2023-07-12T02:03:57.141921+0000","last_active":"2023-07-12T02:04:03.706336+0000","last_peered":"2023-07-12T02:04:03.706336+0000","last_clean":"2023-07-12T02:04:03.706336+0000","last_became_active":"2023-07-12T02:03:57.141617+0000","last_became_peered":"2023-07-12T02:03:57.141617+0000","last_unstale":"2023-07-12T02:04:03.706336+0000","last_undegraded":"2023-07-12T02:04:03.706336+0000","last_fullsized":"2023-07-12T02:04:03.706336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:57:56.465849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706855+0000","last_change":"2023-07-12T02:03:58.167642+0000","last_active":"2023-07-12T02:04:03.706855+0000","last_peered":"2023-07-12T02:04:03.706855+0000","last_clean":"2023-07-12T02:04:03.706855+0000","last_became_active":"2023-07-12T02:03:58.166984+0000","last_became_peered":"2023-07-12T02:03:58.166984+0000","last_unstale":"2023-07-12T02:04:03.706855+0000","last_undegraded":"2023-07-12T02:04:03.706855+0000","last_fullsized":"2023-07-12T02:04:03.706855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:52.656557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589980+0000","last_change":"2023-07-12T02:04:02.198255+0000","last_active":"2023-07-12T02:04:03.589980+0000","last_peered":"2023-07-12T02:04:03.589980+0000","last_clean":"2023-07-12T02:04:03.589980+0000","last_became_active":"2023-07-12T02:04:02.197843+0000","last_became_peered":"2023-07-12T02:04:02.197843+0000","last_unstale":"2023-07-12T02:04:03.589980+0000","last_undegraded":"2023-07-12T02:04:03.589980+0000","last_fullsized":"2023-07-12T02:04:03.589980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:58:21.161390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707028+0000","last_change":"2023-07-12T02:03:51.909324+0000","last_active":"2023-07-12T02:04:03.707028+0000","last_peered":"2023-07-12T02:04:03.707028+0000","last_clean":"2023-07-12T02:04:03.707028+0000","last_became_active":"2023-07-12T02:03:51.908982+0000","last_became_peered":"2023-07-12T02:03:51.908982+0000","last_unstale":"2023-07-12T02:04:03.707028+0000","last_undegraded":"2023-07-12T02:04:03.707028+0000","last_fullsized":"2023-07-12T02:04:03.707028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:31.138300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.589719+0000","last_change":"2023-07-12T02:03:44.783225+0000","last_active":"2023-07-12T02:04:03.589719+0000","last_peered":"2023-07-12T02:04:03.589719+0000","last_clean":"2023-07-12T02:04:03.589719+0000","last_became_active":"2023-07-12T02:03:44.782048+0000","last_became_peered":"2023-07-12T02:03:44.782048+0000","last_unstale":"2023-07-12T02:04:03.589719+0000","last_undegraded":"2023-07-12T02:04:03.589719+0000","last_fullsized":"2023-07-12T02:04:03.589719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:43.565472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:43.565472+0000","last_clean_scrub_stamp":"2023-07-12T02:03:43.565472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:08.293722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707366+0000","last_change":"2023-07-12T02:03:57.139490+0000","last_active":"2023-07-12T02:04:03.707366+0000","last_peered":"2023-07-12T02:04:03.707366+0000","last_clean":"2023-07-12T02:04:03.707366+0000","last_became_active":"2023-07-12T02:03:57.139072+0000","last_became_peered":"2023-07-12T02:03:57.139072+0000","last_unstale":"2023-07-12T02:04:03.707366+0000","last_undegraded":"2023-07-12T02:04:03.707366+0000","last_fullsized":"2023-07-12T02:04:03.707366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:38:29.157627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707565+0000","last_change":"2023-07-12T02:03:58.154809+0000","last_active":"2023-07-12T02:04:03.707565+0000","last_peered":"2023-07-12T02:04:03.707565+0000","last_clean":"2023-07-12T02:04:03.707565+0000","last_became_active":"2023-07-12T02:03:58.154559+0000","last_became_peered":"2023-07-12T02:03:58.154559+0000","last_unstale":"2023-07-12T02:04:03.707565+0000","last_undegraded":"2023-07-12T02:04:03.707565+0000","last_fullsized":"2023-07-12T02:04:03.707565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:46:33.480535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707383+0000","last_change":"2023-07-12T02:04:02.197503+0000","last_active":"2023-07-12T02:04:03.707383+0000","last_peered":"2023-07-12T02:04:03.707383+0000","last_clean":"2023-07-12T02:04:03.707383+0000","last_became_active":"2023-07-12T02:04:02.197064+0000","last_became_peered":"2023-07-12T02:04:02.197064+0000","last_unstale":"2023-07-12T02:04:03.707383+0000","last_undegraded":"2023-07-12T02:04:03.707383+0000","last_fullsized":"2023-07-12T02:04:03.707383+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:18.923707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590089+0000","last_change":"2023-07-12T02:03:51.909395+0000","last_active":"2023-07-12T02:04:03.590089+0000","last_peered":"2023-07-12T02:04:03.590089+0000","last_clean":"2023-07-12T02:04:03.590089+0000","last_became_active":"2023-07-12T02:03:51.909125+0000","last_became_peered":"2023-07-12T02:03:51.909125+0000","last_unstale":"2023-07-12T02:04:03.590089+0000","last_undegraded":"2023-07-12T02:04:03.590089+0000","last_fullsized":"2023-07-12T02:04:03.590089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:15:15.169698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171436+0000","last_change":"2023-07-12T02:03:57.150059+0000","last_active":"2023-07-12T02:04:03.171436+0000","last_peered":"2023-07-12T02:04:03.171436+0000","last_clean":"2023-07-12T02:04:03.171436+0000","last_became_active":"2023-07-12T02:03:57.149751+0000","last_became_peered":"2023-07-12T02:03:57.149751+0000","last_unstale":"2023-07-12T02:04:03.171436+0000","last_undegraded":"2023-07-12T02:04:03.171436+0000","last_fullsized":"2023-07-12T02:04:03.171436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:53:41.149722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172171+0000","last_change":"2023-07-12T02:03:58.168413+0000","last_active":"2023-07-12T02:04:03.172171+0000","last_peered":"2023-07-12T02:04:03.172171+0000","last_clean":"2023-07-12T02:04:03.172171+0000","last_became_active":"2023-07-12T02:03:58.168106+0000","last_became_peered":"2023-07-12T02:03:58.168106+0000","last_unstale":"2023-07-12T02:04:03.172171+0000","last_undegraded":"2023-07-12T02:04:03.172171+0000","last_fullsized":"2023-07-12T02:04:03.172171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:52.156977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707401+0000","last_change":"2023-07-12T02:04:02.197727+0000","last_active":"2023-07-12T02:04:03.707401+0000","last_peered":"2023-07-12T02:04:03.707401+0000","last_clean":"2023-07-12T02:04:03.707401+0000","last_became_active":"2023-07-12T02:04:02.197340+0000","last_became_peered":"2023-07-12T02:04:02.197340+0000","last_unstale":"2023-07-12T02:04:03.707401+0000","last_undegraded":"2023-07-12T02:04:03.707401+0000","last_fullsized":"2023-07-12T02:04:03.707401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:01:54.191121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590364+0000","last_change":"2023-07-12T02:03:52.304880+0000","last_active":"2023-07-12T02:04:03.590364+0000","last_peered":"2023-07-12T02:04:03.590364+0000","last_clean":"2023-07-12T02:04:03.590364+0000","last_became_active":"2023-07-12T02:03:52.304598+0000","last_became_peered":"2023-07-12T02:03:52.304598+0000","last_unstale":"2023-07-12T02:04:03.590364+0000","last_undegraded":"2023-07-12T02:04:03.590364+0000","last_fullsized":"2023-07-12T02:04:03.590364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:30:38.554090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706579+0000","last_change":"2023-07-12T02:03:57.134671+0000","last_active":"2023-07-12T02:04:03.706579+0000","last_peered":"2023-07-12T02:04:03.706579+0000","last_clean":"2023-07-12T02:04:03.706579+0000","last_became_active":"2023-07-12T02:03:57.134319+0000","last_became_peered":"2023-07-12T02:03:57.134319+0000","last_unstale":"2023-07-12T02:04:03.706579+0000","last_undegraded":"2023-07-12T02:04:03.706579+0000","last_fullsized":"2023-07-12T02:04:03.706579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:21.026700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172428+0000","last_change":"2023-07-12T02:03:58.158643+0000","last_active":"2023-07-12T02:04:03.172428+0000","last_peered":"2023-07-12T02:04:03.172428+0000","last_clean":"2023-07-12T02:04:03.172428+0000","last_became_active":"2023-07-12T02:03:58.158356+0000","last_became_peered":"2023-07-12T02:03:58.158356+0000","last_unstale":"2023-07-12T02:04:03.172428+0000","last_undegraded":"2023-07-12T02:04:03.172428+0000","last_fullsized":"2023-07-12T02:04:03.172428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:37:27.430690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173232+0000","last_change":"2023-07-12T02:04:02.198751+0000","last_active":"2023-07-12T02:04:03.173232+0000","last_peered":"2023-07-12T02:04:03.173232+0000","last_clean":"2023-07-12T02:04:03.173232+0000","last_became_active":"2023-07-12T02:04:02.198369+0000","last_became_peered":"2023-07-12T02:04:02.198369+0000","last_unstale":"2023-07-12T02:04:03.173232+0000","last_undegraded":"2023-07-12T02:04:03.173232+0000","last_fullsized":"2023-07-12T02:04:03.173232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:36:39.188205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707404+0000","last_change":"2023-07-12T02:03:57.140454+0000","last_active":"2023-07-12T02:04:03.707404+0000","last_peered":"2023-07-12T02:04:03.707404+0000","last_clean":"2023-07-12T02:04:03.707404+0000","last_became_active":"2023-07-12T02:03:57.140085+0000","last_became_peered":"2023-07-12T02:03:57.140085+0000","last_unstale":"2023-07-12T02:04:03.707404+0000","last_undegraded":"2023-07-12T02:04:03.707404+0000","last_fullsized":"2023-07-12T02:04:03.707404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:31:40.528381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706901+0000","last_change":"2023-07-12T02:03:51.906406+0000","last_active":"2023-07-12T02:04:03.706901+0000","last_peered":"2023-07-12T02:04:03.706901+0000","last_clean":"2023-07-12T02:04:03.706901+0000","last_became_active":"2023-07-12T02:03:51.905875+0000","last_became_peered":"2023-07-12T02:03:51.905875+0000","last_unstale":"2023-07-12T02:04:03.706901+0000","last_undegraded":"2023-07-12T02:04:03.706901+0000","last_fullsized":"2023-07-12T02:04:03.706901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:33.734016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.705982+0000","last_change":"2023-07-12T02:03:58.156488+0000","last_active":"2023-07-12T02:04:03.705982+0000","last_peered":"2023-07-12T02:04:03.705982+0000","last_clean":"2023-07-12T02:04:03.705982+0000","last_became_active":"2023-07-12T02:03:58.155960+0000","last_became_peered":"2023-07-12T02:03:58.155960+0000","last_unstale":"2023-07-12T02:04:03.705982+0000","last_undegraded":"2023-07-12T02:04:03.705982+0000","last_fullsized":"2023-07-12T02:04:03.705982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:48:37.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.705926+0000","last_change":"2023-07-12T02:04:02.198638+0000","last_active":"2023-07-12T02:04:03.705926+0000","last_peered":"2023-07-12T02:04:03.705926+0000","last_clean":"2023-07-12T02:04:03.705926+0000","last_became_active":"2023-07-12T02:04:02.198244+0000","last_became_peered":"2023-07-12T02:04:02.198244+0000","last_unstale":"2023-07-12T02:04:03.705926+0000","last_undegraded":"2023-07-12T02:04:03.705926+0000","last_fullsized":"2023-07-12T02:04:03.705926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:36:44.001444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.708048+0000","last_change":"2023-07-12T02:03:51.908137+0000","last_active":"2023-07-12T02:04:03.708048+0000","last_peered":"2023-07-12T02:04:03.708048+0000","last_clean":"2023-07-12T02:04:03.708048+0000","last_became_active":"2023-07-12T02:03:51.907900+0000","last_became_peered":"2023-07-12T02:03:51.907900+0000","last_unstale":"2023-07-12T02:04:03.708048+0000","last_undegraded":"2023-07-12T02:04:03.708048+0000","last_fullsized":"2023-07-12T02:04:03.708048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:04:38.301609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.171901+0000","last_change":"2023-07-12T02:03:57.148723+0000","last_active":"2023-07-12T02:04:03.171901+0000","last_peered":"2023-07-12T02:04:03.171901+0000","last_clean":"2023-07-12T02:04:03.171901+0000","last_became_active":"2023-07-12T02:03:57.148402+0000","last_became_peered":"2023-07-12T02:03:57.148402+0000","last_unstale":"2023-07-12T02:04:03.171901+0000","last_undegraded":"2023-07-12T02:04:03.171901+0000","last_fullsized":"2023-07-12T02:04:03.171901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:51.649402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172813+0000","last_change":"2023-07-12T02:03:58.146752+0000","last_active":"2023-07-12T02:04:03.172813+0000","last_peered":"2023-07-12T02:04:03.172813+0000","last_clean":"2023-07-12T02:04:03.172813+0000","last_became_active":"2023-07-12T02:03:58.146475+0000","last_became_peered":"2023-07-12T02:03:58.146475+0000","last_unstale":"2023-07-12T02:04:03.172813+0000","last_undegraded":"2023-07-12T02:04:03.172813+0000","last_fullsized":"2023-07-12T02:04:03.172813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:18.127189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707349+0000","last_change":"2023-07-12T02:04:02.197112+0000","last_active":"2023-07-12T02:04:03.707349+0000","last_peered":"2023-07-12T02:04:03.707349+0000","last_clean":"2023-07-12T02:04:03.707349+0000","last_became_active":"2023-07-12T02:04:02.196665+0000","last_became_peered":"2023-07-12T02:04:02.196665+0000","last_unstale":"2023-07-12T02:04:03.707349+0000","last_undegraded":"2023-07-12T02:04:03.707349+0000","last_fullsized":"2023-07-12T02:04:03.707349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:25.882427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172383+0000","last_change":"2023-07-12T02:03:57.149946+0000","last_active":"2023-07-12T02:04:03.172383+0000","last_peered":"2023-07-12T02:04:03.172383+0000","last_clean":"2023-07-12T02:04:03.172383+0000","last_became_active":"2023-07-12T02:03:57.149707+0000","last_became_peered":"2023-07-12T02:03:57.149707+0000","last_unstale":"2023-07-12T02:04:03.172383+0000","last_undegraded":"2023-07-12T02:04:03.172383+0000","last_fullsized":"2023-07-12T02:04:03.172383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:13.872319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173635+0000","last_change":"2023-07-12T02:03:58.153412+0000","last_active":"2023-07-12T02:04:03.173635+0000","last_peered":"2023-07-12T02:04:03.173635+0000","last_clean":"2023-07-12T02:04:03.173635+0000","last_became_active":"2023-07-12T02:03:58.153116+0000","last_became_peered":"2023-07-12T02:03:58.153116+0000","last_unstale":"2023-07-12T02:04:03.173635+0000","last_undegraded":"2023-07-12T02:04:03.173635+0000","last_fullsized":"2023-07-12T02:04:03.173635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:37:03.495726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.590052+0000","last_change":"2023-07-12T02:04:02.192659+0000","last_active":"2023-07-12T02:04:03.590052+0000","last_peered":"2023-07-12T02:04:03.590052+0000","last_clean":"2023-07-12T02:04:03.590052+0000","last_became_active":"2023-07-12T02:04:02.192139+0000","last_became_peered":"2023-07-12T02:04:02.192139+0000","last_unstale":"2023-07-12T02:04:03.590052+0000","last_undegraded":"2023-07-12T02:04:03.590052+0000","last_fullsized":"2023-07-12T02:04:03.590052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:18.923707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707093+0000","last_change":"2023-07-12T02:03:57.140042+0000","last_active":"2023-07-12T02:04:03.707093+0000","last_peered":"2023-07-12T02:04:03.707093+0000","last_clean":"2023-07-12T02:04:03.707093+0000","last_became_active":"2023-07-12T02:03:57.139652+0000","last_became_peered":"2023-07-12T02:03:57.139652+0000","last_unstale":"2023-07-12T02:04:03.707093+0000","last_undegraded":"2023-07-12T02:04:03.707093+0000","last_fullsized":"2023-07-12T02:04:03.707093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:40:51.149821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173207+0000","last_change":"2023-07-12T02:03:58.152883+0000","last_active":"2023-07-12T02:04:03.173207+0000","last_peered":"2023-07-12T02:04:03.173207+0000","last_clean":"2023-07-12T02:04:03.173207+0000","last_became_active":"2023-07-12T02:03:58.152591+0000","last_became_peered":"2023-07-12T02:03:58.152591+0000","last_unstale":"2023-07-12T02:04:03.173207+0000","last_undegraded":"2023-07-12T02:04:03.173207+0000","last_fullsized":"2023-07-12T02:04:03.173207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:07:57.297802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707002+0000","last_change":"2023-07-12T02:04:02.198913+0000","last_active":"2023-07-12T02:04:03.707002+0000","last_peered":"2023-07-12T02:04:03.707002+0000","last_clean":"2023-07-12T02:04:03.707002+0000","last_became_active":"2023-07-12T02:04:02.198553+0000","last_became_peered":"2023-07-12T02:04:02.198553+0000","last_unstale":"2023-07-12T02:04:03.707002+0000","last_undegraded":"2023-07-12T02:04:03.707002+0000","last_fullsized":"2023-07-12T02:04:03.707002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:45:02.943144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707838+0000","last_change":"2023-07-12T02:03:57.136048+0000","last_active":"2023-07-12T02:04:03.707838+0000","last_peered":"2023-07-12T02:04:03.707838+0000","last_clean":"2023-07-12T02:04:03.707838+0000","last_became_active":"2023-07-12T02:03:57.135728+0000","last_became_peered":"2023-07-12T02:03:57.135728+0000","last_unstale":"2023-07-12T02:04:03.707838+0000","last_undegraded":"2023-07-12T02:04:03.707838+0000","last_fullsized":"2023-07-12T02:04:03.707838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:19:50.614981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172897+0000","last_change":"2023-07-12T02:03:58.151134+0000","last_active":"2023-07-12T02:04:03.172897+0000","last_peered":"2023-07-12T02:04:03.172897+0000","last_clean":"2023-07-12T02:04:03.172897+0000","last_became_active":"2023-07-12T02:03:58.150880+0000","last_became_peered":"2023-07-12T02:03:58.150880+0000","last_unstale":"2023-07-12T02:04:03.172897+0000","last_undegraded":"2023-07-12T02:04:03.172897+0000","last_fullsized":"2023-07-12T02:04:03.172897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:04:26.740269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172701+0000","last_change":"2023-07-12T02:04:02.195039+0000","last_active":"2023-07-12T02:04:03.172701+0000","last_peered":"2023-07-12T02:04:03.172701+0000","last_clean":"2023-07-12T02:04:03.172701+0000","last_became_active":"2023-07-12T02:04:02.194199+0000","last_became_peered":"2023-07-12T02:04:02.194199+0000","last_unstale":"2023-07-12T02:04:03.172701+0000","last_undegraded":"2023-07-12T02:04:03.172701+0000","last_fullsized":"2023-07-12T02:04:03.172701+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:31:45.579769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706482+0000","last_change":"2023-07-12T02:03:57.135710+0000","last_active":"2023-07-12T02:04:03.706482+0000","last_peered":"2023-07-12T02:04:03.706482+0000","last_clean":"2023-07-12T02:04:03.706482+0000","last_became_active":"2023-07-12T02:03:57.135435+0000","last_became_peered":"2023-07-12T02:03:57.135435+0000","last_unstale":"2023-07-12T02:04:03.706482+0000","last_undegraded":"2023-07-12T02:04:03.706482+0000","last_fullsized":"2023-07-12T02:04:03.706482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:58:16.110002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706668+0000","last_change":"2023-07-12T02:03:58.150539+0000","last_active":"2023-07-12T02:04:03.706668+0000","last_peered":"2023-07-12T02:04:03.706668+0000","last_clean":"2023-07-12T02:04:03.706668+0000","last_became_active":"2023-07-12T02:03:58.150195+0000","last_became_peered":"2023-07-12T02:03:58.150195+0000","last_unstale":"2023-07-12T02:04:03.706668+0000","last_undegraded":"2023-07-12T02:04:03.706668+0000","last_fullsized":"2023-07-12T02:04:03.706668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:14.879474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706643+0000","last_change":"2023-07-12T02:04:02.198230+0000","last_active":"2023-07-12T02:04:03.706643+0000","last_peered":"2023-07-12T02:04:03.706643+0000","last_clean":"2023-07-12T02:04:03.706643+0000","last_became_active":"2023-07-12T02:04:02.197796+0000","last_became_peered":"2023-07-12T02:04:02.197796+0000","last_unstale":"2023-07-12T02:04:03.706643+0000","last_undegraded":"2023-07-12T02:04:03.706643+0000","last_fullsized":"2023-07-12T02:04:03.706643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:04:01.154177+0000","last_clean_scrub_stamp":"2023-07-12T02:04:01.154177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:53:46.201110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.172259+0000","last_change":"2023-07-12T02:03:57.148075+0000","last_active":"2023-07-12T02:04:03.172259+0000","last_peered":"2023-07-12T02:04:03.172259+0000","last_clean":"2023-07-12T02:04:03.172259+0000","last_became_active":"2023-07-12T02:03:57.147809+0000","last_became_peered":"2023-07-12T02:03:57.147809+0000","last_unstale":"2023-07-12T02:04:03.172259+0000","last_undegraded":"2023-07-12T02:04:03.172259+0000","last_fullsized":"2023-07-12T02:04:03.172259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:56.102789+0000","last_clean_scrub_stamp":"2023-07-12T02:03:56.102789+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:08:04.236723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173070+0000","last_change":"2023-07-12T02:03:58.146147+0000","last_active":"2023-07-12T02:04:03.173070+0000","last_peered":"2023-07-12T02:04:03.173070+0000","last_clean":"2023-07-12T02:04:03.173070+0000","last_became_active":"2023-07-12T02:03:58.145855+0000","last_became_peered":"2023-07-12T02:03:58.145855+0000","last_unstale":"2023-07-12T02:04:03.173070+0000","last_undegraded":"2023-07-12T02:04:03.173070+0000","last_fullsized":"2023-07-12T02:04:03.173070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:54:10.220081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706812+0000","last_change":"2023-07-12T02:03:58.165263+0000","last_active":"2023-07-12T02:04:03.706812+0000","last_peered":"2023-07-12T02:04:03.706812+0000","last_clean":"2023-07-12T02:04:03.706812+0000","last_became_active":"2023-07-12T02:03:58.164980+0000","last_became_peered":"2023-07-12T02:03:58.164980+0000","last_unstale":"2023-07-12T02:04:03.706812+0000","last_undegraded":"2023-07-12T02:04:03.706812+0000","last_fullsized":"2023-07-12T02:04:03.706812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:30:32.214383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706936+0000","last_change":"2023-07-12T02:03:58.166005+0000","last_active":"2023-07-12T02:04:03.706936+0000","last_peered":"2023-07-12T02:04:03.706936+0000","last_clean":"2023-07-12T02:04:03.706936+0000","last_became_active":"2023-07-12T02:03:58.165718+0000","last_became_peered":"2023-07-12T02:03:58.165718+0000","last_unstale":"2023-07-12T02:04:03.706936+0000","last_undegraded":"2023-07-12T02:04:03.706936+0000","last_fullsized":"2023-07-12T02:04:03.706936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:29.024675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.173193+0000","last_change":"2023-07-12T02:03:58.145894+0000","last_active":"2023-07-12T02:04:03.173193+0000","last_peered":"2023-07-12T02:04:03.173193+0000","last_clean":"2023-07-12T02:04:03.173193+0000","last_became_active":"2023-07-12T02:03:58.145442+0000","last_became_peered":"2023-07-12T02:03:58.145442+0000","last_unstale":"2023-07-12T02:04:03.173193+0000","last_undegraded":"2023-07-12T02:04:03.173193+0000","last_fullsized":"2023-07-12T02:04:03.173193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:52:53.582391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.707166+0000","last_change":"2023-07-12T02:03:58.156685+0000","last_active":"2023-07-12T02:04:03.707166+0000","last_peered":"2023-07-12T02:04:03.707166+0000","last_clean":"2023-07-12T02:04:03.707166+0000","last_became_active":"2023-07-12T02:03:58.156127+0000","last_became_peered":"2023-07-12T02:03:58.156127+0000","last_unstale":"2023-07-12T02:04:03.707166+0000","last_undegraded":"2023-07-12T02:04:03.707166+0000","last_fullsized":"2023-07-12T02:04:03.707166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:30:44.777286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-12T02:04:03.706873+0000","last_change":"2023-07-12T02:03:58.159307+0000","last_active":"2023-07-12T02:04:03.706873+0000","last_peered":"2023-07-12T02:04:03.706873+0000","last_clean":"2023-07-12T02:04:03.706873+0000","last_became_active":"2023-07-12T02:03:58.158898+0000","last_became_peered":"2023-07-12T02:03:58.158898+0000","last_unstale":"2023-07-12T02:04:03.706873+0000","last_undegraded":"2023-07-12T02:04:03.706873+0000","last_fullsized":"2023-07-12T02:04:03.706873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:57.109945+0000","last_clean_scrub_stamp":"2023-07-12T02:03:57.109945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:04:36.999164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":884736,"data_stored":709832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2690000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1869999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9650000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8959999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.6660000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.524}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6040000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-12T02:04:33.746 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-12T02:04:33.747 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-12T02:04:33.747 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-12T02:04:33.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-12T02:04:33.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.975+0000 7ff60b9ff700 1 Processor -- start 2023-07-12T02:04:33.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.975+0000 7ff60b9ff700 1 -- start start 2023-07-12T02:04:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.976+0000 7ff60b9ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff60415c460 0x7ff6040b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.976+0000 7ff60b9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6040d2640 0x7ff6040cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.977+0000 7ff60b9ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6040d1790 con 0x7ff6040cf720 2023-07-12T02:04:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.977+0000 7ff60b9ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6040cedd0 con 0x7ff60415c460 2023-07-12T02:04:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.977+0000 7ff60b9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040cd950 con 0x7ff6040d2640 2023-07-12T02:04:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.977+0000 7ff609f9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff6040cf720 0x7ff6040d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39768/0 (socket says 172.21.15.37:39768) 2023-07-12T02:04:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.977+0000 7ff609f9c700 1 -- 172.21.15.37:0/3955165430 learned_addr learned my addr 172.21.15.37:0/3955165430 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.977+0000 7ff60979b700 1 --2- 172.21.15.37:0/3955165430 >> v2:172.21.15.196:3300/0 conn(0x7ff60415c460 0x7ff6040b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.977+0000 7ff608f9a700 1 --2- 172.21.15.37:0/3955165430 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6040d2640 0x7ff6040cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.977+0000 7ff5fbfff700 1 -- 172.21.15.37:0/3955165430 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308163245 0 0) 0x7ff6040d1790 con 0x7ff6040cf720 2023-07-12T02:04:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.977+0000 7ff5fbfff700 1 -- 172.21.15.37:0/3955165430 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5f00035b0 con 0x7ff6040cf720 2023-07-12T02:04:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.977+0000 7ff60979b700 1 -- 172.21.15.37:0/3955165430 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6040d2640 msgr2=0x7ff6040cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.977+0000 7ff60979b700 1 --2- 172.21.15.37:0/3955165430 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6040d2640 0x7ff6040cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.977+0000 7ff60979b700 1 -- 172.21.15.37:0/3955165430 >> v1:172.21.15.37:6789/0 conn(0x7ff6040cf720 legacy=0x7ff6040d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.978+0000 7ff60979b700 1 -- 172.21.15.37:0/3955165430 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6040d14b0 con 0x7ff60415c460 2023-07-12T02:04:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.978+0000 7ff608f9a700 1 --2- 172.21.15.37:0/3955165430 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6040d2640 0x7ff6040cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:04:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.978+0000 7ff60979b700 1 --2- 172.21.15.37:0/3955165430 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff60415c460 0x7ff6040b59d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff600009840 tx=0x7ff600009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d816be7a9a0f2d0d server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.978+0000 7ff5fbfff700 1 -- 172.21.15.37:0/3955165430 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff600011830 con 0x7ff60415c460 2023-07-12T02:04:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.978+0000 7ff5fbfff700 1 -- 172.21.15.37:0/3955165430 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff600011990 con 0x7ff60415c460 2023-07-12T02:04:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.978+0000 7ff5fbfff700 1 -- 172.21.15.37:0/3955165430 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff600011d20 con 0x7ff60415c460 2023-07-12T02:04:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.979+0000 7ff60b9ff700 1 -- 172.21.15.37:0/3955165430 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff60415c460 msgr2=0x7ff6040b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.979+0000 7ff60b9ff700 1 --2- 172.21.15.37:0/3955165430 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff60415c460 0x7ff6040b59d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff600009840 tx=0x7ff600009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.979+0000 7ff60b9ff700 1 -- 172.21.15.37:0/3955165430 shutdown_connections 2023-07-12T02:04:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.979+0000 7ff60b9ff700 1 --2- 172.21.15.37:0/3955165430 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff60415c460 0x7ff6040b59d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.979+0000 7ff60b9ff700 1 --2- 172.21.15.37:0/3955165430 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6040d2640 0x7ff6040cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.979+0000 7ff60b9ff700 1 -- 172.21.15.37:0/3955165430 >> 172.21.15.37:0/3955165430 conn(0x7ff604071660 msgr2=0x7ff604071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.979+0000 7ff60b9ff700 1 -- 172.21.15.37:0/3955165430 shutdown_connections 2023-07-12T02:04:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.979+0000 7ff60b9ff700 1 -- 172.21.15.37:0/3955165430 wait complete. 2023-07-12T02:04:33.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.981+0000 7ff60b9ff700 1 Processor -- start 2023-07-12T02:04:33.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.981+0000 7ff60b9ff700 1 -- start start 2023-07-12T02:04:33.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.982+0000 7ff60b9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6040cf720 0x7ff6040c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.982+0000 7ff60b9ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6040d2640 0x7ff60414e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.982+0000 7ff60b9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff60415c460 0x7ff6040c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.982+0000 7ff60b9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040c95f0 con 0x7ff60415c460 2023-07-12T02:04:33.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.982+0000 7ff60b9ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60414e930 con 0x7ff6040d2640 2023-07-12T02:04:33.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.982+0000 7ff60b9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040c9310 con 0x7ff6040cf720 2023-07-12T02:04:33.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.982+0000 7ff609f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff60415c460 0x7ff6040c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.982+0000 7ff609f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff60415c460 0x7ff6040c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35434/0 (socket says 172.21.15.37:35434) 2023-07-12T02:04:33.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.982+0000 7ff609f9c700 1 -- 172.21.15.37:0/3841364529 learned_addr learned my addr 172.21.15.37:0/3841364529 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:33.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.982+0000 7ff608f9a700 1 --2- 172.21.15.37:0/3841364529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6040d2640 0x7ff60414e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.982+0000 7ff60979b700 1 --2- 172.21.15.37:0/3841364529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6040cf720 0x7ff6040c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.982+0000 7ff609f9c700 1 -- 172.21.15.37:0/3841364529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6040cf720 msgr2=0x7ff6040c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:33.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.982+0000 7ff609f9c700 1 --2- 172.21.15.37:0/3841364529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6040cf720 0x7ff6040c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.982+0000 7ff609f9c700 1 -- 172.21.15.37:0/3841364529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6040d2640 msgr2=0x7ff60414e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:33.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.982+0000 7ff609f9c700 1 --2- 172.21.15.37:0/3841364529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6040d2640 0x7ff60414e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.983+0000 7ff609f9c700 1 -- 172.21.15.37:0/3841364529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f40094a0 con 0x7ff60415c460 2023-07-12T02:04:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.983+0000 7ff609f9c700 1 --2- 172.21.15.37:0/3841364529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff60415c460 0x7ff6040c8a50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00caa0 tx=0x7ff5fc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.983+0000 7ff5f9ffb700 1 -- 172.21.15.37:0/3841364529 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00a9e0 con 0x7ff60415c460 2023-07-12T02:04:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.983+0000 7ff5f9ffb700 1 -- 172.21.15.37:0/3841364529 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc00ab40 con 0x7ff60415c460 2023-07-12T02:04:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.983+0000 7ff5f9ffb700 1 -- 172.21.15.37:0/3841364529 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc012400 con 0x7ff60415c460 2023-07-12T02:04:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.983+0000 7ff60b9ff700 1 -- 172.21.15.37:0/3841364529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6000094a0 con 0x7ff60415c460 2023-07-12T02:04:33.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.983+0000 7ff60b9ff700 1 -- 172.21.15.37:0/3841364529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6040c7b60 con 0x7ff60415c460 2023-07-12T02:04:33.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.984+0000 7ff60b9ff700 1 -- 172.21.15.37:0/3841364529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60404ea60 con 0x7ff60415c460 2023-07-12T02:04:33.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.985+0000 7ff5f9ffb700 1 -- 172.21.15.37:0/3841364529 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff5fc01b3b0 con 0x7ff60415c460 2023-07-12T02:04:33.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.986+0000 7ff5f9ffb700 1 --2- 172.21.15.37:0/3841364529 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff5e806ace0 0x7ff5e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:33.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.986+0000 7ff5f9ffb700 1 -- 172.21.15.37:0/3841364529 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff5fc089390 con 0x7ff60415c460 2023-07-12T02:04:33.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.987+0000 7ff60979b700 1 --2- 172.21.15.37:0/3841364529 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff5e806ace0 0x7ff5e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:33.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.987+0000 7ff60979b700 1 --2- 172.21.15.37:0/3841364529 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff5e806ace0 0x7ff5e806d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff600009fd0 tx=0x7ff600008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:33.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:33.991+0000 7ff5f9ffb700 1 -- 172.21.15.37:0/3841364529 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff5fc054210 con 0x7ff60415c460 2023-07-12T02:04:34.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.248+0000 7ff60b9ff700 1 -- 172.21.15.37:0/3841364529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff6040b4fa0 con 0x7ff60415c460 2023-07-12T02:04:34.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.248+0000 7ff5f9ffb700 1 -- 172.21.15.37:0/3841364529 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff5fc057830 con 0x7ff60415c460 2023-07-12T02:04:34.252 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:34.252 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-12T02:04:34.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.251+0000 7ff60b9ff700 1 -- 172.21.15.37:0/3841364529 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff5e806ace0 msgr2=0x7ff5e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:34.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.251+0000 7ff60b9ff700 1 --2- 172.21.15.37:0/3841364529 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff5e806ace0 0x7ff5e806d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff600009fd0 tx=0x7ff600008030 comp rx=0 tx=0).stop 2023-07-12T02:04:34.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.251+0000 7ff60b9ff700 1 -- 172.21.15.37:0/3841364529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff60415c460 msgr2=0x7ff6040c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:34.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.251+0000 7ff60b9ff700 1 --2- 172.21.15.37:0/3841364529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff60415c460 0x7ff6040c8a50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00caa0 tx=0x7ff5fc00cdb0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.251+0000 7ff60b9ff700 1 -- 172.21.15.37:0/3841364529 shutdown_connections 2023-07-12T02:04:34.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.251+0000 7ff60b9ff700 1 --2- 172.21.15.37:0/3841364529 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff5e806ace0 0x7ff5e806d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.251+0000 7ff60b9ff700 1 --2- 172.21.15.37:0/3841364529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff60415c460 0x7ff6040c8a50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.251+0000 7ff60b9ff700 1 --2- 172.21.15.37:0/3841364529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6040cf720 0x7ff6040c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.251+0000 7ff60b9ff700 1 --2- 172.21.15.37:0/3841364529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6040d2640 0x7ff60414e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.251+0000 7ff60b9ff700 1 -- 172.21.15.37:0/3841364529 >> 172.21.15.37:0/3841364529 conn(0x7ff604071660 msgr2=0x7ff60415c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:34.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.251+0000 7ff60b9ff700 1 -- 172.21.15.37:0/3841364529 shutdown_connections 2023-07-12T02:04:34.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.251+0000 7ff60b9ff700 1 -- 172.21.15.37:0/3841364529 wait complete. 2023-07-12T02:04:34.272 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-12T02:04:34.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:04:34.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.469+0000 7f3bd01ff700 1 Processor -- start 2023-07-12T02:04:34.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.470+0000 7f3bd01ff700 1 -- start start 2023-07-12T02:04:34.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.471+0000 7f3bd01ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc815c460 0x7f3bc80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.471+0000 7f3bd01ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc80d1790 con 0x7f3bc80cf8f0 2023-07-12T02:04:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.471+0000 7f3bd01ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc80cd950 con 0x7f3bc80d2640 2023-07-12T02:04:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.471+0000 7f3bd01ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80cedd0 con 0x7f3bc815c460 2023-07-12T02:04:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.471+0000 7f3bce79c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3bc80cf8f0 0x7f3bc815fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39770/0 (socket says 172.21.15.37:39770) 2023-07-12T02:04:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.471+0000 7f3bce79c700 1 -- 172.21.15.37:0/974198382 learned_addr learned my addr 172.21.15.37:0/974198382 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:34.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.471+0000 7f3bcdf9b700 1 --2- 172.21.15.37:0/974198382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc815c460 0x7f3bc80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:34.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.472+0000 7f3bccf99700 1 -- 172.21.15.37:0/974198382 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423108933 0 0) 0x7f3bc80d1790 con 0x7f3bc80cf8f0 2023-07-12T02:04:34.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.472+0000 7f3bccf99700 1 -- 172.21.15.37:0/974198382 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bb40035b0 con 0x7f3bc80cf8f0 2023-07-12T02:04:34.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.472+0000 7f3bccf99700 1 -- 172.21.15.37:0/974198382 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173596666 0 0) 0x7f3bc80cd950 con 0x7f3bc80d2640 2023-07-12T02:04:34.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.472+0000 7f3bccf99700 1 -- 172.21.15.37:0/974198382 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc80d1790 con 0x7f3bc80d2640 2023-07-12T02:04:34.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.472+0000 7f3bcdf9b700 1 -- 172.21.15.37:0/974198382 >> v1:172.21.15.196:6789/0 conn(0x7f3bc80d2640 legacy=0x7f3bc80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:34.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.472+0000 7f3bcdf9b700 1 -- 172.21.15.37:0/974198382 >> v1:172.21.15.37:6789/0 conn(0x7f3bc80cf8f0 legacy=0x7f3bc815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:34.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.472+0000 7f3bcdf9b700 1 -- 172.21.15.37:0/974198382 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc80d14b0 con 0x7f3bc815c460 2023-07-12T02:04:34.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.472+0000 7f3bcdf9b700 1 --2- 172.21.15.37:0/974198382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc815c460 0x7f3bc80b59d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009870 tx=0x7f3bc4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=879e81945022876f server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:34.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.472+0000 7f3bccf99700 1 -- 172.21.15.37:0/974198382 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4011830 con 0x7f3bc815c460 2023-07-12T02:04:34.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.473+0000 7f3bccf99700 1 -- 172.21.15.37:0/974198382 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc4011990 con 0x7f3bc815c460 2023-07-12T02:04:34.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.473+0000 7f3bccf99700 1 -- 172.21.15.37:0/974198382 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4011d20 con 0x7f3bc815c460 2023-07-12T02:04:34.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.473+0000 7f3bd01ff700 1 -- 172.21.15.37:0/974198382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc815c460 msgr2=0x7f3bc80b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:34.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.473+0000 7f3bd01ff700 1 --2- 172.21.15.37:0/974198382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc815c460 0x7f3bc80b59d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009870 tx=0x7f3bc4009b80 comp rx=0 tx=0).stop 2023-07-12T02:04:34.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.473+0000 7f3bd01ff700 1 -- 172.21.15.37:0/974198382 shutdown_connections 2023-07-12T02:04:34.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.473+0000 7f3bd01ff700 1 --2- 172.21.15.37:0/974198382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc815c460 0x7f3bc80b59d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.473+0000 7f3bd01ff700 1 -- 172.21.15.37:0/974198382 >> 172.21.15.37:0/974198382 conn(0x7f3bc8071660 msgr2=0x7f3bc8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:34.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.473+0000 7f3bd01ff700 1 -- 172.21.15.37:0/974198382 shutdown_connections 2023-07-12T02:04:34.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.473+0000 7f3bd01ff700 1 -- 172.21.15.37:0/974198382 wait complete. 2023-07-12T02:04:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.475+0000 7f3bd01ff700 1 Processor -- start 2023-07-12T02:04:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.475+0000 7f3bd01ff700 1 -- start start 2023-07-12T02:04:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.476+0000 7f3bd01ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc80cf8f0 0x7f3bc814cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.476+0000 7f3bd01ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3bc80d2640 0x7f3bc80cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.476+0000 7f3bd01ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bc815c460 0x7f3bc80c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:34.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.476+0000 7f3bd01ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc8158200 con 0x7f3bc815c460 2023-07-12T02:04:34.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.476+0000 7f3bd01ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80cc170 con 0x7f3bc80d2640 2023-07-12T02:04:34.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.476+0000 7f3bd01ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80cc450 con 0x7f3bc80cf8f0 2023-07-12T02:04:34.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.476+0000 7f3bce79c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bc815c460 0x7f3bc80c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:34.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.476+0000 7f3bcdf9b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc80cf8f0 0x7f3bc814cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:34.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.476+0000 7f3bce79c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bc815c460 0x7f3bc80c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35448/0 (socket says 172.21.15.37:35448) 2023-07-12T02:04:34.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.476+0000 7f3bce79c700 1 -- 172.21.15.37:0/2859418 learned_addr learned my addr 172.21.15.37:0/2859418 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:34.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.476+0000 7f3bcd79a700 1 --2- 172.21.15.37:0/2859418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3bc80d2640 0x7f3bc80cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:34.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.477+0000 7f3bce79c700 1 -- 172.21.15.37:0/2859418 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc80cf8f0 msgr2=0x7f3bc814cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:34.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.477+0000 7f3bce79c700 1 --2- 172.21.15.37:0/2859418 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc80cf8f0 0x7f3bc814cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.477+0000 7f3bce79c700 1 -- 172.21.15.37:0/2859418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3bc80d2640 msgr2=0x7f3bc80cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:34.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.477+0000 7f3bce79c700 1 --2- 172.21.15.37:0/2859418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3bc80d2640 0x7f3bc80cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.477+0000 7f3bce79c700 1 -- 172.21.15.37:0/2859418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc40094a0 con 0x7f3bc815c460 2023-07-12T02:04:34.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.477+0000 7f3bce79c700 1 --2- 172.21.15.37:0/2859418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bc815c460 0x7f3bc80c8a90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000caa0 tx=0x7f3bc000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.477+0000 7f3bbe7fc700 1 -- 172.21.15.37:0/2859418 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000a9e0 con 0x7f3bc815c460 2023-07-12T02:04:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.477+0000 7f3bbe7fc700 1 -- 172.21.15.37:0/2859418 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc000ab40 con 0x7f3bc815c460 2023-07-12T02:04:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.477+0000 7f3bd01ff700 1 -- 172.21.15.37:0/2859418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc8158410 con 0x7f3bc815c460 2023-07-12T02:04:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.477+0000 7f3bbe7fc700 1 -- 172.21.15.37:0/2859418 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0012400 con 0x7f3bc815c460 2023-07-12T02:04:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.477+0000 7f3bd01ff700 1 -- 172.21.15.37:0/2859418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc81e6930 con 0x7f3bc815c460 2023-07-12T02:04:34.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.478+0000 7f3bd01ff700 1 -- 172.21.15.37:0/2859418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc8158930 con 0x7f3bc815c460 2023-07-12T02:04:34.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.479+0000 7f3bbe7fc700 1 -- 172.21.15.37:0/2859418 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3bc001b3b0 con 0x7f3bc815c460 2023-07-12T02:04:34.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.481+0000 7f3bbe7fc700 1 --2- 172.21.15.37:0/2859418 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3bac06ace0 0x7f3bac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:34.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.481+0000 7f3bbe7fc700 1 -- 172.21.15.37:0/2859418 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3bc0089480 con 0x7f3bc815c460 2023-07-12T02:04:34.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.481+0000 7f3bcdf9b700 1 --2- 172.21.15.37:0/2859418 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3bac06ace0 0x7f3bac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:34.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.482+0000 7f3bcdf9b700 1 --2- 172.21.15.37:0/2859418 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3bac06ace0 0x7f3bac06d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40097c0 tx=0x7f3bc401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:34.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.485+0000 7f3bbe7fc700 1 -- 172.21.15.37:0/2859418 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3bc8158930 con 0x7f3bc815c460 2023-07-12T02:04:34.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.693+0000 7f3bd01ff700 1 -- 172.21.15.37:0/2859418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bc8158930 con 0x7f3bc815c460 2023-07-12T02:04:34.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.694+0000 7f3bbe7fc700 1 -- 172.21.15.37:0/2859418 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f3bc8158930 con 0x7f3bc815c460 2023-07-12T02:04:34.698 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:34.698 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:02.702198+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:04:34.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.697+0000 7f3bd01ff700 1 -- 172.21.15.37:0/2859418 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3bac06ace0 msgr2=0x7f3bac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:34.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.697+0000 7f3bd01ff700 1 --2- 172.21.15.37:0/2859418 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3bac06ace0 0x7f3bac06d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40097c0 tx=0x7f3bc401c040 comp rx=0 tx=0).stop 2023-07-12T02:04:34.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.697+0000 7f3bd01ff700 1 -- 172.21.15.37:0/2859418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bc815c460 msgr2=0x7f3bc80c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:34.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.697+0000 7f3bd01ff700 1 --2- 172.21.15.37:0/2859418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bc815c460 0x7f3bc80c8a90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000caa0 tx=0x7f3bc000cdb0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.697+0000 7f3bd01ff700 1 -- 172.21.15.37:0/2859418 shutdown_connections 2023-07-12T02:04:34.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.697+0000 7f3bd01ff700 1 --2- 172.21.15.37:0/2859418 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3bac06ace0 0x7f3bac06d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.697+0000 7f3bd01ff700 1 --2- 172.21.15.37:0/2859418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bc815c460 0x7f3bc80c8a90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.697+0000 7f3bd01ff700 1 --2- 172.21.15.37:0/2859418 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc80cf8f0 0x7f3bc814cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.697+0000 7f3bd01ff700 1 --2- 172.21.15.37:0/2859418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3bc80d2640 0x7f3bc80cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.697+0000 7f3bd01ff700 1 -- 172.21.15.37:0/2859418 >> 172.21.15.37:0/2859418 conn(0x7f3bc8071660 msgr2=0x7f3bc80b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:34.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.697+0000 7f3bd01ff700 1 -- 172.21.15.37:0/2859418 shutdown_connections 2023-07-12T02:04:34.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.697+0000 7f3bd01ff700 1 -- 172.21.15.37:0/2859418 wait complete. 2023-07-12T02:04:34.718 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:03:56.039938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:03:56.612707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-12T02:04:00.200885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-12T02:04:34.719 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:04:34.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.919+0000 7f73147ff700 1 Processor -- start 2023-07-12T02:04:34.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.919+0000 7f73147ff700 1 -- start start 2023-07-12T02:04:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.920+0000 7f73147ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f730c0d3730 0x7f730c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.920+0000 7f73147ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f730c0cfa90 0x7f730c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.920+0000 7f73147ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730c0d0b20 con 0x7f730c0b8430 2023-07-12T02:04:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.920+0000 7f73147ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730c0cda30 con 0x7f730c0cfa90 2023-07-12T02:04:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.920+0000 7f73147ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0b8800 con 0x7f730c0d3730 2023-07-12T02:04:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.921+0000 7f7312d9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f730c0cfa90 0x7f730c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:34.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.921+0000 7f7312d9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f730c0cfa90 0x7f730c0d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35458/0 (socket says 172.21.15.37:35458) 2023-07-12T02:04:34.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.921+0000 7f7312d9c700 1 -- 172.21.15.37:0/3902846671 learned_addr learned my addr 172.21.15.37:0/3902846671 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:34.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.921+0000 7f7311d9a700 1 --2- 172.21.15.37:0/3902846671 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f730c0d3730 0x7f730c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:34.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.921+0000 7f7312d9c700 1 -- 172.21.15.37:0/3902846671 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f730c0d3730 msgr2=0x7f730c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:34.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.921+0000 7f7312d9c700 1 --2- 172.21.15.37:0/3902846671 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f730c0d3730 0x7f730c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.921+0000 7f7312d9c700 1 -- 172.21.15.37:0/3902846671 >> v1:172.21.15.196:6789/0 conn(0x7f730c0b8430 legacy=0x7f730c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:34.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.921+0000 7f7312d9c700 1 -- 172.21.15.37:0/3902846671 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c0cfeb0 con 0x7f730c0cfa90 2023-07-12T02:04:34.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.921+0000 7f7312d9c700 1 --2- 172.21.15.37:0/3902846671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c0cfa90 0x7f730c0d0fb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7304009e50 tx=0x7f730400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c901d7b18beb8c7b server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:34.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.922+0000 7f7311599700 1 -- 172.21.15.37:0/3902846671 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730400e070 con 0x7f730c0cfa90 2023-07-12T02:04:34.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.922+0000 7f7311599700 1 -- 172.21.15.37:0/3902846671 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730400b9c0 con 0x7f730c0cfa90 2023-07-12T02:04:34.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.922+0000 7f7311599700 1 -- 172.21.15.37:0/3902846671 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730400bd70 con 0x7f730c0cfa90 2023-07-12T02:04:34.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.922+0000 7f73147ff700 1 -- 172.21.15.37:0/3902846671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c0cfa90 msgr2=0x7f730c0d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:34.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.922+0000 7f73147ff700 1 --2- 172.21.15.37:0/3902846671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c0cfa90 0x7f730c0d0fb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7304009e50 tx=0x7f730400b330 comp rx=0 tx=0).stop 2023-07-12T02:04:34.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.922+0000 7f73147ff700 1 -- 172.21.15.37:0/3902846671 shutdown_connections 2023-07-12T02:04:34.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.922+0000 7f73147ff700 1 --2- 172.21.15.37:0/3902846671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c0cfa90 0x7f730c0d0fb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.922+0000 7f73147ff700 1 --2- 172.21.15.37:0/3902846671 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f730c0d3730 0x7f730c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.922+0000 7f73147ff700 1 -- 172.21.15.37:0/3902846671 >> 172.21.15.37:0/3902846671 conn(0x7f730c06b3f0 msgr2=0x7f730c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:34.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.922+0000 7f73147ff700 1 -- 172.21.15.37:0/3902846671 shutdown_connections 2023-07-12T02:04:34.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.922+0000 7f73147ff700 1 -- 172.21.15.37:0/3902846671 wait complete. 2023-07-12T02:04:34.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.924+0000 7f73147ff700 1 Processor -- start 2023-07-12T02:04:34.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.924+0000 7f73147ff700 1 -- start start 2023-07-12T02:04:34.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.925+0000 7f73147ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f730c0b8430 0x7f730c158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:34.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.925+0000 7f73147ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f730c0cfa90 0x7f730c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:34.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.925+0000 7f73147ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c0d3730 0x7f730c0c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:34.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.925+0000 7f73147ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0cb800 con 0x7f730c0d3730 2023-07-12T02:04:34.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.925+0000 7f73147ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0cbae0 con 0x7f730c0cfa90 2023-07-12T02:04:34.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.925+0000 7f73147ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730c1594f0 con 0x7f730c0b8430 2023-07-12T02:04:34.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.925+0000 7f7312d9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c0d3730 0x7f730c0c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:34.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.925+0000 7f7312d9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c0d3730 0x7f730c0c77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35470/0 (socket says 172.21.15.37:35470) 2023-07-12T02:04:34.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.925+0000 7f7312d9c700 1 -- 172.21.15.37:0/2162750758 learned_addr learned my addr 172.21.15.37:0/2162750758 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:34.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.926+0000 7f7311d9a700 1 --2- 172.21.15.37:0/2162750758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f730c0cfa90 0x7f730c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:34.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.926+0000 7f731259b700 1 --2- 172.21.15.37:0/2162750758 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f730c0b8430 0x7f730c158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:34.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.926+0000 7f7312d9c700 1 -- 172.21.15.37:0/2162750758 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f730c0b8430 msgr2=0x7f730c158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:34.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.926+0000 7f7312d9c700 1 --2- 172.21.15.37:0/2162750758 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f730c0b8430 0x7f730c158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.926+0000 7f7312d9c700 1 -- 172.21.15.37:0/2162750758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f730c0cfa90 msgr2=0x7f730c0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:34.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.926+0000 7f7312d9c700 1 --2- 172.21.15.37:0/2162750758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f730c0cfa90 0x7f730c0c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:34.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.926+0000 7f7312d9c700 1 -- 172.21.15.37:0/2162750758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7304009b30 con 0x7f730c0d3730 2023-07-12T02:04:34.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.926+0000 7f7311d9a700 1 --2- 172.21.15.37:0/2162750758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f730c0cfa90 0x7f730c0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:34.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.926+0000 7f7312d9c700 1 --2- 172.21.15.37:0/2162750758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c0d3730 0x7f730c0c77f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f730c06c780 tx=0x7f7304004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:34.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.926+0000 7f7302ffd700 1 -- 172.21.15.37:0/2162750758 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304004960 con 0x7f730c0d3730 2023-07-12T02:04:34.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.926+0000 7f7302ffd700 1 -- 172.21.15.37:0/2162750758 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73040099b0 con 0x7f730c0d3730 2023-07-12T02:04:34.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.926+0000 7f7302ffd700 1 -- 172.21.15.37:0/2162750758 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730401c680 con 0x7f730c0d3730 2023-07-12T02:04:34.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.926+0000 7f73147ff700 1 -- 172.21.15.37:0/2162750758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730c0c81b0 con 0x7f730c0d3730 2023-07-12T02:04:34.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.926+0000 7f73147ff700 1 -- 172.21.15.37:0/2162750758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730c0c8770 con 0x7f730c0d3730 2023-07-12T02:04:34.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.927+0000 7f73147ff700 1 -- 172.21.15.37:0/2162750758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730c04ea60 con 0x7f730c0d3730 2023-07-12T02:04:34.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.928+0000 7f7302ffd700 1 -- 172.21.15.37:0/2162750758 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f730401c7e0 con 0x7f730c0d3730 2023-07-12T02:04:34.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.929+0000 7f7302ffd700 1 --2- 172.21.15.37:0/2162750758 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f72f006ace0 0x7f72f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:34.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.930+0000 7f7302ffd700 1 -- 172.21.15.37:0/2162750758 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f730408b4f0 con 0x7f730c0d3730 2023-07-12T02:04:34.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.930+0000 7f731259b700 1 --2- 172.21.15.37:0/2162750758 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f72f006ace0 0x7f72f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:34.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.931+0000 7f731259b700 1 --2- 172.21.15.37:0/2162750758 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f72f006ace0 0x7f72f006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f730c1f4df0 tx=0x7f7308009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:34.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:34.934+0000 7f7302ffd700 1 -- 172.21.15.37:0/2162750758 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f73040562a0 con 0x7f730c0d3730 2023-07-12T02:04:35.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.142+0000 7f73147ff700 1 -- 172.21.15.37:0/2162750758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f730c06b8d0 con 0x7f730c0d3730 2023-07-12T02:04:35.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.143+0000 7f7302ffd700 1 -- 172.21.15.37:0/2162750758 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73040598c0 con 0x7f730c0d3730 2023-07-12T02:04:35.147 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:04:35.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.145+0000 7f73147ff700 1 -- 172.21.15.37:0/2162750758 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f72f006ace0 msgr2=0x7f72f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:35.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.145+0000 7f73147ff700 1 --2- 172.21.15.37:0/2162750758 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f72f006ace0 0x7f72f006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f730c1f4df0 tx=0x7f7308009040 comp rx=0 tx=0).stop 2023-07-12T02:04:35.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.145+0000 7f73147ff700 1 -- 172.21.15.37:0/2162750758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c0d3730 msgr2=0x7f730c0c77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:35.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.145+0000 7f73147ff700 1 --2- 172.21.15.37:0/2162750758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c0d3730 0x7f730c0c77f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f730c06c780 tx=0x7f7304004ad0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.145+0000 7f73147ff700 1 -- 172.21.15.37:0/2162750758 shutdown_connections 2023-07-12T02:04:35.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.145+0000 7f73147ff700 1 --2- 172.21.15.37:0/2162750758 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f72f006ace0 0x7f72f006d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.145+0000 7f73147ff700 1 --2- 172.21.15.37:0/2162750758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c0d3730 0x7f730c0c77f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.145+0000 7f73147ff700 1 --2- 172.21.15.37:0/2162750758 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f730c0b8430 0x7f730c158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.145+0000 7f73147ff700 1 --2- 172.21.15.37:0/2162750758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f730c0cfa90 0x7f730c0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.145+0000 7f73147ff700 1 -- 172.21.15.37:0/2162750758 >> 172.21.15.37:0/2162750758 conn(0x7f730c06b3f0 msgr2=0x7f730c0d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:35.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.145+0000 7f73147ff700 1 -- 172.21.15.37:0/2162750758 shutdown_connections 2023-07-12T02:04:35.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.145+0000 7f73147ff700 1 -- 172.21.15.37:0/2162750758 wait complete. 2023-07-12T02:04:35.167 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:04:35.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.367+0000 7f1e1a59d700 1 Processor -- start 2023-07-12T02:04:35.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.368+0000 7f1e1a59d700 1 -- start start 2023-07-12T02:04:35.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.369+0000 7f1e1a59d700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1e140d2bf0 0x7f1e14160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:35.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.369+0000 7f1e1a59d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e140d09a0 con 0x7f1e140cebb0 2023-07-12T02:04:35.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.369+0000 7f1e1a59d700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e140b8530 con 0x7f1e140b8160 2023-07-12T02:04:35.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.369+0000 7f1e1a59d700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e140cf030 con 0x7f1e140d2bf0 2023-07-12T02:04:35.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.369+0000 7f1e18d9a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1e140cebb0 0x7f1e140d24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39780/0 (socket says 172.21.15.37:39780) 2023-07-12T02:04:35.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.369+0000 7f1e18d9a700 1 -- 172.21.15.37:0/2724350712 learned_addr learned my addr 172.21.15.37:0/2724350712 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:35.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.369+0000 7f1e0bfff700 1 -- 172.21.15.37:0/2724350712 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003106830 0 0) 0x7f1e140d09a0 con 0x7f1e140cebb0 2023-07-12T02:04:35.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.369+0000 7f1e19d9c700 1 --2- 172.21.15.37:0/2724350712 >> v2:172.21.15.196:3300/0 conn(0x7f1e140d2bf0 0x7f1e14160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:35.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.369+0000 7f1e0bfff700 1 -- 172.21.15.37:0/2724350712 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e000035b0 con 0x7f1e140cebb0 2023-07-12T02:04:35.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.370+0000 7f1e0bfff700 1 -- 172.21.15.37:0/2724350712 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 507920566 0 0) 0x7f1e000035b0 con 0x7f1e140cebb0 2023-07-12T02:04:35.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.370+0000 7f1e0bfff700 1 -- 172.21.15.37:0/2724350712 >> v2:172.21.15.196:3300/0 conn(0x7f1e140d2bf0 msgr2=0x7f1e14160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:35.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.370+0000 7f1e0bfff700 1 --2- 172.21.15.37:0/2724350712 >> v2:172.21.15.196:3300/0 conn(0x7f1e140d2bf0 0x7f1e14160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.370+0000 7f1e0bfff700 1 -- 172.21.15.37:0/2724350712 >> v1:172.21.15.196:6789/0 conn(0x7f1e140b8160 legacy=0x7f1e140d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:35.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.370+0000 7f1e0bfff700 1 -- 172.21.15.37:0/2724350712 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e140d0670 con 0x7f1e140cebb0 2023-07-12T02:04:35.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.370+0000 7f1e0bfff700 1 -- 172.21.15.37:0/2724350712 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7f1e04001670 con 0x7f1e140cebb0 2023-07-12T02:04:35.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.370+0000 7f1e0bfff700 1 -- 172.21.15.37:0/2724350712 >> v1:172.21.15.37:6789/0 conn(0x7f1e140cebb0 legacy=0x7f1e140d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:35.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.370+0000 7f1e0bfff700 1 --2- 172.21.15.37:0/2724350712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1e00003a50 0x7f1e00003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:35.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.370+0000 7f1e0bfff700 1 --2- 172.21.15.37:0/2724350712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e00004850 0x7f1e00004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:35.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.370+0000 7f1e0bfff700 1 --2- 172.21.15.37:0/2724350712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e00005200 0x7f1e0000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:35.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.370+0000 7f1e0bfff700 1 -- 172.21.15.37:0/2724350712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140cf030 con 0x7f1e00004850 2023-07-12T02:04:35.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.370+0000 7f1e0bfff700 1 -- 172.21.15.37:0/2724350712 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0000c0e0 con 0x7f1e00005200 2023-07-12T02:04:35.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.370+0000 7f1e0bfff700 1 -- 172.21.15.37:0/2724350712 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0000c2a0 con 0x7f1e00003a50 2023-07-12T02:04:35.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.370+0000 7f1e1959b700 1 --2- 172.21.15.37:0/2724350712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1e00003a50 0x7f1e00003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:35.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.370+0000 7f1e18d9a700 1 --2- 172.21.15.37:0/2724350712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e00004850 0x7f1e00004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:35.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.370+0000 7f1e19d9c700 1 --2- 172.21.15.37:0/2724350712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e00005200 0x7f1e0000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:35.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.371+0000 7f1e18d9a700 1 -- 172.21.15.37:0/2724350712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1e00003a50 msgr2=0x7f1e00003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:35.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.371+0000 7f1e18d9a700 1 --2- 172.21.15.37:0/2724350712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1e00003a50 0x7f1e00003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.371+0000 7f1e18d9a700 1 -- 172.21.15.37:0/2724350712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e00005200 msgr2=0x7f1e0000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:35.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.371+0000 7f1e18d9a700 1 --2- 172.21.15.37:0/2724350712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e00005200 0x7f1e0000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.371+0000 7f1e18d9a700 1 -- 172.21.15.37:0/2724350712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e000035b0 con 0x7f1e00004850 2023-07-12T02:04:35.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.371+0000 7f1e19d9c700 1 -- 172.21.15.37:0/2724350712 reap_dead start 2023-07-12T02:04:35.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.371+0000 7f1e18d9a700 1 --2- 172.21.15.37:0/2724350712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e00004850 0x7f1e00004cc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400c160 tx=0x7f1e00005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f425a5b1da5160 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:35.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.371+0000 7f1e0bfff700 1 -- 172.21.15.37:0/2724350712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04007b30 con 0x7f1e00004850 2023-07-12T02:04:35.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.371+0000 7f1e0bfff700 1 -- 172.21.15.37:0/2724350712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0400cca0 con 0x7f1e00004850 2023-07-12T02:04:35.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.371+0000 7f1e0bfff700 1 -- 172.21.15.37:0/2724350712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04005ba0 con 0x7f1e00004850 2023-07-12T02:04:35.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.372+0000 7f1e1a59d700 1 -- 172.21.15.37:0/2724350712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e00004850 msgr2=0x7f1e00004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:35.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.372+0000 7f1e1a59d700 1 --2- 172.21.15.37:0/2724350712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e00004850 0x7f1e00004cc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400c160 tx=0x7f1e00005880 comp rx=0 tx=0).stop 2023-07-12T02:04:35.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.372+0000 7f1e1a59d700 1 -- 172.21.15.37:0/2724350712 shutdown_connections 2023-07-12T02:04:35.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.372+0000 7f1e1a59d700 1 --2- 172.21.15.37:0/2724350712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e00004850 0x7f1e00004cc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.372+0000 7f1e1a59d700 1 -- 172.21.15.37:0/2724350712 >> 172.21.15.37:0/2724350712 conn(0x7f1e14071660 msgr2=0x7f1e14071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:35.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.372+0000 7f1e1a59d700 1 -- 172.21.15.37:0/2724350712 shutdown_connections 2023-07-12T02:04:35.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.372+0000 7f1e1a59d700 1 -- 172.21.15.37:0/2724350712 wait complete. 2023-07-12T02:04:35.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.374+0000 7f1e1a59d700 1 Processor -- start 2023-07-12T02:04:35.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.374+0000 7f1e1a59d700 1 -- start start 2023-07-12T02:04:35.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.375+0000 7f1e1a59d700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1e00004850 0x7f1e14147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:35.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.375+0000 7f1e1a59d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e14154f90 0x7f1e140c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:35.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.375+0000 7f1e1a59d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e1415da70 0x7f1e1415def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:35.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.375+0000 7f1e1a59d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1415e430 con 0x7f1e14154f90 2023-07-12T02:04:35.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.375+0000 7f1e1a59d700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e14147d50 con 0x7f1e1415da70 2023-07-12T02:04:35.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.375+0000 7f1e1a59d700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140c8dd0 con 0x7f1e00004850 2023-07-12T02:04:35.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.375+0000 7f1e18d9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e14154f90 0x7f1e140c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:35.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.375+0000 7f1e18d9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e14154f90 0x7f1e140c8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35490/0 (socket says 172.21.15.37:35490) 2023-07-12T02:04:35.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.375+0000 7f1e18d9a700 1 -- 172.21.15.37:0/1814077349 learned_addr learned my addr 172.21.15.37:0/1814077349 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:35.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.375+0000 7f1e19d9c700 1 --2- 172.21.15.37:0/1814077349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e1415da70 0x7f1e1415def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:35.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.375+0000 7f1e1959b700 1 --2- 172.21.15.37:0/1814077349 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1e00004850 0x7f1e14147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:35.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.375+0000 7f1e18d9a700 1 -- 172.21.15.37:0/1814077349 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1e00004850 msgr2=0x7f1e14147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:35.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.375+0000 7f1e18d9a700 1 --2- 172.21.15.37:0/1814077349 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1e00004850 0x7f1e14147810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.375+0000 7f1e18d9a700 1 -- 172.21.15.37:0/1814077349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e1415da70 msgr2=0x7f1e1415def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:35.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.375+0000 7f1e18d9a700 1 --2- 172.21.15.37:0/1814077349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e1415da70 0x7f1e1415def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.375+0000 7f1e18d9a700 1 -- 172.21.15.37:0/1814077349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e14157060 con 0x7f1e14154f90 2023-07-12T02:04:35.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.376+0000 7f1e18d9a700 1 --2- 172.21.15.37:0/1814077349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e14154f90 0x7f1e140c8890 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1e04008fd0 tx=0x7f1e140d0910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:35.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.376+0000 7f1e09ffb700 1 -- 172.21.15.37:0/1814077349 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04004c80 con 0x7f1e14154f90 2023-07-12T02:04:35.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.376+0000 7f1e09ffb700 1 -- 172.21.15.37:0/1814077349 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e04004e00 con 0x7f1e14154f90 2023-07-12T02:04:35.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.376+0000 7f1e09ffb700 1 -- 172.21.15.37:0/1814077349 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04007310 con 0x7f1e14154f90 2023-07-12T02:04:35.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.376+0000 7f1e1a59d700 1 -- 172.21.15.37:0/1814077349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e140cc1d0 con 0x7f1e14154f90 2023-07-12T02:04:35.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.376+0000 7f1e1a59d700 1 -- 172.21.15.37:0/1814077349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e140cc780 con 0x7f1e14154f90 2023-07-12T02:04:35.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.377+0000 7f1e1a59d700 1 -- 172.21.15.37:0/1814077349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e14067590 con 0x7f1e14154f90 2023-07-12T02:04:35.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.378+0000 7f1e09ffb700 1 -- 172.21.15.37:0/1814077349 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e04007470 con 0x7f1e14154f90 2023-07-12T02:04:35.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.379+0000 7f1e09ffb700 1 --2- 172.21.15.37:0/1814077349 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1df806ace0 0x7f1df806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:35.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.379+0000 7f1e09ffb700 1 -- 172.21.15.37:0/1814077349 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1e0408a4c0 con 0x7f1e14154f90 2023-07-12T02:04:35.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.379+0000 7f1e1959b700 1 --2- 172.21.15.37:0/1814077349 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1df806ace0 0x7f1df806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:35.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.380+0000 7f1e1959b700 1 --2- 172.21.15.37:0/1814077349 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1df806ace0 0x7f1df806d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1e1415edd0 tx=0x7f1e10009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:35.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.383+0000 7f1e09ffb700 1 -- 172.21.15.37:0/1814077349 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1e04055320 con 0x7f1e14154f90 2023-07-12T02:04:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.590+0000 7f1e1a59d700 1 -- 172.21.15.37:0/1814077349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1e1415e430 con 0x7f1e14154f90 2023-07-12T02:04:35.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.590+0000 7f1e09ffb700 1 -- 172.21.15.37:0/1814077349 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1e04058940 con 0x7f1e14154f90 2023-07-12T02:04:35.594 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:04:35.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.593+0000 7f1e1a59d700 1 -- 172.21.15.37:0/1814077349 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1df806ace0 msgr2=0x7f1df806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:35.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.593+0000 7f1e1a59d700 1 --2- 172.21.15.37:0/1814077349 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1df806ace0 0x7f1df806d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1e1415edd0 tx=0x7f1e10009040 comp rx=0 tx=0).stop 2023-07-12T02:04:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.593+0000 7f1e1a59d700 1 -- 172.21.15.37:0/1814077349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e14154f90 msgr2=0x7f1e140c8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.593+0000 7f1e1a59d700 1 --2- 172.21.15.37:0/1814077349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e14154f90 0x7f1e140c8890 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1e04008fd0 tx=0x7f1e140d0910 comp rx=0 tx=0).stop 2023-07-12T02:04:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.593+0000 7f1e1a59d700 1 -- 172.21.15.37:0/1814077349 shutdown_connections 2023-07-12T02:04:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.593+0000 7f1e1a59d700 1 --2- 172.21.15.37:0/1814077349 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1df806ace0 0x7f1df806d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.593+0000 7f1e1a59d700 1 --2- 172.21.15.37:0/1814077349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e1415da70 0x7f1e1415def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.593+0000 7f1e1a59d700 1 --2- 172.21.15.37:0/1814077349 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1e00004850 0x7f1e14147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.593+0000 7f1e1a59d700 1 --2- 172.21.15.37:0/1814077349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e14154f90 0x7f1e140c8890 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.593+0000 7f1e1a59d700 1 -- 172.21.15.37:0/1814077349 >> 172.21.15.37:0/1814077349 conn(0x7f1e14071660 msgr2=0x7f1e1415f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:35.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.593+0000 7f1e1a59d700 1 -- 172.21.15.37:0/1814077349 shutdown_connections 2023-07-12T02:04:35.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.593+0000 7f1e1a59d700 1 -- 172.21.15.37:0/1814077349 wait complete. 2023-07-12T02:04:35.614 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:04:35.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.813+0000 7f0f517ff700 1 Processor -- start 2023-07-12T02:04:35.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.813+0000 7f0f517ff700 1 -- start start 2023-07-12T02:04:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.814+0000 7f0f517ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f4c0b8430 0x7f0f4c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.814+0000 7f0f517ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0f4c0d3730 0x7f0f4c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.814+0000 7f0f517ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f4c0d0b20 con 0x7f0f4c0cfa90 2023-07-12T02:04:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.814+0000 7f0f517ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f4c0b8800 con 0x7f0f4c0d3730 2023-07-12T02:04:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.814+0000 7f0f517ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c0cfeb0 con 0x7f0f4c0b8430 2023-07-12T02:04:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.814+0000 7f0f4b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0f4c0cfa90 0x7f0f4c15feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39794/0 (socket says 172.21.15.37:39794) 2023-07-12T02:04:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.814+0000 7f0f4b7fe700 1 -- 172.21.15.37:0/2022986031 learned_addr learned my addr 172.21.15.37:0/2022986031 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.815+0000 7f0f4affd700 1 --2- 172.21.15.37:0/2022986031 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f4c0b8430 0x7f0f4c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.815+0000 7f0f43fff700 1 --2- 172.21.15.37:0/2022986031 >> v2:172.21.15.196:3300/0 conn(0x7f0f4c0d3730 0x7f0f4c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.815+0000 7f0f4a7fc700 1 -- 172.21.15.37:0/2022986031 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695564176 0 0) 0x7f0f4c0d0b20 con 0x7f0f4c0cfa90 2023-07-12T02:04:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.815+0000 7f0f4a7fc700 1 -- 172.21.15.37:0/2022986031 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f380035b0 con 0x7f0f4c0cfa90 2023-07-12T02:04:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.815+0000 7f0f4affd700 1 -- 172.21.15.37:0/2022986031 >> v2:172.21.15.196:3300/0 conn(0x7f0f4c0d3730 msgr2=0x7f0f4c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.815+0000 7f0f4affd700 1 --2- 172.21.15.37:0/2022986031 >> v2:172.21.15.196:3300/0 conn(0x7f0f4c0d3730 0x7f0f4c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.815+0000 7f0f4affd700 1 -- 172.21.15.37:0/2022986031 >> v1:172.21.15.37:6789/0 conn(0x7f0f4c0cfa90 legacy=0x7f0f4c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.815+0000 7f0f4affd700 1 -- 172.21.15.37:0/2022986031 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c0b4ee0 con 0x7f0f4c0b8430 2023-07-12T02:04:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.815+0000 7f0f43fff700 1 --2- 172.21.15.37:0/2022986031 >> v2:172.21.15.196:3300/0 conn(0x7f0f4c0d3730 0x7f0f4c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:04:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.815+0000 7f0f4affd700 1 --2- 172.21.15.37:0/2022986031 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f4c0b8430 0x7f0f4c0cd320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009840 tx=0x7f0f3c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a6a42a702d31605 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.816+0000 7f0f4a7fc700 1 -- 172.21.15.37:0/2022986031 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c011830 con 0x7f0f4c0b8430 2023-07-12T02:04:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.816+0000 7f0f4a7fc700 1 -- 172.21.15.37:0/2022986031 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3c011990 con 0x7f0f4c0b8430 2023-07-12T02:04:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.816+0000 7f0f4a7fc700 1 -- 172.21.15.37:0/2022986031 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c011d20 con 0x7f0f4c0b8430 2023-07-12T02:04:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.816+0000 7f0f517ff700 1 -- 172.21.15.37:0/2022986031 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f4c0b8430 msgr2=0x7f0f4c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.816+0000 7f0f517ff700 1 --2- 172.21.15.37:0/2022986031 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f4c0b8430 0x7f0f4c0cd320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009840 tx=0x7f0f3c009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.816+0000 7f0f517ff700 1 -- 172.21.15.37:0/2022986031 shutdown_connections 2023-07-12T02:04:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.816+0000 7f0f517ff700 1 --2- 172.21.15.37:0/2022986031 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f4c0b8430 0x7f0f4c0cd320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.816+0000 7f0f517ff700 1 --2- 172.21.15.37:0/2022986031 >> v2:172.21.15.196:3300/0 conn(0x7f0f4c0d3730 0x7f0f4c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.816+0000 7f0f517ff700 1 -- 172.21.15.37:0/2022986031 >> 172.21.15.37:0/2022986031 conn(0x7f0f4c06b3f0 msgr2=0x7f0f4c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.816+0000 7f0f517ff700 1 -- 172.21.15.37:0/2022986031 shutdown_connections 2023-07-12T02:04:35.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.816+0000 7f0f517ff700 1 -- 172.21.15.37:0/2022986031 wait complete. 2023-07-12T02:04:35.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.818+0000 7f0f517ff700 1 Processor -- start 2023-07-12T02:04:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.818+0000 7f0f517ff700 1 -- start start 2023-07-12T02:04:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.819+0000 7f0f517ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f4c0b8430 0x7f0f4c1f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.819+0000 7f0f517ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f4c0cfa90 0x7f0f4c0b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.819+0000 7f0f517ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f4c0d3730 0x7f0f4c0b7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.819+0000 7f0f517ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c0c6670 con 0x7f0f4c0cfa90 2023-07-12T02:04:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.819+0000 7f0f517ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c1f2480 con 0x7f0f4c0d3730 2023-07-12T02:04:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.819+0000 7f0f517ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c1f2760 con 0x7f0f4c0b8430 2023-07-12T02:04:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.819+0000 7f0f43fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f4c0cfa90 0x7f0f4c0b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.819+0000 7f0f43fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f4c0cfa90 0x7f0f4c0b6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35494/0 (socket says 172.21.15.37:35494) 2023-07-12T02:04:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.819+0000 7f0f43fff700 1 -- 172.21.15.37:0/2134049961 learned_addr learned my addr 172.21.15.37:0/2134049961 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.820+0000 7f0f4affd700 1 --2- 172.21.15.37:0/2134049961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f4c0b8430 0x7f0f4c1f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.820+0000 7f0f4b7fe700 1 --2- 172.21.15.37:0/2134049961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f4c0d3730 0x7f0f4c0b7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.820+0000 7f0f43fff700 1 -- 172.21.15.37:0/2134049961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f4c0b8430 msgr2=0x7f0f4c1f2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.820+0000 7f0f43fff700 1 --2- 172.21.15.37:0/2134049961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f4c0b8430 0x7f0f4c1f2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.820+0000 7f0f43fff700 1 -- 172.21.15.37:0/2134049961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f4c0d3730 msgr2=0x7f0f4c0b7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:35.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.820+0000 7f0f43fff700 1 --2- 172.21.15.37:0/2134049961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f4c0d3730 0x7f0f4c0b7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:35.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.820+0000 7f0f43fff700 1 -- 172.21.15.37:0/2134049961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f340094a0 con 0x7f0f4c0cfa90 2023-07-12T02:04:35.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.820+0000 7f0f43fff700 1 --2- 172.21.15.37:0/2134049961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f4c0cfa90 0x7f0f4c0b6c20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400ebe0 tx=0x7f0f34009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:35.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.820+0000 7f0f437fe700 1 -- 172.21.15.37:0/2134049961 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3400c910 con 0x7f0f4c0cfa90 2023-07-12T02:04:35.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.820+0000 7f0f437fe700 1 -- 172.21.15.37:0/2134049961 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3400ca70 con 0x7f0f4c0cfa90 2023-07-12T02:04:35.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.820+0000 7f0f517ff700 1 -- 172.21.15.37:0/2134049961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3c0094a0 con 0x7f0f4c0cfa90 2023-07-12T02:04:35.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.820+0000 7f0f437fe700 1 -- 172.21.15.37:0/2134049961 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3400cde0 con 0x7f0f4c0cfa90 2023-07-12T02:04:35.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.820+0000 7f0f517ff700 1 -- 172.21.15.37:0/2134049961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4c0c6880 con 0x7f0f4c0cfa90 2023-07-12T02:04:35.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.821+0000 7f0f517ff700 1 -- 172.21.15.37:0/2134049961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f4c0c6bf0 con 0x7f0f4c0cfa90 2023-07-12T02:04:35.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.822+0000 7f0f437fe700 1 -- 172.21.15.37:0/2134049961 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f34013470 con 0x7f0f4c0cfa90 2023-07-12T02:04:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.823+0000 7f0f437fe700 1 --2- 172.21.15.37:0/2134049961 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0f2c06ace0 0x7f0f2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.824+0000 7f0f437fe700 1 -- 172.21.15.37:0/2134049961 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0f34089a70 con 0x7f0f4c0cfa90 2023-07-12T02:04:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.824+0000 7f0f4affd700 1 --2- 172.21.15.37:0/2134049961 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0f2c06ace0 0x7f0f2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.825+0000 7f0f4affd700 1 --2- 172.21.15.37:0/2134049961 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0f2c06ace0 0x7f0f2c06d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c000c00 tx=0x7f0f3c01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:35.828+0000 7f0f437fe700 1 -- 172.21.15.37:0/2134049961 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0f34054710 con 0x7f0f4c0cfa90 2023-07-12T02:04:36.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.032+0000 7f0f517ff700 1 -- 172.21.15.37:0/2134049961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f4c04ea60 con 0x7f0f4c0cfa90 2023-07-12T02:04:36.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.033+0000 7f0f437fe700 1 -- 172.21.15.37:0/2134049961 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f34057d30 con 0x7f0f4c0cfa90 2023-07-12T02:04:36.036 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:04:36.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.035+0000 7f0f517ff700 1 -- 172.21.15.37:0/2134049961 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0f2c06ace0 msgr2=0x7f0f2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.035+0000 7f0f517ff700 1 --2- 172.21.15.37:0/2134049961 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0f2c06ace0 0x7f0f2c06d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c000c00 tx=0x7f0f3c01c040 comp rx=0 tx=0).stop 2023-07-12T02:04:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.035+0000 7f0f517ff700 1 -- 172.21.15.37:0/2134049961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f4c0cfa90 msgr2=0x7f0f4c0b6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.035+0000 7f0f517ff700 1 --2- 172.21.15.37:0/2134049961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f4c0cfa90 0x7f0f4c0b6c20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400ebe0 tx=0x7f0f34009ec0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.035+0000 7f0f517ff700 1 -- 172.21.15.37:0/2134049961 shutdown_connections 2023-07-12T02:04:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.035+0000 7f0f517ff700 1 --2- 172.21.15.37:0/2134049961 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0f2c06ace0 0x7f0f2c06d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.035+0000 7f0f517ff700 1 --2- 172.21.15.37:0/2134049961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f4c0d3730 0x7f0f4c0b7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.035+0000 7f0f517ff700 1 --2- 172.21.15.37:0/2134049961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f4c0b8430 0x7f0f4c1f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.035+0000 7f0f517ff700 1 --2- 172.21.15.37:0/2134049961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f4c0cfa90 0x7f0f4c0b6c20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.035+0000 7f0f517ff700 1 -- 172.21.15.37:0/2134049961 >> 172.21.15.37:0/2134049961 conn(0x7f0f4c06b3f0 msgr2=0x7f0f4c0d18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:36.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.035+0000 7f0f517ff700 1 -- 172.21.15.37:0/2134049961 shutdown_connections 2023-07-12T02:04:36.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.035+0000 7f0f517ff700 1 -- 172.21.15.37:0/2134049961 wait complete. 2023-07-12T02:04:36.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:04:36.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.257+0000 7fb13e7ff700 1 Processor -- start 2023-07-12T02:04:36.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.257+0000 7fb13e7ff700 1 -- start start 2023-07-12T02:04:36.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.259+0000 7fb13e7ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb138158630 0x7fb138158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:36.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.259+0000 7fb13e7ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb1380ccd70 0x7fb138069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:36.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.259+0000 7fb13e7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1380711a0 con 0x7fb13806dfc0 2023-07-12T02:04:36.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.259+0000 7fb13e7ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13806caf0 con 0x7fb138158630 2023-07-12T02:04:36.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.259+0000 7fb13e7ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13806cdd0 con 0x7fb1380ccd70 2023-07-12T02:04:36.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.259+0000 7fb1377fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb13806dfc0 0x7fb13806d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39800/0 (socket says 172.21.15.37:39800) 2023-07-12T02:04:36.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.259+0000 7fb137fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb138158630 0x7fb138158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:36.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.259+0000 7fb1377fe700 1 -- 172.21.15.37:0/240457363 learned_addr learned my addr 172.21.15.37:0/240457363 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:36.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.259+0000 7fb13cd9c700 1 --2- 172.21.15.37:0/240457363 >> v2:172.21.15.196:3300/0 conn(0x7fb1380ccd70 0x7fb138069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:36.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.259+0000 7fb136ffd700 1 -- 172.21.15.37:0/240457363 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880324197 0 0) 0x7fb1380711a0 con 0x7fb13806dfc0 2023-07-12T02:04:36.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.259+0000 7fb137fff700 1 -- 172.21.15.37:0/240457363 >> v2:172.21.15.196:3300/0 conn(0x7fb1380ccd70 msgr2=0x7fb138069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:36.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.259+0000 7fb137fff700 1 --2- 172.21.15.37:0/240457363 >> v2:172.21.15.196:3300/0 conn(0x7fb1380ccd70 0x7fb138069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.259+0000 7fb137fff700 1 -- 172.21.15.37:0/240457363 >> v1:172.21.15.37:6789/0 conn(0x7fb13806dfc0 legacy=0x7fb13806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:36.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.259+0000 7fb137fff700 1 -- 172.21.15.37:0/240457363 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13806d0b0 con 0x7fb138158630 2023-07-12T02:04:36.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.260+0000 7fb137fff700 1 --2- 172.21.15.37:0/240457363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb138158630 0x7fb138158a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb1380c8d90 tx=0x7fb128009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e524f78a279fcb server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:36.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.260+0000 7fb136ffd700 1 -- 172.21.15.37:0/240457363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb128011830 con 0x7fb138158630 2023-07-12T02:04:36.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.260+0000 7fb136ffd700 1 -- 172.21.15.37:0/240457363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb128011990 con 0x7fb138158630 2023-07-12T02:04:36.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.260+0000 7fb136ffd700 1 -- 172.21.15.37:0/240457363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb128011d20 con 0x7fb138158630 2023-07-12T02:04:36.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.261+0000 7fb13e7ff700 1 -- 172.21.15.37:0/240457363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb138158630 msgr2=0x7fb138158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:36.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.261+0000 7fb13e7ff700 1 --2- 172.21.15.37:0/240457363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb138158630 0x7fb138158a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb1380c8d90 tx=0x7fb128009b20 comp rx=0 tx=0).stop 2023-07-12T02:04:36.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.261+0000 7fb13e7ff700 1 -- 172.21.15.37:0/240457363 shutdown_connections 2023-07-12T02:04:36.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.261+0000 7fb13e7ff700 1 --2- 172.21.15.37:0/240457363 >> v2:172.21.15.196:3300/0 conn(0x7fb1380ccd70 0x7fb138069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.261+0000 7fb13e7ff700 1 --2- 172.21.15.37:0/240457363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb138158630 0x7fb138158a00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.261+0000 7fb13e7ff700 1 -- 172.21.15.37:0/240457363 >> 172.21.15.37:0/240457363 conn(0x7fb1380b0fd0 msgr2=0x7fb1380ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:36.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.261+0000 7fb13e7ff700 1 -- 172.21.15.37:0/240457363 shutdown_connections 2023-07-12T02:04:36.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.261+0000 7fb13e7ff700 1 -- 172.21.15.37:0/240457363 wait complete. 2023-07-12T02:04:36.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.263+0000 7fb13e7ff700 1 Processor -- start 2023-07-12T02:04:36.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.263+0000 7fb13e7ff700 1 -- start start 2023-07-12T02:04:36.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb13e7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb13806dfc0 0x7fb1381521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:36.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb13e7ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1380ccd70 0x7fb138158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:36.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb13e7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb138158630 0x7fb1380b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:36.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb13e7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1380c82a0 con 0x7fb13806dfc0 2023-07-12T02:04:36.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb13e7ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1381660a0 con 0x7fb1380ccd70 2023-07-12T02:04:36.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb13e7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb138166380 con 0x7fb138158630 2023-07-12T02:04:36.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb137fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb13806dfc0 0x7fb1381521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:36.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb137fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb13806dfc0 0x7fb1381521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35514/0 (socket says 172.21.15.37:35514) 2023-07-12T02:04:36.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb137fff700 1 -- 172.21.15.37:0/2730642492 learned_addr learned my addr 172.21.15.37:0/2730642492 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:36.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb13cd9c700 1 --2- 172.21.15.37:0/2730642492 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb138158630 0x7fb1380b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:36.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb1377fe700 1 --2- 172.21.15.37:0/2730642492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1380ccd70 0x7fb138158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:36.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb137fff700 1 -- 172.21.15.37:0/2730642492 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb138158630 msgr2=0x7fb1380b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb137fff700 1 --2- 172.21.15.37:0/2730642492 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb138158630 0x7fb1380b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb137fff700 1 -- 172.21.15.37:0/2730642492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1380ccd70 msgr2=0x7fb138158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb137fff700 1 --2- 172.21.15.37:0/2730642492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1380ccd70 0x7fb138158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb137fff700 1 -- 172.21.15.37:0/2730642492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1280094a0 con 0x7fb13806dfc0 2023-07-12T02:04:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb13cd9c700 1 --2- 172.21.15.37:0/2730642492 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb138158630 0x7fb1380b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.264+0000 7fb1377fe700 1 --2- 172.21.15.37:0/2730642492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1380ccd70 0x7fb138158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.265+0000 7fb137fff700 1 --2- 172.21.15.37:0/2730642492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb13806dfc0 0x7fb1381521d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb1280090b0 tx=0x7fb128004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.265+0000 7fb134ff9700 1 -- 172.21.15.37:0/2730642492 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1280038a0 con 0x7fb13806dfc0 2023-07-12T02:04:36.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.265+0000 7fb134ff9700 1 -- 172.21.15.37:0/2730642492 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12801f070 con 0x7fb13806dfc0 2023-07-12T02:04:36.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.265+0000 7fb134ff9700 1 -- 172.21.15.37:0/2730642492 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb128003c20 con 0x7fb13806dfc0 2023-07-12T02:04:36.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.265+0000 7fb13e7ff700 1 -- 172.21.15.37:0/2730642492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb138166660 con 0x7fb13806dfc0 2023-07-12T02:04:36.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.265+0000 7fb13e7ff700 1 -- 172.21.15.37:0/2730642492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb138158f40 con 0x7fb13806dfc0 2023-07-12T02:04:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.266+0000 7fb13e7ff700 1 -- 172.21.15.37:0/2730642492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1381661e0 con 0x7fb13806dfc0 2023-07-12T02:04:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.267+0000 7fb134ff9700 1 -- 172.21.15.37:0/2730642492 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb128026480 con 0x7fb13806dfc0 2023-07-12T02:04:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.268+0000 7fb134ff9700 1 --2- 172.21.15.37:0/2730642492 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb12406ace0 0x7fb12406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.268+0000 7fb134ff9700 1 -- 172.21.15.37:0/2730642492 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb128021070 con 0x7fb13806dfc0 2023-07-12T02:04:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.269+0000 7fb1377fe700 1 --2- 172.21.15.37:0/2730642492 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb12406ace0 0x7fb12406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:36.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.269+0000 7fb1377fe700 1 --2- 172.21.15.37:0/2730642492 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb12406ace0 0x7fb12406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb12c007fd0 tx=0x7fb12c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:36.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.273+0000 7fb134ff9700 1 -- 172.21.15.37:0/2730642492 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb1381661e0 con 0x7fb13806dfc0 2023-07-12T02:04:36.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.479+0000 7fb13e7ff700 1 -- 172.21.15.37:0/2730642492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb1381661e0 con 0x7fb13806dfc0 2023-07-12T02:04:36.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.480+0000 7fb134ff9700 1 -- 172.21.15.37:0/2730642492 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1381661e0 con 0x7fb13806dfc0 2023-07-12T02:04:36.483 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-12T02:04:36.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.482+0000 7fb13e7ff700 1 -- 172.21.15.37:0/2730642492 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb12406ace0 msgr2=0x7fb12406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:36.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.482+0000 7fb13e7ff700 1 --2- 172.21.15.37:0/2730642492 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb12406ace0 0x7fb12406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb12c007fd0 tx=0x7fb12c009040 comp rx=0 tx=0).stop 2023-07-12T02:04:36.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.482+0000 7fb13e7ff700 1 -- 172.21.15.37:0/2730642492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb13806dfc0 msgr2=0x7fb1381521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:36.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.482+0000 7fb13e7ff700 1 --2- 172.21.15.37:0/2730642492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb13806dfc0 0x7fb1381521d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb1280090b0 tx=0x7fb128004750 comp rx=0 tx=0).stop 2023-07-12T02:04:36.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.482+0000 7fb13e7ff700 1 -- 172.21.15.37:0/2730642492 shutdown_connections 2023-07-12T02:04:36.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.482+0000 7fb13e7ff700 1 --2- 172.21.15.37:0/2730642492 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb12406ace0 0x7fb12406d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.482+0000 7fb13e7ff700 1 --2- 172.21.15.37:0/2730642492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb13806dfc0 0x7fb1381521d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.482+0000 7fb13e7ff700 1 --2- 172.21.15.37:0/2730642492 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb138158630 0x7fb1380b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.482+0000 7fb13e7ff700 1 --2- 172.21.15.37:0/2730642492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1380ccd70 0x7fb138158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.482+0000 7fb13e7ff700 1 -- 172.21.15.37:0/2730642492 >> 172.21.15.37:0/2730642492 conn(0x7fb1380b0fd0 msgr2=0x7fb13806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:36.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.482+0000 7fb13e7ff700 1 -- 172.21.15.37:0/2730642492 shutdown_connections 2023-07-12T02:04:36.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.482+0000 7fb13e7ff700 1 -- 172.21.15.37:0/2730642492 wait complete. 2023-07-12T02:04:36.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-12T02:04:36.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.703+0000 7fbcb19ff700 1 Processor -- start 2023-07-12T02:04:36.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.703+0000 7fbcb19ff700 1 -- start start 2023-07-12T02:04:36.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.704+0000 7fbcb19ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcac0b8430 0x7fbcac0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:36.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.704+0000 7fbcb19ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbcac0d3730 0x7fbcac0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:36.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.704+0000 7fbcb19ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbcac0cfa90 0x7fbcac15feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:36.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.704+0000 7fbcb19ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcac0b8800 con 0x7fbcac0d3730 2023-07-12T02:04:36.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.704+0000 7fbcb19ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcac0d0b20 con 0x7fbcac0cfa90 2023-07-12T02:04:36.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.704+0000 7fbcb19ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0cfeb0 con 0x7fbcac0b8430 2023-07-12T02:04:36.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.705+0000 7fbcaa7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbcac0d3730 0x7fbcac0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:36.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.705+0000 7fbcaa7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbcac0d3730 0x7fbcac0cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35516/0 (socket says 172.21.15.37:35516) 2023-07-12T02:04:36.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.705+0000 7fbcaa7fc700 1 -- 172.21.15.37:0/1225485528 learned_addr learned my addr 172.21.15.37:0/1225485528 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:36.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.705+0000 7fbcaaffd700 1 --2- 172.21.15.37:0/1225485528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcac0b8430 0x7fbcac0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:36.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.705+0000 7fbcab7fe700 1 --2- 172.21.15.37:0/1225485528 >> v2:172.21.15.196:3300/0 conn(0x7fbcac0cfa90 0x7fbcac15feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.705+0000 7fbcaa7fc700 1 -- 172.21.15.37:0/1225485528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcac0b8430 msgr2=0x7fbcac0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.705+0000 7fbcaa7fc700 1 --2- 172.21.15.37:0/1225485528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcac0b8430 0x7fbcac0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.705+0000 7fbcaa7fc700 1 -- 172.21.15.37:0/1225485528 >> v2:172.21.15.196:3300/0 conn(0x7fbcac0cfa90 msgr2=0x7fbcac15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.705+0000 7fbcaa7fc700 1 --2- 172.21.15.37:0/1225485528 >> v2:172.21.15.196:3300/0 conn(0x7fbcac0cfa90 0x7fbcac15feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.705+0000 7fbcaa7fc700 1 -- 172.21.15.37:0/1225485528 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac0b4ee0 con 0x7fbcac0d3730 2023-07-12T02:04:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.705+0000 7fbcaa7fc700 1 --2- 172.21.15.37:0/1225485528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcac0d3730 0x7fbcac0cf550 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbcac06c570 tx=0x7fbca0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fabd66b7668632 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.706+0000 7fbca9ffb700 1 -- 172.21.15.37:0/1225485528 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0011830 con 0x7fbcac0d3730 2023-07-12T02:04:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.706+0000 7fbca9ffb700 1 -- 172.21.15.37:0/1225485528 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca0011990 con 0x7fbcac0d3730 2023-07-12T02:04:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.706+0000 7fbca9ffb700 1 -- 172.21.15.37:0/1225485528 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0011d20 con 0x7fbcac0d3730 2023-07-12T02:04:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.706+0000 7fbcb19ff700 1 -- 172.21.15.37:0/1225485528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcac0d3730 msgr2=0x7fbcac0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.706+0000 7fbcb19ff700 1 --2- 172.21.15.37:0/1225485528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcac0d3730 0x7fbcac0cf550 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbcac06c570 tx=0x7fbca0009bd0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.706+0000 7fbcb19ff700 1 -- 172.21.15.37:0/1225485528 shutdown_connections 2023-07-12T02:04:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.706+0000 7fbcb19ff700 1 --2- 172.21.15.37:0/1225485528 >> v2:172.21.15.196:3300/0 conn(0x7fbcac0cfa90 0x7fbcac15feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.706+0000 7fbcb19ff700 1 --2- 172.21.15.37:0/1225485528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcac0b8430 0x7fbcac0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.706+0000 7fbcb19ff700 1 --2- 172.21.15.37:0/1225485528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcac0d3730 0x7fbcac0cf550 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.706+0000 7fbcb19ff700 1 -- 172.21.15.37:0/1225485528 >> 172.21.15.37:0/1225485528 conn(0x7fbcac06b3f0 msgr2=0x7fbcac06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:36.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.707+0000 7fbcb19ff700 1 -- 172.21.15.37:0/1225485528 shutdown_connections 2023-07-12T02:04:36.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.707+0000 7fbcb19ff700 1 -- 172.21.15.37:0/1225485528 wait complete. 2023-07-12T02:04:36.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.708+0000 7fbcb19ff700 1 Processor -- start 2023-07-12T02:04:36.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.708+0000 7fbcb19ff700 1 -- start start 2023-07-12T02:04:36.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.709+0000 7fbcb19ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcac0b8430 0x7fbcac0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:36.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.709+0000 7fbcb19ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcac0cfa90 0x7fbcac0cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:36.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.709+0000 7fbcb19ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcac0d3730 0x7fbcac0b7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:36.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.709+0000 7fbcb19ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac1f2d20 con 0x7fbcac0cfa90 2023-07-12T02:04:36.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.709+0000 7fbcb19ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0c9cb0 con 0x7fbcac0b8430 2023-07-12T02:04:36.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.709+0000 7fbcb19ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0c9f90 con 0x7fbcac0d3730 2023-07-12T02:04:36.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.710+0000 7fbcaa7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcac0cfa90 0x7fbcac0cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:36.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.710+0000 7fbcaa7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcac0cfa90 0x7fbcac0cb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35532/0 (socket says 172.21.15.37:35532) 2023-07-12T02:04:36.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.710+0000 7fbcaaffd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcac0b8430 0x7fbcac0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:36.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.710+0000 7fbcaa7fc700 1 -- 172.21.15.37:0/1923523838 learned_addr learned my addr 172.21.15.37:0/1923523838 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:36.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.710+0000 7fbcab7fe700 1 --2- 172.21.15.37:0/1923523838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcac0d3730 0x7fbcac0b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:36.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.710+0000 7fbcaa7fc700 1 -- 172.21.15.37:0/1923523838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcac0d3730 msgr2=0x7fbcac0b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:36.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.710+0000 7fbcaa7fc700 1 --2- 172.21.15.37:0/1923523838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcac0d3730 0x7fbcac0b7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.710+0000 7fbcaa7fc700 1 -- 172.21.15.37:0/1923523838 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcac0b8430 msgr2=0x7fbcac0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:36.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.710+0000 7fbcaa7fc700 1 --2- 172.21.15.37:0/1923523838 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcac0b8430 0x7fbcac0caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.710+0000 7fbcaa7fc700 1 -- 172.21.15.37:0/1923523838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca0009550 con 0x7fbcac0cfa90 2023-07-12T02:04:36.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.710+0000 7fbcaa7fc700 1 --2- 172.21.15.37:0/1923523838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcac0cfa90 0x7fbcac0cb730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbca0000c00 tx=0x7fbca0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:36.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.710+0000 7fbc93fff700 1 -- 172.21.15.37:0/1923523838 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0004450 con 0x7fbcac0cfa90 2023-07-12T02:04:36.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.711+0000 7fbc93fff700 1 -- 172.21.15.37:0/1923523838 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca00045b0 con 0x7fbcac0cfa90 2023-07-12T02:04:36.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.711+0000 7fbc93fff700 1 -- 172.21.15.37:0/1923523838 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00038e0 con 0x7fbcac0cfa90 2023-07-12T02:04:36.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.711+0000 7fbcb19ff700 1 -- 172.21.15.37:0/1923523838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac0ca270 con 0x7fbcac0cfa90 2023-07-12T02:04:36.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.711+0000 7fbcb19ff700 1 -- 172.21.15.37:0/1923523838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac0cbc70 con 0x7fbcac0cfa90 2023-07-12T02:04:36.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.712+0000 7fbcb19ff700 1 -- 172.21.15.37:0/1923523838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcac04ea60 con 0x7fbcac0cfa90 2023-07-12T02:04:36.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.713+0000 7fbc93fff700 1 -- 172.21.15.37:0/1923523838 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbca0003a40 con 0x7fbcac0cfa90 2023-07-12T02:04:36.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.713+0000 7fbc93fff700 1 --2- 172.21.15.37:0/1923523838 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbc9806ace0 0x7fbc9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.714+0000 7fbc93fff700 1 -- 172.21.15.37:0/1923523838 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbca008a520 con 0x7fbcac0cfa90 2023-07-12T02:04:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.714+0000 7fbcaaffd700 1 --2- 172.21.15.37:0/1923523838 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbc9806ace0 0x7fbc9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.715+0000 7fbcaaffd700 1 --2- 172.21.15.37:0/1923523838 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbc9806ace0 0x7fbc9806d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009b40 tx=0x7fbc9c009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.718+0000 7fbc93fff700 1 -- 172.21.15.37:0/1923523838 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbca00553f0 con 0x7fbcac0cfa90 2023-07-12T02:04:36.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.928+0000 7fbcb19ff700 1 -- 172.21.15.37:0/1923523838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbcac0cf550 con 0x7fbcac0cfa90 2023-07-12T02:04:36.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.928+0000 7fbc93fff700 1 -- 172.21.15.37:0/1923523838 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbca0058a10 con 0x7fbcac0cfa90 2023-07-12T02:04:36.932 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:04:36.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.931+0000 7fbcb19ff700 1 -- 172.21.15.37:0/1923523838 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbc9806ace0 msgr2=0x7fbc9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:36.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.931+0000 7fbcb19ff700 1 --2- 172.21.15.37:0/1923523838 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbc9806ace0 0x7fbc9806d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009b40 tx=0x7fbc9c009210 comp rx=0 tx=0).stop 2023-07-12T02:04:36.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.931+0000 7fbcb19ff700 1 -- 172.21.15.37:0/1923523838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcac0cfa90 msgr2=0x7fbcac0cb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:36.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.931+0000 7fbcb19ff700 1 --2- 172.21.15.37:0/1923523838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcac0cfa90 0x7fbcac0cb730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbca0000c00 tx=0x7fbca0004750 comp rx=0 tx=0).stop 2023-07-12T02:04:36.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.931+0000 7fbcb19ff700 1 -- 172.21.15.37:0/1923523838 shutdown_connections 2023-07-12T02:04:36.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.931+0000 7fbcb19ff700 1 --2- 172.21.15.37:0/1923523838 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbc9806ace0 0x7fbc9806d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.931+0000 7fbcb19ff700 1 --2- 172.21.15.37:0/1923523838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcac0d3730 0x7fbcac0b7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.931+0000 7fbcb19ff700 1 --2- 172.21.15.37:0/1923523838 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcac0b8430 0x7fbcac0caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.931+0000 7fbcb19ff700 1 --2- 172.21.15.37:0/1923523838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcac0cfa90 0x7fbcac0cb730 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:36.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.931+0000 7fbcb19ff700 1 -- 172.21.15.37:0/1923523838 >> 172.21.15.37:0/1923523838 conn(0x7fbcac06b3f0 msgr2=0x7fbcac0b6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:36.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.931+0000 7fbcb19ff700 1 -- 172.21.15.37:0/1923523838 shutdown_connections 2023-07-12T02:04:36.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:36.931+0000 7fbcb19ff700 1 -- 172.21.15.37:0/1923523838 wait complete. 2023-07-12T02:04:36.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:04:37.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.149+0000 7f93ec5ff700 1 Processor -- start 2023-07-12T02:04:37.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.149+0000 7f93ec5ff700 1 -- start start 2023-07-12T02:04:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.150+0000 7f93ec5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f93e41601d0 0x7f93e4160620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.150+0000 7f93ec5ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f93e40d0dd0 0x7f93e40d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.150+0000 7f93ec5ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e40cd120 con 0x7f93e415fe00 2023-07-12T02:04:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.150+0000 7f93ec5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e40cd930 con 0x7f93e41601d0 2023-07-12T02:04:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.150+0000 7f93ec5ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e40d06a0 con 0x7f93e40d0dd0 2023-07-12T02:04:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.151+0000 7f93e9b9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f93e41601d0 0x7f93e4160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.151+0000 7f93ea39b700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f93e415fe00 0x7f93e40cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:54648/0 (socket says 172.21.15.37:54648) 2023-07-12T02:04:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.151+0000 7f93ea39b700 1 -- 172.21.15.37:0/2564922927 learned_addr learned my addr 172.21.15.37:0/2564922927 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.151+0000 7f93eab9c700 1 --2- 172.21.15.37:0/2564922927 >> v2:172.21.15.196:3300/0 conn(0x7f93e40d0dd0 0x7f93e40d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.151+0000 7f93e9b9a700 1 -- 172.21.15.37:0/2564922927 >> v2:172.21.15.196:3300/0 conn(0x7f93e40d0dd0 msgr2=0x7f93e40d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.151+0000 7f93e9b9a700 1 --2- 172.21.15.37:0/2564922927 >> v2:172.21.15.196:3300/0 conn(0x7f93e40d0dd0 0x7f93e40d1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.151+0000 7f93e9b9a700 1 -- 172.21.15.37:0/2564922927 >> v1:172.21.15.196:6789/0 conn(0x7f93e415fe00 legacy=0x7f93e40cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.151+0000 7f93e9b9a700 1 -- 172.21.15.37:0/2564922927 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e40d0940 con 0x7f93e41601d0 2023-07-12T02:04:37.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.151+0000 7f93e9b9a700 1 --2- 172.21.15.37:0/2564922927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e41601d0 0x7f93e4160620 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f93e408bd60 tx=0x7f93d4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72cc62a9c5934124 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:37.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.152+0000 7f93e9399700 1 -- 172.21.15.37:0/2564922927 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4011830 con 0x7f93e41601d0 2023-07-12T02:04:37.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.152+0000 7f93e9399700 1 -- 172.21.15.37:0/2564922927 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d4011990 con 0x7f93e41601d0 2023-07-12T02:04:37.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.152+0000 7f93e9399700 1 -- 172.21.15.37:0/2564922927 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4011d20 con 0x7f93e41601d0 2023-07-12T02:04:37.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.152+0000 7f93ec5ff700 1 -- 172.21.15.37:0/2564922927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e41601d0 msgr2=0x7f93e4160620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:37.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.152+0000 7f93ec5ff700 1 --2- 172.21.15.37:0/2564922927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e41601d0 0x7f93e4160620 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f93e408bd60 tx=0x7f93d4009b20 comp rx=0 tx=0).stop 2023-07-12T02:04:37.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.152+0000 7f93ec5ff700 1 -- 172.21.15.37:0/2564922927 shutdown_connections 2023-07-12T02:04:37.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.152+0000 7f93ec5ff700 1 --2- 172.21.15.37:0/2564922927 >> v2:172.21.15.196:3300/0 conn(0x7f93e40d0dd0 0x7f93e40d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.152+0000 7f93ec5ff700 1 --2- 172.21.15.37:0/2564922927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e41601d0 0x7f93e4160620 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.152+0000 7f93ec5ff700 1 -- 172.21.15.37:0/2564922927 >> 172.21.15.37:0/2564922927 conn(0x7f93e4071660 msgr2=0x7f93e4071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:37.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.152+0000 7f93ec5ff700 1 -- 172.21.15.37:0/2564922927 shutdown_connections 2023-07-12T02:04:37.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.152+0000 7f93ec5ff700 1 -- 172.21.15.37:0/2564922927 wait complete. 2023-07-12T02:04:37.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.154+0000 7f93ec5ff700 1 Processor -- start 2023-07-12T02:04:37.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.154+0000 7f93ec5ff700 1 -- start start 2023-07-12T02:04:37.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.155+0000 7f93ec5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93e40d0dd0 0x7f93e4159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:37.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.155+0000 7f93ec5ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93e415fe00 0x7f93e40cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:37.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.155+0000 7f93ec5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e41601d0 0x7f93e40cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:37.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.155+0000 7f93ec5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e415e390 con 0x7f93e41601d0 2023-07-12T02:04:37.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.155+0000 7f93ec5ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e415e670 con 0x7f93e415fe00 2023-07-12T02:04:37.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.155+0000 7f93ec5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e415e950 con 0x7f93e40d0dd0 2023-07-12T02:04:37.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.155+0000 7f93eab9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e41601d0 0x7f93e40cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:37.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.156+0000 7f93eab9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e41601d0 0x7f93e40cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35552/0 (socket says 172.21.15.37:35552) 2023-07-12T02:04:37.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.156+0000 7f93eab9c700 1 -- 172.21.15.37:0/435854651 learned_addr learned my addr 172.21.15.37:0/435854651 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:37.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.156+0000 7f93e9b9a700 1 --2- 172.21.15.37:0/435854651 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93e415fe00 0x7f93e40cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:37.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.156+0000 7f93ea39b700 1 --2- 172.21.15.37:0/435854651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93e40d0dd0 0x7f93e4159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:37.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.156+0000 7f93eab9c700 1 -- 172.21.15.37:0/435854651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93e40d0dd0 msgr2=0x7f93e4159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:37.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.156+0000 7f93eab9c700 1 --2- 172.21.15.37:0/435854651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93e40d0dd0 0x7f93e4159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.156+0000 7f93eab9c700 1 -- 172.21.15.37:0/435854651 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93e415fe00 msgr2=0x7f93e40cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:37.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.156+0000 7f93eab9c700 1 --2- 172.21.15.37:0/435854651 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93e415fe00 0x7f93e40cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.156+0000 7f93eab9c700 1 -- 172.21.15.37:0/435854651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d40094a0 con 0x7f93e41601d0 2023-07-12T02:04:37.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.156+0000 7f93eab9c700 1 --2- 172.21.15.37:0/435854651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e41601d0 0x7f93e40cb640 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00efc0 tx=0x7f93dc00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:37.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.156+0000 7f93daffd700 1 -- 172.21.15.37:0/435854651 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc00cad0 con 0x7f93e41601d0 2023-07-12T02:04:37.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.156+0000 7f93daffd700 1 -- 172.21.15.37:0/435854651 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93dc00f040 con 0x7f93e41601d0 2023-07-12T02:04:37.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.156+0000 7f93daffd700 1 -- 172.21.15.37:0/435854651 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc00ce70 con 0x7f93e41601d0 2023-07-12T02:04:37.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.156+0000 7f93ec5ff700 1 -- 172.21.15.37:0/435854651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e415ec30 con 0x7f93e41601d0 2023-07-12T02:04:37.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.157+0000 7f93ec5ff700 1 -- 172.21.15.37:0/435854651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e40c8f80 con 0x7f93e41601d0 2023-07-12T02:04:37.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.158+0000 7f93ec5ff700 1 -- 172.21.15.37:0/435854651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e404ea60 con 0x7f93e41601d0 2023-07-12T02:04:37.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.159+0000 7f93daffd700 1 -- 172.21.15.37:0/435854651 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f93dc014480 con 0x7f93e41601d0 2023-07-12T02:04:37.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.160+0000 7f93daffd700 1 --2- 172.21.15.37:0/435854651 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f93c806ace0 0x7f93c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:37.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.160+0000 7f93daffd700 1 -- 172.21.15.37:0/435854651 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f93dc089fe0 con 0x7f93e41601d0 2023-07-12T02:04:37.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.160+0000 7f93ea39b700 1 --2- 172.21.15.37:0/435854651 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f93c806ace0 0x7f93c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:37.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.161+0000 7f93ea39b700 1 --2- 172.21.15.37:0/435854651 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f93c806ace0 0x7f93c806d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f93e0005910 tx=0x7f93e0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:37.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.164+0000 7f93daffd700 1 -- 172.21.15.37:0/435854651 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f93dc054d90 con 0x7f93e41601d0 2023-07-12T02:04:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.418+0000 7f93ec5ff700 1 -- 172.21.15.37:0/435854651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93e40cdd80 con 0x7f93e41601d0 2023-07-12T02:04:37.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.419+0000 7f93daffd700 1 -- 172.21.15.37:0/435854651 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f93dc0583b0 con 0x7f93e41601d0 2023-07-12T02:04:37.422 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:37.423 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/2496042538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":2496042538},{"type":"v1","addr":"172.21.15.196:6836","nonce":2496042538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2193116262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":2193116262},{"type":"v1","addr":"172.21.15.196:6837","nonce":2193116262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3195008737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3195008737},{"type":"v1","addr":"172.21.15.37:6834","nonce":3195008737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:03:57.647919+0000","modified":"2023-07-12T02:04:25.438552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/4264740807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4264740807},{"type":"v1","addr":"172.21.15.37:6835","nonce":4264740807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-12T02:04:37.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.421+0000 7f93ec5ff700 1 -- 172.21.15.37:0/435854651 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f93c806ace0 msgr2=0x7f93c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:37.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.421+0000 7f93ec5ff700 1 --2- 172.21.15.37:0/435854651 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f93c806ace0 0x7f93c806d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f93e0005910 tx=0x7f93e0009040 comp rx=0 tx=0).stop 2023-07-12T02:04:37.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.421+0000 7f93ec5ff700 1 -- 172.21.15.37:0/435854651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e41601d0 msgr2=0x7f93e40cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:37.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.421+0000 7f93ec5ff700 1 --2- 172.21.15.37:0/435854651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e41601d0 0x7f93e40cb640 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00efc0 tx=0x7f93dc00c0c0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.421+0000 7f93ec5ff700 1 -- 172.21.15.37:0/435854651 shutdown_connections 2023-07-12T02:04:37.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.421+0000 7f93ec5ff700 1 --2- 172.21.15.37:0/435854651 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f93c806ace0 0x7f93c806d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.421+0000 7f93ec5ff700 1 --2- 172.21.15.37:0/435854651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e41601d0 0x7f93e40cb640 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.421+0000 7f93ec5ff700 1 --2- 172.21.15.37:0/435854651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93e40d0dd0 0x7f93e4159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.421+0000 7f93ec5ff700 1 --2- 172.21.15.37:0/435854651 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93e415fe00 0x7f93e40cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.421+0000 7f93ec5ff700 1 -- 172.21.15.37:0/435854651 >> 172.21.15.37:0/435854651 conn(0x7f93e4071660 msgr2=0x7f93e4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:37.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.421+0000 7f93ec5ff700 1 -- 172.21.15.37:0/435854651 shutdown_connections 2023-07-12T02:04:37.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.421+0000 7f93ec5ff700 1 -- 172.21.15.37:0/435854651 wait complete. 2023-07-12T02:04:37.428 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2023-07-12T02:04:37.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:04:37.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.640+0000 7f6f475ff700 1 Processor -- start 2023-07-12T02:04:37.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.641+0000 7f6f475ff700 1 -- start start 2023-07-12T02:04:37.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.642+0000 7f6f475ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f400d2640 0x7f6f400b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:37.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.642+0000 7f6f475ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f400d1790 con 0x7f6f400cf8f0 2023-07-12T02:04:37.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.642+0000 7f6f475ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f400cd950 con 0x7f6f4015c460 2023-07-12T02:04:37.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.642+0000 7f6f475ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f400cedd0 con 0x7f6f400d2640 2023-07-12T02:04:37.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.642+0000 7f6f45b9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6f400cf8f0 0x7f6f4015fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39814/0 (socket says 172.21.15.37:39814) 2023-07-12T02:04:37.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.642+0000 7f6f45b9c700 1 -- 172.21.15.37:0/677030820 learned_addr learned my addr 172.21.15.37:0/677030820 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:37.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.642+0000 7f6f44b9a700 1 --2- 172.21.15.37:0/677030820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f400d2640 0x7f6f400b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:37.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.643+0000 7f6f37fff700 1 -- 172.21.15.37:0/677030820 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169164870 0 0) 0x7f6f400d1790 con 0x7f6f400cf8f0 2023-07-12T02:04:37.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.643+0000 7f6f37fff700 1 -- 172.21.15.37:0/677030820 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f2c0035b0 con 0x7f6f400cf8f0 2023-07-12T02:04:37.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.643+0000 7f6f37fff700 1 -- 172.21.15.37:0/677030820 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075947276 0 0) 0x7f6f400cd950 con 0x7f6f4015c460 2023-07-12T02:04:37.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.643+0000 7f6f37fff700 1 -- 172.21.15.37:0/677030820 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f400d1790 con 0x7f6f4015c460 2023-07-12T02:04:37.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.643+0000 7f6f44b9a700 1 -- 172.21.15.37:0/677030820 >> v1:172.21.15.196:6789/0 conn(0x7f6f4015c460 legacy=0x7f6f400cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:37.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.643+0000 7f6f44b9a700 1 -- 172.21.15.37:0/677030820 >> v1:172.21.15.37:6789/0 conn(0x7f6f400cf8f0 legacy=0x7f6f4015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:37.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.643+0000 7f6f44b9a700 1 -- 172.21.15.37:0/677030820 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f400d14b0 con 0x7f6f400d2640 2023-07-12T02:04:37.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.643+0000 7f6f44b9a700 1 --2- 172.21.15.37:0/677030820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f400d2640 0x7f6f400b59d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009870 tx=0x7f6f30009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a7d3bed1ddff31b server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:37.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.643+0000 7f6f37fff700 1 -- 172.21.15.37:0/677030820 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30011830 con 0x7f6f400d2640 2023-07-12T02:04:37.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.643+0000 7f6f37fff700 1 -- 172.21.15.37:0/677030820 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f30011990 con 0x7f6f400d2640 2023-07-12T02:04:37.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.643+0000 7f6f37fff700 1 -- 172.21.15.37:0/677030820 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30011d20 con 0x7f6f400d2640 2023-07-12T02:04:37.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.644+0000 7f6f475ff700 1 -- 172.21.15.37:0/677030820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f400d2640 msgr2=0x7f6f400b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:37.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.644+0000 7f6f475ff700 1 --2- 172.21.15.37:0/677030820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f400d2640 0x7f6f400b59d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009870 tx=0x7f6f30009b80 comp rx=0 tx=0).stop 2023-07-12T02:04:37.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.644+0000 7f6f475ff700 1 -- 172.21.15.37:0/677030820 shutdown_connections 2023-07-12T02:04:37.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.644+0000 7f6f475ff700 1 --2- 172.21.15.37:0/677030820 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f400d2640 0x7f6f400b59d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.644+0000 7f6f475ff700 1 -- 172.21.15.37:0/677030820 >> 172.21.15.37:0/677030820 conn(0x7f6f40071660 msgr2=0x7f6f40071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:37.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.644+0000 7f6f475ff700 1 -- 172.21.15.37:0/677030820 shutdown_connections 2023-07-12T02:04:37.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.644+0000 7f6f475ff700 1 -- 172.21.15.37:0/677030820 wait complete. 2023-07-12T02:04:37.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.646+0000 7f6f475ff700 1 Processor -- start 2023-07-12T02:04:37.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.646+0000 7f6f475ff700 1 -- start start 2023-07-12T02:04:37.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.647+0000 7f6f475ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f400cf8f0 0x7f6f400c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:37.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.647+0000 7f6f475ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f400d2640 0x7f6f400c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:37.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.647+0000 7f6f475ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4015c460 0x7f6f40150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:37.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.647+0000 7f6f475ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f400c6d20 con 0x7f6f4015c460 2023-07-12T02:04:37.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.647+0000 7f6f475ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f400c7000 con 0x7f6f400d2640 2023-07-12T02:04:37.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.647+0000 7f6f475ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f400c72e0 con 0x7f6f400cf8f0 2023-07-12T02:04:37.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.647+0000 7f6f45b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4015c460 0x7f6f40150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:37.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.647+0000 7f6f45b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4015c460 0x7f6f40150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35558/0 (socket says 172.21.15.37:35558) 2023-07-12T02:04:37.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.647+0000 7f6f45b9c700 1 -- 172.21.15.37:0/2322760513 learned_addr learned my addr 172.21.15.37:0/2322760513 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:37.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.648+0000 7f6f44b9a700 1 --2- 172.21.15.37:0/2322760513 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f400d2640 0x7f6f400c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:37.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.648+0000 7f6f4539b700 1 --2- 172.21.15.37:0/2322760513 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f400cf8f0 0x7f6f400c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:37.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.648+0000 7f6f45b9c700 1 -- 172.21.15.37:0/2322760513 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f400cf8f0 msgr2=0x7f6f400c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:37.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.648+0000 7f6f45b9c700 1 --2- 172.21.15.37:0/2322760513 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f400cf8f0 0x7f6f400c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.648+0000 7f6f45b9c700 1 -- 172.21.15.37:0/2322760513 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f400d2640 msgr2=0x7f6f400c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:37.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.648+0000 7f6f45b9c700 1 --2- 172.21.15.37:0/2322760513 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f400d2640 0x7f6f400c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.648+0000 7f6f45b9c700 1 -- 172.21.15.37:0/2322760513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f300094a0 con 0x7f6f4015c460 2023-07-12T02:04:37.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.648+0000 7f6f4539b700 1 --2- 172.21.15.37:0/2322760513 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f400cf8f0 0x7f6f400c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:37.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.648+0000 7f6f45b9c700 1 --2- 172.21.15.37:0/2322760513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4015c460 0x7f6f40150280 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800cb10 tx=0x7f6f3800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:37.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.648+0000 7f6f35ffb700 1 -- 172.21.15.37:0/2322760513 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3800ab00 con 0x7f6f4015c460 2023-07-12T02:04:37.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.648+0000 7f6f35ffb700 1 -- 172.21.15.37:0/2322760513 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3800ac60 con 0x7f6f4015c460 2023-07-12T02:04:37.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.648+0000 7f6f475ff700 1 -- 172.21.15.37:0/2322760513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f400c75c0 con 0x7f6f4015c460 2023-07-12T02:04:37.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.648+0000 7f6f35ffb700 1 -- 172.21.15.37:0/2322760513 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38012400 con 0x7f6f4015c460 2023-07-12T02:04:37.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.648+0000 7f6f475ff700 1 -- 172.21.15.37:0/2322760513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4014d870 con 0x7f6f4015c460 2023-07-12T02:04:37.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.649+0000 7f6f475ff700 1 -- 172.21.15.37:0/2322760513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f4004ea60 con 0x7f6f4015c460 2023-07-12T02:04:37.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.650+0000 7f6f35ffb700 1 -- 172.21.15.37:0/2322760513 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f3801b3b0 con 0x7f6f4015c460 2023-07-12T02:04:37.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.651+0000 7f6f35ffb700 1 --2- 172.21.15.37:0/2322760513 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6f2406ace0 0x7f6f2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:37.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.651+0000 7f6f35ffb700 1 -- 172.21.15.37:0/2322760513 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6f38089480 con 0x7f6f4015c460 2023-07-12T02:04:37.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.652+0000 7f6f4539b700 1 --2- 172.21.15.37:0/2322760513 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6f2406ace0 0x7f6f2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:37.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.653+0000 7f6f4539b700 1 --2- 172.21.15.37:0/2322760513 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6f2406ace0 0x7f6f2406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0011e0 tx=0x7f6f3c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:37.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.656+0000 7f6f35ffb700 1 -- 172.21.15.37:0/2322760513 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6f38054260 con 0x7f6f4015c460 2023-07-12T02:04:37.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.865+0000 7f6f475ff700 1 -- 172.21.15.37:0/2322760513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f400b4fa0 con 0x7f6f4015c460 2023-07-12T02:04:37.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.866+0000 7f6f35ffb700 1 -- 172.21.15.37:0/2322760513 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20072 (secure 0 0 0) 0x7f6f38057880 con 0x7f6f4015c460 2023-07-12T02:04:37.870 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:37.871 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:02.702198+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:04:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.869+0000 7f6f475ff700 1 -- 172.21.15.37:0/2322760513 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6f2406ace0 msgr2=0x7f6f2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.869+0000 7f6f475ff700 1 --2- 172.21.15.37:0/2322760513 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6f2406ace0 0x7f6f2406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0011e0 tx=0x7f6f3c009040 comp rx=0 tx=0).stop 2023-07-12T02:04:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.869+0000 7f6f475ff700 1 -- 172.21.15.37:0/2322760513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4015c460 msgr2=0x7f6f40150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.869+0000 7f6f475ff700 1 --2- 172.21.15.37:0/2322760513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4015c460 0x7f6f40150280 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800cb10 tx=0x7f6f3800ced0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.869+0000 7f6f475ff700 1 -- 172.21.15.37:0/2322760513 shutdown_connections 2023-07-12T02:04:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.869+0000 7f6f475ff700 1 --2- 172.21.15.37:0/2322760513 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6f2406ace0 0x7f6f2406d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.869+0000 7f6f475ff700 1 --2- 172.21.15.37:0/2322760513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4015c460 0x7f6f40150280 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.869+0000 7f6f475ff700 1 --2- 172.21.15.37:0/2322760513 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f400cf8f0 0x7f6f400c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.869+0000 7f6f475ff700 1 --2- 172.21.15.37:0/2322760513 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f400d2640 0x7f6f400c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:37.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.869+0000 7f6f475ff700 1 -- 172.21.15.37:0/2322760513 >> 172.21.15.37:0/2322760513 conn(0x7f6f40071660 msgr2=0x7f6f400b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:37.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.869+0000 7f6f475ff700 1 -- 172.21.15.37:0/2322760513 shutdown_connections 2023-07-12T02:04:37.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:37.869+0000 7f6f475ff700 1 -- 172.21.15.37:0/2322760513 wait complete. 2023-07-12T02:04:37.891 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:03:56.039938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:03:56.612707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-12T02:04:00.200885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-12T02:04:37.892 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:04:38.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.094+0000 7fcef47ff700 1 Processor -- start 2023-07-12T02:04:38.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.094+0000 7fcef47ff700 1 -- start start 2023-07-12T02:04:38.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.095+0000 7fcef47ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fceec0b8430 0x7fceec0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:38.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.096+0000 7fcef47ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fceec0d3730 0x7fceec0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.096+0000 7fcef47ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fceec0cfa90 0x7fceec15feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.096+0000 7fcef47ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceec0b8800 con 0x7fceec0b8430 2023-07-12T02:04:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.096+0000 7fcef47ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceec0d0b20 con 0x7fceec0cfa90 2023-07-12T02:04:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.096+0000 7fcef47ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0cfeb0 con 0x7fceec0d3730 2023-07-12T02:04:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.096+0000 7fcef259b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fceec0b8430 0x7fceec0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.096+0000 7fcef259b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fceec0b8430 0x7fceec0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35566/0 (socket says 172.21.15.37:35566) 2023-07-12T02:04:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.096+0000 7fcef259b700 1 -- 172.21.15.37:0/3653456988 learned_addr learned my addr 172.21.15.37:0/3653456988 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.096+0000 7fcef1d9a700 1 --2- 172.21.15.37:0/3653456988 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fceec0d3730 0x7fceec0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.096+0000 7fcef2d9c700 1 --2- 172.21.15.37:0/3653456988 >> v2:172.21.15.196:3300/0 conn(0x7fceec0cfa90 0x7fceec15feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.096+0000 7fcef259b700 1 -- 172.21.15.37:0/3653456988 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fceec0d3730 msgr2=0x7fceec0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.096+0000 7fcef259b700 1 --2- 172.21.15.37:0/3653456988 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fceec0d3730 0x7fceec0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.096+0000 7fcef259b700 1 -- 172.21.15.37:0/3653456988 >> v2:172.21.15.196:3300/0 conn(0x7fceec0cfa90 msgr2=0x7fceec15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.096+0000 7fcef259b700 1 --2- 172.21.15.37:0/3653456988 >> v2:172.21.15.196:3300/0 conn(0x7fceec0cfa90 0x7fceec15feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.096+0000 7fcef259b700 1 -- 172.21.15.37:0/3653456988 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec0b4ee0 con 0x7fceec0b8430 2023-07-12T02:04:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.097+0000 7fcef259b700 1 --2- 172.21.15.37:0/3653456988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec0b8430 0x7fceec0cd320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fceec06c570 tx=0x7fcee8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874ec083e949887e server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.097+0000 7fcef1599700 1 -- 172.21.15.37:0/3653456988 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8011830 con 0x7fceec0b8430 2023-07-12T02:04:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.097+0000 7fcef1599700 1 -- 172.21.15.37:0/3653456988 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee8011990 con 0x7fceec0b8430 2023-07-12T02:04:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.097+0000 7fcef1599700 1 -- 172.21.15.37:0/3653456988 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8011d20 con 0x7fceec0b8430 2023-07-12T02:04:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.097+0000 7fcef47ff700 1 -- 172.21.15.37:0/3653456988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec0b8430 msgr2=0x7fceec0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.097+0000 7fcef47ff700 1 --2- 172.21.15.37:0/3653456988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec0b8430 0x7fceec0cd320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fceec06c570 tx=0x7fcee8009bd0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.097+0000 7fcef47ff700 1 -- 172.21.15.37:0/3653456988 shutdown_connections 2023-07-12T02:04:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.097+0000 7fcef47ff700 1 --2- 172.21.15.37:0/3653456988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec0b8430 0x7fceec0cd320 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.097+0000 7fcef47ff700 1 --2- 172.21.15.37:0/3653456988 >> v2:172.21.15.196:3300/0 conn(0x7fceec0cfa90 0x7fceec15feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.097+0000 7fcef47ff700 1 --2- 172.21.15.37:0/3653456988 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fceec0d3730 0x7fceec0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.097+0000 7fcef47ff700 1 -- 172.21.15.37:0/3653456988 >> 172.21.15.37:0/3653456988 conn(0x7fceec06b3f0 msgr2=0x7fceec06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.098+0000 7fcef47ff700 1 -- 172.21.15.37:0/3653456988 shutdown_connections 2023-07-12T02:04:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.098+0000 7fcef47ff700 1 -- 172.21.15.37:0/3653456988 wait complete. 2023-07-12T02:04:38.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.099+0000 7fcef47ff700 1 Processor -- start 2023-07-12T02:04:38.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.099+0000 7fcef47ff700 1 -- start start 2023-07-12T02:04:38.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.100+0000 7fcef47ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceec0b8430 0x7fceec1498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:38.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.100+0000 7fcef47ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fceec0cfa90 0x7fceec15d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:38.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.100+0000 7fcef47ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec0d3730 0x7fceec15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:38.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.100+0000 7fcef47ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec1f2c60 con 0x7fceec0d3730 2023-07-12T02:04:38.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.100+0000 7fcef47ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec1f1d20 con 0x7fceec0b8430 2023-07-12T02:04:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.100+0000 7fcef47ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec1f1fe0 con 0x7fceec0cfa90 2023-07-12T02:04:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.101+0000 7fcef2d9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec0d3730 0x7fceec15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.101+0000 7fcef2d9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec0d3730 0x7fceec15eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35568/0 (socket says 172.21.15.37:35568) 2023-07-12T02:04:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.101+0000 7fcef2d9c700 1 -- 172.21.15.37:0/21053308 learned_addr learned my addr 172.21.15.37:0/21053308 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.101+0000 7fcef1d9a700 1 --2- 172.21.15.37:0/21053308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fceec0cfa90 0x7fceec15d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.101+0000 7fcef259b700 1 --2- 172.21.15.37:0/21053308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceec0b8430 0x7fceec1498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.101+0000 7fcef2d9c700 1 -- 172.21.15.37:0/21053308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fceec0cfa90 msgr2=0x7fceec15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.101+0000 7fcef2d9c700 1 --2- 172.21.15.37:0/21053308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fceec0cfa90 0x7fceec15d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.101+0000 7fcef2d9c700 1 -- 172.21.15.37:0/21053308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceec0b8430 msgr2=0x7fceec1498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.101+0000 7fcef2d9c700 1 --2- 172.21.15.37:0/21053308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceec0b8430 0x7fceec1498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.101+0000 7fcef2d9c700 1 -- 172.21.15.37:0/21053308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee8009550 con 0x7fceec0d3730 2023-07-12T02:04:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.101+0000 7fcef2d9c700 1 --2- 172.21.15.37:0/21053308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec0d3730 0x7fceec15eb90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcee400efc0 tx=0x7fcee400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.102+0000 7fcee2ffd700 1 -- 172.21.15.37:0/21053308 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee400cad0 con 0x7fceec0d3730 2023-07-12T02:04:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.102+0000 7fcee2ffd700 1 -- 172.21.15.37:0/21053308 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee400f040 con 0x7fceec0d3730 2023-07-12T02:04:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.102+0000 7fcee2ffd700 1 -- 172.21.15.37:0/21053308 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee400ce70 con 0x7fceec0d3730 2023-07-12T02:04:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.102+0000 7fcef47ff700 1 -- 172.21.15.37:0/21053308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec1f22c0 con 0x7fceec0d3730 2023-07-12T02:04:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.102+0000 7fcef47ff700 1 -- 172.21.15.37:0/21053308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec1f2880 con 0x7fceec0d3730 2023-07-12T02:04:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.103+0000 7fcef47ff700 1 -- 172.21.15.37:0/21053308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec04ea60 con 0x7fceec0d3730 2023-07-12T02:04:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.104+0000 7fcee2ffd700 1 -- 172.21.15.37:0/21053308 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcee4014480 con 0x7fceec0d3730 2023-07-12T02:04:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.105+0000 7fcee2ffd700 1 --2- 172.21.15.37:0/21053308 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fced006ace0 0x7fced006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.105+0000 7fcee2ffd700 1 -- 172.21.15.37:0/21053308 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcee4089fb0 con 0x7fceec0d3730 2023-07-12T02:04:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.105+0000 7fcef259b700 1 --2- 172.21.15.37:0/21053308 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fced006ace0 0x7fced006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.106+0000 7fcef259b700 1 --2- 172.21.15.37:0/21053308 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fced006ace0 0x7fced006d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcee8014040 tx=0x7fcee8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.109+0000 7fcee2ffd700 1 -- 172.21.15.37:0/21053308 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fcee4054c90 con 0x7fceec0d3730 2023-07-12T02:04:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.323+0000 7fcef47ff700 1 -- 172.21.15.37:0/21053308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fceec15b5d0 con 0x7fceec0d3730 2023-07-12T02:04:38.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.323+0000 7fcee2ffd700 1 -- 172.21.15.37:0/21053308 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcee4018020 con 0x7fceec0d3730 2023-07-12T02:04:38.327 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:04:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.325+0000 7fcef47ff700 1 -- 172.21.15.37:0/21053308 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fced006ace0 msgr2=0x7fced006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.325+0000 7fcef47ff700 1 --2- 172.21.15.37:0/21053308 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fced006ace0 0x7fced006d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcee8014040 tx=0x7fcee8008030 comp rx=0 tx=0).stop 2023-07-12T02:04:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.325+0000 7fcef47ff700 1 -- 172.21.15.37:0/21053308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec0d3730 msgr2=0x7fceec15eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.325+0000 7fcef47ff700 1 --2- 172.21.15.37:0/21053308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec0d3730 0x7fceec15eb90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcee400efc0 tx=0x7fcee400c0c0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.326+0000 7fcef47ff700 1 -- 172.21.15.37:0/21053308 shutdown_connections 2023-07-12T02:04:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.326+0000 7fcef47ff700 1 --2- 172.21.15.37:0/21053308 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fced006ace0 0x7fced006d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.326+0000 7fcef47ff700 1 --2- 172.21.15.37:0/21053308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec0d3730 0x7fceec15eb90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.326+0000 7fcef47ff700 1 --2- 172.21.15.37:0/21053308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceec0b8430 0x7fceec1498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.326+0000 7fcef47ff700 1 --2- 172.21.15.37:0/21053308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fceec0cfa90 0x7fceec15d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.326+0000 7fcef47ff700 1 -- 172.21.15.37:0/21053308 >> 172.21.15.37:0/21053308 conn(0x7fceec06b3f0 msgr2=0x7fceec0b62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:38.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.326+0000 7fcef47ff700 1 -- 172.21.15.37:0/21053308 shutdown_connections 2023-07-12T02:04:38.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.326+0000 7fcef47ff700 1 -- 172.21.15.37:0/21053308 wait complete. 2023-07-12T02:04:38.347 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:04:38.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.551+0000 7f51777ff700 1 Processor -- start 2023-07-12T02:04:38.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.551+0000 7f51777ff700 1 -- start start 2023-07-12T02:04:38.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.552+0000 7f51777ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51700b8430 0x7f51700cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:38.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.552+0000 7f51777ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f51700cfc60 0x7f51700d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:38.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.552+0000 7f51777ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51700d0b20 con 0x7f51700d3730 2023-07-12T02:04:38.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.552+0000 7f51777ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51700b8800 con 0x7f51700cfc60 2023-07-12T02:04:38.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.552+0000 7f51777ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51700b4ee0 con 0x7f51700b8430 2023-07-12T02:04:38.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.552+0000 7f5174d9a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f51700d3730 0x7f51700cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39828/0 (socket says 172.21.15.37:39828) 2023-07-12T02:04:38.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.552+0000 7f5174d9a700 1 -- 172.21.15.37:0/1922820027 learned_addr learned my addr 172.21.15.37:0/1922820027 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:38.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.552+0000 7f5175d9c700 1 --2- 172.21.15.37:0/1922820027 >> v2:172.21.15.37:3300/0 conn(0x7f51700cfc60 0x7f51700d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:38.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.553+0000 7f517559b700 1 --2- 172.21.15.37:0/1922820027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51700b8430 0x7f51700cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:38.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.553+0000 7f5167fff700 1 -- 172.21.15.37:0/1922820027 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139376991 0 0) 0x7f51700d0b20 con 0x7f51700d3730 2023-07-12T02:04:38.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.553+0000 7f5167fff700 1 -- 172.21.15.37:0/1922820027 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f515c0035b0 con 0x7f51700d3730 2023-07-12T02:04:38.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.553+0000 7f5175d9c700 1 -- 172.21.15.37:0/1922820027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51700b8430 msgr2=0x7f51700cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:38.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.553+0000 7f5175d9c700 1 --2- 172.21.15.37:0/1922820027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51700b8430 0x7f51700cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.553+0000 7f5175d9c700 1 -- 172.21.15.37:0/1922820027 >> v1:172.21.15.37:6789/0 conn(0x7f51700d3730 legacy=0x7f51700cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:38.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.553+0000 7f5175d9c700 1 -- 172.21.15.37:0/1922820027 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51700b51c0 con 0x7f51700cfc60 2023-07-12T02:04:38.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.553+0000 7f5175d9c700 1 --2- 172.21.15.37:0/1922820027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51700cfc60 0x7f51700d0fb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5168009d90 tx=0x7f516800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9205da9f34bcbd0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.553+0000 7f5167fff700 1 -- 172.21.15.37:0/1922820027 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516800e070 con 0x7f51700cfc60 2023-07-12T02:04:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.554+0000 7f5167fff700 1 -- 172.21.15.37:0/1922820027 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516800bb20 con 0x7f51700cfc60 2023-07-12T02:04:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.554+0000 7f5167fff700 1 -- 172.21.15.37:0/1922820027 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5168012430 con 0x7f51700cfc60 2023-07-12T02:04:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.554+0000 7f51777ff700 1 -- 172.21.15.37:0/1922820027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51700cfc60 msgr2=0x7f51700d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.554+0000 7f51777ff700 1 --2- 172.21.15.37:0/1922820027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51700cfc60 0x7f51700d0fb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5168009d90 tx=0x7f516800b330 comp rx=0 tx=0).stop 2023-07-12T02:04:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.554+0000 7f51777ff700 1 -- 172.21.15.37:0/1922820027 shutdown_connections 2023-07-12T02:04:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.554+0000 7f51777ff700 1 --2- 172.21.15.37:0/1922820027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51700cfc60 0x7f51700d0fb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.554+0000 7f51777ff700 1 --2- 172.21.15.37:0/1922820027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51700b8430 0x7f51700cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.554+0000 7f51777ff700 1 -- 172.21.15.37:0/1922820027 >> 172.21.15.37:0/1922820027 conn(0x7f517006b3f0 msgr2=0x7f517006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.554+0000 7f51777ff700 1 -- 172.21.15.37:0/1922820027 shutdown_connections 2023-07-12T02:04:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.554+0000 7f51777ff700 1 -- 172.21.15.37:0/1922820027 wait complete. 2023-07-12T02:04:38.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.556+0000 7f51777ff700 1 Processor -- start 2023-07-12T02:04:38.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.556+0000 7f51777ff700 1 -- start start 2023-07-12T02:04:38.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.557+0000 7f51777ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51700b8430 0x7f517015df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:38.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.557+0000 7f51777ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51700cfc60 0x7f51700c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:38.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.557+0000 7f51777ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51700d3730 0x7f517015a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:38.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.557+0000 7f51777ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517015e770 con 0x7f51700b8430 2023-07-12T02:04:38.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.557+0000 7f51777ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517015ea50 con 0x7f51700d3730 2023-07-12T02:04:38.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.557+0000 7f51777ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517015ed30 con 0x7f51700cfc60 2023-07-12T02:04:38.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.557+0000 7f517559b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51700b8430 0x7f517015df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:38.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.557+0000 7f517559b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51700b8430 0x7f517015df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35590/0 (socket says 172.21.15.37:35590) 2023-07-12T02:04:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.557+0000 7f517559b700 1 -- 172.21.15.37:0/3249544012 learned_addr learned my addr 172.21.15.37:0/3249544012 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.557+0000 7f5174d9a700 1 --2- 172.21.15.37:0/3249544012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51700cfc60 0x7f51700c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.558+0000 7f5175d9c700 1 --2- 172.21.15.37:0/3249544012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51700d3730 0x7f517015a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.558+0000 7f517559b700 1 -- 172.21.15.37:0/3249544012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51700cfc60 msgr2=0x7f51700c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.558+0000 7f517559b700 1 --2- 172.21.15.37:0/3249544012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51700cfc60 0x7f51700c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.558+0000 7f517559b700 1 -- 172.21.15.37:0/3249544012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51700d3730 msgr2=0x7f517015a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.558+0000 7f517559b700 1 --2- 172.21.15.37:0/3249544012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51700d3730 0x7f517015a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.558+0000 7f517559b700 1 -- 172.21.15.37:0/3249544012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5168009a70 con 0x7f51700b8430 2023-07-12T02:04:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.558+0000 7f517559b700 1 --2- 172.21.15.37:0/3249544012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51700b8430 0x7f517015df20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f516c00e9b0 tx=0x7f516c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.558+0000 7f5165ffb700 1 -- 172.21.15.37:0/3249544012 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c009710 con 0x7f51700b8430 2023-07-12T02:04:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.558+0000 7f5165ffb700 1 -- 172.21.15.37:0/3249544012 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c00ee50 con 0x7f51700b8430 2023-07-12T02:04:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.558+0000 7f51777ff700 1 -- 172.21.15.37:0/3249544012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517015f010 con 0x7f51700b8430 2023-07-12T02:04:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.558+0000 7f5165ffb700 1 -- 172.21.15.37:0/3249544012 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c00ca50 con 0x7f51700b8430 2023-07-12T02:04:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.558+0000 7f51777ff700 1 -- 172.21.15.37:0/3249544012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517015f810 con 0x7f51700b8430 2023-07-12T02:04:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.560+0000 7f51777ff700 1 -- 172.21.15.37:0/3249544012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51700cd7e0 con 0x7f51700b8430 2023-07-12T02:04:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.561+0000 7f5165ffb700 1 -- 172.21.15.37:0/3249544012 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f516c00cbb0 con 0x7f51700b8430 2023-07-12T02:04:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.562+0000 7f5165ffb700 1 --2- 172.21.15.37:0/3249544012 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f515406ace0 0x7f515406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:38.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.562+0000 7f5165ffb700 1 -- 172.21.15.37:0/3249544012 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f516c0897b0 con 0x7f51700b8430 2023-07-12T02:04:38.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.562+0000 7f5174d9a700 1 --2- 172.21.15.37:0/3249544012 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f515406ace0 0x7f515406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:38.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.564+0000 7f5174d9a700 1 --2- 172.21.15.37:0/3249544012 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f515406ace0 0x7f515406d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f51700b10e0 tx=0x7f5160007dc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:38.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.566+0000 7f5165ffb700 1 -- 172.21.15.37:0/3249544012 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f516c057fb0 con 0x7f51700b8430 2023-07-12T02:04:38.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.772+0000 7f51777ff700 1 -- 172.21.15.37:0/3249544012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f517004ea60 con 0x7f51700b8430 2023-07-12T02:04:38.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.773+0000 7f5165ffb700 1 -- 172.21.15.37:0/3249544012 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f516c00ce60 con 0x7f51700b8430 2023-07-12T02:04:38.776 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:04:38.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.775+0000 7f51777ff700 1 -- 172.21.15.37:0/3249544012 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f515406ace0 msgr2=0x7f515406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:38.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.775+0000 7f51777ff700 1 --2- 172.21.15.37:0/3249544012 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f515406ace0 0x7f515406d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f51700b10e0 tx=0x7f5160007dc0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.775+0000 7f51777ff700 1 -- 172.21.15.37:0/3249544012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51700b8430 msgr2=0x7f517015df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:38.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.775+0000 7f51777ff700 1 --2- 172.21.15.37:0/3249544012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51700b8430 0x7f517015df20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f516c00e9b0 tx=0x7f516c00ecc0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.775+0000 7f51777ff700 1 -- 172.21.15.37:0/3249544012 shutdown_connections 2023-07-12T02:04:38.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.775+0000 7f51777ff700 1 --2- 172.21.15.37:0/3249544012 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f515406ace0 0x7f515406d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.775+0000 7f51777ff700 1 --2- 172.21.15.37:0/3249544012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51700b8430 0x7f517015df20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.775+0000 7f51777ff700 1 --2- 172.21.15.37:0/3249544012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51700d3730 0x7f517015a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.775+0000 7f51777ff700 1 --2- 172.21.15.37:0/3249544012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51700cfc60 0x7f51700c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:38.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.775+0000 7f51777ff700 1 -- 172.21.15.37:0/3249544012 >> 172.21.15.37:0/3249544012 conn(0x7f517006b3f0 msgr2=0x7f517015fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:38.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.775+0000 7f51777ff700 1 -- 172.21.15.37:0/3249544012 shutdown_connections 2023-07-12T02:04:38.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.775+0000 7f51777ff700 1 -- 172.21.15.37:0/3249544012 wait complete. 2023-07-12T02:04:38.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:04:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.997+0000 7fbd4a5ff700 1 Processor -- start 2023-07-12T02:04:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.997+0000 7fbd4a5ff700 1 -- start start 2023-07-12T02:04:39.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.998+0000 7fbd4a5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbd440b8430 0x7fbd440cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.999+0000 7fbd4a5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd440d3730 0x7fbd440cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.999+0000 7fbd4a5ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd440d0b20 con 0x7fbd440cfa90 2023-07-12T02:04:39.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.999+0000 7fbd4a5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd440b8800 con 0x7fbd440b8430 2023-07-12T02:04:39.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.999+0000 7fbd4a5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440cfeb0 con 0x7fbd440d3730 2023-07-12T02:04:39.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.999+0000 7fbd43fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbd440b8430 0x7fbd440cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.999+0000 7fbd43fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbd440b8430 0x7fbd440cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35598/0 (socket says 172.21.15.37:35598) 2023-07-12T02:04:39.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.999+0000 7fbd43fff700 1 -- 172.21.15.37:0/3850562674 learned_addr learned my addr 172.21.15.37:0/3850562674 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:39.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.999+0000 7fbd437fe700 1 --2- 172.21.15.37:0/3850562674 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd440d3730 0x7fbd440cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.999+0000 7fbd43fff700 1 -- 172.21.15.37:0/3850562674 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd440d3730 msgr2=0x7fbd440cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:39.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.999+0000 7fbd43fff700 1 --2- 172.21.15.37:0/3850562674 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd440d3730 0x7fbd440cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.999+0000 7fbd43fff700 1 -- 172.21.15.37:0/3850562674 >> v1:172.21.15.196:6789/0 conn(0x7fbd440cfa90 legacy=0x7fbd4415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.999+0000 7fbd42ffd700 1 -- 172.21.15.37:0/3850562674 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383235918 0 0) 0x7fbd440d0b20 con 0x7fbd440cfa90 2023-07-12T02:04:39.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:38.999+0000 7fbd43fff700 1 -- 172.21.15.37:0/3850562674 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd440b4ee0 con 0x7fbd440b8430 2023-07-12T02:04:39.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.000+0000 7fbd43fff700 1 --2- 172.21.15.37:0/3850562674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd440b8430 0x7fbd440cd320 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbd340098f0 tx=0x7fbd34009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9413081b8aa8cde1 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:39.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.000+0000 7fbd42ffd700 1 -- 172.21.15.37:0/3850562674 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34011830 con 0x7fbd440b8430 2023-07-12T02:04:39.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.000+0000 7fbd42ffd700 1 -- 172.21.15.37:0/3850562674 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd34011990 con 0x7fbd440b8430 2023-07-12T02:04:39.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.000+0000 7fbd42ffd700 1 -- 172.21.15.37:0/3850562674 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34011d20 con 0x7fbd440b8430 2023-07-12T02:04:39.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.000+0000 7fbd4a5ff700 1 -- 172.21.15.37:0/3850562674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd440b8430 msgr2=0x7fbd440cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.000+0000 7fbd4a5ff700 1 --2- 172.21.15.37:0/3850562674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd440b8430 0x7fbd440cd320 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbd340098f0 tx=0x7fbd34009c00 comp rx=0 tx=0).stop 2023-07-12T02:04:39.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.001+0000 7fbd4a5ff700 1 -- 172.21.15.37:0/3850562674 shutdown_connections 2023-07-12T02:04:39.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.001+0000 7fbd4a5ff700 1 --2- 172.21.15.37:0/3850562674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd440b8430 0x7fbd440cd320 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.001+0000 7fbd4a5ff700 1 --2- 172.21.15.37:0/3850562674 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd440d3730 0x7fbd440cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.001+0000 7fbd4a5ff700 1 -- 172.21.15.37:0/3850562674 >> 172.21.15.37:0/3850562674 conn(0x7fbd4406b3f0 msgr2=0x7fbd4406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:39.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.001+0000 7fbd4a5ff700 1 -- 172.21.15.37:0/3850562674 shutdown_connections 2023-07-12T02:04:39.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.001+0000 7fbd4a5ff700 1 -- 172.21.15.37:0/3850562674 wait complete. 2023-07-12T02:04:39.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.002+0000 7fbd4a5ff700 1 Processor -- start 2023-07-12T02:04:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.003+0000 7fbd4a5ff700 1 -- start start 2023-07-12T02:04:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.003+0000 7fbd4a5ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd440b8430 0x7fbd4414aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.003+0000 7fbd4a5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd440cfa90 0x7fbd440cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.004+0000 7fbd4a5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd440d3730 0x7fbd440b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.004+0000 7fbd4a5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440cbb90 con 0x7fbd440cfa90 2023-07-12T02:04:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.004+0000 7fbd4a5ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440cb5d0 con 0x7fbd440b8430 2023-07-12T02:04:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.004+0000 7fbd4a5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440cb8b0 con 0x7fbd440d3730 2023-07-12T02:04:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.004+0000 7fbd437fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd440cfa90 0x7fbd440cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.004+0000 7fbd437fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd440cfa90 0x7fbd440cac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35608/0 (socket says 172.21.15.37:35608) 2023-07-12T02:04:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.004+0000 7fbd437fe700 1 -- 172.21.15.37:0/911723036 learned_addr learned my addr 172.21.15.37:0/911723036 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.004+0000 7fbd43fff700 1 --2- 172.21.15.37:0/911723036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd440b8430 0x7fbd4414aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.004+0000 7fbd48b9c700 1 --2- 172.21.15.37:0/911723036 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd440d3730 0x7fbd440b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.004+0000 7fbd437fe700 1 -- 172.21.15.37:0/911723036 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd440d3730 msgr2=0x7fbd440b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.004+0000 7fbd437fe700 1 --2- 172.21.15.37:0/911723036 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd440d3730 0x7fbd440b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.004+0000 7fbd437fe700 1 -- 172.21.15.37:0/911723036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd440b8430 msgr2=0x7fbd4414aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.004+0000 7fbd437fe700 1 --2- 172.21.15.37:0/911723036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd440b8430 0x7fbd4414aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.004+0000 7fbd437fe700 1 -- 172.21.15.37:0/911723036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd34009550 con 0x7fbd440cfa90 2023-07-12T02:04:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.005+0000 7fbd437fe700 1 --2- 172.21.15.37:0/911723036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd440cfa90 0x7fbd440cac60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800e9b0 tx=0x7fbd3800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.005+0000 7fbd40ff9700 1 -- 172.21.15.37:0/911723036 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd38009710 con 0x7fbd440cfa90 2023-07-12T02:04:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.005+0000 7fbd40ff9700 1 -- 172.21.15.37:0/911723036 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3800ee50 con 0x7fbd440cfa90 2023-07-12T02:04:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.005+0000 7fbd4a5ff700 1 -- 172.21.15.37:0/911723036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd44156c70 con 0x7fbd440cfa90 2023-07-12T02:04:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.005+0000 7fbd40ff9700 1 -- 172.21.15.37:0/911723036 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3800ca50 con 0x7fbd440cfa90 2023-07-12T02:04:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.005+0000 7fbd4a5ff700 1 -- 172.21.15.37:0/911723036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4414b3f0 con 0x7fbd440cfa90 2023-07-12T02:04:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.006+0000 7fbd4a5ff700 1 -- 172.21.15.37:0/911723036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4404ea60 con 0x7fbd440cfa90 2023-07-12T02:04:39.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.007+0000 7fbd40ff9700 1 -- 172.21.15.37:0/911723036 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd3800cbb0 con 0x7fbd440cfa90 2023-07-12T02:04:39.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.009+0000 7fbd40ff9700 1 --2- 172.21.15.37:0/911723036 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbd3006ace0 0x7fbd3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.009+0000 7fbd40ff9700 1 -- 172.21.15.37:0/911723036 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbd38089840 con 0x7fbd440cfa90 2023-07-12T02:04:39.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.009+0000 7fbd43fff700 1 --2- 172.21.15.37:0/911723036 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbd3006ace0 0x7fbd3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.010+0000 7fbd43fff700 1 --2- 172.21.15.37:0/911723036 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbd3006ace0 0x7fbd3006d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbd34014040 tx=0x7fbd34008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:39.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.013+0000 7fbd40ff9700 1 -- 172.21.15.37:0/911723036 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbd38057fb0 con 0x7fbd440cfa90 2023-07-12T02:04:39.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.223+0000 7fbd4a5ff700 1 -- 172.21.15.37:0/911723036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd440b7cf0 con 0x7fbd440cfa90 2023-07-12T02:04:39.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.223+0000 7fbd40ff9700 1 -- 172.21.15.37:0/911723036 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd3800ce60 con 0x7fbd440cfa90 2023-07-12T02:04:39.227 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:04:39.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.226+0000 7fbd4a5ff700 1 -- 172.21.15.37:0/911723036 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbd3006ace0 msgr2=0x7fbd3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.226+0000 7fbd4a5ff700 1 --2- 172.21.15.37:0/911723036 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbd3006ace0 0x7fbd3006d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbd34014040 tx=0x7fbd34008030 comp rx=0 tx=0).stop 2023-07-12T02:04:39.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.226+0000 7fbd4a5ff700 1 -- 172.21.15.37:0/911723036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd440cfa90 msgr2=0x7fbd440cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.226+0000 7fbd4a5ff700 1 --2- 172.21.15.37:0/911723036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd440cfa90 0x7fbd440cac60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800e9b0 tx=0x7fbd3800ecc0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.226+0000 7fbd4a5ff700 1 -- 172.21.15.37:0/911723036 shutdown_connections 2023-07-12T02:04:39.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.226+0000 7fbd4a5ff700 1 --2- 172.21.15.37:0/911723036 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbd3006ace0 0x7fbd3006d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.226+0000 7fbd4a5ff700 1 --2- 172.21.15.37:0/911723036 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd440d3730 0x7fbd440b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.226+0000 7fbd4a5ff700 1 --2- 172.21.15.37:0/911723036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd440b8430 0x7fbd4414aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.226+0000 7fbd4a5ff700 1 --2- 172.21.15.37:0/911723036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd440cfa90 0x7fbd440cac60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.226+0000 7fbd4a5ff700 1 -- 172.21.15.37:0/911723036 >> 172.21.15.37:0/911723036 conn(0x7fbd4406b3f0 msgr2=0x7fbd4415bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:39.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.226+0000 7fbd4a5ff700 1 -- 172.21.15.37:0/911723036 shutdown_connections 2023-07-12T02:04:39.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.226+0000 7fbd4a5ff700 1 -- 172.21.15.37:0/911723036 wait complete. 2023-07-12T02:04:39.247 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:04:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.448+0000 7f7834dff700 1 Processor -- start 2023-07-12T02:04:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.448+0000 7f7834dff700 1 -- start start 2023-07-12T02:04:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.448+0000 7f7834dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78300d3730 0x7f78300cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.448+0000 7f7834dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f78300cfa90 0x7f78300d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.448+0000 7f7834dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78300d0b20 con 0x7f78300b8430 2023-07-12T02:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.448+0000 7f7834dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78300cda30 con 0x7f78300d3730 2023-07-12T02:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.448+0000 7f7834dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78300b8800 con 0x7f78300cfa90 2023-07-12T02:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.449+0000 7f782e59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f78300b8430 0x7f78300cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39834/0 (socket says 172.21.15.37:39834) 2023-07-12T02:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.449+0000 7f782e59c700 1 -- 172.21.15.37:0/1672307225 learned_addr learned my addr 172.21.15.37:0/1672307225 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.449+0000 7f7827fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78300d3730 0x7f78300cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.449+0000 7f782ed9d700 1 --2- 172.21.15.37:0/1672307225 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f78300cfa90 0x7f78300d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.449+0000 7f7827fff700 1 -- 172.21.15.37:0/1672307225 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f78300cfa90 msgr2=0x7f78300d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.449+0000 7f7827fff700 1 --2- 172.21.15.37:0/1672307225 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f78300cfa90 0x7f78300d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.449+0000 7f7827fff700 1 -- 172.21.15.37:0/1672307225 >> v1:172.21.15.37:6789/0 conn(0x7f78300b8430 legacy=0x7f78300cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.449+0000 7f7827fff700 1 -- 172.21.15.37:0/1672307225 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78300cfeb0 con 0x7f78300d3730 2023-07-12T02:04:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.449+0000 7f7827fff700 1 --2- 172.21.15.37:0/1672307225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78300d3730 0x7f78300cf550 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7818009840 tx=0x7f7818009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64dca2d58f1c01eb server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.450+0000 7f782dd9b700 1 -- 172.21.15.37:0/1672307225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818011830 con 0x7f78300d3730 2023-07-12T02:04:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.450+0000 7f782dd9b700 1 -- 172.21.15.37:0/1672307225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7818011990 con 0x7f78300d3730 2023-07-12T02:04:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.450+0000 7f782dd9b700 1 -- 172.21.15.37:0/1672307225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818011d20 con 0x7f78300d3730 2023-07-12T02:04:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.450+0000 7f7834dff700 1 -- 172.21.15.37:0/1672307225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78300d3730 msgr2=0x7f78300cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.450+0000 7f7834dff700 1 --2- 172.21.15.37:0/1672307225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78300d3730 0x7f78300cf550 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7818009840 tx=0x7f7818009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.450+0000 7f7834dff700 1 -- 172.21.15.37:0/1672307225 shutdown_connections 2023-07-12T02:04:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.450+0000 7f7834dff700 1 --2- 172.21.15.37:0/1672307225 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f78300cfa90 0x7f78300d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.450+0000 7f7834dff700 1 --2- 172.21.15.37:0/1672307225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78300d3730 0x7f78300cf550 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.450+0000 7f7834dff700 1 -- 172.21.15.37:0/1672307225 >> 172.21.15.37:0/1672307225 conn(0x7f783006b3f0 msgr2=0x7f783006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.450+0000 7f7834dff700 1 -- 172.21.15.37:0/1672307225 shutdown_connections 2023-07-12T02:04:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.450+0000 7f7834dff700 1 -- 172.21.15.37:0/1672307225 wait complete. 2023-07-12T02:04:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.452+0000 7f7834dff700 1 Processor -- start 2023-07-12T02:04:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.452+0000 7f7834dff700 1 -- start start 2023-07-12T02:04:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.453+0000 7f7834dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78300b8430 0x7f78301e6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.453+0000 7f7834dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f78300cfa90 0x7f783015af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.453+0000 7f7834dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78300d3730 0x7f78301f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.453+0000 7f7834dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78301e63e0 con 0x7f78300b8430 2023-07-12T02:04:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.453+0000 7f7834dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78301e7680 con 0x7f78300d3730 2023-07-12T02:04:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.453+0000 7f7834dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78301f5b10 con 0x7f78300cfa90 2023-07-12T02:04:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.453+0000 7f782e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78300b8430 0x7f78301e6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.454+0000 7f782e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78300b8430 0x7f78301e6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35622/0 (socket says 172.21.15.37:35622) 2023-07-12T02:04:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.454+0000 7f782e59c700 1 -- 172.21.15.37:0/2006206449 learned_addr learned my addr 172.21.15.37:0/2006206449 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.454+0000 7f7827fff700 1 --2- 172.21.15.37:0/2006206449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f78300cfa90 0x7f783015af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.454+0000 7f782ed9d700 1 --2- 172.21.15.37:0/2006206449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78300d3730 0x7f78301f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.454+0000 7f782e59c700 1 -- 172.21.15.37:0/2006206449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f78300cfa90 msgr2=0x7f783015af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.454+0000 7f782e59c700 1 --2- 172.21.15.37:0/2006206449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f78300cfa90 0x7f783015af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.454+0000 7f782e59c700 1 -- 172.21.15.37:0/2006206449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78300d3730 msgr2=0x7f78301f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.454+0000 7f782e59c700 1 --2- 172.21.15.37:0/2006206449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78300d3730 0x7f78301f4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.454+0000 7f782e59c700 1 -- 172.21.15.37:0/2006206449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78180094a0 con 0x7f78300b8430 2023-07-12T02:04:39.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.454+0000 7f782ed9d700 1 --2- 172.21.15.37:0/2006206449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78300d3730 0x7f78301f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:39.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.454+0000 7f782e59c700 1 --2- 172.21.15.37:0/2006206449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78300b8430 0x7f78301e6870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f782000c520 tx=0x7f782000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:39.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.454+0000 7f7826ffd700 1 -- 172.21.15.37:0/2006206449 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820005d70 con 0x7f78300b8430 2023-07-12T02:04:39.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.454+0000 7f7826ffd700 1 -- 172.21.15.37:0/2006206449 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78200070d0 con 0x7f78300b8430 2023-07-12T02:04:39.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.454+0000 7f7826ffd700 1 -- 172.21.15.37:0/2006206449 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820007440 con 0x7f78300b8430 2023-07-12T02:04:39.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.454+0000 7f7834dff700 1 -- 172.21.15.37:0/2006206449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78301f5df0 con 0x7f78300b8430 2023-07-12T02:04:39.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.456+0000 7f7834dff700 1 -- 172.21.15.37:0/2006206449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78301e6070 con 0x7f78300b8430 2023-07-12T02:04:39.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.457+0000 7f7834dff700 1 -- 172.21.15.37:0/2006206449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78301e66c0 con 0x7f78300b8430 2023-07-12T02:04:39.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.458+0000 7f7826ffd700 1 -- 172.21.15.37:0/2006206449 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f78200075a0 con 0x7f78300b8430 2023-07-12T02:04:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.458+0000 7f7826ffd700 1 --2- 172.21.15.37:0/2006206449 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f781006ace0 0x7f781006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.459+0000 7f7826ffd700 1 -- 172.21.15.37:0/2006206449 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7820088c50 con 0x7f78300b8430 2023-07-12T02:04:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.459+0000 7f7827fff700 1 --2- 172.21.15.37:0/2006206449 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f781006ace0 0x7f781006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.460+0000 7f7827fff700 1 --2- 172.21.15.37:0/2006206449 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f781006ace0 0x7f781006d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7818000c00 tx=0x7f781801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.463+0000 7f7826ffd700 1 -- 172.21.15.37:0/2006206449 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7820053950 con 0x7f78300b8430 2023-07-12T02:04:39.481 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:04:39.485 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:04:39.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.673+0000 7f7834dff700 1 -- 172.21.15.37:0/2006206449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f783004ea60 con 0x7f78300b8430 2023-07-12T02:04:39.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.674+0000 7f7826ffd700 1 -- 172.21.15.37:0/2006206449 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7820017020 con 0x7f78300b8430 2023-07-12T02:04:39.676 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-12T02:04:39.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.676+0000 7f7834dff700 1 -- 172.21.15.37:0/2006206449 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f781006ace0 msgr2=0x7f781006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.676+0000 7f7834dff700 1 --2- 172.21.15.37:0/2006206449 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f781006ace0 0x7f781006d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7818000c00 tx=0x7f781801c040 comp rx=0 tx=0).stop 2023-07-12T02:04:39.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.676+0000 7f7834dff700 1 -- 172.21.15.37:0/2006206449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78300b8430 msgr2=0x7f78301e6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.676+0000 7f7834dff700 1 --2- 172.21.15.37:0/2006206449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78300b8430 0x7f78301e6870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f782000c520 tx=0x7f782000c830 comp rx=0 tx=0).stop 2023-07-12T02:04:39.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.676+0000 7f7834dff700 1 -- 172.21.15.37:0/2006206449 shutdown_connections 2023-07-12T02:04:39.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.676+0000 7f7834dff700 1 --2- 172.21.15.37:0/2006206449 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f781006ace0 0x7f781006d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.676+0000 7f7834dff700 1 --2- 172.21.15.37:0/2006206449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78300b8430 0x7f78301e6870 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.676+0000 7f7834dff700 1 --2- 172.21.15.37:0/2006206449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78300d3730 0x7f78301f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.676+0000 7f7834dff700 1 --2- 172.21.15.37:0/2006206449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f78300cfa90 0x7f783015af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.676+0000 7f7834dff700 1 -- 172.21.15.37:0/2006206449 >> 172.21.15.37:0/2006206449 conn(0x7f783006b3f0 msgr2=0x7f78300b6560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:39.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.676+0000 7f7834dff700 1 -- 172.21.15.37:0/2006206449 shutdown_connections 2023-07-12T02:04:39.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.676+0000 7f7834dff700 1 -- 172.21.15.37:0/2006206449 wait complete. 2023-07-12T02:04:39.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-12T02:04:39.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.898+0000 7f3fa05ff700 1 Processor -- start 2023-07-12T02:04:39.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.899+0000 7f3fa05ff700 1 -- start start 2023-07-12T02:04:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.900+0000 7f3fa05ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f98160a40 0x7f3f9806bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.900+0000 7f3fa05ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f980b0070 con 0x7f3f9806c300 2023-07-12T02:04:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.900+0000 7f3fa05ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9806e880 con 0x7f3f980afca0 2023-07-12T02:04:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.900+0000 7f3fa05ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f98160eb0 con 0x7f3f98160a40 2023-07-12T02:04:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.900+0000 7f3f9eb9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3f9806c300 0x7f3f980caee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39842/0 (socket says 172.21.15.37:39842) 2023-07-12T02:04:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.900+0000 7f3f9db9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f98160a40 0x7f3f9806bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.900+0000 7f3f9eb9c700 1 -- 172.21.15.37:0/619697294 learned_addr learned my addr 172.21.15.37:0/619697294 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.901+0000 7f3f9d399700 1 -- 172.21.15.37:0/619697294 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948925105 0 0) 0x7f3f980b0070 con 0x7f3f9806c300 2023-07-12T02:04:39.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.901+0000 7f3f9db9a700 1 -- 172.21.15.37:0/619697294 >> v1:172.21.15.196:6789/0 conn(0x7f3f980afca0 legacy=0x7f3f9806e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.901+0000 7f3f9db9a700 1 -- 172.21.15.37:0/619697294 >> v1:172.21.15.37:6789/0 conn(0x7f3f9806c300 legacy=0x7f3f980caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.901+0000 7f3f9db9a700 1 -- 172.21.15.37:0/619697294 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9806eb60 con 0x7f3f98160a40 2023-07-12T02:04:39.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.901+0000 7f3f9db9a700 1 --2- 172.21.15.37:0/619697294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f98160a40 0x7f3f9806bdc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3f880097a0 tx=0x7f3f88009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f83737520164b82 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:39.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.901+0000 7f3f9d399700 1 -- 172.21.15.37:0/619697294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88005e30 con 0x7f3f98160a40 2023-07-12T02:04:39.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.902+0000 7f3f9d399700 1 -- 172.21.15.37:0/619697294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f88004030 con 0x7f3f98160a40 2023-07-12T02:04:39.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.902+0000 7f3f9d399700 1 -- 172.21.15.37:0/619697294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f880043e0 con 0x7f3f98160a40 2023-07-12T02:04:39.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.902+0000 7f3fa05ff700 1 -- 172.21.15.37:0/619697294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f98160a40 msgr2=0x7f3f9806bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.902+0000 7f3fa05ff700 1 --2- 172.21.15.37:0/619697294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f98160a40 0x7f3f9806bdc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3f880097a0 tx=0x7f3f88009ab0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.902+0000 7f3fa05ff700 1 -- 172.21.15.37:0/619697294 shutdown_connections 2023-07-12T02:04:39.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.902+0000 7f3fa05ff700 1 --2- 172.21.15.37:0/619697294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f98160a40 0x7f3f9806bdc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.902+0000 7f3fa05ff700 1 -- 172.21.15.37:0/619697294 >> 172.21.15.37:0/619697294 conn(0x7f3f9808a3b0 msgr2=0x7f3f9806a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:39.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.902+0000 7f3fa05ff700 1 -- 172.21.15.37:0/619697294 shutdown_connections 2023-07-12T02:04:39.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.902+0000 7f3fa05ff700 1 -- 172.21.15.37:0/619697294 wait complete. 2023-07-12T02:04:39.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.904+0000 7f3fa05ff700 1 Processor -- start 2023-07-12T02:04:39.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.904+0000 7f3fa05ff700 1 -- start start 2023-07-12T02:04:39.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.905+0000 7f3fa05ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f9806c300 0x7f3f980ce460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.905+0000 7f3fa05ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f980afca0 0x7f3f9814b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.905+0000 7f3fa05ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f98160a40 0x7f3f980ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.905+0000 7f3fa05ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980ce9a0 con 0x7f3f98160a40 2023-07-12T02:04:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.905+0000 7f3fa05ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9814b6d0 con 0x7f3f9806c300 2023-07-12T02:04:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.905+0000 7f3fa05ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980ca850 con 0x7f3f980afca0 2023-07-12T02:04:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.905+0000 7f3f9eb9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f98160a40 0x7f3f980ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.905+0000 7f3f9eb9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f98160a40 0x7f3f980ca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35640/0 (socket says 172.21.15.37:35640) 2023-07-12T02:04:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.905+0000 7f3f9eb9c700 1 -- 172.21.15.37:0/2543912758 learned_addr learned my addr 172.21.15.37:0/2543912758 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.906+0000 7f3f9e39b700 1 --2- 172.21.15.37:0/2543912758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f9806c300 0x7f3f980ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.906+0000 7f3f9db9a700 1 --2- 172.21.15.37:0/2543912758 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f980afca0 0x7f3f9814b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.906+0000 7f3f9eb9c700 1 -- 172.21.15.37:0/2543912758 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f980afca0 msgr2=0x7f3f9814b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.906+0000 7f3f9eb9c700 1 --2- 172.21.15.37:0/2543912758 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f980afca0 0x7f3f9814b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.906+0000 7f3f9eb9c700 1 -- 172.21.15.37:0/2543912758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f9806c300 msgr2=0x7f3f980ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.906+0000 7f3f9eb9c700 1 --2- 172.21.15.37:0/2543912758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f9806c300 0x7f3f980ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.906+0000 7f3f9eb9c700 1 -- 172.21.15.37:0/2543912758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f88009430 con 0x7f3f98160a40 2023-07-12T02:04:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.906+0000 7f3f9e39b700 1 --2- 172.21.15.37:0/2543912758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f9806c300 0x7f3f980ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.906+0000 7f3f9eb9c700 1 --2- 172.21.15.37:0/2543912758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f98160a40 0x7f3f980ca310 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000cc40 tx=0x7f3f9000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.906+0000 7f3f8effd700 1 -- 172.21.15.37:0/2543912758 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000aba0 con 0x7f3f98160a40 2023-07-12T02:04:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.906+0000 7f3f8effd700 1 -- 172.21.15.37:0/2543912758 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9000ad00 con 0x7f3f98160a40 2023-07-12T02:04:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.906+0000 7f3f8effd700 1 -- 172.21.15.37:0/2543912758 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90007310 con 0x7f3f98160a40 2023-07-12T02:04:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.906+0000 7f3fa05ff700 1 -- 172.21.15.37:0/2543912758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f980d0950 con 0x7f3f98160a40 2023-07-12T02:04:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.907+0000 7f3fa05ff700 1 -- 172.21.15.37:0/2543912758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f980d0ed0 con 0x7f3f98160a40 2023-07-12T02:04:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.907+0000 7f3fa05ff700 1 -- 172.21.15.37:0/2543912758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f980cdfa0 con 0x7f3f98160a40 2023-07-12T02:04:39.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.909+0000 7f3f8effd700 1 -- 172.21.15.37:0/2543912758 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f90007470 con 0x7f3f98160a40 2023-07-12T02:04:39.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.910+0000 7f3f8effd700 1 --2- 172.21.15.37:0/2543912758 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3f7c06ace0 0x7f3f7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:39.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.910+0000 7f3f8effd700 1 -- 172.21.15.37:0/2543912758 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3f900893c0 con 0x7f3f98160a40 2023-07-12T02:04:39.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.910+0000 7f3f9e39b700 1 --2- 172.21.15.37:0/2543912758 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3f7c06ace0 0x7f3f7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:39.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.911+0000 7f3f9e39b700 1 --2- 172.21.15.37:0/2543912758 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3f7c06ace0 0x7f3f7c06d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3f94000fb0 tx=0x7f3f94009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:39.914+0000 7f3f8effd700 1 -- 172.21.15.37:0/2543912758 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3f90054130 con 0x7f3f98160a40 2023-07-12T02:04:40.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.127+0000 7f3fa05ff700 1 -- 172.21.15.37:0/2543912758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3f9804ea60 con 0x7f3f98160a40 2023-07-12T02:04:40.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.127+0000 7f3f8effd700 1 -- 172.21.15.37:0/2543912758 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3f90057750 con 0x7f3f98160a40 2023-07-12T02:04:40.130 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:04:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.130+0000 7f3fa05ff700 1 -- 172.21.15.37:0/2543912758 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3f7c06ace0 msgr2=0x7f3f7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:40.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.130+0000 7f3fa05ff700 1 --2- 172.21.15.37:0/2543912758 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3f7c06ace0 0x7f3f7c06d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3f94000fb0 tx=0x7f3f94009040 comp rx=0 tx=0).stop 2023-07-12T02:04:40.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.130+0000 7f3fa05ff700 1 -- 172.21.15.37:0/2543912758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f98160a40 msgr2=0x7f3f980ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:40.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.130+0000 7f3fa05ff700 1 --2- 172.21.15.37:0/2543912758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f98160a40 0x7f3f980ca310 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000cc40 tx=0x7f3f9000a060 comp rx=0 tx=0).stop 2023-07-12T02:04:40.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.130+0000 7f3fa05ff700 1 -- 172.21.15.37:0/2543912758 shutdown_connections 2023-07-12T02:04:40.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.130+0000 7f3fa05ff700 1 --2- 172.21.15.37:0/2543912758 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3f7c06ace0 0x7f3f7c06d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.130+0000 7f3fa05ff700 1 --2- 172.21.15.37:0/2543912758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f98160a40 0x7f3f980ca310 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.130+0000 7f3fa05ff700 1 --2- 172.21.15.37:0/2543912758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f9806c300 0x7f3f980ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.130+0000 7f3fa05ff700 1 --2- 172.21.15.37:0/2543912758 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f980afca0 0x7f3f9814b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.130+0000 7f3fa05ff700 1 -- 172.21.15.37:0/2543912758 >> 172.21.15.37:0/2543912758 conn(0x7f3f9808a3b0 msgr2=0x7f3f9806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:40.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.130+0000 7f3fa05ff700 1 -- 172.21.15.37:0/2543912758 shutdown_connections 2023-07-12T02:04:40.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.130+0000 7f3fa05ff700 1 -- 172.21.15.37:0/2543912758 wait complete. 2023-07-12T02:04:40.151 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:04:40.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.349+0000 7f3dc91ff700 1 Processor -- start 2023-07-12T02:04:40.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.349+0000 7f3dc91ff700 1 -- start start 2023-07-12T02:04:40.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.350+0000 7f3dc91ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3dc415c460 0x7f3dc40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:40.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.350+0000 7f3dc91ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dc40cf8f0 0x7f3dc415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:40.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.350+0000 7f3dc91ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc40d1790 con 0x7f3dc40d2640 2023-07-12T02:04:40.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.350+0000 7f3dc91ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc40cedd0 con 0x7f3dc415c460 2023-07-12T02:04:40.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.350+0000 7f3dc91ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40cd950 con 0x7f3dc40cf8f0 2023-07-12T02:04:40.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.351+0000 7f3dc2d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3dc415c460 0x7f3dc40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:40.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.351+0000 7f3dc259c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3dc40d2640 0x7f3dc40cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39848/0 (socket says 172.21.15.37:39848) 2023-07-12T02:04:40.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.351+0000 7f3dc259c700 1 -- 172.21.15.37:0/2553804134 learned_addr learned my addr 172.21.15.37:0/2553804134 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:40.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.351+0000 7f3dc359e700 1 --2- 172.21.15.37:0/2553804134 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dc40cf8f0 0x7f3dc415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:40.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.351+0000 7f3dc2d9d700 1 -- 172.21.15.37:0/2553804134 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dc40cf8f0 msgr2=0x7f3dc415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:40.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.351+0000 7f3dc2d9d700 1 --2- 172.21.15.37:0/2553804134 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dc40cf8f0 0x7f3dc415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.351+0000 7f3dc2d9d700 1 -- 172.21.15.37:0/2553804134 >> v1:172.21.15.37:6789/0 conn(0x7f3dc40d2640 legacy=0x7f3dc40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:40.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.351+0000 7f3dc2d9d700 1 -- 172.21.15.37:0/2553804134 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc40d14b0 con 0x7f3dc415c460 2023-07-12T02:04:40.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.351+0000 7f3dc2d9d700 1 --2- 172.21.15.37:0/2553804134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dc415c460 0x7f3dc40b59d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009840 tx=0x7f3db4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6f2215ec91cc36 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:40.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.352+0000 7f3dc1d9b700 1 -- 172.21.15.37:0/2553804134 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4011830 con 0x7f3dc415c460 2023-07-12T02:04:40.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.352+0000 7f3dc1d9b700 1 -- 172.21.15.37:0/2553804134 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db4011990 con 0x7f3dc415c460 2023-07-12T02:04:40.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.352+0000 7f3dc1d9b700 1 -- 172.21.15.37:0/2553804134 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4011d20 con 0x7f3dc415c460 2023-07-12T02:04:40.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.352+0000 7f3dc91ff700 1 -- 172.21.15.37:0/2553804134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dc415c460 msgr2=0x7f3dc40b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:40.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.352+0000 7f3dc91ff700 1 --2- 172.21.15.37:0/2553804134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dc415c460 0x7f3dc40b59d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009840 tx=0x7f3db4009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:40.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.352+0000 7f3dc91ff700 1 -- 172.21.15.37:0/2553804134 shutdown_connections 2023-07-12T02:04:40.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.352+0000 7f3dc91ff700 1 --2- 172.21.15.37:0/2553804134 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dc40cf8f0 0x7f3dc415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.352+0000 7f3dc91ff700 1 --2- 172.21.15.37:0/2553804134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dc415c460 0x7f3dc40b59d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.352+0000 7f3dc91ff700 1 -- 172.21.15.37:0/2553804134 >> 172.21.15.37:0/2553804134 conn(0x7f3dc4071660 msgr2=0x7f3dc4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:40.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.352+0000 7f3dc91ff700 1 -- 172.21.15.37:0/2553804134 shutdown_connections 2023-07-12T02:04:40.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.352+0000 7f3dc91ff700 1 -- 172.21.15.37:0/2553804134 wait complete. 2023-07-12T02:04:40.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.354+0000 7f3dc91ff700 1 Processor -- start 2023-07-12T02:04:40.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.354+0000 7f3dc91ff700 1 -- start start 2023-07-12T02:04:40.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.355+0000 7f3dc91ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dc40cf8f0 0x7f3dc4157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:40.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.355+0000 7f3dc91ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dc40d2640 0x7f3dc415a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:40.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.355+0000 7f3dc91ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dc415c460 0x7f3dc415ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:40.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.355+0000 7f3dc91ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc41e5f30 con 0x7f3dc40d2640 2023-07-12T02:04:40.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.355+0000 7f3dc91ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40c7a20 con 0x7f3dc40cf8f0 2023-07-12T02:04:40.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.355+0000 7f3dc91ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40ca830 con 0x7f3dc415c460 2023-07-12T02:04:40.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.356+0000 7f3dc259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dc40d2640 0x7f3dc415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:40.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.356+0000 7f3dc259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dc40d2640 0x7f3dc415a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35650/0 (socket says 172.21.15.37:35650) 2023-07-12T02:04:40.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.356+0000 7f3dc259c700 1 -- 172.21.15.37:0/488041102 learned_addr learned my addr 172.21.15.37:0/488041102 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:40.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.356+0000 7f3dc359e700 1 --2- 172.21.15.37:0/488041102 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dc415c460 0x7f3dc415ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.356+0000 7f3dc2d9d700 1 --2- 172.21.15.37:0/488041102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dc40cf8f0 0x7f3dc4157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.356+0000 7f3dc259c700 1 -- 172.21.15.37:0/488041102 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dc415c460 msgr2=0x7f3dc415ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.356+0000 7f3dc259c700 1 --2- 172.21.15.37:0/488041102 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dc415c460 0x7f3dc415ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.356+0000 7f3dc259c700 1 -- 172.21.15.37:0/488041102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dc40cf8f0 msgr2=0x7f3dc4157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.356+0000 7f3dc259c700 1 --2- 172.21.15.37:0/488041102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dc40cf8f0 0x7f3dc4157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.356+0000 7f3dc259c700 1 -- 172.21.15.37:0/488041102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db40094a0 con 0x7f3dc40d2640 2023-07-12T02:04:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.356+0000 7f3dc259c700 1 --2- 172.21.15.37:0/488041102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dc40d2640 0x7f3dc415a810 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3db800c480 tx=0x7f3db800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.356+0000 7f3dab7fe700 1 -- 172.21.15.37:0/488041102 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8005d70 con 0x7f3dc40d2640 2023-07-12T02:04:40.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.357+0000 7f3dab7fe700 1 -- 172.21.15.37:0/488041102 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db80070d0 con 0x7f3dc40d2640 2023-07-12T02:04:40.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.357+0000 7f3dab7fe700 1 -- 172.21.15.37:0/488041102 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8007440 con 0x7f3dc40d2640 2023-07-12T02:04:40.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.357+0000 7f3dc91ff700 1 -- 172.21.15.37:0/488041102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc40cab10 con 0x7f3dc40d2640 2023-07-12T02:04:40.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.357+0000 7f3dc91ff700 1 -- 172.21.15.37:0/488041102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc40cb0d0 con 0x7f3dc40d2640 2023-07-12T02:04:40.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.358+0000 7f3dc91ff700 1 -- 172.21.15.37:0/488041102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc41e5d00 con 0x7f3dc40d2640 2023-07-12T02:04:40.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.359+0000 7f3dab7fe700 1 -- 172.21.15.37:0/488041102 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3db80075a0 con 0x7f3dc40d2640 2023-07-12T02:04:40.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.360+0000 7f3dab7fe700 1 --2- 172.21.15.37:0/488041102 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3db006ace0 0x7f3db006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:40.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.360+0000 7f3dab7fe700 1 -- 172.21.15.37:0/488041102 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3db8088c80 con 0x7f3dc40d2640 2023-07-12T02:04:40.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.360+0000 7f3dc2d9d700 1 --2- 172.21.15.37:0/488041102 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3db006ace0 0x7f3db006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:40.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.361+0000 7f3dc2d9d700 1 --2- 172.21.15.37:0/488041102 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3db006ace0 0x7f3db006d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3db40090b0 tx=0x7f3db401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:40.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.364+0000 7f3dab7fe700 1 -- 172.21.15.37:0/488041102 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3dc41e5d00 con 0x7f3dc40d2640 2023-07-12T02:04:40.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.613+0000 7f3dc91ff700 1 -- 172.21.15.37:0/488041102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3dc41e5d00 con 0x7f3dc40d2640 2023-07-12T02:04:40.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.613+0000 7f3dab7fe700 1 -- 172.21.15.37:0/488041102 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f3dc41e5d00 con 0x7f3dc40d2640 2023-07-12T02:04:40.616 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:40.616 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/2496042538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":2496042538},{"type":"v1","addr":"172.21.15.196:6836","nonce":2496042538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2193116262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":2193116262},{"type":"v1","addr":"172.21.15.196:6837","nonce":2193116262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3195008737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3195008737},{"type":"v1","addr":"172.21.15.37:6834","nonce":3195008737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:03:57.647919+0000","modified":"2023-07-12T02:04:25.438552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/4264740807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4264740807},{"type":"v1","addr":"172.21.15.37:6835","nonce":4264740807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-12T02:04:40.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.616+0000 7f3dc91ff700 1 -- 172.21.15.37:0/488041102 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3db006ace0 msgr2=0x7f3db006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:40.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.616+0000 7f3dc91ff700 1 --2- 172.21.15.37:0/488041102 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3db006ace0 0x7f3db006d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3db40090b0 tx=0x7f3db401c040 comp rx=0 tx=0).stop 2023-07-12T02:04:40.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.616+0000 7f3dc91ff700 1 -- 172.21.15.37:0/488041102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dc40d2640 msgr2=0x7f3dc415a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:40.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.616+0000 7f3dc91ff700 1 --2- 172.21.15.37:0/488041102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dc40d2640 0x7f3dc415a810 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3db800c480 tx=0x7f3db800c840 comp rx=0 tx=0).stop 2023-07-12T02:04:40.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.616+0000 7f3dc91ff700 1 -- 172.21.15.37:0/488041102 shutdown_connections 2023-07-12T02:04:40.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.616+0000 7f3dc91ff700 1 --2- 172.21.15.37:0/488041102 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3db006ace0 0x7f3db006d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.616+0000 7f3dc91ff700 1 --2- 172.21.15.37:0/488041102 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dc415c460 0x7f3dc415ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.616+0000 7f3dc91ff700 1 --2- 172.21.15.37:0/488041102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dc40cf8f0 0x7f3dc4157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.616+0000 7f3dc91ff700 1 --2- 172.21.15.37:0/488041102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dc40d2640 0x7f3dc415a810 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.616+0000 7f3dc91ff700 1 -- 172.21.15.37:0/488041102 >> 172.21.15.37:0/488041102 conn(0x7f3dc4071660 msgr2=0x7f3dc406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:40.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.616+0000 7f3dc91ff700 1 -- 172.21.15.37:0/488041102 shutdown_connections 2023-07-12T02:04:40.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.616+0000 7f3dc91ff700 1 -- 172.21.15.37:0/488041102 wait complete. 2023-07-12T02:04:40.620 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2023-07-12T02:04:40.637 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:04:40.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.835+0000 7f88d9dff700 1 Processor -- start 2023-07-12T02:04:40.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.836+0000 7f88d9dff700 1 -- start start 2023-07-12T02:04:40.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.837+0000 7f88d9dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88d415c460 0x7f88d40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:40.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.837+0000 7f88d9dff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f88d40d2640 0x7f88d40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:40.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.837+0000 7f88d9dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d40d1790 con 0x7f88d40cf720 2023-07-12T02:04:40.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.837+0000 7f88d9dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d40cedd0 con 0x7f88d415c460 2023-07-12T02:04:40.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.837+0000 7f88d9dff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d40cd950 con 0x7f88d40d2640 2023-07-12T02:04:40.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.837+0000 7f88d37fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88d415c460 0x7f88d40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:40.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.837+0000 7f88d3fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f88d40cf720 0x7f88d40d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39850/0 (socket says 172.21.15.37:39850) 2023-07-12T02:04:40.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.837+0000 7f88d3fff700 1 -- 172.21.15.37:0/135724180 learned_addr learned my addr 172.21.15.37:0/135724180 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:40.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.837+0000 7f88d2ffd700 1 --2- 172.21.15.37:0/135724180 >> v2:172.21.15.196:3300/0 conn(0x7f88d40d2640 0x7f88d40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:40.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.838+0000 7f88d27fc700 1 -- 172.21.15.37:0/135724180 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960983161 0 0) 0x7f88d40d1790 con 0x7f88d40cf720 2023-07-12T02:04:40.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.838+0000 7f88d27fc700 1 -- 172.21.15.37:0/135724180 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88bc0035b0 con 0x7f88d40cf720 2023-07-12T02:04:40.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.838+0000 7f88d37fe700 1 -- 172.21.15.37:0/135724180 >> v2:172.21.15.196:3300/0 conn(0x7f88d40d2640 msgr2=0x7f88d40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:40.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.838+0000 7f88d37fe700 1 --2- 172.21.15.37:0/135724180 >> v2:172.21.15.196:3300/0 conn(0x7f88d40d2640 0x7f88d40cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.838+0000 7f88d37fe700 1 -- 172.21.15.37:0/135724180 >> v1:172.21.15.37:6789/0 conn(0x7f88d40cf720 legacy=0x7f88d40d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.838+0000 7f88d37fe700 1 -- 172.21.15.37:0/135724180 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d40d14b0 con 0x7f88d415c460 2023-07-12T02:04:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.838+0000 7f88d2ffd700 1 --2- 172.21.15.37:0/135724180 >> v2:172.21.15.196:3300/0 conn(0x7f88d40d2640 0x7f88d40cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.838+0000 7f88d37fe700 1 --2- 172.21.15.37:0/135724180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d415c460 0x7f88d40b59d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f88d415fd80 tx=0x7f88c4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1496927d007ca5e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.838+0000 7f88d27fc700 1 -- 172.21.15.37:0/135724180 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c4011830 con 0x7f88d415c460 2023-07-12T02:04:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.838+0000 7f88d27fc700 1 -- 172.21.15.37:0/135724180 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c4011990 con 0x7f88d415c460 2023-07-12T02:04:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.838+0000 7f88d27fc700 1 -- 172.21.15.37:0/135724180 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c4011d20 con 0x7f88d415c460 2023-07-12T02:04:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.839+0000 7f88d9dff700 1 -- 172.21.15.37:0/135724180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d415c460 msgr2=0x7f88d40b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.839+0000 7f88d9dff700 1 --2- 172.21.15.37:0/135724180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d415c460 0x7f88d40b59d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f88d415fd80 tx=0x7f88c4009b20 comp rx=0 tx=0).stop 2023-07-12T02:04:40.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.839+0000 7f88d9dff700 1 -- 172.21.15.37:0/135724180 shutdown_connections 2023-07-12T02:04:40.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.839+0000 7f88d9dff700 1 --2- 172.21.15.37:0/135724180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d415c460 0x7f88d40b59d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.839+0000 7f88d9dff700 1 --2- 172.21.15.37:0/135724180 >> v2:172.21.15.196:3300/0 conn(0x7f88d40d2640 0x7f88d40cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.839+0000 7f88d9dff700 1 -- 172.21.15.37:0/135724180 >> 172.21.15.37:0/135724180 conn(0x7f88d4071660 msgr2=0x7f88d4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:40.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.839+0000 7f88d9dff700 1 -- 172.21.15.37:0/135724180 shutdown_connections 2023-07-12T02:04:40.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.839+0000 7f88d9dff700 1 -- 172.21.15.37:0/135724180 wait complete. 2023-07-12T02:04:40.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.841+0000 7f88d9dff700 1 Processor -- start 2023-07-12T02:04:40.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.841+0000 7f88d9dff700 1 -- start start 2023-07-12T02:04:40.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.842+0000 7f88d9dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40cf720 0x7f88d40c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:40.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.842+0000 7f88d9dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88d40d2640 0x7f88d4145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:40.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.842+0000 7f88d9dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88d415c460 0x7f88d4147b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.842+0000 7f88d9dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d4146570 con 0x7f88d40cf720 2023-07-12T02:04:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.842+0000 7f88d9dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d4146850 con 0x7f88d415c460 2023-07-12T02:04:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.842+0000 7f88d9dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d4146b30 con 0x7f88d40d2640 2023-07-12T02:04:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.842+0000 7f88d37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40cf720 0x7f88d40c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.842+0000 7f88d37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40cf720 0x7f88d40c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35666/0 (socket says 172.21.15.37:35666) 2023-07-12T02:04:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.842+0000 7f88d37fe700 1 -- 172.21.15.37:0/4230307995 learned_addr learned my addr 172.21.15.37:0/4230307995 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.842+0000 7f88d2ffd700 1 --2- 172.21.15.37:0/4230307995 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88d40d2640 0x7f88d4145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:40.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.842+0000 7f88d3fff700 1 --2- 172.21.15.37:0/4230307995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88d415c460 0x7f88d4147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:40.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.842+0000 7f88d37fe700 1 -- 172.21.15.37:0/4230307995 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88d40d2640 msgr2=0x7f88d4145ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:40.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.842+0000 7f88d37fe700 1 --2- 172.21.15.37:0/4230307995 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88d40d2640 0x7f88d4145ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.842+0000 7f88d37fe700 1 -- 172.21.15.37:0/4230307995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88d415c460 msgr2=0x7f88d4147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:40.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.842+0000 7f88d37fe700 1 --2- 172.21.15.37:0/4230307995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88d415c460 0x7f88d4147b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:40.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.842+0000 7f88d37fe700 1 -- 172.21.15.37:0/4230307995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c40094a0 con 0x7f88d40cf720 2023-07-12T02:04:40.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.843+0000 7f88d37fe700 1 --2- 172.21.15.37:0/4230307995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40cf720 0x7f88d40c5850 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009b60 tx=0x7f88c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:40.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.843+0000 7f88bbfff700 1 -- 172.21.15.37:0/4230307995 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c40036a0 con 0x7f88d40cf720 2023-07-12T02:04:40.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.843+0000 7f88bbfff700 1 -- 172.21.15.37:0/4230307995 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c401f070 con 0x7f88d40cf720 2023-07-12T02:04:40.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.843+0000 7f88d9dff700 1 -- 172.21.15.37:0/4230307995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d4146e10 con 0x7f88d40cf720 2023-07-12T02:04:40.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.843+0000 7f88bbfff700 1 -- 172.21.15.37:0/4230307995 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c4003a40 con 0x7f88d40cf720 2023-07-12T02:04:40.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.843+0000 7f88d9dff700 1 -- 172.21.15.37:0/4230307995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d4155da0 con 0x7f88d40cf720 2023-07-12T02:04:40.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.844+0000 7f88d9dff700 1 -- 172.21.15.37:0/4230307995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d41576e0 con 0x7f88d40cf720 2023-07-12T02:04:40.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.845+0000 7f88bbfff700 1 -- 172.21.15.37:0/4230307995 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f88c4003ba0 con 0x7f88d40cf720 2023-07-12T02:04:40.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.846+0000 7f88bbfff700 1 --2- 172.21.15.37:0/4230307995 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f88c006ace0 0x7f88c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:40.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.846+0000 7f88bbfff700 1 -- 172.21.15.37:0/4230307995 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f88c4021070 con 0x7f88d40cf720 2023-07-12T02:04:40.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.846+0000 7f88d2ffd700 1 --2- 172.21.15.37:0/4230307995 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f88c006ace0 0x7f88c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:40.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.847+0000 7f88d2ffd700 1 --2- 172.21.15.37:0/4230307995 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f88c006ace0 0x7f88c006d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f88d41f59b0 tx=0x7f88c8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:40.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:40.850+0000 7f88bbfff700 1 -- 172.21.15.37:0/4230307995 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f88c4055df0 con 0x7f88d40cf720 2023-07-12T02:04:41.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.059+0000 7f88d9dff700 1 -- 172.21.15.37:0/4230307995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88d404ea60 con 0x7f88d40cf720 2023-07-12T02:04:41.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.061+0000 7f88bbfff700 1 -- 172.21.15.37:0/4230307995 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20168 (secure 0 0 0) 0x7f88c4015090 con 0x7f88d40cf720 2023-07-12T02:04:41.064 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:41.064 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:39.032667+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:04:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.063+0000 7f88d9dff700 1 -- 172.21.15.37:0/4230307995 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f88c006ace0 msgr2=0x7f88c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.063+0000 7f88d9dff700 1 --2- 172.21.15.37:0/4230307995 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f88c006ace0 0x7f88c006d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f88d41f59b0 tx=0x7f88c8008040 comp rx=0 tx=0).stop 2023-07-12T02:04:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.063+0000 7f88d9dff700 1 -- 172.21.15.37:0/4230307995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40cf720 msgr2=0x7f88d40c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.063+0000 7f88d9dff700 1 --2- 172.21.15.37:0/4230307995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40cf720 0x7f88d40c5850 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009b60 tx=0x7f88c4004750 comp rx=0 tx=0).stop 2023-07-12T02:04:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.063+0000 7f88d9dff700 1 -- 172.21.15.37:0/4230307995 shutdown_connections 2023-07-12T02:04:41.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.063+0000 7f88d9dff700 1 --2- 172.21.15.37:0/4230307995 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f88c006ace0 0x7f88c006d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:41.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.063+0000 7f88d9dff700 1 --2- 172.21.15.37:0/4230307995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40cf720 0x7f88d40c5850 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:41.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.063+0000 7f88d9dff700 1 --2- 172.21.15.37:0/4230307995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88d415c460 0x7f88d4147b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:41.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.063+0000 7f88d9dff700 1 --2- 172.21.15.37:0/4230307995 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88d40d2640 0x7f88d4145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:41.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.063+0000 7f88d9dff700 1 -- 172.21.15.37:0/4230307995 >> 172.21.15.37:0/4230307995 conn(0x7f88d4071660 msgr2=0x7f88d40d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:41.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.063+0000 7f88d9dff700 1 -- 172.21.15.37:0/4230307995 shutdown_connections 2023-07-12T02:04:41.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.063+0000 7f88d9dff700 1 -- 172.21.15.37:0/4230307995 wait complete. 2023-07-12T02:04:41.084 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:04:41.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.283+0000 7f84087ff700 1 Processor -- start 2023-07-12T02:04:41.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.283+0000 7f84087ff700 1 -- start start 2023-07-12T02:04:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.284+0000 7f84087ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f840015c460 0x7f84000b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.284+0000 7f84087ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84000d2640 0x7f84000cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.285+0000 7f84087ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84000d1790 con 0x7f84000cf720 2023-07-12T02:04:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.285+0000 7f84087ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84000cedd0 con 0x7f84000d2640 2023-07-12T02:04:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.285+0000 7f84087ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84000cd950 con 0x7f840015c460 2023-07-12T02:04:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.285+0000 7f8405d9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84000d2640 0x7f84000cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.285+0000 7f8405d9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84000d2640 0x7f84000cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35676/0 (socket says 172.21.15.37:35676) 2023-07-12T02:04:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.285+0000 7f8405d9a700 1 -- 172.21.15.37:0/1875719351 learned_addr learned my addr 172.21.15.37:0/1875719351 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.285+0000 7f840659b700 1 --2- 172.21.15.37:0/1875719351 >> v2:172.21.15.196:3300/0 conn(0x7f840015c460 0x7f84000b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.285+0000 7f8405d9a700 1 -- 172.21.15.37:0/1875719351 >> v2:172.21.15.196:3300/0 conn(0x7f840015c460 msgr2=0x7f84000b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.285+0000 7f8405d9a700 1 --2- 172.21.15.37:0/1875719351 >> v2:172.21.15.196:3300/0 conn(0x7f840015c460 0x7f84000b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.285+0000 7f8405d9a700 1 -- 172.21.15.37:0/1875719351 >> v1:172.21.15.196:6789/0 conn(0x7f84000cf720 legacy=0x7f84000d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.285+0000 7f8405d9a700 1 -- 172.21.15.37:0/1875719351 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84000d14b0 con 0x7f84000d2640 2023-07-12T02:04:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.286+0000 7f8405d9a700 1 --2- 172.21.15.37:0/1875719351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000d2640 0x7f84000cf1e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f84000b4f00 tx=0x7f83f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189ee13deb3030d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.286+0000 7f8405599700 1 -- 172.21.15.37:0/1875719351 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f000b870 con 0x7f84000d2640 2023-07-12T02:04:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.286+0000 7f8405599700 1 -- 172.21.15.37:0/1875719351 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f000b9d0 con 0x7f84000d2640 2023-07-12T02:04:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.286+0000 7f8405599700 1 -- 172.21.15.37:0/1875719351 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f000bd60 con 0x7f84000d2640 2023-07-12T02:04:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.286+0000 7f84087ff700 1 -- 172.21.15.37:0/1875719351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000d2640 msgr2=0x7f84000cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.286+0000 7f84087ff700 1 --2- 172.21.15.37:0/1875719351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000d2640 0x7f84000cf1e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f84000b4f00 tx=0x7f83f0009bd0 comp rx=0 tx=0).stop 2023-07-12T02:04:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.286+0000 7f84087ff700 1 -- 172.21.15.37:0/1875719351 shutdown_connections 2023-07-12T02:04:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.286+0000 7f84087ff700 1 --2- 172.21.15.37:0/1875719351 >> v2:172.21.15.196:3300/0 conn(0x7f840015c460 0x7f84000b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.286+0000 7f84087ff700 1 --2- 172.21.15.37:0/1875719351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000d2640 0x7f84000cf1e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.286+0000 7f84087ff700 1 -- 172.21.15.37:0/1875719351 >> 172.21.15.37:0/1875719351 conn(0x7f8400071660 msgr2=0x7f8400071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.286+0000 7f84087ff700 1 -- 172.21.15.37:0/1875719351 shutdown_connections 2023-07-12T02:04:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.287+0000 7f84087ff700 1 -- 172.21.15.37:0/1875719351 wait complete. 2023-07-12T02:04:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.288+0000 7f84087ff700 1 Processor -- start 2023-07-12T02:04:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.288+0000 7f84087ff700 1 -- start start 2023-07-12T02:04:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.289+0000 7f84087ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000cf720 0x7f840014dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.289+0000 7f84087ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84000d2640 0x7f84001e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.289+0000 7f84087ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f840015c460 0x7f84000c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.289+0000 7f84087ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84001e6d10 con 0x7f84000cf720 2023-07-12T02:04:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.289+0000 7f84087ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840014e510 con 0x7f84000d2640 2023-07-12T02:04:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.289+0000 7f84087ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84001e6470 con 0x7f840015c460 2023-07-12T02:04:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.289+0000 7f840659b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000cf720 0x7f840014dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.289+0000 7f840659b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000cf720 0x7f840014dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35684/0 (socket says 172.21.15.37:35684) 2023-07-12T02:04:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.289+0000 7f840659b700 1 -- 172.21.15.37:0/2728541972 learned_addr learned my addr 172.21.15.37:0/2728541972 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.290+0000 7f8406d9c700 1 --2- 172.21.15.37:0/2728541972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f840015c460 0x7f84000c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.290+0000 7f8405d9a700 1 --2- 172.21.15.37:0/2728541972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84000d2640 0x7f84001e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.290+0000 7f840659b700 1 -- 172.21.15.37:0/2728541972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f840015c460 msgr2=0x7f84000c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.290+0000 7f840659b700 1 --2- 172.21.15.37:0/2728541972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f840015c460 0x7f84000c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.290+0000 7f840659b700 1 -- 172.21.15.37:0/2728541972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84000d2640 msgr2=0x7f84001e5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.290+0000 7f840659b700 1 --2- 172.21.15.37:0/2728541972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84000d2640 0x7f84001e5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.290+0000 7f840659b700 1 -- 172.21.15.37:0/2728541972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f0009550 con 0x7f84000cf720 2023-07-12T02:04:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.290+0000 7f8405d9a700 1 --2- 172.21.15.37:0/2728541972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84000d2640 0x7f84001e5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.290+0000 7f840659b700 1 --2- 172.21.15.37:0/2728541972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000cf720 0x7f840014dfd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00e810 tx=0x7f83fc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.290+0000 7f83f6ffd700 1 -- 172.21.15.37:0/2728541972 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc013610 con 0x7f84000cf720 2023-07-12T02:04:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.290+0000 7f83f6ffd700 1 -- 172.21.15.37:0/2728541972 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc013770 con 0x7f84000cf720 2023-07-12T02:04:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.290+0000 7f83f6ffd700 1 -- 172.21.15.37:0/2728541972 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc013b20 con 0x7f84000cf720 2023-07-12T02:04:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.290+0000 7f84087ff700 1 -- 172.21.15.37:0/2728541972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84001e6750 con 0x7f84000cf720 2023-07-12T02:04:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.291+0000 7f84087ff700 1 -- 172.21.15.37:0/2728541972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84001f2010 con 0x7f84000cf720 2023-07-12T02:04:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.292+0000 7f84087ff700 1 -- 172.21.15.37:0/2728541972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84001f2380 con 0x7f84000cf720 2023-07-12T02:04:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.293+0000 7f83f6ffd700 1 -- 172.21.15.37:0/2728541972 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83fc013c80 con 0x7f84000cf720 2023-07-12T02:04:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.294+0000 7f83f6ffd700 1 --2- 172.21.15.37:0/2728541972 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f83e406ace0 0x7f83e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.294+0000 7f83f6ffd700 1 -- 172.21.15.37:0/2728541972 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f83fc089580 con 0x7f84000cf720 2023-07-12T02:04:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.295+0000 7f8405d9a700 1 --2- 172.21.15.37:0/2728541972 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f83e406ace0 0x7f83e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.295+0000 7f8405d9a700 1 --2- 172.21.15.37:0/2728541972 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f83e406ace0 0x7f83e406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f84000cc720 tx=0x7f83f0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.298+0000 7f83f6ffd700 1 -- 172.21.15.37:0/2728541972 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f83fc054270 con 0x7f84000cf720 2023-07-12T02:04:41.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.554+0000 7f84087ff700 1 -- 172.21.15.37:0/2728541972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84001f1e40 con 0x7f84000cf720 2023-07-12T02:04:41.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.555+0000 7f83f6ffd700 1 -- 172.21.15.37:0/2728541972 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f83fc057890 con 0x7f84000cf720 2023-07-12T02:04:41.558 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:41.558 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/2496042538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":2496042538},{"type":"v1","addr":"172.21.15.196:6836","nonce":2496042538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2193116262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":2193116262},{"type":"v1","addr":"172.21.15.196:6837","nonce":2193116262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3195008737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3195008737},{"type":"v1","addr":"172.21.15.37:6834","nonce":3195008737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:03:57.647919+0000","modified":"2023-07-12T02:04:25.438552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/4264740807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4264740807},{"type":"v1","addr":"172.21.15.37:6835","nonce":4264740807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-12T02:04:41.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.557+0000 7f84087ff700 1 -- 172.21.15.37:0/2728541972 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f83e406ace0 msgr2=0x7f83e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:41.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.557+0000 7f84087ff700 1 --2- 172.21.15.37:0/2728541972 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f83e406ace0 0x7f83e406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f84000cc720 tx=0x7f83f0008030 comp rx=0 tx=0).stop 2023-07-12T02:04:41.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.557+0000 7f84087ff700 1 -- 172.21.15.37:0/2728541972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000cf720 msgr2=0x7f840014dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:41.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.557+0000 7f84087ff700 1 --2- 172.21.15.37:0/2728541972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000cf720 0x7f840014dfd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00e810 tx=0x7f83fc00ebd0 comp rx=0 tx=0).stop 2023-07-12T02:04:41.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.557+0000 7f84087ff700 1 -- 172.21.15.37:0/2728541972 shutdown_connections 2023-07-12T02:04:41.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.557+0000 7f84087ff700 1 --2- 172.21.15.37:0/2728541972 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f83e406ace0 0x7f83e406d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:41.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.557+0000 7f84087ff700 1 --2- 172.21.15.37:0/2728541972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000cf720 0x7f840014dfd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:41.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.557+0000 7f84087ff700 1 --2- 172.21.15.37:0/2728541972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f840015c460 0x7f84000c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:41.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.557+0000 7f84087ff700 1 --2- 172.21.15.37:0/2728541972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84000d2640 0x7f84001e5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:41.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.557+0000 7f84087ff700 1 -- 172.21.15.37:0/2728541972 >> 172.21.15.37:0/2728541972 conn(0x7f8400071660 msgr2=0x7f84000b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:41.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.557+0000 7f84087ff700 1 -- 172.21.15.37:0/2728541972 shutdown_connections 2023-07-12T02:04:41.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:41.557+0000 7f84087ff700 1 -- 172.21.15.37:0/2728541972 wait complete. 2023-07-12T02:04:41.562 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2023-07-12T02:04:41.980 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-12T02:03:57.647919+0000', 'modified': '2023-07-12T02:04:25.438552+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/4264740807', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 4264740807}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 4264740807}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-12T02:04:41.980 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-12T02:04:41.980 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-12T02:04:42.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.184+0000 7f94a83ff700 1 Processor -- start 2023-07-12T02:04:42.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.184+0000 7f94a83ff700 1 -- start start 2023-07-12T02:04:42.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.185+0000 7f94a83ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94a015c460 0x7f94a00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.185+0000 7f94a83ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f94a00d2640 0x7f94a00cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.185+0000 7f94a83ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a00d1790 con 0x7f94a00cf720 2023-07-12T02:04:42.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.185+0000 7f94a83ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a00cedd0 con 0x7f94a015c460 2023-07-12T02:04:42.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.185+0000 7f94a83ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a00cd950 con 0x7f94a00d2640 2023-07-12T02:04:42.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.186+0000 7f94a619b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94a015c460 0x7f94a00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.186+0000 7f94a619b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94a015c460 0x7f94a00b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60094/0 (socket says 172.21.15.37:60094) 2023-07-12T02:04:42.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.186+0000 7f94a619b700 1 -- 172.21.15.37:0/3644736817 learned_addr learned my addr 172.21.15.37:0/3644736817 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:42.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.186+0000 7f94a599a700 1 --2- 172.21.15.37:0/3644736817 >> v2:172.21.15.196:3300/0 conn(0x7f94a00d2640 0x7f94a00cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.186+0000 7f94a619b700 1 -- 172.21.15.37:0/3644736817 >> v2:172.21.15.196:3300/0 conn(0x7f94a00d2640 msgr2=0x7f94a00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:42.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.186+0000 7f94a619b700 1 --2- 172.21.15.37:0/3644736817 >> v2:172.21.15.196:3300/0 conn(0x7f94a00d2640 0x7f94a00cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.186+0000 7f94a619b700 1 -- 172.21.15.37:0/3644736817 >> v1:172.21.15.196:6789/0 conn(0x7f94a00cf720 legacy=0x7f94a00d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:42.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.186+0000 7f94a619b700 1 -- 172.21.15.37:0/3644736817 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a00d14b0 con 0x7f94a015c460 2023-07-12T02:04:42.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.186+0000 7f94a619b700 1 --2- 172.21.15.37:0/3644736817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94a015c460 0x7f94a00b59d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f94a015fd80 tx=0x7f949c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384eef5d2b4ec696 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:42.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.186+0000 7f94a5199700 1 -- 172.21.15.37:0/3644736817 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c011830 con 0x7f94a015c460 2023-07-12T02:04:42.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.187+0000 7f94a5199700 1 -- 172.21.15.37:0/3644736817 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c011990 con 0x7f94a015c460 2023-07-12T02:04:42.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.187+0000 7f94a5199700 1 -- 172.21.15.37:0/3644736817 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c011d20 con 0x7f94a015c460 2023-07-12T02:04:42.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.187+0000 7f94a83ff700 1 -- 172.21.15.37:0/3644736817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94a015c460 msgr2=0x7f94a00b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:42.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.187+0000 7f94a83ff700 1 --2- 172.21.15.37:0/3644736817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94a015c460 0x7f94a00b59d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f94a015fd80 tx=0x7f949c009bd0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.187+0000 7f94a83ff700 1 -- 172.21.15.37:0/3644736817 shutdown_connections 2023-07-12T02:04:42.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.187+0000 7f94a83ff700 1 --2- 172.21.15.37:0/3644736817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94a015c460 0x7f94a00b59d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.187+0000 7f94a83ff700 1 --2- 172.21.15.37:0/3644736817 >> v2:172.21.15.196:3300/0 conn(0x7f94a00d2640 0x7f94a00cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.187+0000 7f94a83ff700 1 -- 172.21.15.37:0/3644736817 >> 172.21.15.37:0/3644736817 conn(0x7f94a0071660 msgr2=0x7f94a0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:42.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.187+0000 7f94a83ff700 1 -- 172.21.15.37:0/3644736817 shutdown_connections 2023-07-12T02:04:42.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.187+0000 7f94a83ff700 1 -- 172.21.15.37:0/3644736817 wait complete. 2023-07-12T02:04:42.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.189+0000 7f94a83ff700 1 Processor -- start 2023-07-12T02:04:42.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.189+0000 7f94a83ff700 1 -- start start 2023-07-12T02:04:42.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.190+0000 7f94a83ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94a00cf720 0x7f94a0151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.190+0000 7f94a83ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94a00d2640 0x7f94a015a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.190+0000 7f94a83ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f94a015c460 0x7f94a0159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.190+0000 7f94a83ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a00c66b0 con 0x7f94a00d2640 2023-07-12T02:04:42.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.190+0000 7f94a83ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a0152290 con 0x7f94a00cf720 2023-07-12T02:04:42.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.190+0000 7f94a83ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a00cb040 con 0x7f94a015c460 2023-07-12T02:04:42.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.191+0000 7f94a599a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94a00d2640 0x7f94a015a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.191+0000 7f94a619b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94a00cf720 0x7f94a0151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.191+0000 7f94a599a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94a00d2640 0x7f94a015a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60098/0 (socket says 172.21.15.37:60098) 2023-07-12T02:04:42.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.191+0000 7f94a599a700 1 -- 172.21.15.37:0/3990284454 learned_addr learned my addr 172.21.15.37:0/3990284454 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:42.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.191+0000 7f94a619b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94a00cf720 0x7f94a0151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:38664/0 (socket says 172.21.15.37:38664) 2023-07-12T02:04:42.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.191+0000 7f94a699c700 1 --2- 172.21.15.37:0/3990284454 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f94a015c460 0x7f94a0159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.191+0000 7f94a599a700 1 -- 172.21.15.37:0/3990284454 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f94a015c460 msgr2=0x7f94a0159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.191+0000 7f94a599a700 1 --2- 172.21.15.37:0/3990284454 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f94a015c460 0x7f94a0159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.191+0000 7f94a599a700 1 -- 172.21.15.37:0/3990284454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94a00cf720 msgr2=0x7f94a0151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.191+0000 7f94a599a700 1 --2- 172.21.15.37:0/3990284454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94a00cf720 0x7f94a0151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.191+0000 7f94a599a700 1 -- 172.21.15.37:0/3990284454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c009550 con 0x7f94a00d2640 2023-07-12T02:04:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.192+0000 7f94a599a700 1 --2- 172.21.15.37:0/3990284454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94a00d2640 0x7f94a015a4e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f949000e870 tx=0x7f949000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:42.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.192+0000 7f9496ffd700 1 -- 172.21.15.37:0/3990284454 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9490009590 con 0x7f94a00d2640 2023-07-12T02:04:42.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.192+0000 7f9496ffd700 1 -- 172.21.15.37:0/3990284454 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9490013680 con 0x7f94a00d2640 2023-07-12T02:04:42.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.192+0000 7f94a83ff700 1 -- 172.21.15.37:0/3990284454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a00cb320 con 0x7f94a00d2640 2023-07-12T02:04:42.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.192+0000 7f9496ffd700 1 -- 172.21.15.37:0/3990284454 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94900139f0 con 0x7f94a00d2640 2023-07-12T02:04:42.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.192+0000 7f94a83ff700 1 -- 172.21.15.37:0/3990284454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a00c6900 con 0x7f94a00d2640 2023-07-12T02:04:42.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.195+0000 7f9496ffd700 1 -- 172.21.15.37:0/3990284454 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9490013b50 con 0x7f94a00d2640 2023-07-12T02:04:42.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.197+0000 7f9496ffd700 1 --2- 172.21.15.37:0/3990284454 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f948406ace0 0x7f948406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.197+0000 7f9496ffd700 1 -- 172.21.15.37:0/3990284454 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9490089720 con 0x7f94a00d2640 2023-07-12T02:04:42.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.197+0000 7f94a619b700 1 --2- 172.21.15.37:0/3990284454 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f948406ace0 0x7f948406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.199+0000 7f94a619b700 1 --2- 172.21.15.37:0/3990284454 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f948406ace0 0x7f948406d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f949c009c10 tx=0x7f949c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:42.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.199+0000 7f94bbdeab80 1 Processor -- start 2023-07-12T02:04:42.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.200+0000 7f94bbdeab80 1 -- start start 2023-07-12T02:04:42.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.201+0000 7f94bbdeab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b99570 0x557955b99940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.201+0000 7f94bbdeab80 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b9e9b0 0x557955bbd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.201+0000 7f94bbdeab80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b74370 0x557955b76930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.201+0000 7f94bbdeab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x557955ae2ea0 con 0x557955b99570 2023-07-12T02:04:42.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.201+0000 7f94bbdeab80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x557955a56600 con 0x557955b74370 2023-07-12T02:04:42.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.201+0000 7f94bbdeab80 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x557955ac5910 con 0x557955b9e9b0 2023-07-12T02:04:42.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.201+0000 7f94a619b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b99570 0x557955b99940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.201+0000 7f94a619b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b99570 0x557955b99940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60108/0 (socket says 172.21.15.37:60108) 2023-07-12T02:04:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.201+0000 7f94a619b700 1 -- 172.21.15.37:0/1655802455 learned_addr learned my addr 172.21.15.37:0/1655802455 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.201+0000 7f94a699c700 1 --2- 172.21.15.37:0/1655802455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b74370 0x557955b76930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.201+0000 7f94a599a700 1 --2- 172.21.15.37:0/1655802455 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b9e9b0 0x557955bbd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.202+0000 7f94a619b700 1 -- 172.21.15.37:0/1655802455 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b9e9b0 msgr2=0x557955bbd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.202+0000 7f94a619b700 1 --2- 172.21.15.37:0/1655802455 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b9e9b0 0x557955bbd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.202+0000 7f94a619b700 1 -- 172.21.15.37:0/1655802455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b74370 msgr2=0x557955b76930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.202+0000 7f94a619b700 1 --2- 172.21.15.37:0/1655802455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b74370 0x557955b76930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.202+0000 7f94a619b700 1 -- 172.21.15.37:0/1655802455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579558b2790 con 0x557955b99570 2023-07-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.202+0000 7f94a619b700 1 --2- 172.21.15.37:0/1655802455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b99570 0x557955b99940 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f949c011cc0 tx=0x7f949c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68e82ad7213fb39 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.202+0000 7f9483fff700 1 -- 172.21.15.37:0/1655802455 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c02c070 con 0x557955b99570 2023-07-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.202+0000 7f9483fff700 1 -- 172.21.15.37:0/1655802455 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c011cf0 con 0x557955b99570 2023-07-12T02:04:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.202+0000 7f9483fff700 1 -- 172.21.15.37:0/1655802455 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c020070 con 0x557955b99570 2023-07-12T02:04:42.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.203+0000 7f94bbdeab80 1 -- 172.21.15.37:0/1655802455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b99570 msgr2=0x557955b99940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:42.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.203+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/1655802455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b99570 0x557955b99940 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f949c011cc0 tx=0x7f949c010000 comp rx=0 tx=0).stop 2023-07-12T02:04:42.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.203+0000 7f94bbdeab80 1 -- 172.21.15.37:0/1655802455 shutdown_connections 2023-07-12T02:04:42.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.203+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/1655802455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b99570 0x557955b99940 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.203+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/1655802455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b74370 0x557955b76930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.203+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/1655802455 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b9e9b0 0x557955bbd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.203+0000 7f94bbdeab80 1 -- 172.21.15.37:0/1655802455 >> 172.21.15.37:0/1655802455 conn(0x557955b63320 msgr2=0x557955bbbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:42.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.203+0000 7f94bbdeab80 1 -- 172.21.15.37:0/1655802455 shutdown_connections 2023-07-12T02:04:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.203+0000 7f94bbdeab80 1 -- 172.21.15.37:0/1655802455 wait complete. 2023-07-12T02:04:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.204+0000 7f94bbdeab80 1 -- start start 2023-07-12T02:04:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.204+0000 7f94bbdeab80 1 Processor -- start 2023-07-12T02:04:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.205+0000 7f94bbdeab80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b74370 0x557955ba1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.205+0000 7f94bbdeab80 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b99570 0x557955b96d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.205+0000 7f94bbdeab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b9e9b0 0x557955ba1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.205+0000 7f94bbdeab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x557955abebe0 con 0x557955b9e9b0 2023-07-12T02:04:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.205+0000 7f94bbdeab80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x557955a7c5b0 con 0x557955b74370 2023-07-12T02:04:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.205+0000 7f94bbdeab80 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x557955a62910 con 0x557955b99570 2023-07-12T02:04:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.206+0000 7f94bbdeab80 10 client.0 _ll_register_callbacks cb 0x557955a7ab70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-12T02:04:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.206+0000 7f94a699c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b9e9b0 0x557955ba1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.206+0000 7f94a619b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b74370 0x557955ba1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.206+0000 7f94a699c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b9e9b0 0x557955ba1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60114/0 (socket says 172.21.15.37:60114) 2023-07-12T02:04:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.206+0000 7f94a699c700 1 -- 172.21.15.37:0/4129884864 learned_addr learned my addr 172.21.15.37:0/4129884864 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.206+0000 7f94a619b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b74370 0x557955ba1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:38680/0 (socket says 172.21.15.37:38680) 2023-07-12T02:04:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.206+0000 7f94a599a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b99570 0x557955b96d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.206+0000 7f94a699c700 1 -- 172.21.15.37:0/4129884864 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b99570 msgr2=0x557955b96d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.206+0000 7f94a699c700 1 --2- 172.21.15.37:0/4129884864 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b99570 0x557955b96d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.206+0000 7f94a699c700 1 -- 172.21.15.37:0/4129884864 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b74370 msgr2=0x557955ba1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.206+0000 7f94a699c700 1 --2- 172.21.15.37:0/4129884864 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b74370 0x557955ba1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.206+0000 7f94a699c700 1 -- 172.21.15.37:0/4129884864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a00d14b0 con 0x557955b9e9b0 2023-07-12T02:04:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.206+0000 7f94a699c700 1 --2- 172.21.15.37:0/4129884864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b9e9b0 0x557955ba1ac0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9498011940 tx=0x7f9498011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15fcdb3d3f48307c server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.206+0000 7f94817fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-12T02:04:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.207+0000 7f94817fa700 1 -- 172.21.15.37:0/4129884864 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498003c10 con 0x557955b9e9b0 2023-07-12T02:04:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.207+0000 7f94817fa700 1 -- 172.21.15.37:0/4129884864 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9498003d70 con 0x557955b9e9b0 2023-07-12T02:04:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.207+0000 7f94bbdeab80 1 -- 172.21.15.37:0/4129884864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557955b60930 con 0x557955b9e9b0 2023-07-12T02:04:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.207+0000 7f94817fa700 1 -- 172.21.15.37:0/4129884864 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94980050d0 con 0x557955b9e9b0 2023-07-12T02:04:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.207+0000 7f94bbdeab80 10 client.4881 fetch_fsmap learned FSMap version 9 2023-07-12T02:04:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.207+0000 7f94bbdeab80 1 -- 172.21.15.37:0/4129884864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55795599f0a0 con 0x557955b9e9b0 2023-07-12T02:04:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.207+0000 7f94817fa700 1 -- 172.21.15.37:0/4129884864 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557955b60930 con 0x557955b9e9b0 2023-07-12T02:04:42.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.207+0000 7f94817fa700 1 -- 172.21.15.37:0/4129884864 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f9498005230 con 0x557955b9e9b0 2023-07-12T02:04:42.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.207+0000 7f94bbdeab80 10 client.4881 fetch_fsmap finished waiting for FSMap version 9 2023-07-12T02:04:42.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.207+0000 7f94bbdeab80 10 client.4881 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-12T02:04:42.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.207+0000 7f94bbdeab80 20 client.4881 populate_metadata read hostname 'smithi037' 2023-07-12T02:04:42.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.207+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/4129884864 >> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] conn(0x557955ba2000 0x557955ba41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.207+0000 7f94bbdeab80 4 client.4881 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-12T02:04:42.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.207+0000 7f94bbdeab80 1 -- 172.21.15.37:0/4129884864 --> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557955b3d0e0 con 0x557955ba2000 2023-07-12T02:04:42.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.208+0000 7f94a619b700 1 --2- 172.21.15.37:0/4129884864 >> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] conn(0x557955ba2000 0x557955ba41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.208+0000 7f94a619b700 1 --2- 172.21.15.37:0/4129884864 >> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] conn(0x557955ba2000 0x557955ba41b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96521f1cf9ab3b1e server_cookie=3cdc055a2e579d63 in_seq=0 out_seq=0 2023-07-12T02:04:42.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.208+0000 7f94817fa700 10 client.4881 ms_handle_connect on v2:172.21.15.37:6833/4264740807 2023-07-12T02:04:42.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.209+0000 7f94817fa700 1 -- 172.21.15.37:0/4129884864 <== mds.0 v2:172.21.15.37:6833/4264740807 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557955b3d0e0 con 0x557955ba2000 2023-07-12T02:04:42.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.209+0000 7f94817fa700 10 client.4881 handle_command_reply: tid=0 2023-07-12T02:04:42.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.209+0000 7f94bbdeab80 1 client.4881 shutdown 2023-07-12T02:04:42.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.209+0000 7f94bbdeab80 1 -- 172.21.15.37:0/4129884864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b9e9b0 msgr2=0x557955ba1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:42.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.209+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/4129884864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b9e9b0 0x557955ba1ac0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9498011940 tx=0x7f9498011c50 comp rx=0 tx=0).stop 2023-07-12T02:04:42.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.209+0000 7f94bbdeab80 1 -- 172.21.15.37:0/4129884864 shutdown_connections 2023-07-12T02:04:42.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.209+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/4129884864 >> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] conn(0x557955ba2000 0x557955ba41b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.209+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/4129884864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b9e9b0 0x557955ba1ac0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.209+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/4129884864 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b74370 0x557955ba1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.209+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/4129884864 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b99570 0x557955b96d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.209+0000 7f94bbdeab80 1 -- 172.21.15.37:0/4129884864 >> 172.21.15.37:0/4129884864 conn(0x557955b63320 msgr2=0x557955b68dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:42.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.209+0000 7f94817fa700 0 client.4881 ms_handle_reset on v2:172.21.15.37:6833/4264740807 2023-07-12T02:04:42.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.209+0000 7f94bbdeab80 1 -- 172.21.15.37:0/4129884864 shutdown_connections 2023-07-12T02:04:42.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.209+0000 7f94bbdeab80 1 -- 172.21.15.37:0/4129884864 wait complete. 2023-07-12T02:04:42.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.210+0000 7f94bbdeab80 20 client.4881 trim_cache size 0 max 16384 2023-07-12T02:04:42.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.228+0000 7f94bbdeab80 1 Processor -- start 2023-07-12T02:04:42.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.229+0000 7f94bbdeab80 1 -- start start 2023-07-12T02:04:42.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.229+0000 7f94bbdeab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b74370 0x557955b73520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.229+0000 7f94bbdeab80 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b99570 0x557955bb3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.229+0000 7f94bbdeab80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b9e9b0 0x557955bb4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.229+0000 7f94bbdeab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579558b3390 con 0x557955b74370 2023-07-12T02:04:42.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.229+0000 7f94bbdeab80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x557955b98250 con 0x557955b9e9b0 2023-07-12T02:04:42.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.229+0000 7f94bbdeab80 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x557955b73a60 con 0x557955b99570 2023-07-12T02:04:42.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.230+0000 7f94a619b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b74370 0x557955b73520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.230+0000 7f94a619b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b74370 0x557955b73520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60120/0 (socket says 172.21.15.37:60120) 2023-07-12T02:04:42.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.230+0000 7f94a619b700 1 -- 172.21.15.37:0/2580042329 learned_addr learned my addr 172.21.15.37:0/2580042329 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:42.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.230+0000 7f94a699c700 1 --2- 172.21.15.37:0/2580042329 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b9e9b0 0x557955bb4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.230+0000 7f94a599a700 1 --2- 172.21.15.37:0/2580042329 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b99570 0x557955bb3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.230+0000 7f94a619b700 1 -- 172.21.15.37:0/2580042329 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b99570 msgr2=0x557955bb3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:42.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.230+0000 7f94a619b700 1 --2- 172.21.15.37:0/2580042329 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b99570 0x557955bb3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.230+0000 7f94a619b700 1 -- 172.21.15.37:0/2580042329 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b9e9b0 msgr2=0x557955bb4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:42.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.230+0000 7f94a619b700 1 --2- 172.21.15.37:0/2580042329 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b9e9b0 0x557955bb4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.230+0000 7f94a619b700 1 -- 172.21.15.37:0/2580042329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557955a84b10 con 0x557955b74370 2023-07-12T02:04:42.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.230+0000 7f94a619b700 1 --2- 172.21.15.37:0/2580042329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b74370 0x557955b73520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f949c029040 tx=0x7f949c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b1ae4fc9900966 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:42.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.230+0000 7f9494bff700 1 -- 172.21.15.37:0/2580042329 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c036070 con 0x557955b74370 2023-07-12T02:04:42.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.231+0000 7f9494bff700 1 -- 172.21.15.37:0/2580042329 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c0036a0 con 0x557955b74370 2023-07-12T02:04:42.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.231+0000 7f9494bff700 1 -- 172.21.15.37:0/2580042329 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c02c040 con 0x557955b74370 2023-07-12T02:04:42.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.231+0000 7f94bbdeab80 1 -- 172.21.15.37:0/2580042329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b74370 msgr2=0x557955b73520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:42.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.231+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/2580042329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b74370 0x557955b73520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f949c029040 tx=0x7f949c020000 comp rx=0 tx=0).stop 2023-07-12T02:04:42.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.231+0000 7f94bbdeab80 1 -- 172.21.15.37:0/2580042329 shutdown_connections 2023-07-12T02:04:42.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.231+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/2580042329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b74370 0x557955b73520 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.231+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/2580042329 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b9e9b0 0x557955bb4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.231+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/2580042329 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b99570 0x557955bb3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.231+0000 7f94bbdeab80 1 -- 172.21.15.37:0/2580042329 >> 172.21.15.37:0/2580042329 conn(0x557955b63320 msgr2=0x557955b960c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:42.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.231+0000 7f94bbdeab80 1 -- 172.21.15.37:0/2580042329 shutdown_connections 2023-07-12T02:04:42.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.231+0000 7f94bbdeab80 1 -- 172.21.15.37:0/2580042329 wait complete. 2023-07-12T02:04:42.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.232+0000 7f94bbdeab80 1 -- start start 2023-07-12T02:04:42.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.232+0000 7f94bbdeab80 1 Processor -- start 2023-07-12T02:04:42.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.233+0000 7f94bbdeab80 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b74370 0x557955b76340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.233+0000 7f94bbdeab80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b99570 0x557955ba1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.233+0000 7f94bbdeab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b9e9b0 0x557955bb3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.233+0000 7f94bbdeab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x557955bb4380 con 0x557955b9e9b0 2023-07-12T02:04:42.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.233+0000 7f94bbdeab80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x557955b747e0 con 0x557955b99570 2023-07-12T02:04:42.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.233+0000 7f94bbdeab80 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x557955b76d40 con 0x557955b74370 2023-07-12T02:04:42.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.233+0000 7f94bbdeab80 10 client.0 _ll_register_callbacks cb 0x7f9498011250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-12T02:04:42.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.233+0000 7f94a699c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b9e9b0 0x557955bb3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.233+0000 7f94a699c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b9e9b0 0x557955bb3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60122/0 (socket says 172.21.15.37:60122) 2023-07-12T02:04:42.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.233+0000 7f94a699c700 1 -- 172.21.15.37:0/4180697731 learned_addr learned my addr 172.21.15.37:0/4180697731 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:42.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.234+0000 7f94a619b700 1 --2- 172.21.15.37:0/4180697731 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b74370 0x557955b76340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.234+0000 7f94a599a700 1 --2- 172.21.15.37:0/4180697731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b99570 0x557955ba1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.234+0000 7f94a699c700 1 -- 172.21.15.37:0/4180697731 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b74370 msgr2=0x557955b76340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:42.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.234+0000 7f94a699c700 1 --2- 172.21.15.37:0/4180697731 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b74370 0x557955b76340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.234+0000 7f94a699c700 1 -- 172.21.15.37:0/4180697731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b99570 msgr2=0x557955ba1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:42.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.234+0000 7f94a699c700 1 --2- 172.21.15.37:0/4180697731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b99570 0x557955ba1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.234+0000 7f94a699c700 1 -- 172.21.15.37:0/4180697731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5579558b2790 con 0x557955b9e9b0 2023-07-12T02:04:42.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.234+0000 7f94a699c700 1 --2- 172.21.15.37:0/4180697731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b9e9b0 0x557955bb3770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9498001a20 tx=0x7f9498001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee11aa625b4f6e4f server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:42.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.234+0000 7f94817fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-12T02:04:42.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.234+0000 7f94817fa700 1 -- 172.21.15.37:0/4180697731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94980052d0 con 0x557955b9e9b0 2023-07-12T02:04:42.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.234+0000 7f94817fa700 1 -- 172.21.15.37:0/4180697731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f949801de40 con 0x557955b9e9b0 2023-07-12T02:04:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.234+0000 7f94bbdeab80 1 -- 172.21.15.37:0/4180697731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f949c011cf0 con 0x557955b9e9b0 2023-07-12T02:04:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.235+0000 7f94817fa700 1 -- 172.21.15.37:0/4180697731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94980110c0 con 0x557955b9e9b0 2023-07-12T02:04:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.235+0000 7f94bbdeab80 10 client.4887 fetch_fsmap learned FSMap version 9 2023-07-12T02:04:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.235+0000 7f94bbdeab80 1 -- 172.21.15.37:0/4180697731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5579559131d0 con 0x557955b9e9b0 2023-07-12T02:04:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.235+0000 7f94817fa700 1 -- 172.21.15.37:0/4180697731 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c011cf0 con 0x557955b9e9b0 2023-07-12T02:04:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.235+0000 7f94817fa700 1 -- 172.21.15.37:0/4180697731 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f9498034200 con 0x557955b9e9b0 2023-07-12T02:04:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.235+0000 7f94bbdeab80 10 client.4887 fetch_fsmap finished waiting for FSMap version 9 2023-07-12T02:04:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.235+0000 7f94bbdeab80 10 client.4887 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-12T02:04:42.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.235+0000 7f94bbdeab80 20 client.4887 populate_metadata read hostname 'smithi037' 2023-07-12T02:04:42.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.235+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/4180697731 >> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] conn(0x557955c21dc0 0x557955c22190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:42.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.235+0000 7f94bbdeab80 4 client.4887 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-07-12T02:04:42.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.235+0000 7f94bbdeab80 1 -- 172.21.15.37:0/4180697731 --> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557955ab7d20 con 0x557955c21dc0 2023-07-12T02:04:42.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.235+0000 7f94a619b700 1 --2- 172.21.15.37:0/4180697731 >> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] conn(0x557955c21dc0 0x557955c22190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:42.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.236+0000 7f94817fa700 10 client.4887 ms_handle_connect on v2:172.21.15.37:6833/4264740807 2023-07-12T02:04:42.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.236+0000 7f94a619b700 1 --2- 172.21.15.37:0/4180697731 >> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] conn(0x557955c21dc0 0x557955c22190 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=139d1a3f0fd828fb server_cookie=bc7edd4d67ed6f71 in_seq=0 out_seq=0 2023-07-12T02:04:42.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.236+0000 7f94817fa700 1 -- 172.21.15.37:0/4180697731 <== mds.0 v2:172.21.15.37:6833/4264740807 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x557955ab7d20 con 0x557955c21dc0 2023-07-12T02:04:42.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.236+0000 7f94817fa700 10 client.4887 handle_command_reply: tid=0 2023-07-12T02:04:42.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.236+0000 7f94bbdeab80 1 client.4887 shutdown 2023-07-12T02:04:42.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.236+0000 7f94bbdeab80 1 -- 172.21.15.37:0/4180697731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b9e9b0 msgr2=0x557955bb3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:42.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.236+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/4180697731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b9e9b0 0x557955bb3770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9498001a20 tx=0x7f9498001400 comp rx=0 tx=0).stop 2023-07-12T02:04:42.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.236+0000 7f94bbdeab80 1 -- 172.21.15.37:0/4180697731 shutdown_connections 2023-07-12T02:04:42.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.236+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/4180697731 >> [v2:172.21.15.37:6833/4264740807,v1:172.21.15.37:6835/4264740807] conn(0x557955c21dc0 0x557955c22190 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.236+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/4180697731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557955b9e9b0 0x557955bb3770 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.236+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/4180697731 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557955b74370 0x557955b76340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.236+0000 7f94bbdeab80 1 --2- 172.21.15.37:0/4180697731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557955b99570 0x557955ba1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.236+0000 7f94817fa700 0 client.4887 ms_handle_reset on v2:172.21.15.37:6833/4264740807 2023-07-12T02:04:42.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.236+0000 7f94bbdeab80 1 -- 172.21.15.37:0/4180697731 >> 172.21.15.37:0/4180697731 conn(0x557955b63320 msgr2=0x557955ba4750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:42.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.236+0000 7f94bbdeab80 1 -- 172.21.15.37:0/4180697731 shutdown_connections 2023-07-12T02:04:42.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.237+0000 7f94bbdeab80 1 -- 172.21.15.37:0/4180697731 wait complete. 2023-07-12T02:04:42.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.237+0000 7f94bbdeab80 20 client.4887 trim_cache size 0 max 16384 2023-07-12T02:04:42.248 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-12T02:04:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "e0d485b9-796c-494c-84d4-d32d9c18c85f", 2023-07-12T02:04:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-12T02:04:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4291, 2023-07-12T02:04:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-12T02:04:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-12T02:04:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-12T02:04:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 44.108780602000003, 2023-07-12T02:04:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 9, 2023-07-12T02:04:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 29, 2023-07-12T02:04:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 27, 2023-07-12T02:04:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 50.145550970999999 2023-07-12T02:04:42.249 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-12T02:04:42.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.237+0000 7f94a83ff700 1 -- 172.21.15.37:0/3990284454 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f948406ace0 msgr2=0x7f948406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:42.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.237+0000 7f94a83ff700 1 --2- 172.21.15.37:0/3990284454 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f948406ace0 0x7f948406d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f949c009c10 tx=0x7f949c008030 comp rx=0 tx=0).stop 2023-07-12T02:04:42.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.237+0000 7f94a83ff700 1 -- 172.21.15.37:0/3990284454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94a00d2640 msgr2=0x7f94a015a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:42.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.237+0000 7f94a83ff700 1 --2- 172.21.15.37:0/3990284454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94a00d2640 0x7f94a015a4e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f949000e870 tx=0x7f949000eb80 comp rx=0 tx=0).stop 2023-07-12T02:04:42.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.237+0000 7f94a83ff700 1 -- 172.21.15.37:0/3990284454 shutdown_connections 2023-07-12T02:04:42.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.237+0000 7f94a83ff700 1 --2- 172.21.15.37:0/3990284454 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f948406ace0 0x7f948406d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.237+0000 7f94a83ff700 1 --2- 172.21.15.37:0/3990284454 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f94a015c460 0x7f94a0159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.237+0000 7f94a83ff700 1 --2- 172.21.15.37:0/3990284454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94a00cf720 0x7f94a0151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.237+0000 7f94a83ff700 1 --2- 172.21.15.37:0/3990284454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94a00d2640 0x7f94a015a4e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:42.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.237+0000 7f94a83ff700 1 -- 172.21.15.37:0/3990284454 >> 172.21.15.37:0/3990284454 conn(0x7f94a0071660 msgr2=0x7f94a0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:42.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.238+0000 7f94a83ff700 1 -- 172.21.15.37:0/3990284454 shutdown_connections 2023-07-12T02:04:42.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:42.238+0000 7f94a83ff700 1 -- 172.21.15.37:0/3990284454 wait complete. 2023-07-12T02:04:42.258 INFO:teuthology.run_tasks:Running task kclient... 2023-07-12T02:04:42.273 INFO:tasks.kclient:Mounting kernel clients... 2023-07-12T02:04:42.273 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-12T02:04:42.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:42.274 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-12T02:04:42.319 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-07-12T02:04:42.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:42.321 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-12T02:04:42.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:42.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-07-12T02:04:42.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:42.499 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-12T02:04:42.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:42.547 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-07-12T02:04:42.621 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2023-07-12T02:04:42.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T02:04:42.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:42.624 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2023-07-12T02:04:42.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:42.675 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link delete ceph-brx 2023-07-12T02:04:42.750 INFO:teuthology.orchestra.run.smithi196.stderr:Cannot find device "ceph-brx" 2023-07-12T02:04:42.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T02:04:42.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:42.754 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2023-07-12T02:04:42.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:42.800 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link delete ceph-brx 2023-07-12T02:04:42.871 INFO:teuthology.orchestra.run.smithi196.stderr:Cannot find device "ceph-brx" 2023-07-12T02:04:42.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T02:04:42.874 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-07-12T02:04:42.874 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-12T02:04:42.875 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-12T02:04:42.875 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-12T02:04:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.074+0000 7fb1353ff700 1 Processor -- start 2023-07-12T02:04:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.075+0000 7fb1353ff700 1 -- start start 2023-07-12T02:04:43.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.076+0000 7fb1353ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb130156be0 0x7fb1300cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.076+0000 7fb1353ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1300cd600 0x7fb1300cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.076+0000 7fb1353ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1300cbc00 con 0x7fb1300cb4f0 2023-07-12T02:04:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.076+0000 7fb1353ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb130156fb0 con 0x7fb130156be0 2023-07-12T02:04:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.076+0000 7fb1353ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13015da40 con 0x7fb1300cd600 2023-07-12T02:04:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.076+0000 7fb12f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb1300cb4f0 0x7fb130070340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60110/0 (socket says 172.21.15.37:60110) 2023-07-12T02:04:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.076+0000 7fb12f7fe700 1 -- 172.21.15.37:0/2052479237 learned_addr learned my addr 172.21.15.37:0/2052479237 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:43.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.076+0000 7fb12e7fc700 1 --2- 172.21.15.37:0/2052479237 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1300cd600 0x7fb1300cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:43.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.076+0000 7fb12effd700 1 --2- 172.21.15.37:0/2052479237 >> v2:172.21.15.196:3300/0 conn(0x7fb130156be0 0x7fb1300cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:43.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.077+0000 7fb12dffb700 1 -- 172.21.15.37:0/2052479237 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829984264 0 0) 0x7fb1300cbc00 con 0x7fb1300cb4f0 2023-07-12T02:04:43.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.077+0000 7fb12dffb700 1 -- 172.21.15.37:0/2052479237 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1180035b0 con 0x7fb1300cb4f0 2023-07-12T02:04:43.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.077+0000 7fb12e7fc700 1 -- 172.21.15.37:0/2052479237 >> v2:172.21.15.196:3300/0 conn(0x7fb130156be0 msgr2=0x7fb1300cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:43.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.077+0000 7fb12e7fc700 1 --2- 172.21.15.37:0/2052479237 >> v2:172.21.15.196:3300/0 conn(0x7fb130156be0 0x7fb1300cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.077+0000 7fb12e7fc700 1 -- 172.21.15.37:0/2052479237 >> v1:172.21.15.37:6789/0 conn(0x7fb1300cb4f0 legacy=0x7fb130070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.077+0000 7fb12e7fc700 1 -- 172.21.15.37:0/2052479237 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1300cda50 con 0x7fb1300cd600 2023-07-12T02:04:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.077+0000 7fb12e7fc700 1 --2- 172.21.15.37:0/2052479237 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1300cd600 0x7fb1300cafb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb124009840 tx=0x7fb124009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1baa3a7e9b2443be server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.077+0000 7fb12dffb700 1 -- 172.21.15.37:0/2052479237 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb124011830 con 0x7fb1300cd600 2023-07-12T02:04:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.077+0000 7fb12dffb700 1 -- 172.21.15.37:0/2052479237 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb124011990 con 0x7fb1300cd600 2023-07-12T02:04:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.077+0000 7fb12dffb700 1 -- 172.21.15.37:0/2052479237 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb124011d20 con 0x7fb1300cd600 2023-07-12T02:04:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.078+0000 7fb1353ff700 1 -- 172.21.15.37:0/2052479237 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1300cd600 msgr2=0x7fb1300cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:43.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.078+0000 7fb1353ff700 1 --2- 172.21.15.37:0/2052479237 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1300cd600 0x7fb1300cafb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb124009840 tx=0x7fb124009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:43.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.078+0000 7fb1353ff700 1 -- 172.21.15.37:0/2052479237 shutdown_connections 2023-07-12T02:04:43.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.078+0000 7fb1353ff700 1 --2- 172.21.15.37:0/2052479237 >> v2:172.21.15.196:3300/0 conn(0x7fb130156be0 0x7fb1300cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:43.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.078+0000 7fb1353ff700 1 --2- 172.21.15.37:0/2052479237 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1300cd600 0x7fb1300cafb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:43.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.078+0000 7fb1353ff700 1 -- 172.21.15.37:0/2052479237 >> 172.21.15.37:0/2052479237 conn(0x7fb1300b0390 msgr2=0x7fb1300b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:43.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.078+0000 7fb1353ff700 1 -- 172.21.15.37:0/2052479237 shutdown_connections 2023-07-12T02:04:43.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.078+0000 7fb1353ff700 1 -- 172.21.15.37:0/2052479237 wait complete. 2023-07-12T02:04:43.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.080+0000 7fb1353ff700 1 Processor -- start 2023-07-12T02:04:43.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.080+0000 7fb1353ff700 1 -- start start 2023-07-12T02:04:43.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.081+0000 7fb1353ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1300cb4f0 0x7fb1301570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:43.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.081+0000 7fb1353ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1300cd600 0x7fb1301519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:43.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.081+0000 7fb1353ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb130156be0 0x7fb130155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:43.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.081+0000 7fb1353ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13015c310 con 0x7fb1300cb4f0 2023-07-12T02:04:43.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.081+0000 7fb1353ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb130153a40 con 0x7fb130156be0 2023-07-12T02:04:43.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.081+0000 7fb1353ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1300c47c0 con 0x7fb1300cd600 2023-07-12T02:04:43.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.081+0000 7fb12effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1300cb4f0 0x7fb1301570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:43.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.081+0000 7fb12effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1300cb4f0 0x7fb1301570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60132/0 (socket says 172.21.15.37:60132) 2023-07-12T02:04:43.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.081+0000 7fb12effd700 1 -- 172.21.15.37:0/1274588353 learned_addr learned my addr 172.21.15.37:0/1274588353 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:43.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.081+0000 7fb12e7fc700 1 --2- 172.21.15.37:0/1274588353 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1300cd600 0x7fb1301519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:43.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.081+0000 7fb12effd700 1 -- 172.21.15.37:0/1274588353 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1300cd600 msgr2=0x7fb1301519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:43.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.081+0000 7fb12effd700 1 --2- 172.21.15.37:0/1274588353 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1300cd600 0x7fb1301519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:43.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.081+0000 7fb12effd700 1 -- 172.21.15.37:0/1274588353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb130156be0 msgr2=0x7fb130155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:43.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.081+0000 7fb12effd700 1 --2- 172.21.15.37:0/1274588353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb130156be0 0x7fb130155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:43.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.081+0000 7fb12effd700 1 -- 172.21.15.37:0/1274588353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1240094a0 con 0x7fb1300cb4f0 2023-07-12T02:04:43.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.081+0000 7fb12e7fc700 1 --2- 172.21.15.37:0/1274588353 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1300cd600 0x7fb1301519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:43.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.082+0000 7fb12effd700 1 --2- 172.21.15.37:0/1274588353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1300cb4f0 0x7fb1301570f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb120010fc0 tx=0x7fb12000e3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:43.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.082+0000 7fb1177fe700 1 -- 172.21.15.37:0/1274588353 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12000bb80 con 0x7fb1300cb4f0 2023-07-12T02:04:43.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.082+0000 7fb1177fe700 1 -- 172.21.15.37:0/1274588353 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb120011040 con 0x7fb1300cb4f0 2023-07-12T02:04:43.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.082+0000 7fb1353ff700 1 -- 172.21.15.37:0/1274588353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1300c4aa0 con 0x7fb1300cb4f0 2023-07-12T02:04:43.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.082+0000 7fb1177fe700 1 -- 172.21.15.37:0/1274588353 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120016480 con 0x7fb1300cb4f0 2023-07-12T02:04:43.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.082+0000 7fb1353ff700 1 -- 172.21.15.37:0/1274588353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1300c5060 con 0x7fb1300cb4f0 2023-07-12T02:04:43.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.083+0000 7fb1353ff700 1 -- 172.21.15.37:0/1274588353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb130153d70 con 0x7fb1300cb4f0 2023-07-12T02:04:43.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.084+0000 7fb1177fe700 1 -- 172.21.15.37:0/1274588353 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb1200165e0 con 0x7fb1300cb4f0 2023-07-12T02:04:43.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.085+0000 7fb1177fe700 1 --2- 172.21.15.37:0/1274588353 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb11c06ace0 0x7fb11c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:43.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.085+0000 7fb1177fe700 1 -- 172.21.15.37:0/1274588353 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb12008c640 con 0x7fb1300cb4f0 2023-07-12T02:04:43.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.085+0000 7fb12e7fc700 1 --2- 172.21.15.37:0/1274588353 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb11c06ace0 0x7fb11c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:43.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.086+0000 7fb12e7fc700 1 --2- 172.21.15.37:0/1274588353 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb11c06ace0 0x7fb11c06d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb1240090b0 tx=0x7fb124008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.089+0000 7fb1177fe700 1 -- 172.21.15.37:0/1274588353 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb12005ad30 con 0x7fb1300cb4f0 2023-07-12T02:04:43.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.343+0000 7fb1353ff700 1 -- 172.21.15.37:0/1274588353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb13004ea60 con 0x7fb1300cb4f0 2023-07-12T02:04:43.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.343+0000 7fb1177fe700 1 -- 172.21.15.37:0/1274588353 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb12005a8c0 con 0x7fb1300cb4f0 2023-07-12T02:04:43.347 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-12T02:04:43.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.345+0000 7fb1353ff700 1 -- 172.21.15.37:0/1274588353 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb11c06ace0 msgr2=0x7fb11c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:43.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.345+0000 7fb1353ff700 1 --2- 172.21.15.37:0/1274588353 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb11c06ace0 0x7fb11c06d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb1240090b0 tx=0x7fb124008030 comp rx=0 tx=0).stop 2023-07-12T02:04:43.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.345+0000 7fb1353ff700 1 -- 172.21.15.37:0/1274588353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1300cb4f0 msgr2=0x7fb1301570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.345+0000 7fb1353ff700 1 --2- 172.21.15.37:0/1274588353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1300cb4f0 0x7fb1301570f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb120010fc0 tx=0x7fb12000e3a0 comp rx=0 tx=0).stop 2023-07-12T02:04:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.345+0000 7fb1353ff700 1 -- 172.21.15.37:0/1274588353 shutdown_connections 2023-07-12T02:04:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.346+0000 7fb1353ff700 1 --2- 172.21.15.37:0/1274588353 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb11c06ace0 0x7fb11c06d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.346+0000 7fb1353ff700 1 --2- 172.21.15.37:0/1274588353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1300cb4f0 0x7fb1301570f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.346+0000 7fb1353ff700 1 --2- 172.21.15.37:0/1274588353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb130156be0 0x7fb130155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.346+0000 7fb1353ff700 1 --2- 172.21.15.37:0/1274588353 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1300cd600 0x7fb1301519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.346+0000 7fb1353ff700 1 -- 172.21.15.37:0/1274588353 >> 172.21.15.37:0/1274588353 conn(0x7fb1300b0390 msgr2=0x7fb13006c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.346+0000 7fb1353ff700 1 -- 172.21.15.37:0/1274588353 shutdown_connections 2023-07-12T02:04:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:43.346+0000 7fb1353ff700 1 -- 172.21.15.37:0/1274588353 wait complete. 2023-07-12T02:04:43.367 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-12T02:04:43.367 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-12T02:04:43.368 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-12T02:04:43.368 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-12T02:04:43.368 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-12T02:04:43.368 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-12T02:04:43.368 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-12T02:04:43.369 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-12T02:04:43.369 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-12T02:04:43.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:43.369 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-12T02:04:43.415 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-12T02:04:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-12T02:04:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-12T02:04:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-12T02:04:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:43.416 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:04:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-12T02:04:43.417 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:04:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-12T02:04:43.417 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-12T02:04:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:43.417 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-12T02:04:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-12T02:04:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41698sec preferred_lft 41698sec 2023-07-12T02:04:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-12T02:04:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:43.418 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:04:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:43.418 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-12T02:04:43.419 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-12T02:04:43.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:43.420 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-12T02:04:43.420 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-12T02:04:43.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2023-07-12T02:04:43.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2023-07-12T02:04:43.421 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2023-07-12T02:04:43.421 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-12T02:04:43.421 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-12T02:04:43.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:43.659 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-12T02:04:43.728 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-12T02:04:43.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:43.731 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-12T02:04:43.779 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-12T02:04:43.780 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-12T02:04:43.780 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-12T02:04:43.780 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-12T02:04:43.780 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-12T02:04:43.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:43.781 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-12T02:04:43.782 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-12T02:04:43.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-12T02:04:43.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-12T02:04:43.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-12T02:04:43.783 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-12T02:04:43.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:43.954 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-12T02:04:44.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:44.000 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-07-12T02:04:44.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:44.087 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-12T02:04:44.087 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-12T02:04:44.087 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-12T02:04:44.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-12T02:04:44.088 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-12T02:04:44.229 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-12T02:04:44.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:44.230 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-12T02:04:44.230 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-12T02:04:44.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-12T02:04:44.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-12T02:04:44.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-12T02:04:44.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-12T02:04:44.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-12T02:04:44.232 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-12T02:04:44.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:44.481 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-12T02:04:44.481 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-12T02:04:44.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-12T02:04:44.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2023-07-12T02:04:44.482 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-12T02:04:44.660 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-12T02:04:44.661 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-12T02:04:44.706 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-12T02:04:44.706 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-12T02:04:44.706 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-12T02:04:44.791 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-12T02:04:44.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:44.791 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-12T02:04:44.938 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-12T02:04:44.938 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-12T02:04:44.938 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-07-12T02:04:45.363 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-12T02:04:45.363 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-12T02:04:45.364 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-07-12T02:04:45.364 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.196:3300,172.21.15.196:3301" 2023-07-12T02:04:45.364 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-12T02:04:45.388 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-12T02:04:45.389 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-12T02:04:45.389 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-07-12T02:04:45.389 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.196:3300,172.21.15.196:3301" 2023-07-12T02:04:45.389 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-12T02:04:45.389 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.196:6789,172.21.15.196:6790" 2023-07-12T02:04:45.389 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.196:6789,172.21.15.196:6790:/ 2023-07-12T02:04:45.389 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e0d485b9-796c-494c-84d4-d32d9c18c85f" will pass to kernel 2023-07-12T02:04:45.393 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-12T02:04:45.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:45.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-12T02:04:45.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:45.464 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:04:45.551 INFO:teuthology.orchestra.run.smithi037.stdout:client4676 2023-07-12T02:04:45.552 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:04:45.552 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:04:45.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:45.598 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:04:45.725 INFO:teuthology.orchestra.run.smithi037.stdout:client4676 2023-07-12T02:04:45.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:45.725 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:04:45.812 INFO:teuthology.orchestra.run.smithi037.stdout:client4676 2023-07-12T02:04:45.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:45.813 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e0d485b9-796c-494c-84d4-d32d9c18c85f.client4676/status') 2023-07-12T02:04:45.920 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.4676 (3)172.21.15.37:0/1322229745 2023-07-12T02:04:45.921 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2023-07-12T02:04:45.921 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2023-07-12T02:04:45.921 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2023-07-12T02:04:45.921 INFO:teuthology.orchestra.run.smithi037.stderr:70 bytes copied, 5.1347e-05 s, 1.4 MB/s 2023-07-12T02:04:45.923 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-07-12T02:04:45.924 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-12T02:04:45.924 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-12T02:04:45.924 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-12T02:04:46.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.122+0000 7fd4381ff700 1 Processor -- start 2023-07-12T02:04:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.122+0000 7fd4381ff700 1 -- start start 2023-07-12T02:04:46.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.123+0000 7fd4381ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43015c460 0x7fd4300b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:46.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.123+0000 7fd4381ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4300d2640 0x7fd4300cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:46.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.123+0000 7fd4381ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd4300cf720 0x7fd4300cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:46.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.123+0000 7fd4381ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4300cedd0 con 0x7fd4300d2640 2023-07-12T02:04:46.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.123+0000 7fd4381ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4300d1790 con 0x7fd4300cf720 2023-07-12T02:04:46.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.123+0000 7fd4381ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300cd950 con 0x7fd43015c460 2023-07-12T02:04:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.123+0000 7fd43579a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4300d2640 0x7fd4300cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.123+0000 7fd43579a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4300d2640 0x7fd4300cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60134/0 (socket says 172.21.15.37:60134) 2023-07-12T02:04:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.123+0000 7fd43579a700 1 -- 172.21.15.37:0/447983337 learned_addr learned my addr 172.21.15.37:0/447983337 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.124+0000 7fd435f9b700 1 --2- 172.21.15.37:0/447983337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43015c460 0x7fd4300b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.124+0000 7fd43679c700 1 --2- 172.21.15.37:0/447983337 >> v2:172.21.15.196:3300/0 conn(0x7fd4300cf720 0x7fd4300cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:46.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.124+0000 7fd43579a700 1 -- 172.21.15.37:0/447983337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43015c460 msgr2=0x7fd4300b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:46.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.124+0000 7fd43579a700 1 --2- 172.21.15.37:0/447983337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43015c460 0x7fd4300b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:46.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.124+0000 7fd43579a700 1 -- 172.21.15.37:0/447983337 >> v2:172.21.15.196:3300/0 conn(0x7fd4300cf720 msgr2=0x7fd4300cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:46.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.124+0000 7fd43579a700 1 --2- 172.21.15.37:0/447983337 >> v2:172.21.15.196:3300/0 conn(0x7fd4300cf720 0x7fd4300cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:46.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.124+0000 7fd43579a700 1 -- 172.21.15.37:0/447983337 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4300d14b0 con 0x7fd4300d2640 2023-07-12T02:04:46.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.124+0000 7fd435f9b700 1 --2- 172.21.15.37:0/447983337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43015c460 0x7fd4300b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:46.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.124+0000 7fd43679c700 1 --2- 172.21.15.37:0/447983337 >> v2:172.21.15.196:3300/0 conn(0x7fd4300cf720 0x7fd4300cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:46.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.124+0000 7fd43579a700 1 --2- 172.21.15.37:0/447983337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4300d2640 0x7fd4300cf1e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd43008bf90 tx=0x7fd420009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e41e2e63654ec2 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:46.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.124+0000 7fd434f99700 1 -- 172.21.15.37:0/447983337 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42000b870 con 0x7fd4300d2640 2023-07-12T02:04:46.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.124+0000 7fd434f99700 1 -- 172.21.15.37:0/447983337 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42000b9d0 con 0x7fd4300d2640 2023-07-12T02:04:46.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.124+0000 7fd434f99700 1 -- 172.21.15.37:0/447983337 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42000bd60 con 0x7fd4300d2640 2023-07-12T02:04:46.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.125+0000 7fd4381ff700 1 -- 172.21.15.37:0/447983337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4300d2640 msgr2=0x7fd4300cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:46.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.125+0000 7fd4381ff700 1 --2- 172.21.15.37:0/447983337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4300d2640 0x7fd4300cf1e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd43008bf90 tx=0x7fd420009bd0 comp rx=0 tx=0).stop 2023-07-12T02:04:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.125+0000 7fd4381ff700 1 -- 172.21.15.37:0/447983337 shutdown_connections 2023-07-12T02:04:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.125+0000 7fd4381ff700 1 --2- 172.21.15.37:0/447983337 >> v2:172.21.15.196:3300/0 conn(0x7fd4300cf720 0x7fd4300cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.125+0000 7fd4381ff700 1 --2- 172.21.15.37:0/447983337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43015c460 0x7fd4300b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.125+0000 7fd4381ff700 1 --2- 172.21.15.37:0/447983337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4300d2640 0x7fd4300cf1e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:46.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.125+0000 7fd4381ff700 1 -- 172.21.15.37:0/447983337 >> 172.21.15.37:0/447983337 conn(0x7fd430071660 msgr2=0x7fd430071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:46.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.125+0000 7fd4381ff700 1 -- 172.21.15.37:0/447983337 shutdown_connections 2023-07-12T02:04:46.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.125+0000 7fd4381ff700 1 -- 172.21.15.37:0/447983337 wait complete. 2023-07-12T02:04:46.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.127+0000 7fd4381ff700 1 Processor -- start 2023-07-12T02:04:46.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.127+0000 7fd4381ff700 1 -- start start 2023-07-12T02:04:46.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.128+0000 7fd4381ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4300cf720 0x7fd43014b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:46.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.128+0000 7fd4381ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4300d2640 0x7fd4301e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:46.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.128+0000 7fd4381ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43015c460 0x7fd4300cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.128+0000 7fd4381ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4301e65b0 con 0x7fd4300d2640 2023-07-12T02:04:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.128+0000 7fd4381ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4301e6890 con 0x7fd4300cf720 2023-07-12T02:04:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.128+0000 7fd4381ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4301e6b70 con 0x7fd43015c460 2023-07-12T02:04:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.128+0000 7fd43579a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4300d2640 0x7fd4301e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.128+0000 7fd43579a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4300d2640 0x7fd4301e5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60142/0 (socket says 172.21.15.37:60142) 2023-07-12T02:04:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.128+0000 7fd43579a700 1 -- 172.21.15.37:0/2439193386 learned_addr learned my addr 172.21.15.37:0/2439193386 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.128+0000 7fd435f9b700 1 --2- 172.21.15.37:0/2439193386 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4300cf720 0x7fd43014b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.128+0000 7fd43679c700 1 --2- 172.21.15.37:0/2439193386 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43015c460 0x7fd4300cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.129+0000 7fd43579a700 1 -- 172.21.15.37:0/2439193386 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43015c460 msgr2=0x7fd4300cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.129+0000 7fd43579a700 1 --2- 172.21.15.37:0/2439193386 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43015c460 0x7fd4300cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.129+0000 7fd43579a700 1 -- 172.21.15.37:0/2439193386 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4300cf720 msgr2=0x7fd43014b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.129+0000 7fd43579a700 1 --2- 172.21.15.37:0/2439193386 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4300cf720 0x7fd43014b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.129+0000 7fd43579a700 1 -- 172.21.15.37:0/2439193386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd420009550 con 0x7fd4300d2640 2023-07-12T02:04:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.129+0000 7fd435f9b700 1 --2- 172.21.15.37:0/2439193386 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4300cf720 0x7fd43014b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.129+0000 7fd43679c700 1 --2- 172.21.15.37:0/2439193386 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43015c460 0x7fd4300cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.129+0000 7fd43579a700 1 --2- 172.21.15.37:0/2439193386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4300d2640 0x7fd4301e5c40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd420014040 tx=0x7fd420004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.129+0000 7fd4267fc700 1 -- 172.21.15.37:0/2439193386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420004520 con 0x7fd4300d2640 2023-07-12T02:04:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.129+0000 7fd4267fc700 1 -- 172.21.15.37:0/2439193386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42001e070 con 0x7fd4300d2640 2023-07-12T02:04:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.129+0000 7fd4267fc700 1 -- 172.21.15.37:0/2439193386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4200038e0 con 0x7fd4300d2640 2023-07-12T02:04:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.129+0000 7fd4381ff700 1 -- 172.21.15.37:0/2439193386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4301e6e50 con 0x7fd4300d2640 2023-07-12T02:04:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.129+0000 7fd4381ff700 1 -- 172.21.15.37:0/2439193386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43014bc00 con 0x7fd4300d2640 2023-07-12T02:04:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.130+0000 7fd4381ff700 1 -- 172.21.15.37:0/2439193386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4301e7370 con 0x7fd4300d2640 2023-07-12T02:04:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.131+0000 7fd4267fc700 1 -- 172.21.15.37:0/2439193386 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd420003a40 con 0x7fd4300d2640 2023-07-12T02:04:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.132+0000 7fd4267fc700 1 --2- 172.21.15.37:0/2439193386 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd41406ace0 0x7fd41406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.133+0000 7fd4267fc700 1 -- 172.21.15.37:0/2439193386 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd420020070 con 0x7fd4300d2640 2023-07-12T02:04:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.133+0000 7fd435f9b700 1 --2- 172.21.15.37:0/2439193386 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd41406ace0 0x7fd41406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.133+0000 7fd435f9b700 1 --2- 172.21.15.37:0/2439193386 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd41406ace0 0x7fd41406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00aa20 tx=0x7fd42c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.137+0000 7fd4267fc700 1 -- 172.21.15.37:0/2439193386 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd4301e7370 con 0x7fd4300d2640 2023-07-12T02:04:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.393+0000 7fd4381ff700 1 -- 172.21.15.37:0/2439193386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd4301e7370 con 0x7fd4300d2640 2023-07-12T02:04:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.393+0000 7fd4267fc700 1 -- 172.21.15.37:0/2439193386 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd4301e7370 con 0x7fd4300d2640 2023-07-12T02:04:46.397 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-12T02:04:46.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.395+0000 7fd4381ff700 1 -- 172.21.15.37:0/2439193386 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd41406ace0 msgr2=0x7fd41406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:46.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.395+0000 7fd4381ff700 1 --2- 172.21.15.37:0/2439193386 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd41406ace0 0x7fd41406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00aa20 tx=0x7fd42c008040 comp rx=0 tx=0).stop 2023-07-12T02:04:46.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.395+0000 7fd4381ff700 1 -- 172.21.15.37:0/2439193386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4300d2640 msgr2=0x7fd4301e5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:46.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.395+0000 7fd4381ff700 1 --2- 172.21.15.37:0/2439193386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4300d2640 0x7fd4301e5c40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd420014040 tx=0x7fd420004750 comp rx=0 tx=0).stop 2023-07-12T02:04:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.395+0000 7fd4381ff700 1 -- 172.21.15.37:0/2439193386 shutdown_connections 2023-07-12T02:04:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.395+0000 7fd4381ff700 1 --2- 172.21.15.37:0/2439193386 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd41406ace0 0x7fd41406d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.395+0000 7fd4381ff700 1 --2- 172.21.15.37:0/2439193386 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43015c460 0x7fd4300cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.395+0000 7fd4381ff700 1 --2- 172.21.15.37:0/2439193386 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd4300cf720 0x7fd43014b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.395+0000 7fd4381ff700 1 --2- 172.21.15.37:0/2439193386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4300d2640 0x7fd4301e5c40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.395+0000 7fd4381ff700 1 -- 172.21.15.37:0/2439193386 >> 172.21.15.37:0/2439193386 conn(0x7fd430071660 msgr2=0x7fd43015fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.395+0000 7fd4381ff700 1 -- 172.21.15.37:0/2439193386 shutdown_connections 2023-07-12T02:04:46.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:46.396+0000 7fd4381ff700 1 -- 172.21.15.37:0/2439193386 wait complete. 2023-07-12T02:04:46.417 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-12T02:04:46.417 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-12T02:04:46.417 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-12T02:04:46.418 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-12T02:04:46.418 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-12T02:04:46.418 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-12T02:04:46.418 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-12T02:04:46.418 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-12T02:04:46.419 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-12T02:04:46.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:46.419 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-12T02:04:46.465 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-12T02:04:46.465 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-12T02:04:46.466 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-12T02:04:46.466 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:46.466 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-12T02:04:46.466 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:46.466 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:04:46.466 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:46.466 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-12T02:04:46.467 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:04:46.467 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:46.467 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-12T02:04:46.467 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-12T02:04:46.467 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:46.467 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-12T02:04:46.467 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-12T02:04:46.467 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41695sec preferred_lft 41695sec 2023-07-12T02:04:46.468 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-12T02:04:46.468 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:46.468 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:04:46.468 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:46.468 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-12T02:04:46.468 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-12T02:04:46.468 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 06:d8:34:67:3f:34 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:46.468 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-12T02:04:46.469 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:46.469 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::7cee:51ff:fe1e:d7b/64 scope link 2023-07-12T02:04:46.469 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:46.469 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-12T02:04:46.469 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 06:d8:34:67:3f:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-12T02:04:46.469 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4d8:34ff:fe67:3f34/64 scope link 2023-07-12T02:04:46.469 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:46.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:46.470 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-12T02:04:46.537 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-12T02:04:46.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:46.540 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-12T02:04:46.588 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-12T02:04:46.589 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-12T02:04:46.589 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-12T02:04:46.589 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-12T02:04:46.589 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-12T02:04:46.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:46.590 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-12T02:04:46.590 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-12T02:04:46.591 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-12T02:04:46.591 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-12T02:04:46.591 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-12T02:04:46.591 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-12T02:04:46.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:46.760 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-12T02:04:46.805 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-12T02:04:46.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:46.807 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-07-12T02:04:46.891 INFO:teuthology.orchestra.run.smithi037.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-12T02:04:46.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:46.893 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-12T02:04:46.893 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-12T02:04:46.893 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-12T02:04:46.893 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-12T02:04:46.894 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-12T02:04:47.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:47.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-12T02:04:47.106 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-12T02:04:47.107 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-12T02:04:47.107 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-12T02:04:47.107 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:47.107 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-12T02:04:47.107 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:47.107 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-12T02:04:47.108 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether d2:88:9f:89:bd:6e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-12T02:04:47.108 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-12T02:04:47.108 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:47.108 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::d088:9fff:fe89:bd6e/64 scope link 2023-07-12T02:04:47.108 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:47.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:47.110 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-12T02:04:47.181 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-12T02:04:47.181 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-12T02:04:47.181 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-12T02:04:47.182 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:47.182 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-12T02:04:47.182 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:47.182 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-12T02:04:47.182 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether d2:88:9f:89:bd:6e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-12T02:04:47.182 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-12T02:04:47.182 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:47.183 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::d088:9fff:fe89:bd6e/64 scope link 2023-07-12T02:04:47.183 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:47.184 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-12T02:04:47.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:47.184 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-12T02:04:47.185 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-12T02:04:47.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-12T02:04:47.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-12T02:04:47.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-12T02:04:47.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-12T02:04:47.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-12T02:04:47.186 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-12T02:04:47.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:47.436 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-12T02:04:47.436 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-12T02:04:47.436 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.1 up 2023-07-12T02:04:47.436 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.1 master ceph-brx 2023-07-12T02:04:47.437 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-12T02:04:47.616 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-12T02:04:47.616 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-12T02:04:47.662 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-12T02:04:47.662 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-12T02:04:47.662 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-12T02:04:47.747 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-12T02:04:47.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:47.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-12T02:04:47.892 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-12T02:04:47.893 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-12T02:04:47.893 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-07-12T02:04:47.908 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-12T02:04:47.909 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-12T02:04:47.909 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-07-12T02:04:47.909 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.196:3300,172.21.15.196:3301" 2023-07-12T02:04:47.909 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-12T02:04:47.931 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-12T02:04:47.932 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-12T02:04:47.932 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-07-12T02:04:47.932 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.196:3300,172.21.15.196:3301" 2023-07-12T02:04:47.932 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-12T02:04:47.932 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.196:6789,172.21.15.196:6790" 2023-07-12T02:04:47.932 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.196:6789,172.21.15.196:6790:/ 2023-07-12T02:04:47.932 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=e0d485b9-796c-494c-84d4-d32d9c18c85f" will pass to kernel 2023-07-12T02:04:47.936 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-12T02:04:47.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:47.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-12T02:04:48.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:48.006 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:04:48.093 INFO:teuthology.orchestra.run.smithi037.stdout:client4682 2023-07-12T02:04:48.093 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:04:48.093 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:04:48.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:48.140 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:04:48.267 INFO:teuthology.orchestra.run.smithi037.stdout:client4682 2023-07-12T02:04:48.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:48.268 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:04:48.354 INFO:teuthology.orchestra.run.smithi037.stdout:client4682 2023-07-12T02:04:48.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:48.355 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e0d485b9-796c-494c-84d4-d32d9c18c85f.client4682/status') 2023-07-12T02:04:48.462 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.4682 (3)172.21.15.37:0/3335976226 2023-07-12T02:04:48.462 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2023-07-12T02:04:48.463 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2023-07-12T02:04:48.463 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2023-07-12T02:04:48.463 INFO:teuthology.orchestra.run.smithi037.stderr:70 bytes copied, 6.7085e-05 s, 1.0 MB/s 2023-07-12T02:04:48.465 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-07-12T02:04:48.465 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-12T02:04:48.465 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-12T02:04:48.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-12T02:04:48.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.662+0000 7ffbdc3ff700 1 Processor -- start 2023-07-12T02:04:48.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.662+0000 7ffbdc3ff700 1 -- start start 2023-07-12T02:04:48.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.663+0000 7ffbdc3ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd415c460 0x7ffbd40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:48.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.663+0000 7ffbdc3ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffbd40d2640 0x7ffbd40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:48.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.663+0000 7ffbdc3ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd40d1790 con 0x7ffbd40cf720 2023-07-12T02:04:48.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.663+0000 7ffbdc3ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd40cedd0 con 0x7ffbd40d2640 2023-07-12T02:04:48.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.663+0000 7ffbdc3ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40cd950 con 0x7ffbd415c460 2023-07-12T02:04:48.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.664+0000 7ffbd999a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffbd40d2640 0x7ffbd40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:48.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.664+0000 7ffbda99c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffbd40cf720 0x7ffbd40d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60120/0 (socket says 172.21.15.37:60120) 2023-07-12T02:04:48.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.664+0000 7ffbda99c700 1 -- 172.21.15.37:0/981772647 learned_addr learned my addr 172.21.15.37:0/981772647 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:48.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.664+0000 7ffbda19b700 1 --2- 172.21.15.37:0/981772647 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd415c460 0x7ffbd40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:48.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.664+0000 7ffbd999a700 1 -- 172.21.15.37:0/981772647 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd415c460 msgr2=0x7ffbd40b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:48.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.664+0000 7ffbd999a700 1 --2- 172.21.15.37:0/981772647 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd415c460 0x7ffbd40b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:48.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.664+0000 7ffbd999a700 1 -- 172.21.15.37:0/981772647 >> v1:172.21.15.37:6789/0 conn(0x7ffbd40cf720 legacy=0x7ffbd40d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:48.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.664+0000 7ffbd999a700 1 -- 172.21.15.37:0/981772647 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd40d14b0 con 0x7ffbd40d2640 2023-07-12T02:04:48.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.664+0000 7ffbd9199700 1 -- 172.21.15.37:0/981772647 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535632068 0 0) 0x7ffbd40d1790 con 0x7ffbd40cf720 2023-07-12T02:04:48.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.664+0000 7ffbd999a700 1 --2- 172.21.15.37:0/981772647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbd40d2640 0x7ffbd40cf1e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4009840 tx=0x7ffbc4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eefb24f5988616bc server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:48.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.665+0000 7ffbd9199700 1 -- 172.21.15.37:0/981772647 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4011830 con 0x7ffbd40d2640 2023-07-12T02:04:48.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.665+0000 7ffbd9199700 1 -- 172.21.15.37:0/981772647 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc4011990 con 0x7ffbd40d2640 2023-07-12T02:04:48.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.665+0000 7ffbd9199700 1 -- 172.21.15.37:0/981772647 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4011d20 con 0x7ffbd40d2640 2023-07-12T02:04:48.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.665+0000 7ffbdc3ff700 1 -- 172.21.15.37:0/981772647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbd40d2640 msgr2=0x7ffbd40cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:48.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.665+0000 7ffbdc3ff700 1 --2- 172.21.15.37:0/981772647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbd40d2640 0x7ffbd40cf1e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4009840 tx=0x7ffbc4009b50 comp rx=0 tx=0).stop 2023-07-12T02:04:48.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.665+0000 7ffbdc3ff700 1 -- 172.21.15.37:0/981772647 shutdown_connections 2023-07-12T02:04:48.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.665+0000 7ffbdc3ff700 1 --2- 172.21.15.37:0/981772647 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd415c460 0x7ffbd40b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:48.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.665+0000 7ffbdc3ff700 1 --2- 172.21.15.37:0/981772647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbd40d2640 0x7ffbd40cf1e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:48.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.665+0000 7ffbdc3ff700 1 -- 172.21.15.37:0/981772647 >> 172.21.15.37:0/981772647 conn(0x7ffbd4071660 msgr2=0x7ffbd4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:48.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.665+0000 7ffbdc3ff700 1 -- 172.21.15.37:0/981772647 shutdown_connections 2023-07-12T02:04:48.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.665+0000 7ffbdc3ff700 1 -- 172.21.15.37:0/981772647 wait complete. 2023-07-12T02:04:48.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.667+0000 7ffbdc3ff700 1 Processor -- start 2023-07-12T02:04:48.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.667+0000 7ffbdc3ff700 1 -- start start 2023-07-12T02:04:48.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.668+0000 7ffbdc3ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd40cf720 0x7ffbd40c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:48.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.668+0000 7ffbdc3ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbd40d2640 0x7ffbd414dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:48.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.668+0000 7ffbdc3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbd415c460 0x7ffbd4158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:48.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.668+0000 7ffbdc3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd4159180 con 0x7ffbd415c460 2023-07-12T02:04:48.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.668+0000 7ffbdc3ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40c7a50 con 0x7ffbd40d2640 2023-07-12T02:04:48.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.668+0000 7ffbdc3ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40c7cd0 con 0x7ffbd40cf720 2023-07-12T02:04:48.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.668+0000 7ffbda99c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbd415c460 0x7ffbd4158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:48.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.669+0000 7ffbda99c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbd415c460 0x7ffbd4158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60150/0 (socket says 172.21.15.37:60150) 2023-07-12T02:04:48.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.669+0000 7ffbda99c700 1 -- 172.21.15.37:0/2251815273 learned_addr learned my addr 172.21.15.37:0/2251815273 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:48.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.669+0000 7ffbda19b700 1 --2- 172.21.15.37:0/2251815273 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd40cf720 0x7ffbd40c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:48.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.669+0000 7ffbd999a700 1 --2- 172.21.15.37:0/2251815273 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbd40d2640 0x7ffbd414dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:48.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.669+0000 7ffbda99c700 1 -- 172.21.15.37:0/2251815273 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd40cf720 msgr2=0x7ffbd40c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:48.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.669+0000 7ffbda99c700 1 --2- 172.21.15.37:0/2251815273 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd40cf720 0x7ffbd40c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:48.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.669+0000 7ffbda99c700 1 -- 172.21.15.37:0/2251815273 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbd40d2640 msgr2=0x7ffbd414dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:48.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.669+0000 7ffbda99c700 1 --2- 172.21.15.37:0/2251815273 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbd40d2640 0x7ffbd414dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:48.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.669+0000 7ffbda99c700 1 -- 172.21.15.37:0/2251815273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc40094a0 con 0x7ffbd415c460 2023-07-12T02:04:48.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.669+0000 7ffbda99c700 1 --2- 172.21.15.37:0/2251815273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbd415c460 0x7ffbd4158300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00cba0 tx=0x7ffbcc00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:48.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.669+0000 7ffbcaffd700 1 -- 172.21.15.37:0/2251815273 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc00aaa0 con 0x7ffbd415c460 2023-07-12T02:04:48.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.669+0000 7ffbcaffd700 1 -- 172.21.15.37:0/2251815273 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc00ac20 con 0x7ffbd415c460 2023-07-12T02:04:48.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.669+0000 7ffbcaffd700 1 -- 172.21.15.37:0/2251815273 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc0070d0 con 0x7ffbd415c460 2023-07-12T02:04:48.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.670+0000 7ffbdc3ff700 1 -- 172.21.15.37:0/2251815273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd40c7fb0 con 0x7ffbd415c460 2023-07-12T02:04:48.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.670+0000 7ffbdc3ff700 1 -- 172.21.15.37:0/2251815273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd40c8570 con 0x7ffbd415c460 2023-07-12T02:04:48.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.671+0000 7ffbdc3ff700 1 -- 172.21.15.37:0/2251815273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd404ea60 con 0x7ffbd415c460 2023-07-12T02:04:48.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.672+0000 7ffbcaffd700 1 -- 172.21.15.37:0/2251815273 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffbcc007230 con 0x7ffbd415c460 2023-07-12T02:04:48.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.672+0000 7ffbcaffd700 1 --2- 172.21.15.37:0/2251815273 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffbb806ace0 0x7ffbb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:48.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.673+0000 7ffbcaffd700 1 -- 172.21.15.37:0/2251815273 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ffbcc089280 con 0x7ffbd415c460 2023-07-12T02:04:48.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.673+0000 7ffbda19b700 1 --2- 172.21.15.37:0/2251815273 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffbb806ace0 0x7ffbb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:48.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.674+0000 7ffbda19b700 1 --2- 172.21.15.37:0/2251815273 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffbb806ace0 0x7ffbb806d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0006b20 tx=0x7ffbd0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:48.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.677+0000 7ffbcaffd700 1 -- 172.21.15.37:0/2251815273 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ffbcc053ff0 con 0x7ffbd415c460 2023-07-12T02:04:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.931+0000 7ffbdc3ff700 1 -- 172.21.15.37:0/2251815273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffbd40b4fa0 con 0x7ffbd415c460 2023-07-12T02:04:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.931+0000 7ffbcaffd700 1 -- 172.21.15.37:0/2251815273 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7ffbcc057610 con 0x7ffbd415c460 2023-07-12T02:04:48.935 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-12T02:04:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.933+0000 7ffbdc3ff700 1 -- 172.21.15.37:0/2251815273 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffbb806ace0 msgr2=0x7ffbb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.933+0000 7ffbdc3ff700 1 --2- 172.21.15.37:0/2251815273 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffbb806ace0 0x7ffbb806d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0006b20 tx=0x7ffbd0008040 comp rx=0 tx=0).stop 2023-07-12T02:04:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.933+0000 7ffbdc3ff700 1 -- 172.21.15.37:0/2251815273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbd415c460 msgr2=0x7ffbd4158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.933+0000 7ffbdc3ff700 1 --2- 172.21.15.37:0/2251815273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbd415c460 0x7ffbd4158300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00cba0 tx=0x7ffbcc00ceb0 comp rx=0 tx=0).stop 2023-07-12T02:04:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.933+0000 7ffbdc3ff700 1 -- 172.21.15.37:0/2251815273 shutdown_connections 2023-07-12T02:04:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.933+0000 7ffbdc3ff700 1 --2- 172.21.15.37:0/2251815273 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ffbb806ace0 0x7ffbb806d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.933+0000 7ffbdc3ff700 1 --2- 172.21.15.37:0/2251815273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbd415c460 0x7ffbd4158300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.933+0000 7ffbdc3ff700 1 --2- 172.21.15.37:0/2251815273 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd40cf720 0x7ffbd40c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.933+0000 7ffbdc3ff700 1 --2- 172.21.15.37:0/2251815273 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbd40d2640 0x7ffbd414dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.933+0000 7ffbdc3ff700 1 -- 172.21.15.37:0/2251815273 >> 172.21.15.37:0/2251815273 conn(0x7ffbd4071660 msgr2=0x7ffbd415c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.934+0000 7ffbdc3ff700 1 -- 172.21.15.37:0/2251815273 shutdown_connections 2023-07-12T02:04:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:48.934+0000 7ffbdc3ff700 1 -- 172.21.15.37:0/2251815273 wait complete. 2023-07-12T02:04:48.955 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-12T02:04:48.955 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-12T02:04:48.956 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi196.front.sepia.ceph.com 2023-07-12T02:04:48.956 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-12T02:04:48.956 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-12T02:04:48.956 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-12T02:04:48.956 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-12T02:04:48.957 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-12T02:04:48.957 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-12T02:04:48.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:48.957 DEBUG:teuthology.orchestra.run.smithi196:> ip addr 2023-07-12T02:04:49.008 INFO:teuthology.orchestra.run.smithi196.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-12T02:04:49.008 INFO:teuthology.orchestra.run.smithi196.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-12T02:04:49.009 INFO:teuthology.orchestra.run.smithi196.stdout: inet 127.0.0.1/8 scope host lo 2023-07-12T02:04:49.009 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:49.009 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 ::1/128 scope host 2023-07-12T02:04:49.009 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:49.009 INFO:teuthology.orchestra.run.smithi196.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:04:49.009 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:be brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:49.009 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f0 2023-07-12T02:04:49.010 INFO:teuthology.orchestra.run.smithi196.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:04:49.010 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:bf brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:49.010 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f1 2023-07-12T02:04:49.010 INFO:teuthology.orchestra.run.smithi196.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:04:49.010 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:46 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:49.010 INFO:teuthology.orchestra.run.smithi196.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-12T02:04:49.010 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:47 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:49.010 INFO:teuthology.orchestra.run.smithi196.stdout: inet 172.21.15.196/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-12T02:04:49.011 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft 41714sec preferred_lft 41714sec 2023-07-12T02:04:49.011 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::ec4:7aff:fe88:7f47/64 scope link 2023-07-12T02:04:49.011 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:49.012 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-12T02:04:49.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:49.012 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2023-07-12T02:04:49.012 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2023-07-12T02:04:49.013 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link add name ceph-brx type bridge 2023-07-12T02:04:49.013 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip addr flush dev ceph-brx 2023-07-12T02:04:49.013 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set ceph-brx up 2023-07-12T02:04:49.013 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-12T02:04:49.014 DEBUG:teuthology.orchestra.run.smithi196:> ') 2023-07-12T02:04:49.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:49.500 DEBUG:teuthology.orchestra.run.smithi196:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-12T02:04:49.603 INFO:teuthology.orchestra.run.smithi196.stdout:1 2023-07-12T02:04:49.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:49.606 DEBUG:teuthology.orchestra.run.smithi196:> route 2023-07-12T02:04:49.678 INFO:teuthology.orchestra.run.smithi196.stdout:Kernel IP routing table 2023-07-12T02:04:49.678 INFO:teuthology.orchestra.run.smithi196.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-12T02:04:49.678 INFO:teuthology.orchestra.run.smithi196.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-12T02:04:49.679 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-12T02:04:49.679 INFO:teuthology.orchestra.run.smithi196.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-12T02:04:49.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:49.679 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2023-07-12T02:04:49.679 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2023-07-12T02:04:49.680 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-12T02:04:49.680 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-12T02:04:49.680 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-12T02:04:49.680 DEBUG:teuthology.orchestra.run.smithi196:> ') 2023-07-12T02:04:50.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:50.346 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2023-07-12T02:04:50.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:50.393 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list-id 2023-07-12T02:04:50.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:50.439 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2023-07-12T02:04:50.439 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2023-07-12T02:04:50.439 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-12T02:04:50.439 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-12T02:04:50.439 DEBUG:teuthology.orchestra.run.smithi196:> ') 2023-07-12T02:04:50.619 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-12T02:04:50.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:50.619 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2023-07-12T02:04:50.620 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2023-07-12T02:04:50.620 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-12T02:04:50.620 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-12T02:04:50.620 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-12T02:04:50.620 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-12T02:04:50.621 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-12T02:04:50.621 DEBUG:teuthology.orchestra.run.smithi196:> ') 2023-07-12T02:04:50.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:50.885 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2023-07-12T02:04:50.885 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2023-07-12T02:04:50.885 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set brx.0 up 2023-07-12T02:04:50.885 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set dev brx.0 master ceph-brx 2023-07-12T02:04:50.886 DEBUG:teuthology.orchestra.run.smithi196:> ') 2023-07-12T02:04:51.063 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-12T02:04:51.063 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-12T02:04:51.108 INFO:teuthology.orchestra.run.smithi196.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-12T02:04:51.109 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-12T02:04:51.109 DEBUG:teuthology.orchestra.run.smithi196:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-12T02:04:51.193 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-12T02:04:51.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:51.193 DEBUG:teuthology.orchestra.run.smithi196:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-12T02:04:51.336 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-12T02:04:51.336 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-12T02:04:51.337 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2023-07-12T02:04:51.774 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-12T02:04:51.774 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-12T02:04:51.774 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2023-07-12T02:04:51.774 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.196:3300,172.21.15.196:3301" 2023-07-12T02:04:51.775 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-12T02:04:51.798 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-12T02:04:51.799 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-12T02:04:51.799 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2023-07-12T02:04:51.799 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.196:3300,172.21.15.196:3301" 2023-07-12T02:04:51.799 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-12T02:04:51.799 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.196:6789,172.21.15.196:6790" 2023-07-12T02:04:51.799 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.196:6789,172.21.15.196:6790:/ 2023-07-12T02:04:51.799 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=e0d485b9-796c-494c-84d4-d32d9c18c85f" will pass to kernel 2023-07-12T02:04:51.804 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-12T02:04:51.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:51.805 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-12T02:04:51.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:51.873 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:04:51.973 INFO:teuthology.orchestra.run.smithi196.stdout:client4911 2023-07-12T02:04:51.973 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:04:51.974 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:04:52.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:52.018 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:04:52.146 INFO:teuthology.orchestra.run.smithi196.stdout:client4911 2023-07-12T02:04:52.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:52.147 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:04:52.233 INFO:teuthology.orchestra.run.smithi196.stdout:client4911 2023-07-12T02:04:52.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:52.234 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e0d485b9-796c-494c-84d4-d32d9c18c85f.client4911/status') 2023-07-12T02:04:52.341 INFO:teuthology.orchestra.run.smithi196.stdout:instance: client.4911 (3)172.21.15.196:0/2971012331 2023-07-12T02:04:52.341 INFO:teuthology.orchestra.run.smithi196.stdout:blocklisted: false 2023-07-12T02:04:52.342 INFO:teuthology.orchestra.run.smithi196.stderr:0+1 records in 2023-07-12T02:04:52.342 INFO:teuthology.orchestra.run.smithi196.stderr:0+1 records out 2023-07-12T02:04:52.342 INFO:teuthology.orchestra.run.smithi196.stderr:71 bytes copied, 5.0199e-05 s, 1.4 MB/s 2023-07-12T02:04:52.344 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-07-12T02:04:52.344 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-12T02:04:52.345 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-12T02:04:52.345 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-12T02:04:52.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.554+0000 7f588d7ff700 1 Processor -- start 2023-07-12T02:04:52.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.554+0000 7f588d7ff700 1 -- start start 2023-07-12T02:04:52.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.555+0000 7f588d7ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f588815c460 0x7f58880b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:52.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.555+0000 7f588d7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58880cf8f0 0x7f588815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:52.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.555+0000 7f588d7ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58880d1790 con 0x7f58880d2640 2023-07-12T02:04:52.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.555+0000 7f588d7ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58880cedd0 con 0x7f588815c460 2023-07-12T02:04:52.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.555+0000 7f588d7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58880cd950 con 0x7f58880cf8f0 2023-07-12T02:04:52.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.556+0000 7f58877fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58880cf8f0 0x7f588815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:52.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.556+0000 7f5886ffd700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f588815c460 0x7f58880b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:52.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.556+0000 7f587ffff700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f58880d2640 0x7f58880cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:43094/0 (socket says 172.21.15.37:43094) 2023-07-12T02:04:52.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.556+0000 7f587ffff700 1 -- 172.21.15.37:0/3595395020 learned_addr learned my addr 172.21.15.37:0/3595395020 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:52.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.556+0000 7f58867fc700 1 -- 172.21.15.37:0/3595395020 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397327468 0 0) 0x7f58880d1790 con 0x7f58880d2640 2023-07-12T02:04:52.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.556+0000 7f58877fe700 1 -- 172.21.15.37:0/3595395020 >> v2:172.21.15.196:3300/0 conn(0x7f588815c460 msgr2=0x7f58880b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:52.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.556+0000 7f58877fe700 1 --2- 172.21.15.37:0/3595395020 >> v2:172.21.15.196:3300/0 conn(0x7f588815c460 0x7f58880b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:52.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.556+0000 7f58877fe700 1 -- 172.21.15.37:0/3595395020 >> v1:172.21.15.196:6789/0 conn(0x7f58880d2640 legacy=0x7f58880cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:52.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.556+0000 7f58877fe700 1 -- 172.21.15.37:0/3595395020 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58880d14b0 con 0x7f58880cf8f0 2023-07-12T02:04:52.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.556+0000 7f58877fe700 1 --2- 172.21.15.37:0/3595395020 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58880cf8f0 0x7f588815fe20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5880009d90 tx=0x7f588000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4602435f678d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:52.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.557+0000 7f58867fc700 1 -- 172.21.15.37:0/3595395020 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588000e070 con 0x7f58880cf8f0 2023-07-12T02:04:52.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.557+0000 7f58867fc700 1 -- 172.21.15.37:0/3595395020 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588000bb20 con 0x7f58880cf8f0 2023-07-12T02:04:52.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.557+0000 7f58867fc700 1 -- 172.21.15.37:0/3595395020 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5880012430 con 0x7f58880cf8f0 2023-07-12T02:04:52.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.557+0000 7f588d7ff700 1 -- 172.21.15.37:0/3595395020 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58880cf8f0 msgr2=0x7f588815fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:52.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.557+0000 7f588d7ff700 1 --2- 172.21.15.37:0/3595395020 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58880cf8f0 0x7f588815fe20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5880009d90 tx=0x7f588000b330 comp rx=0 tx=0).stop 2023-07-12T02:04:52.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.557+0000 7f588d7ff700 1 -- 172.21.15.37:0/3595395020 shutdown_connections 2023-07-12T02:04:52.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.557+0000 7f588d7ff700 1 --2- 172.21.15.37:0/3595395020 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58880cf8f0 0x7f588815fe20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:52.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.557+0000 7f588d7ff700 1 --2- 172.21.15.37:0/3595395020 >> v2:172.21.15.196:3300/0 conn(0x7f588815c460 0x7f58880b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:52.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.557+0000 7f588d7ff700 1 -- 172.21.15.37:0/3595395020 >> 172.21.15.37:0/3595395020 conn(0x7f5888071660 msgr2=0x7f5888071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:52.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.557+0000 7f588d7ff700 1 -- 172.21.15.37:0/3595395020 shutdown_connections 2023-07-12T02:04:52.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.557+0000 7f588d7ff700 1 -- 172.21.15.37:0/3595395020 wait complete. 2023-07-12T02:04:52.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.559+0000 7f588d7ff700 1 Processor -- start 2023-07-12T02:04:52.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.559+0000 7f588d7ff700 1 -- start start 2023-07-12T02:04:52.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.560+0000 7f588d7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58880cf8f0 0x7f58881e7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:52.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.560+0000 7f588d7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58880d2640 0x7f58881e8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:52.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.560+0000 7f588d7ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f588815c460 0x7f588815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.560+0000 7f588d7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58880b7bd0 con 0x7f58880cf8f0 2023-07-12T02:04:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.560+0000 7f588d7ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588815ea70 con 0x7f588815c460 2023-07-12T02:04:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.560+0000 7f588d7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588815ed50 con 0x7f58880d2640 2023-07-12T02:04:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.560+0000 7f5886ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58880cf8f0 0x7f58881e7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.560+0000 7f5886ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58880cf8f0 0x7f58881e7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57500/0 (socket says 172.21.15.37:57500) 2023-07-12T02:04:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.560+0000 7f5886ffd700 1 -- 172.21.15.37:0/892994098 learned_addr learned my addr 172.21.15.37:0/892994098 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.560+0000 7f58877fe700 1 --2- 172.21.15.37:0/892994098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f588815c460 0x7f588815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.560+0000 7f587ffff700 1 --2- 172.21.15.37:0/892994098 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58880d2640 0x7f58881e8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:52.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.561+0000 7f5886ffd700 1 -- 172.21.15.37:0/892994098 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58880d2640 msgr2=0x7f58881e8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:52.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.561+0000 7f5886ffd700 1 --2- 172.21.15.37:0/892994098 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58880d2640 0x7f58881e8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:52.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.561+0000 7f5886ffd700 1 -- 172.21.15.37:0/892994098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f588815c460 msgr2=0x7f588815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:52.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.561+0000 7f5886ffd700 1 --2- 172.21.15.37:0/892994098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f588815c460 0x7f588815c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:52.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.561+0000 7f5886ffd700 1 -- 172.21.15.37:0/892994098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5880009a70 con 0x7f58880cf8f0 2023-07-12T02:04:52.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.561+0000 7f5886ffd700 1 --2- 172.21.15.37:0/892994098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58880cf8f0 0x7f58881e7e10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f587800e9b0 tx=0x7f587800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:52.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.561+0000 7f587f7fe700 1 -- 172.21.15.37:0/892994098 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878009710 con 0x7f58880cf8f0 2023-07-12T02:04:52.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.561+0000 7f587f7fe700 1 -- 172.21.15.37:0/892994098 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587800ee50 con 0x7f58880cf8f0 2023-07-12T02:04:52.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.561+0000 7f588d7ff700 1 -- 172.21.15.37:0/892994098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588815f030 con 0x7f58880cf8f0 2023-07-12T02:04:52.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.561+0000 7f587f7fe700 1 -- 172.21.15.37:0/892994098 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587800ca50 con 0x7f58880cf8f0 2023-07-12T02:04:52.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.561+0000 7f588d7ff700 1 -- 172.21.15.37:0/892994098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588815f5f0 con 0x7f58880cf8f0 2023-07-12T02:04:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.562+0000 7f588d7ff700 1 -- 172.21.15.37:0/892994098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588815f810 con 0x7f58880cf8f0 2023-07-12T02:04:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.563+0000 7f587f7fe700 1 -- 172.21.15.37:0/892994098 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f587800cbb0 con 0x7f58880cf8f0 2023-07-12T02:04:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.564+0000 7f587f7fe700 1 --2- 172.21.15.37:0/892994098 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f586806ace0 0x7f586806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.564+0000 7f587f7fe700 1 -- 172.21.15.37:0/892994098 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5878089840 con 0x7f58880cf8f0 2023-07-12T02:04:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.565+0000 7f587ffff700 1 --2- 172.21.15.37:0/892994098 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f586806ace0 0x7f586806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.566+0000 7f587ffff700 1 --2- 172.21.15.37:0/892994098 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f586806ace0 0x7f586806d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f58881e8a30 tx=0x7f5870007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:52.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.569+0000 7f587f7fe700 1 -- 172.21.15.37:0/892994098 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5878057fb0 con 0x7f58880cf8f0 2023-07-12T02:04:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.820+0000 7f588d7ff700 1 -- 172.21.15.37:0/892994098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5888142d10 con 0x7f58880cf8f0 2023-07-12T02:04:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.820+0000 7f587f7fe700 1 -- 172.21.15.37:0/892994098 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f587800ce60 con 0x7f58880cf8f0 2023-07-12T02:04:52.824 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-12T02:04:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.822+0000 7f588d7ff700 1 -- 172.21.15.37:0/892994098 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f586806ace0 msgr2=0x7f586806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.822+0000 7f588d7ff700 1 --2- 172.21.15.37:0/892994098 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f586806ace0 0x7f586806d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f58881e8a30 tx=0x7f5870007de0 comp rx=0 tx=0).stop 2023-07-12T02:04:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.822+0000 7f588d7ff700 1 -- 172.21.15.37:0/892994098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58880cf8f0 msgr2=0x7f58881e7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.822+0000 7f588d7ff700 1 --2- 172.21.15.37:0/892994098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58880cf8f0 0x7f58881e7e10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f587800e9b0 tx=0x7f587800ecc0 comp rx=0 tx=0).stop 2023-07-12T02:04:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.822+0000 7f588d7ff700 1 -- 172.21.15.37:0/892994098 shutdown_connections 2023-07-12T02:04:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.822+0000 7f588d7ff700 1 --2- 172.21.15.37:0/892994098 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f586806ace0 0x7f586806d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.822+0000 7f588d7ff700 1 --2- 172.21.15.37:0/892994098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58880cf8f0 0x7f58881e7e10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.822+0000 7f588d7ff700 1 --2- 172.21.15.37:0/892994098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f588815c460 0x7f588815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.822+0000 7f588d7ff700 1 --2- 172.21.15.37:0/892994098 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58880d2640 0x7f58881e8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.822+0000 7f588d7ff700 1 -- 172.21.15.37:0/892994098 >> 172.21.15.37:0/892994098 conn(0x7f5888071660 msgr2=0x7f58880b8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.822+0000 7f588d7ff700 1 -- 172.21.15.37:0/892994098 shutdown_connections 2023-07-12T02:04:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:52.822+0000 7f588d7ff700 1 -- 172.21.15.37:0/892994098 wait complete. 2023-07-12T02:04:52.844 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-12T02:04:52.844 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-12T02:04:52.844 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi196.front.sepia.ceph.com 2023-07-12T02:04:52.844 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-12T02:04:52.845 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-12T02:04:52.845 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-12T02:04:52.845 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-12T02:04:52.845 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-12T02:04:52.845 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-12T02:04:52.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:52.846 DEBUG:teuthology.orchestra.run.smithi196:> ip addr 2023-07-12T02:04:52.894 INFO:teuthology.orchestra.run.smithi196.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-12T02:04:52.894 INFO:teuthology.orchestra.run.smithi196.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-12T02:04:52.894 INFO:teuthology.orchestra.run.smithi196.stdout: inet 127.0.0.1/8 scope host lo 2023-07-12T02:04:52.894 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:52.894 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 ::1/128 scope host 2023-07-12T02:04:52.894 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:52.895 INFO:teuthology.orchestra.run.smithi196.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:04:52.895 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:be brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:52.895 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f0 2023-07-12T02:04:52.895 INFO:teuthology.orchestra.run.smithi196.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:04:52.895 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:bf brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:52.895 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f1 2023-07-12T02:04:52.895 INFO:teuthology.orchestra.run.smithi196.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:04:52.895 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:46 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:52.896 INFO:teuthology.orchestra.run.smithi196.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-12T02:04:52.896 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:47 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:52.896 INFO:teuthology.orchestra.run.smithi196.stdout: inet 172.21.15.196/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-12T02:04:52.896 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft 41710sec preferred_lft 41710sec 2023-07-12T02:04:52.896 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::ec4:7aff:fe88:7f47/64 scope link 2023-07-12T02:04:52.896 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:52.896 INFO:teuthology.orchestra.run.smithi196.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-12T02:04:52.897 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 66:75:26:11:3b:1e brd ff:ff:ff:ff:ff:ff 2023-07-12T02:04:52.897 INFO:teuthology.orchestra.run.smithi196.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-12T02:04:52.897 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:52.897 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::bcb2:b8ff:fe44:dcb4/64 scope link 2023-07-12T02:04:52.897 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:52.897 INFO:teuthology.orchestra.run.smithi196.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-12T02:04:52.897 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 66:75:26:11:3b:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-12T02:04:52.897 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::6475:26ff:fe11:3b1e/64 scope link 2023-07-12T02:04:52.898 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:52.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:52.899 DEBUG:teuthology.orchestra.run.smithi196:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-12T02:04:52.966 INFO:teuthology.orchestra.run.smithi196.stdout:1 2023-07-12T02:04:52.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:52.969 DEBUG:teuthology.orchestra.run.smithi196:> route 2023-07-12T02:04:53.017 INFO:teuthology.orchestra.run.smithi196.stdout:Kernel IP routing table 2023-07-12T02:04:53.017 INFO:teuthology.orchestra.run.smithi196.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-12T02:04:53.017 INFO:teuthology.orchestra.run.smithi196.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-12T02:04:53.017 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-12T02:04:53.017 INFO:teuthology.orchestra.run.smithi196.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-12T02:04:53.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:53.018 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2023-07-12T02:04:53.019 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2023-07-12T02:04:53.019 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-12T02:04:53.019 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-12T02:04:53.019 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-12T02:04:53.019 DEBUG:teuthology.orchestra.run.smithi196:> ') 2023-07-12T02:04:53.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:53.190 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2023-07-12T02:04:53.236 INFO:teuthology.orchestra.run.smithi196.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-12T02:04:53.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:53.237 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list-id 2023-07-12T02:04:53.282 INFO:teuthology.orchestra.run.smithi196.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-12T02:04:53.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:53.283 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2023-07-12T02:04:53.283 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2023-07-12T02:04:53.284 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-12T02:04:53.284 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-12T02:04:53.284 DEBUG:teuthology.orchestra.run.smithi196:> ') 2023-07-12T02:04:53.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:53.462 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-12T02:04:53.531 INFO:teuthology.orchestra.run.smithi196.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-12T02:04:53.531 INFO:teuthology.orchestra.run.smithi196.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-12T02:04:53.531 INFO:teuthology.orchestra.run.smithi196.stdout: inet 127.0.0.1/8 scope host lo 2023-07-12T02:04:53.531 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:53.532 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 ::1/128 scope host 2023-07-12T02:04:53.532 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:53.532 INFO:teuthology.orchestra.run.smithi196.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-12T02:04:53.532 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether ae:93:fd:b1:ab:6b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-12T02:04:53.532 INFO:teuthology.orchestra.run.smithi196.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-12T02:04:53.532 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:53.532 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::ac93:fdff:feb1:ab6b/64 scope link 2023-07-12T02:04:53.533 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:53.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:53.534 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-12T02:04:53.604 INFO:teuthology.orchestra.run.smithi196.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-12T02:04:53.604 INFO:teuthology.orchestra.run.smithi196.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-12T02:04:53.604 INFO:teuthology.orchestra.run.smithi196.stdout: inet 127.0.0.1/8 scope host lo 2023-07-12T02:04:53.604 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:53.604 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 ::1/128 scope host 2023-07-12T02:04:53.604 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:53.605 INFO:teuthology.orchestra.run.smithi196.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-12T02:04:53.605 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether ae:93:fd:b1:ab:6b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-12T02:04:53.605 INFO:teuthology.orchestra.run.smithi196.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-12T02:04:53.605 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:53.605 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::ac93:fdff:feb1:ab6b/64 scope link 2023-07-12T02:04:53.605 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:04:53.606 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-12T02:04:53.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:53.607 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2023-07-12T02:04:53.607 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2023-07-12T02:04:53.607 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-12T02:04:53.607 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-12T02:04:53.608 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-12T02:04:53.608 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-12T02:04:53.608 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-12T02:04:53.608 DEBUG:teuthology.orchestra.run.smithi196:> ') 2023-07-12T02:04:53.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:53.844 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2023-07-12T02:04:53.844 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2023-07-12T02:04:53.844 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set brx.1 up 2023-07-12T02:04:53.845 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set dev brx.1 master ceph-brx 2023-07-12T02:04:53.845 DEBUG:teuthology.orchestra.run.smithi196:> ') 2023-07-12T02:04:54.022 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-12T02:04:54.023 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-12T02:04:54.067 INFO:teuthology.orchestra.run.smithi196.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-12T02:04:54.068 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-12T02:04:54.068 DEBUG:teuthology.orchestra.run.smithi196:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-12T02:04:54.153 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-12T02:04:54.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:54.154 DEBUG:teuthology.orchestra.run.smithi196:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-12T02:04:54.297 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-12T02:04:54.297 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-12T02:04:54.297 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2023-07-12T02:04:54.313 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-12T02:04:54.313 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-12T02:04:54.313 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2023-07-12T02:04:54.314 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.196:3300,172.21.15.196:3301" 2023-07-12T02:04:54.314 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-12T02:04:54.336 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-12T02:04:54.336 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-12T02:04:54.336 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2023-07-12T02:04:54.336 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.196:3300,172.21.15.196:3301" 2023-07-12T02:04:54.336 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-12T02:04:54.336 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.196:6789,172.21.15.196:6790" 2023-07-12T02:04:54.337 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.196:6789,172.21.15.196:6790:/ 2023-07-12T02:04:54.337 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=e0d485b9-796c-494c-84d4-d32d9c18c85f" will pass to kernel 2023-07-12T02:04:54.340 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-12T02:04:54.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:54.341 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-12T02:04:54.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:54.409 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:04:54.495 INFO:teuthology.orchestra.run.smithi196.stdout:client4837 2023-07-12T02:04:54.496 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:04:54.496 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:04:54.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:54.540 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:04:54.666 INFO:teuthology.orchestra.run.smithi196.stdout:client4837 2023-07-12T02:04:54.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:54.667 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:04:54.754 INFO:teuthology.orchestra.run.smithi196.stdout:client4837 2023-07-12T02:04:54.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:04:54.754 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e0d485b9-796c-494c-84d4-d32d9c18c85f.client4837/status') 2023-07-12T02:04:54.861 INFO:teuthology.orchestra.run.smithi196.stdout:instance: client.4837 (3)192.168.0.2:0/4268869924 2023-07-12T02:04:54.861 INFO:teuthology.orchestra.run.smithi196.stdout:blocklisted: false 2023-07-12T02:04:54.861 INFO:teuthology.orchestra.run.smithi196.stderr:0+1 records in 2023-07-12T02:04:54.861 INFO:teuthology.orchestra.run.smithi196.stderr:0+1 records out 2023-07-12T02:04:54.861 INFO:teuthology.orchestra.run.smithi196.stderr:69 bytes copied, 5.3571e-05 s, 1.3 MB/s 2023-07-12T02:04:54.863 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-12T02:04:54.880 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:04:55.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.090+0000 7fcb2f1ff700 1 Processor -- start 2023-07-12T02:04:55.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.091+0000 7fcb2f1ff700 1 -- start start 2023-07-12T02:04:55.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.092+0000 7fcb2f1ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb2815c460 0x7fcb280b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:55.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.092+0000 7fcb2f1ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb280d2640 0x7fcb280cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:55.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.092+0000 7fcb2f1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb280d1790 con 0x7fcb280cf720 2023-07-12T02:04:55.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.092+0000 7fcb2f1ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb280cedd0 con 0x7fcb280d2640 2023-07-12T02:04:55.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.092+0000 7fcb2f1ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280cd950 con 0x7fcb2815c460 2023-07-12T02:04:55.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.092+0000 7fcb27fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb280d2640 0x7fcb280cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:55.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.092+0000 7fcb27fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb280d2640 0x7fcb280cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57516/0 (socket says 172.21.15.37:57516) 2023-07-12T02:04:55.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.092+0000 7fcb27fff700 1 -- 172.21.15.37:0/2933474118 learned_addr learned my addr 172.21.15.37:0/2933474118 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:55.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.092+0000 7fcb2d79c700 1 --1- 172.21.15.37:0/2933474118 >> v1:172.21.15.37:6789/0 conn(0x7fcb280cf720 0x7fcb280d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52686/0 (socket says 172.21.15.37:52686) 2023-07-12T02:04:55.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.092+0000 7fcb2cf9b700 1 --2- 172.21.15.37:0/2933474118 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb2815c460 0x7fcb280b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:55.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.093+0000 7fcb27fff700 1 -- 172.21.15.37:0/2933474118 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb2815c460 msgr2=0x7fcb280b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:55.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.093+0000 7fcb27fff700 1 --2- 172.21.15.37:0/2933474118 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb2815c460 0x7fcb280b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.093+0000 7fcb27fff700 1 -- 172.21.15.37:0/2933474118 >> v1:172.21.15.37:6789/0 conn(0x7fcb280cf720 legacy=0x7fcb280d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:55.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.093+0000 7fcb27fff700 1 -- 172.21.15.37:0/2933474118 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb280d14b0 con 0x7fcb280d2640 2023-07-12T02:04:55.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.093+0000 7fcb277fe700 1 -- 172.21.15.37:0/2933474118 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178331087 0 0) 0x7fcb280d1790 con 0x7fcb280cf720 2023-07-12T02:04:55.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.093+0000 7fcb27fff700 1 --2- 172.21.15.37:0/2933474118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280d2640 0x7fcb280cf1e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcb140098f0 tx=0x7fcb14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc639213e8a216f server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:55.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.093+0000 7fcb277fe700 1 -- 172.21.15.37:0/2933474118 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb14011830 con 0x7fcb280d2640 2023-07-12T02:04:55.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.093+0000 7fcb277fe700 1 -- 172.21.15.37:0/2933474118 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb14011990 con 0x7fcb280d2640 2023-07-12T02:04:55.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.093+0000 7fcb277fe700 1 -- 172.21.15.37:0/2933474118 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb14011d20 con 0x7fcb280d2640 2023-07-12T02:04:55.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.094+0000 7fcb2f1ff700 1 -- 172.21.15.37:0/2933474118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280d2640 msgr2=0x7fcb280cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:55.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.094+0000 7fcb2f1ff700 1 --2- 172.21.15.37:0/2933474118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280d2640 0x7fcb280cf1e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcb140098f0 tx=0x7fcb14009c00 comp rx=0 tx=0).stop 2023-07-12T02:04:55.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.094+0000 7fcb2f1ff700 1 -- 172.21.15.37:0/2933474118 shutdown_connections 2023-07-12T02:04:55.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.094+0000 7fcb2f1ff700 1 --2- 172.21.15.37:0/2933474118 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb2815c460 0x7fcb280b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.094+0000 7fcb2f1ff700 1 --2- 172.21.15.37:0/2933474118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280d2640 0x7fcb280cf1e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.094+0000 7fcb2f1ff700 1 -- 172.21.15.37:0/2933474118 >> 172.21.15.37:0/2933474118 conn(0x7fcb28071660 msgr2=0x7fcb28071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:55.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.094+0000 7fcb2f1ff700 1 -- 172.21.15.37:0/2933474118 shutdown_connections 2023-07-12T02:04:55.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.094+0000 7fcb2f1ff700 1 -- 172.21.15.37:0/2933474118 wait complete. 2023-07-12T02:04:55.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.096+0000 7fcb2f1ff700 1 Processor -- start 2023-07-12T02:04:55.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.096+0000 7fcb2f1ff700 1 -- start start 2023-07-12T02:04:55.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb2f1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280cf720 0x7fcb28151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:55.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb2f1ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb280d2640 0x7fcb2814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:55.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb2f1ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb2815c460 0x7fcb28156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:55.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb2f1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28151cc0 con 0x7fcb280cf720 2023-07-12T02:04:55.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb2f1ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280c6a60 con 0x7fcb2815c460 2023-07-12T02:04:55.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb2f1ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281f2950 con 0x7fcb280d2640 2023-07-12T02:04:55.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb2cf9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280cf720 0x7fcb28151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:55.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb2cf9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280cf720 0x7fcb28151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57518/0 (socket says 172.21.15.37:57518) 2023-07-12T02:04:55.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb2cf9b700 1 -- 172.21.15.37:0/3802167853 learned_addr learned my addr 172.21.15.37:0/3802167853 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:55.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb27fff700 1 --2- 172.21.15.37:0/3802167853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb280d2640 0x7fcb2814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:55.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb2d79c700 1 --2- 172.21.15.37:0/3802167853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb2815c460 0x7fcb28156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:55.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb2cf9b700 1 -- 172.21.15.37:0/3802167853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb280d2640 msgr2=0x7fcb2814e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:55.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb2cf9b700 1 --2- 172.21.15.37:0/3802167853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb280d2640 0x7fcb2814e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb2cf9b700 1 -- 172.21.15.37:0/3802167853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb2815c460 msgr2=0x7fcb28156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:55.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb2cf9b700 1 --2- 172.21.15.37:0/3802167853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb2815c460 0x7fcb28156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb2cf9b700 1 -- 172.21.15.37:0/3802167853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb14009550 con 0x7fcb280cf720 2023-07-12T02:04:55.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.097+0000 7fcb27fff700 1 --2- 172.21.15.37:0/3802167853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb280d2640 0x7fcb2814e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:55.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.098+0000 7fcb2cf9b700 1 --2- 172.21.15.37:0/3802167853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280cf720 0x7fcb28151780 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00e9b0 tx=0x7fcb1c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:55.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.098+0000 7fcb257fa700 1 -- 172.21.15.37:0/3802167853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c009710 con 0x7fcb280cf720 2023-07-12T02:04:55.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.098+0000 7fcb257fa700 1 -- 172.21.15.37:0/3802167853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c00c850 con 0x7fcb280cf720 2023-07-12T02:04:55.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.098+0000 7fcb257fa700 1 -- 172.21.15.37:0/3802167853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c00cbc0 con 0x7fcb280cf720 2023-07-12T02:04:55.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.098+0000 7fcb2f1ff700 1 -- 172.21.15.37:0/3802167853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb281f2c30 con 0x7fcb280cf720 2023-07-12T02:04:55.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.098+0000 7fcb2f1ff700 1 -- 172.21.15.37:0/3802167853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb28150f80 con 0x7fcb280cf720 2023-07-12T02:04:55.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.099+0000 7fcb2f1ff700 1 -- 172.21.15.37:0/3802167853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2804ea60 con 0x7fcb280cf720 2023-07-12T02:04:55.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.100+0000 7fcb257fa700 1 -- 172.21.15.37:0/3802167853 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcb1c00cd20 con 0x7fcb280cf720 2023-07-12T02:04:55.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.101+0000 7fcb257fa700 1 --2- 172.21.15.37:0/3802167853 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcb0c06ace0 0x7fcb0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:55.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.101+0000 7fcb257fa700 1 -- 172.21.15.37:0/3802167853 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcb1c0898d0 con 0x7fcb280cf720 2023-07-12T02:04:55.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.102+0000 7fcb27fff700 1 --2- 172.21.15.37:0/3802167853 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcb0c06ace0 0x7fcb0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:55.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.102+0000 7fcb27fff700 1 --2- 172.21.15.37:0/3802167853 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcb0c06ace0 0x7fcb0c06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcb14014040 tx=0x7fcb14008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:55.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.106+0000 7fcb257fa700 1 -- 172.21.15.37:0/3802167853 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fcb1c0580d0 con 0x7fcb280cf720 2023-07-12T02:04:55.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.316+0000 7fcb2f1ff700 1 -- 172.21.15.37:0/3802167853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb280b4fa0 con 0x7fcb280cf720 2023-07-12T02:04:55.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.317+0000 7fcb257fa700 1 -- 172.21.15.37:0/3802167853 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20168 (secure 0 0 0) 0x7fcb1c057c60 con 0x7fcb280cf720 2023-07-12T02:04:55.321 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:55.321 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:39.032667+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:04:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.319+0000 7fcb2f1ff700 1 -- 172.21.15.37:0/3802167853 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcb0c06ace0 msgr2=0x7fcb0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.319+0000 7fcb2f1ff700 1 --2- 172.21.15.37:0/3802167853 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcb0c06ace0 0x7fcb0c06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcb14014040 tx=0x7fcb14008030 comp rx=0 tx=0).stop 2023-07-12T02:04:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.320+0000 7fcb2f1ff700 1 -- 172.21.15.37:0/3802167853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280cf720 msgr2=0x7fcb28151780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.320+0000 7fcb2f1ff700 1 --2- 172.21.15.37:0/3802167853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280cf720 0x7fcb28151780 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00e9b0 tx=0x7fcb1c00ed70 comp rx=0 tx=0).stop 2023-07-12T02:04:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.320+0000 7fcb2f1ff700 1 -- 172.21.15.37:0/3802167853 shutdown_connections 2023-07-12T02:04:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.320+0000 7fcb2f1ff700 1 --2- 172.21.15.37:0/3802167853 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcb0c06ace0 0x7fcb0c06d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.320+0000 7fcb2f1ff700 1 --2- 172.21.15.37:0/3802167853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280cf720 0x7fcb28151780 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.320+0000 7fcb2f1ff700 1 --2- 172.21.15.37:0/3802167853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb2815c460 0x7fcb28156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.320+0000 7fcb2f1ff700 1 --2- 172.21.15.37:0/3802167853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb280d2640 0x7fcb2814e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.320+0000 7fcb2f1ff700 1 -- 172.21.15.37:0/3802167853 >> 172.21.15.37:0/3802167853 conn(0x7fcb28071660 msgr2=0x7fcb2815c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:55.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.320+0000 7fcb2f1ff700 1 -- 172.21.15.37:0/3802167853 shutdown_connections 2023-07-12T02:04:55.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.320+0000 7fcb2f1ff700 1 -- 172.21.15.37:0/3802167853 wait complete. 2023-07-12T02:04:55.341 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:03:56.039938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:03:56.612707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-12T02:04:00.200885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-12T02:04:55.342 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:04:55.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.543+0000 7fafd8dff700 1 Processor -- start 2023-07-12T02:04:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.543+0000 7fafd8dff700 1 -- start start 2023-07-12T02:04:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.544+0000 7fafd8dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafd40cfc60 0x7fafd4167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.544+0000 7fafd8dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd40d0b20 con 0x7fafd40d3730 2023-07-12T02:04:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.544+0000 7fafd8dff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd40b4ee0 con 0x7fafd40b8430 2023-07-12T02:04:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.544+0000 7fafd8dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd40cda30 con 0x7fafd40cfc60 2023-07-12T02:04:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd1d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fafd40d3730 0x7fafd40cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52698/0 (socket says 172.21.15.37:52698) 2023-07-12T02:04:55.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd1d9b700 1 -- 172.21.15.37:0/164215825 learned_addr learned my addr 172.21.15.37:0/164215825 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:55.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd2d9d700 1 --2- 172.21.15.37:0/164215825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafd40cfc60 0x7fafd4167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:55.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd159a700 1 -- 172.21.15.37:0/164215825 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196304556 0 0) 0x7fafd40d0b20 con 0x7fafd40d3730 2023-07-12T02:04:55.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd159a700 1 -- 172.21.15.37:0/164215825 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafbc0035b0 con 0x7fafd40d3730 2023-07-12T02:04:55.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd159a700 1 -- 172.21.15.37:0/164215825 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169603400 0 0) 0x7fafd40b4ee0 con 0x7fafd40b8430 2023-07-12T02:04:55.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd159a700 1 -- 172.21.15.37:0/164215825 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafd40d0b20 con 0x7fafd40b8430 2023-07-12T02:04:55.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd159a700 1 -- 172.21.15.37:0/164215825 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 668148884 0 0) 0x7fafbc0035b0 con 0x7fafd40d3730 2023-07-12T02:04:55.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd159a700 1 -- 172.21.15.37:0/164215825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafd40cfc60 msgr2=0x7fafd4167010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:55.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd159a700 1 --2- 172.21.15.37:0/164215825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafd40cfc60 0x7fafd4167010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd159a700 1 -- 172.21.15.37:0/164215825 >> v1:172.21.15.196:6789/0 conn(0x7fafd40b8430 legacy=0x7fafd40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:55.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd159a700 1 -- 172.21.15.37:0/164215825 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd40b51c0 con 0x7fafd40d3730 2023-07-12T02:04:55.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd159a700 1 -- 172.21.15.37:0/164215825 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7fafc8001670 con 0x7fafd40d3730 2023-07-12T02:04:55.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd159a700 1 -- 172.21.15.37:0/164215825 >> v1:172.21.15.37:6789/0 conn(0x7fafd40d3730 legacy=0x7fafd40cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:55.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd159a700 1 --2- 172.21.15.37:0/164215825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc003bc0 0x7fafbc003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:55.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd159a700 1 --2- 172.21.15.37:0/164215825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafbc004850 0x7fafbc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.545+0000 7fafd159a700 1 --2- 172.21.15.37:0/164215825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafbc005200 0x7fafbc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.546+0000 7fafd159a700 1 -- 172.21.15.37:0/164215825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc00c000 con 0x7fafbc003bc0 2023-07-12T02:04:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.546+0000 7fafd159a700 1 -- 172.21.15.37:0/164215825 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc00c170 con 0x7fafbc005200 2023-07-12T02:04:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.546+0000 7fafd159a700 1 -- 172.21.15.37:0/164215825 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc00c330 con 0x7fafbc004850 2023-07-12T02:04:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.546+0000 7fafd2d9d700 1 --2- 172.21.15.37:0/164215825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafd40cfc60 0x7fafd4167010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:04:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.546+0000 7fafd259c700 1 --2- 172.21.15.37:0/164215825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc003bc0 0x7fafbc003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.546+0000 7fafd1d9b700 1 --2- 172.21.15.37:0/164215825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafbc004850 0x7fafbc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.546+0000 7fafd2d9d700 1 --2- 172.21.15.37:0/164215825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafbc005200 0x7fafbc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:55.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.546+0000 7fafd259c700 1 -- 172.21.15.37:0/164215825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafbc004850 msgr2=0x7fafbc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:55.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.546+0000 7fafd259c700 1 --2- 172.21.15.37:0/164215825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafbc004850 0x7fafbc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.546+0000 7fafd259c700 1 -- 172.21.15.37:0/164215825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafbc005200 msgr2=0x7fafbc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:55.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.546+0000 7fafd259c700 1 --2- 172.21.15.37:0/164215825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafbc005200 0x7fafbc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.546+0000 7fafd259c700 1 -- 172.21.15.37:0/164215825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc0035b0 con 0x7fafbc003bc0 2023-07-12T02:04:55.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.546+0000 7fafd1d9b700 1 --2- 172.21.15.37:0/164215825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafbc004850 0x7fafbc004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:04:55.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.546+0000 7fafd259c700 1 --2- 172.21.15.37:0/164215825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc003bc0 0x7fafbc003fb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fafc4001940 tx=0x7fafbc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3e93e98fc892cd server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:55.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.547+0000 7fafd159a700 1 -- 172.21.15.37:0/164215825 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4001430 con 0x7fafbc003bc0 2023-07-12T02:04:55.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.547+0000 7fafd159a700 1 -- 172.21.15.37:0/164215825 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc4001d70 con 0x7fafbc003bc0 2023-07-12T02:04:55.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.547+0000 7fafd159a700 1 -- 172.21.15.37:0/164215825 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4005510 con 0x7fafbc003bc0 2023-07-12T02:04:55.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.547+0000 7fafd8dff700 1 -- 172.21.15.37:0/164215825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc003bc0 msgr2=0x7fafbc003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:55.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.547+0000 7fafd8dff700 1 --2- 172.21.15.37:0/164215825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc003bc0 0x7fafbc003fb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fafc4001940 tx=0x7fafbc005880 comp rx=0 tx=0).stop 2023-07-12T02:04:55.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.547+0000 7fafd2d9d700 1 -- 172.21.15.37:0/164215825 reap_dead start 2023-07-12T02:04:55.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.547+0000 7fafd8dff700 1 -- 172.21.15.37:0/164215825 shutdown_connections 2023-07-12T02:04:55.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.547+0000 7fafd8dff700 1 -- 172.21.15.37:0/164215825 >> 172.21.15.37:0/164215825 conn(0x7fafd406b3f0 msgr2=0x7fafd406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:55.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.547+0000 7fafd8dff700 1 -- 172.21.15.37:0/164215825 shutdown_connections 2023-07-12T02:04:55.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.547+0000 7fafd8dff700 1 -- 172.21.15.37:0/164215825 wait complete. 2023-07-12T02:04:55.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.549+0000 7fafd8dff700 1 Processor -- start 2023-07-12T02:04:55.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.549+0000 7fafd8dff700 1 -- start start 2023-07-12T02:04:55.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.550+0000 7fafd8dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc003bc0 0x7fafd40cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:55.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.550+0000 7fafd8dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafd4153e10 0x7fafd40b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:55.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.550+0000 7fafd8dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafd4154280 0x7fafd40b6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:55.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.550+0000 7fafd8dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd40ca4a0 con 0x7fafbc003bc0 2023-07-12T02:04:55.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.550+0000 7fafd8dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd40cc9f0 con 0x7fafd4153e10 2023-07-12T02:04:55.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.550+0000 7fafd8dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd40c8b70 con 0x7fafd4154280 2023-07-12T02:04:55.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.550+0000 7fafd259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc003bc0 0x7fafd40cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:55.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.550+0000 7fafd259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc003bc0 0x7fafd40cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57530/0 (socket says 172.21.15.37:57530) 2023-07-12T02:04:55.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.550+0000 7fafd259c700 1 -- 172.21.15.37:0/3919192579 learned_addr learned my addr 172.21.15.37:0/3919192579 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:55.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.551+0000 7fafd1d9b700 1 --2- 172.21.15.37:0/3919192579 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafd4153e10 0x7fafd40b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:55.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.551+0000 7fafd2d9d700 1 --2- 172.21.15.37:0/3919192579 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafd4154280 0x7fafd40b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:55.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.551+0000 7fafd259c700 1 -- 172.21.15.37:0/3919192579 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafd4154280 msgr2=0x7fafd40b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:55.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.551+0000 7fafd259c700 1 --2- 172.21.15.37:0/3919192579 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafd4154280 0x7fafd40b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.551+0000 7fafd259c700 1 -- 172.21.15.37:0/3919192579 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafd4153e10 msgr2=0x7fafd40b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.551+0000 7fafd259c700 1 --2- 172.21.15.37:0/3919192579 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafd4153e10 0x7fafd40b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.551+0000 7fafd259c700 1 -- 172.21.15.37:0/3919192579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd40c8e50 con 0x7fafbc003bc0 2023-07-12T02:04:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.551+0000 7fafd2d9d700 1 --2- 172.21.15.37:0/3919192579 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafd4154280 0x7fafd40b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.551+0000 7fafd1d9b700 1 --2- 172.21.15.37:0/3919192579 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafd4153e10 0x7fafd40b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.551+0000 7fafd259c700 1 --2- 172.21.15.37:0/3919192579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc003bc0 0x7fafd40cc4b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fafc400c3c0 tx=0x7fafc40012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.551+0000 7fafc2ffd700 1 -- 172.21.15.37:0/3919192579 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4006c70 con 0x7fafbc003bc0 2023-07-12T02:04:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.551+0000 7fafc2ffd700 1 -- 172.21.15.37:0/3919192579 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc4006dd0 con 0x7fafbc003bc0 2023-07-12T02:04:55.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.551+0000 7fafd8dff700 1 -- 172.21.15.37:0/3919192579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd40c9130 con 0x7fafbc003bc0 2023-07-12T02:04:55.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.551+0000 7fafc2ffd700 1 -- 172.21.15.37:0/3919192579 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4007280 con 0x7fafbc003bc0 2023-07-12T02:04:55.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.552+0000 7fafd8dff700 1 -- 172.21.15.37:0/3919192579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd41548b0 con 0x7fafbc003bc0 2023-07-12T02:04:55.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.552+0000 7fafd8dff700 1 -- 172.21.15.37:0/3919192579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd40ca740 con 0x7fafbc003bc0 2023-07-12T02:04:55.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.553+0000 7fafc2ffd700 1 -- 172.21.15.37:0/3919192579 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fafc40073e0 con 0x7fafbc003bc0 2023-07-12T02:04:55.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.554+0000 7fafc2ffd700 1 --2- 172.21.15.37:0/3919192579 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fafb406ace0 0x7fafb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:55.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.554+0000 7fafc2ffd700 1 -- 172.21.15.37:0/3919192579 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fafc408a8c0 con 0x7fafbc003bc0 2023-07-12T02:04:55.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.555+0000 7fafd1d9b700 1 --2- 172.21.15.37:0/3919192579 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fafb406ace0 0x7fafb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:55.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.556+0000 7fafd1d9b700 1 --2- 172.21.15.37:0/3919192579 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fafb406ace0 0x7fafb406d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fafc80017a0 tx=0x7fafc8001110 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:55.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.559+0000 7fafc2ffd700 1 -- 172.21.15.37:0/3919192579 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fafc4055630 con 0x7fafbc003bc0 2023-07-12T02:04:55.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.766+0000 7fafd8dff700 1 -- 172.21.15.37:0/3919192579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fafd404ea60 con 0x7fafbc003bc0 2023-07-12T02:04:55.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.766+0000 7fafc2ffd700 1 -- 172.21.15.37:0/3919192579 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fafc4058c50 con 0x7fafbc003bc0 2023-07-12T02:04:55.770 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.768+0000 7fafd8dff700 1 -- 172.21.15.37:0/3919192579 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fafb406ace0 msgr2=0x7fafb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.768+0000 7fafd8dff700 1 --2- 172.21.15.37:0/3919192579 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fafb406ace0 0x7fafb406d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fafc80017a0 tx=0x7fafc8001110 comp rx=0 tx=0).stop 2023-07-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.768+0000 7fafd8dff700 1 -- 172.21.15.37:0/3919192579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc003bc0 msgr2=0x7fafd40cc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.768+0000 7fafd8dff700 1 --2- 172.21.15.37:0/3919192579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc003bc0 0x7fafd40cc4b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fafc400c3c0 tx=0x7fafc40012d0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.768+0000 7fafd8dff700 1 -- 172.21.15.37:0/3919192579 shutdown_connections 2023-07-12T02:04:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.768+0000 7fafd8dff700 1 --2- 172.21.15.37:0/3919192579 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fafb406ace0 0x7fafb406d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.768+0000 7fafd8dff700 1 --2- 172.21.15.37:0/3919192579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc003bc0 0x7fafd40cc4b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.768+0000 7fafd8dff700 1 --2- 172.21.15.37:0/3919192579 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafd4154280 0x7fafd40b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.768+0000 7fafd8dff700 1 --2- 172.21.15.37:0/3919192579 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafd4153e10 0x7fafd40b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.768+0000 7fafd8dff700 1 -- 172.21.15.37:0/3919192579 >> 172.21.15.37:0/3919192579 conn(0x7fafd406b3f0 msgr2=0x7fafd415fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.768+0000 7fafd8dff700 1 -- 172.21.15.37:0/3919192579 shutdown_connections 2023-07-12T02:04:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.769+0000 7fafd8dff700 1 -- 172.21.15.37:0/3919192579 wait complete. 2023-07-12T02:04:55.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:04:55.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.990+0000 7f85615ff700 1 Processor -- start 2023-07-12T02:04:55.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.991+0000 7f85615ff700 1 -- start start 2023-07-12T02:04:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.992+0000 7f85615ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f855c0b8430 0x7f855c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.992+0000 7f85615ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f855c0cfc60 0x7f855c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.992+0000 7f85615ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855c0d0b20 con 0x7f855c0d3730 2023-07-12T02:04:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.992+0000 7f85615ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855c0b8800 con 0x7f855c0cfc60 2023-07-12T02:04:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.992+0000 7f85615ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855c0b4ee0 con 0x7f855c0b8430 2023-07-12T02:04:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.992+0000 7f855b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f855c0cfc60 0x7f855c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:55.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.992+0000 7f855b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f855c0cfc60 0x7f855c0d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57544/0 (socket says 172.21.15.37:57544) 2023-07-12T02:04:55.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.992+0000 7f8553fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f855c0d3730 0x7f855c0cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52700/0 (socket says 172.21.15.37:52700) 2023-07-12T02:04:55.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.992+0000 7f855b7fe700 1 -- 172.21.15.37:0/2291470588 learned_addr learned my addr 172.21.15.37:0/2291470588 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:55.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.992+0000 7f855affd700 1 --2- 172.21.15.37:0/2291470588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f855c0b8430 0x7f855c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.993+0000 7f855b7fe700 1 -- 172.21.15.37:0/2291470588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f855c0b8430 msgr2=0x7f855c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.993+0000 7f855b7fe700 1 --2- 172.21.15.37:0/2291470588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f855c0b8430 0x7f855c0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.993+0000 7f855b7fe700 1 -- 172.21.15.37:0/2291470588 >> v1:172.21.15.37:6789/0 conn(0x7f855c0d3730 legacy=0x7f855c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.993+0000 7f855b7fe700 1 -- 172.21.15.37:0/2291470588 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c0b51c0 con 0x7f855c0cfc60 2023-07-12T02:04:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.993+0000 7f855b7fe700 1 --2- 172.21.15.37:0/2291470588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0cfc60 0x7f855c0d0fb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8554009e50 tx=0x7f855400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323f1b2e51275dc8 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.993+0000 7f855a7fc700 1 -- 172.21.15.37:0/2291470588 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855400e070 con 0x7f855c0cfc60 2023-07-12T02:04:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.993+0000 7f855a7fc700 1 -- 172.21.15.37:0/2291470588 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855400b910 con 0x7f855c0cfc60 2023-07-12T02:04:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.993+0000 7f855a7fc700 1 -- 172.21.15.37:0/2291470588 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855400bcc0 con 0x7f855c0cfc60 2023-07-12T02:04:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.994+0000 7f85615ff700 1 -- 172.21.15.37:0/2291470588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0cfc60 msgr2=0x7f855c0d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.994+0000 7f85615ff700 1 --2- 172.21.15.37:0/2291470588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0cfc60 0x7f855c0d0fb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8554009e50 tx=0x7f855400b330 comp rx=0 tx=0).stop 2023-07-12T02:04:56.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.994+0000 7f85615ff700 1 -- 172.21.15.37:0/2291470588 shutdown_connections 2023-07-12T02:04:56.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.994+0000 7f85615ff700 1 --2- 172.21.15.37:0/2291470588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0cfc60 0x7f855c0d0fb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.994+0000 7f85615ff700 1 --2- 172.21.15.37:0/2291470588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f855c0b8430 0x7f855c0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.994+0000 7f85615ff700 1 -- 172.21.15.37:0/2291470588 >> 172.21.15.37:0/2291470588 conn(0x7f855c06b3f0 msgr2=0x7f855c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:56.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.994+0000 7f85615ff700 1 -- 172.21.15.37:0/2291470588 shutdown_connections 2023-07-12T02:04:56.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.994+0000 7f85615ff700 1 -- 172.21.15.37:0/2291470588 wait complete. 2023-07-12T02:04:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.996+0000 7f85615ff700 1 Processor -- start 2023-07-12T02:04:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.996+0000 7f85615ff700 1 -- start start 2023-07-12T02:04:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f85615ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f855c0b8430 0x7f855c0c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f85615ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0cfc60 0x7f855c0c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f85615ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f855c0d3730 0x7f855c15bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f85615ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c15ddf0 con 0x7f855c0cfc60 2023-07-12T02:04:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f85615ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c0c8330 con 0x7f855c0d3730 2023-07-12T02:04:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f85615ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855c0c8610 con 0x7f855c0b8430 2023-07-12T02:04:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f8553fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0cfc60 0x7f855c0c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f8553fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0cfc60 0x7f855c0c70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57554/0 (socket says 172.21.15.37:57554) 2023-07-12T02:04:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f8553fff700 1 -- 172.21.15.37:0/3461963558 learned_addr learned my addr 172.21.15.37:0/3461963558 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f855affd700 1 --2- 172.21.15.37:0/3461963558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f855c0b8430 0x7f855c0c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f855b7fe700 1 --2- 172.21.15.37:0/3461963558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f855c0d3730 0x7f855c15bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f8553fff700 1 -- 172.21.15.37:0/3461963558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f855c0b8430 msgr2=0x7f855c0c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f8553fff700 1 --2- 172.21.15.37:0/3461963558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f855c0b8430 0x7f855c0c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f8553fff700 1 -- 172.21.15.37:0/3461963558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f855c0d3730 msgr2=0x7f855c15bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f8553fff700 1 --2- 172.21.15.37:0/3461963558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f855c0d3730 0x7f855c15bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f8553fff700 1 -- 172.21.15.37:0/3461963558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8554009b30 con 0x7f855c0cfc60 2023-07-12T02:04:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.997+0000 7f855b7fe700 1 --2- 172.21.15.37:0/3461963558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f855c0d3730 0x7f855c15bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.998+0000 7f8553fff700 1 --2- 172.21.15.37:0/3461963558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0cfc60 0x7f855c0c70a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f854400c500 tx=0x7f854400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.998+0000 7f85537fe700 1 -- 172.21.15.37:0/3461963558 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8544005cb0 con 0x7f855c0cfc60 2023-07-12T02:04:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.998+0000 7f85537fe700 1 -- 172.21.15.37:0/3461963558 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8544005e10 con 0x7f855c0cfc60 2023-07-12T02:04:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.998+0000 7f85537fe700 1 -- 172.21.15.37:0/3461963558 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85440072d0 con 0x7f855c0cfc60 2023-07-12T02:04:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.998+0000 7f85615ff700 1 -- 172.21.15.37:0/3461963558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c0c88f0 con 0x7f855c0cfc60 2023-07-12T02:04:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.998+0000 7f85615ff700 1 -- 172.21.15.37:0/3461963558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c0c75e0 con 0x7f855c0cfc60 2023-07-12T02:04:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:55.999+0000 7f85615ff700 1 -- 172.21.15.37:0/3461963558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855c15d8e0 con 0x7f855c0cfc60 2023-07-12T02:04:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.000+0000 7f85537fe700 1 -- 172.21.15.37:0/3461963558 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8544007430 con 0x7f855c0cfc60 2023-07-12T02:04:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.001+0000 7f85537fe700 1 --2- 172.21.15.37:0/3461963558 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f853c06ace0 0x7f853c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:56.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.001+0000 7f85537fe700 1 -- 172.21.15.37:0/3461963558 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8544088ba0 con 0x7f855c0cfc60 2023-07-12T02:04:56.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.001+0000 7f855affd700 1 --2- 172.21.15.37:0/3461963558 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f853c06ace0 0x7f853c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:56.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.002+0000 7f855affd700 1 --2- 172.21.15.37:0/3461963558 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f853c06ace0 0x7f853c06d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f854c009b70 tx=0x7f854c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:56.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.005+0000 7f85537fe700 1 -- 172.21.15.37:0/3461963558 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f855c15d8e0 con 0x7f855c0cfc60 2023-07-12T02:04:56.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.212+0000 7f85615ff700 1 -- 172.21.15.37:0/3461963558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f855c15d8e0 con 0x7f855c0cfc60 2023-07-12T02:04:56.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.212+0000 7f85537fe700 1 -- 172.21.15.37:0/3461963558 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f855c15d8e0 con 0x7f855c0cfc60 2023-07-12T02:04:56.216 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:04:56.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.215+0000 7f85615ff700 1 -- 172.21.15.37:0/3461963558 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f853c06ace0 msgr2=0x7f853c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:56.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.215+0000 7f85615ff700 1 --2- 172.21.15.37:0/3461963558 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f853c06ace0 0x7f853c06d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f854c009b70 tx=0x7f854c008040 comp rx=0 tx=0).stop 2023-07-12T02:04:56.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.215+0000 7f85615ff700 1 -- 172.21.15.37:0/3461963558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0cfc60 msgr2=0x7f855c0c70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:56.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.215+0000 7f85615ff700 1 --2- 172.21.15.37:0/3461963558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0cfc60 0x7f855c0c70a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f854400c500 tx=0x7f854400c8c0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.215+0000 7f85615ff700 1 -- 172.21.15.37:0/3461963558 shutdown_connections 2023-07-12T02:04:56.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.215+0000 7f85615ff700 1 --2- 172.21.15.37:0/3461963558 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f853c06ace0 0x7f853c06d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.215+0000 7f85615ff700 1 --2- 172.21.15.37:0/3461963558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f855c0d3730 0x7f855c15bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.215+0000 7f85615ff700 1 --2- 172.21.15.37:0/3461963558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f855c0b8430 0x7f855c0c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.215+0000 7f85615ff700 1 --2- 172.21.15.37:0/3461963558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0cfc60 0x7f855c0c70a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.215+0000 7f85615ff700 1 -- 172.21.15.37:0/3461963558 >> 172.21.15.37:0/3461963558 conn(0x7f855c06b3f0 msgr2=0x7f855c0b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:56.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.215+0000 7f85615ff700 1 -- 172.21.15.37:0/3461963558 shutdown_connections 2023-07-12T02:04:56.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.215+0000 7f85615ff700 1 -- 172.21.15.37:0/3461963558 wait complete. 2023-07-12T02:04:56.236 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:04:56.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.436+0000 7fb7b17ff700 1 Processor -- start 2023-07-12T02:04:56.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.436+0000 7fb7b17ff700 1 -- start start 2023-07-12T02:04:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.438+0000 7fb7b17ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb7ac0b8430 0x7fb7ac0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.438+0000 7fb7b17ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7ac0cfc60 0x7fb7ac0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.438+0000 7fb7b17ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ac0d0b20 con 0x7fb7ac0d3730 2023-07-12T02:04:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.438+0000 7fb7b17ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ac0b8800 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.438+0000 7fb7b17ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ac0b4ee0 con 0x7fb7ac0b8430 2023-07-12T02:04:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.438+0000 7fb7a3fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb7ac0d3730 0x7fb7ac0cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52710/0 (socket says 172.21.15.37:52710) 2023-07-12T02:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.438+0000 7fb7a3fff700 1 -- 172.21.15.37:0/1615270638 learned_addr learned my addr 172.21.15.37:0/1615270638 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.438+0000 7fb7ab7fe700 1 --2- 172.21.15.37:0/1615270638 >> v2:172.21.15.37:3300/0 conn(0x7fb7ac0cfc60 0x7fb7ac0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.438+0000 7fb7aaffd700 1 --2- 172.21.15.37:0/1615270638 >> v2:172.21.15.196:3300/0 conn(0x7fb7ac0b8430 0x7fb7ac0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.439+0000 7fb7ab7fe700 1 -- 172.21.15.37:0/1615270638 >> v2:172.21.15.196:3300/0 conn(0x7fb7ac0b8430 msgr2=0x7fb7ac0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.439+0000 7fb7ab7fe700 1 --2- 172.21.15.37:0/1615270638 >> v2:172.21.15.196:3300/0 conn(0x7fb7ac0b8430 0x7fb7ac0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.438+0000 7fb7aa7fc700 1 -- 172.21.15.37:0/1615270638 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447039983 0 0) 0x7fb7ac0d0b20 con 0x7fb7ac0d3730 2023-07-12T02:04:56.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.439+0000 7fb7ab7fe700 1 -- 172.21.15.37:0/1615270638 >> v1:172.21.15.37:6789/0 conn(0x7fb7ac0d3730 legacy=0x7fb7ac0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:56.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.439+0000 7fb7ab7fe700 1 -- 172.21.15.37:0/1615270638 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac0b51c0 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.439+0000 7fb7ab7fe700 1 --2- 172.21.15.37:0/1615270638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ac0cfc60 0x7fb7ac0d0fb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0cf520 tx=0x7fb7a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274766f3e4534a1f server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:56.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.439+0000 7fb7aa7fc700 1 -- 172.21.15.37:0/1615270638 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a400e070 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.439+0000 7fb7aa7fc700 1 -- 172.21.15.37:0/1615270638 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a400bbd0 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.439+0000 7fb7aa7fc700 1 -- 172.21.15.37:0/1615270638 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4012430 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.440+0000 7fb7b17ff700 1 -- 172.21.15.37:0/1615270638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ac0cfc60 msgr2=0x7fb7ac0d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:56.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.440+0000 7fb7b17ff700 1 --2- 172.21.15.37:0/1615270638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ac0cfc60 0x7fb7ac0d0fb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0cf520 tx=0x7fb7a400b330 comp rx=0 tx=0).stop 2023-07-12T02:04:56.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.440+0000 7fb7b17ff700 1 -- 172.21.15.37:0/1615270638 shutdown_connections 2023-07-12T02:04:56.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.440+0000 7fb7b17ff700 1 --2- 172.21.15.37:0/1615270638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ac0cfc60 0x7fb7ac0d0fb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.440+0000 7fb7b17ff700 1 --2- 172.21.15.37:0/1615270638 >> v2:172.21.15.196:3300/0 conn(0x7fb7ac0b8430 0x7fb7ac0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.440+0000 7fb7b17ff700 1 -- 172.21.15.37:0/1615270638 >> 172.21.15.37:0/1615270638 conn(0x7fb7ac06b3f0 msgr2=0x7fb7ac06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:56.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.440+0000 7fb7b17ff700 1 -- 172.21.15.37:0/1615270638 shutdown_connections 2023-07-12T02:04:56.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.440+0000 7fb7b17ff700 1 -- 172.21.15.37:0/1615270638 wait complete. 2023-07-12T02:04:56.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.441+0000 7fb7b17ff700 1 Processor -- start 2023-07-12T02:04:56.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.442+0000 7fb7b17ff700 1 -- start start 2023-07-12T02:04:56.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7b17ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7ac0b8430 0x7fb7ac0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:56.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7b17ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ac0cfc60 0x7fb7ac15d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:56.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7b17ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7ac0d3730 0x7fb7ac15dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:56.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7b17ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac15e6d0 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7b17ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac15cc10 con 0x7fb7ac0b8430 2023-07-12T02:04:56.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7b17ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac15e3f0 con 0x7fb7ac0d3730 2023-07-12T02:04:56.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7a3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ac0cfc60 0x7fb7ac15d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:56.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7a3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ac0cfc60 0x7fb7ac15d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57572/0 (socket says 172.21.15.37:57572) 2023-07-12T02:04:56.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7a3fff700 1 -- 172.21.15.37:0/1125468375 learned_addr learned my addr 172.21.15.37:0/1125468375 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:56.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7aaffd700 1 --2- 172.21.15.37:0/1125468375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7ac0b8430 0x7fb7ac0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:56.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7ab7fe700 1 --2- 172.21.15.37:0/1125468375 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7ac0d3730 0x7fb7ac15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:56.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7a3fff700 1 -- 172.21.15.37:0/1125468375 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7ac0d3730 msgr2=0x7fb7ac15dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:56.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7a3fff700 1 --2- 172.21.15.37:0/1125468375 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7ac0d3730 0x7fb7ac15dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7a3fff700 1 -- 172.21.15.37:0/1125468375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7ac0b8430 msgr2=0x7fb7ac0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:56.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7a3fff700 1 --2- 172.21.15.37:0/1125468375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7ac0b8430 0x7fb7ac0c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7a3fff700 1 -- 172.21.15.37:0/1125468375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a4009a70 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7aaffd700 1 --2- 172.21.15.37:0/1125468375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7ac0b8430 0x7fb7ac0c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:56.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.443+0000 7fb7ab7fe700 1 --2- 172.21.15.37:0/1125468375 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7ac0d3730 0x7fb7ac15dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:56.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.444+0000 7fb7a3fff700 1 --2- 172.21.15.37:0/1125468375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ac0cfc60 0x7fb7ac15d7b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb79400c550 tx=0x7fb79400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:56.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.444+0000 7fb7a37fe700 1 -- 172.21.15.37:0/1125468375 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb794004c80 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.444+0000 7fb7a37fe700 1 -- 172.21.15.37:0/1125468375 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb794004e00 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.444+0000 7fb7a37fe700 1 -- 172.21.15.37:0/1125468375 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb794007310 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.444+0000 7fb7b17ff700 1 -- 172.21.15.37:0/1125468375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7ac0c6810 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.444+0000 7fb7b17ff700 1 -- 172.21.15.37:0/1125468375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ac0c6dd0 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.445+0000 7fb7b17ff700 1 -- 172.21.15.37:0/1125468375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ac0c6670 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.446+0000 7fb7a37fe700 1 -- 172.21.15.37:0/1125468375 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb794007470 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.447+0000 7fb7a37fe700 1 --2- 172.21.15.37:0/1125468375 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb78c06ace0 0x7fb78c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:56.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.448+0000 7fb7a37fe700 1 -- 172.21.15.37:0/1125468375 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb794089490 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.448+0000 7fb7aaffd700 1 --2- 172.21.15.37:0/1125468375 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb78c06ace0 0x7fb78c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:56.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.449+0000 7fb7aaffd700 1 --2- 172.21.15.37:0/1125468375 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb78c06ace0 0x7fb78c06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb79c009a00 tx=0x7fb79c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:56.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.452+0000 7fb7a37fe700 1 -- 172.21.15.37:0/1125468375 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb7ac0c6670 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.658+0000 7fb7b17ff700 1 -- 172.21.15.37:0/1125468375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7ac0c6670 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.658+0000 7fb7a37fe700 1 -- 172.21.15.37:0/1125468375 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb7ac0c6670 con 0x7fb7ac0cfc60 2023-07-12T02:04:56.662 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:04:56.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.660+0000 7fb7b17ff700 1 -- 172.21.15.37:0/1125468375 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb78c06ace0 msgr2=0x7fb78c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:56.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.660+0000 7fb7b17ff700 1 --2- 172.21.15.37:0/1125468375 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb78c06ace0 0x7fb78c06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb79c009a00 tx=0x7fb79c008040 comp rx=0 tx=0).stop 2023-07-12T02:04:56.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.660+0000 7fb7b17ff700 1 -- 172.21.15.37:0/1125468375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ac0cfc60 msgr2=0x7fb7ac15d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:56.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.660+0000 7fb7b17ff700 1 --2- 172.21.15.37:0/1125468375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ac0cfc60 0x7fb7ac15d7b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb79400c550 tx=0x7fb79400c910 comp rx=0 tx=0).stop 2023-07-12T02:04:56.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.661+0000 7fb7b17ff700 1 -- 172.21.15.37:0/1125468375 shutdown_connections 2023-07-12T02:04:56.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.661+0000 7fb7b17ff700 1 --2- 172.21.15.37:0/1125468375 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb78c06ace0 0x7fb78c06d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.661+0000 7fb7b17ff700 1 --2- 172.21.15.37:0/1125468375 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7ac0d3730 0x7fb7ac15dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.661+0000 7fb7b17ff700 1 --2- 172.21.15.37:0/1125468375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7ac0b8430 0x7fb7ac0c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.661+0000 7fb7b17ff700 1 --2- 172.21.15.37:0/1125468375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ac0cfc60 0x7fb7ac15d7b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.661+0000 7fb7b17ff700 1 -- 172.21.15.37:0/1125468375 >> 172.21.15.37:0/1125468375 conn(0x7fb7ac06b3f0 msgr2=0x7fb7ac0b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:56.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.661+0000 7fb7b17ff700 1 -- 172.21.15.37:0/1125468375 shutdown_connections 2023-07-12T02:04:56.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.661+0000 7fb7b17ff700 1 -- 172.21.15.37:0/1125468375 wait complete. 2023-07-12T02:04:56.682 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:04:56.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.881+0000 7f4967bff700 1 Processor -- start 2023-07-12T02:04:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.881+0000 7f4967bff700 1 -- start start 2023-07-12T02:04:56.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.882+0000 7f4967bff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f49600b8430 0x7f49600cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:56.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.882+0000 7f4967bff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49600cfc60 0x7f49600d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:56.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.882+0000 7f4967bff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49600d0b20 con 0x7f49600d3730 2023-07-12T02:04:56.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.882+0000 7f4967bff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49600b8800 con 0x7f49600b8430 2023-07-12T02:04:56.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.882+0000 7f4967bff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49600b4ee0 con 0x7f49600cfc60 2023-07-12T02:04:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.883+0000 7f496599b700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f49600b8430 0x7f49600cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.883+0000 7f496619c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49600cfc60 0x7f49600d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.883+0000 7f496519a700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f49600d3730 0x7f49600cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:43122/0 (socket says 172.21.15.37:43122) 2023-07-12T02:04:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.883+0000 7f496519a700 1 -- 172.21.15.37:0/3910591435 learned_addr learned my addr 172.21.15.37:0/3910591435 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.883+0000 7f496619c700 1 -- 172.21.15.37:0/3910591435 >> v2:172.21.15.196:3300/0 conn(0x7f49600b8430 msgr2=0x7f49600cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.883+0000 7f496619c700 1 --2- 172.21.15.37:0/3910591435 >> v2:172.21.15.196:3300/0 conn(0x7f49600b8430 0x7f49600cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.883+0000 7f496619c700 1 -- 172.21.15.37:0/3910591435 >> v1:172.21.15.196:6789/0 conn(0x7f49600d3730 legacy=0x7f49600cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.883+0000 7f496619c700 1 -- 172.21.15.37:0/3910591435 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49600b51c0 con 0x7f49600cfc60 2023-07-12T02:04:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.883+0000 7f4964999700 1 -- 172.21.15.37:0/3910591435 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460841274 0 0) 0x7f49600d0b20 con 0x7f49600d3730 2023-07-12T02:04:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.884+0000 7f496619c700 1 --2- 172.21.15.37:0/3910591435 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49600cfc60 0x7f49600d0fb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4958009d90 tx=0x7f495800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99881b1787374452 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.884+0000 7f4964999700 1 -- 172.21.15.37:0/3910591435 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495800e070 con 0x7f49600cfc60 2023-07-12T02:04:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.884+0000 7f4964999700 1 -- 172.21.15.37:0/3910591435 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495800bb20 con 0x7f49600cfc60 2023-07-12T02:04:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.884+0000 7f4964999700 1 -- 172.21.15.37:0/3910591435 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958012430 con 0x7f49600cfc60 2023-07-12T02:04:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.884+0000 7f4967bff700 1 -- 172.21.15.37:0/3910591435 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49600cfc60 msgr2=0x7f49600d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.884+0000 7f4967bff700 1 --2- 172.21.15.37:0/3910591435 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49600cfc60 0x7f49600d0fb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4958009d90 tx=0x7f495800b330 comp rx=0 tx=0).stop 2023-07-12T02:04:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.885+0000 7f4967bff700 1 -- 172.21.15.37:0/3910591435 shutdown_connections 2023-07-12T02:04:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.885+0000 7f4967bff700 1 --2- 172.21.15.37:0/3910591435 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49600cfc60 0x7f49600d0fb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.885+0000 7f4967bff700 1 --2- 172.21.15.37:0/3910591435 >> v2:172.21.15.196:3300/0 conn(0x7f49600b8430 0x7f49600cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.885+0000 7f4967bff700 1 -- 172.21.15.37:0/3910591435 >> 172.21.15.37:0/3910591435 conn(0x7f496006b3f0 msgr2=0x7f496006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.885+0000 7f4967bff700 1 -- 172.21.15.37:0/3910591435 shutdown_connections 2023-07-12T02:04:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.885+0000 7f4967bff700 1 -- 172.21.15.37:0/3910591435 wait complete. 2023-07-12T02:04:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.886+0000 7f4967bff700 1 Processor -- start 2023-07-12T02:04:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.887+0000 7f4967bff700 1 -- start start 2023-07-12T02:04:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.887+0000 7f4967bff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49600b8430 0x7f4960154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.887+0000 7f4967bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49600cfc60 0x7f49600cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.887+0000 7f4967bff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49600d3730 0x7f49601f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.887+0000 7f4967bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49601f1a40 con 0x7f49600cfc60 2023-07-12T02:04:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.887+0000 7f4967bff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49600cbe20 con 0x7f49600b8430 2023-07-12T02:04:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.887+0000 7f4967bff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496015c9c0 con 0x7f49600d3730 2023-07-12T02:04:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.888+0000 7f496519a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49600cfc60 0x7f49600cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.888+0000 7f496519a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49600cfc60 0x7f49600cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57586/0 (socket says 172.21.15.37:57586) 2023-07-12T02:04:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.888+0000 7f496519a700 1 -- 172.21.15.37:0/368228519 learned_addr learned my addr 172.21.15.37:0/368228519 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.888+0000 7f496619c700 1 --2- 172.21.15.37:0/368228519 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49600d3730 0x7f49601f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.888+0000 7f496599b700 1 --2- 172.21.15.37:0/368228519 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49600b8430 0x7f4960154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.888+0000 7f496519a700 1 -- 172.21.15.37:0/368228519 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49600d3730 msgr2=0x7f49601f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.888+0000 7f496519a700 1 --2- 172.21.15.37:0/368228519 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49600d3730 0x7f49601f5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.888+0000 7f496519a700 1 -- 172.21.15.37:0/368228519 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49600b8430 msgr2=0x7f4960154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.888+0000 7f496519a700 1 --2- 172.21.15.37:0/368228519 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49600b8430 0x7f4960154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.888+0000 7f496519a700 1 -- 172.21.15.37:0/368228519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4958009a70 con 0x7f49600cfc60 2023-07-12T02:04:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.888+0000 7f496519a700 1 --2- 172.21.15.37:0/368228519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49600cfc60 0x7f49600cb8e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f49500011e0 tx=0x7f495000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.889+0000 7f49567fc700 1 -- 172.21.15.37:0/368228519 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4950004c80 con 0x7f49600cfc60 2023-07-12T02:04:56.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.889+0000 7f49567fc700 1 -- 172.21.15.37:0/368228519 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4950004e00 con 0x7f49600cfc60 2023-07-12T02:04:56.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.889+0000 7f4967bff700 1 -- 172.21.15.37:0/368228519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496015cca0 con 0x7f49600cfc60 2023-07-12T02:04:56.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.889+0000 7f49567fc700 1 -- 172.21.15.37:0/368228519 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4950007310 con 0x7f49600cfc60 2023-07-12T02:04:56.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.889+0000 7f4967bff700 1 -- 172.21.15.37:0/368228519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496015d260 con 0x7f49600cfc60 2023-07-12T02:04:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.890+0000 7f4967bff700 1 -- 172.21.15.37:0/368228519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496004ea60 con 0x7f49600cfc60 2023-07-12T02:04:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.891+0000 7f49567fc700 1 -- 172.21.15.37:0/368228519 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4950007470 con 0x7f49600cfc60 2023-07-12T02:04:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.893+0000 7f49567fc700 1 --2- 172.21.15.37:0/368228519 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f494406ace0 0x7f494406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.893+0000 7f49567fc700 1 -- 172.21.15.37:0/368228519 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f49500893f0 con 0x7f49600cfc60 2023-07-12T02:04:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.893+0000 7f496599b700 1 --2- 172.21.15.37:0/368228519 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f494406ace0 0x7f494406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:56.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.894+0000 7f496599b700 1 --2- 172.21.15.37:0/368228519 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f494406ace0 0x7f494406d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f495c009b40 tx=0x7f495c009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:56.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:56.897+0000 7f49567fc700 1 -- 172.21.15.37:0/368228519 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f4950054160 con 0x7f49600cfc60 2023-07-12T02:04:57.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.104+0000 7f4967bff700 1 -- 172.21.15.37:0/368228519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49600cc030 con 0x7f49600cfc60 2023-07-12T02:04:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.105+0000 7f49567fc700 1 -- 172.21.15.37:0/368228519 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4950057780 con 0x7f49600cfc60 2023-07-12T02:04:57.108 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-12T02:04:57.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.107+0000 7f4967bff700 1 -- 172.21.15.37:0/368228519 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f494406ace0 msgr2=0x7f494406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:57.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.107+0000 7f4967bff700 1 --2- 172.21.15.37:0/368228519 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f494406ace0 0x7f494406d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f495c009b40 tx=0x7f495c009210 comp rx=0 tx=0).stop 2023-07-12T02:04:57.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.107+0000 7f4967bff700 1 -- 172.21.15.37:0/368228519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49600cfc60 msgr2=0x7f49600cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:57.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.107+0000 7f4967bff700 1 --2- 172.21.15.37:0/368228519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49600cfc60 0x7f49600cb8e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f49500011e0 tx=0x7f495000ca30 comp rx=0 tx=0).stop 2023-07-12T02:04:57.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.107+0000 7f4967bff700 1 -- 172.21.15.37:0/368228519 shutdown_connections 2023-07-12T02:04:57.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.107+0000 7f4967bff700 1 --2- 172.21.15.37:0/368228519 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f494406ace0 0x7f494406d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.107+0000 7f4967bff700 1 --2- 172.21.15.37:0/368228519 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49600d3730 0x7f49601f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.107+0000 7f4967bff700 1 --2- 172.21.15.37:0/368228519 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49600b8430 0x7f4960154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.107+0000 7f4967bff700 1 --2- 172.21.15.37:0/368228519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49600cfc60 0x7f49600cb8e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.107+0000 7f4967bff700 1 -- 172.21.15.37:0/368228519 >> 172.21.15.37:0/368228519 conn(0x7f496006b3f0 msgr2=0x7f496015fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:57.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.107+0000 7f4967bff700 1 -- 172.21.15.37:0/368228519 shutdown_connections 2023-07-12T02:04:57.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.107+0000 7f4967bff700 1 -- 172.21.15.37:0/368228519 wait complete. 2023-07-12T02:04:57.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-12T02:04:57.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.331+0000 7f5a4c7ff700 1 Processor -- start 2023-07-12T02:04:57.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.331+0000 7f5a4c7ff700 1 -- start start 2023-07-12T02:04:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.332+0000 7f5a4c7ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5a440d3730 0x7f5a440cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.332+0000 7f5a4c7ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a440cfa90 0x7f5a440d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.332+0000 7f5a4c7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a440d0b20 con 0x7f5a440b8430 2023-07-12T02:04:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.332+0000 7f5a4c7ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a440cda30 con 0x7f5a440cfa90 2023-07-12T02:04:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.332+0000 7f5a4c7ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a440b8800 con 0x7f5a440d3730 2023-07-12T02:04:57.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.332+0000 7f5a4a59b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5a440b8430 0x7f5a440cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52720/0 (socket says 172.21.15.37:52720) 2023-07-12T02:04:57.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.332+0000 7f5a4a59b700 1 -- 172.21.15.37:0/4275587624 learned_addr learned my addr 172.21.15.37:0/4275587624 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:57.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.332+0000 7f5a4ad9c700 1 --2- 172.21.15.37:0/4275587624 >> v2:172.21.15.37:3300/0 conn(0x7f5a440cfa90 0x7f5a440d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:57.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.333+0000 7f5a49d9a700 1 --2- 172.21.15.37:0/4275587624 >> v2:172.21.15.196:3300/0 conn(0x7f5a440d3730 0x7f5a440cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:57.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.333+0000 7f5a4ad9c700 1 -- 172.21.15.37:0/4275587624 >> v2:172.21.15.196:3300/0 conn(0x7f5a440d3730 msgr2=0x7f5a440cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:57.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.333+0000 7f5a49599700 1 -- 172.21.15.37:0/4275587624 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728151992 0 0) 0x7f5a440d0b20 con 0x7f5a440b8430 2023-07-12T02:04:57.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.333+0000 7f5a4ad9c700 1 --2- 172.21.15.37:0/4275587624 >> v2:172.21.15.196:3300/0 conn(0x7f5a440d3730 0x7f5a440cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.333+0000 7f5a4ad9c700 1 -- 172.21.15.37:0/4275587624 >> v1:172.21.15.37:6789/0 conn(0x7f5a440b8430 legacy=0x7f5a440cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:57.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.333+0000 7f5a4ad9c700 1 -- 172.21.15.37:0/4275587624 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a440cfe90 con 0x7f5a440cfa90 2023-07-12T02:04:57.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.333+0000 7f5a4ad9c700 1 --2- 172.21.15.37:0/4275587624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a440cfa90 0x7f5a440d0fb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5a44160f50 tx=0x7f5a3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481ca95902f2cf4b server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:57.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.333+0000 7f5a49599700 1 -- 172.21.15.37:0/4275587624 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c00e070 con 0x7f5a440cfa90 2023-07-12T02:04:57.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.333+0000 7f5a49599700 1 -- 172.21.15.37:0/4275587624 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c00bbd0 con 0x7f5a440cfa90 2023-07-12T02:04:57.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.333+0000 7f5a49599700 1 -- 172.21.15.37:0/4275587624 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c012430 con 0x7f5a440cfa90 2023-07-12T02:04:57.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.334+0000 7f5a4c7ff700 1 -- 172.21.15.37:0/4275587624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a440cfa90 msgr2=0x7f5a440d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:57.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.334+0000 7f5a4c7ff700 1 --2- 172.21.15.37:0/4275587624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a440cfa90 0x7f5a440d0fb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5a44160f50 tx=0x7f5a3c00b330 comp rx=0 tx=0).stop 2023-07-12T02:04:57.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.334+0000 7f5a4c7ff700 1 -- 172.21.15.37:0/4275587624 shutdown_connections 2023-07-12T02:04:57.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.334+0000 7f5a4c7ff700 1 --2- 172.21.15.37:0/4275587624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a440cfa90 0x7f5a440d0fb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.334+0000 7f5a4c7ff700 1 --2- 172.21.15.37:0/4275587624 >> v2:172.21.15.196:3300/0 conn(0x7f5a440d3730 0x7f5a440cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.334+0000 7f5a4c7ff700 1 -- 172.21.15.37:0/4275587624 >> 172.21.15.37:0/4275587624 conn(0x7f5a4406b3f0 msgr2=0x7f5a4406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:57.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.334+0000 7f5a4c7ff700 1 -- 172.21.15.37:0/4275587624 shutdown_connections 2023-07-12T02:04:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.334+0000 7f5a4c7ff700 1 -- 172.21.15.37:0/4275587624 wait complete. 2023-07-12T02:04:57.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.336+0000 7f5a4c7ff700 1 Processor -- start 2023-07-12T02:04:57.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.337+0000 7f5a4c7ff700 1 -- start start 2023-07-12T02:04:57.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.338+0000 7f5a4c7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a440b8430 0x7f5a4415f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:57.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.338+0000 7f5a4c7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a440cfa90 0x7f5a440c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:57.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.338+0000 7f5a4c7ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a440d3730 0x7f5a440ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:57.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.338+0000 7f5a4c7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4415d350 con 0x7f5a440cfa90 2023-07-12T02:04:57.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.338+0000 7f5a4c7ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4415d630 con 0x7f5a440d3730 2023-07-12T02:04:57.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.338+0000 7f5a4c7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4415d910 con 0x7f5a440b8430 2023-07-12T02:04:57.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.338+0000 7f5a49d9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a440cfa90 0x7f5a440c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:57.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.338+0000 7f5a49d9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a440cfa90 0x7f5a440c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57598/0 (socket says 172.21.15.37:57598) 2023-07-12T02:04:57.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.338+0000 7f5a49d9a700 1 -- 172.21.15.37:0/2540892555 learned_addr learned my addr 172.21.15.37:0/2540892555 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:57.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.339+0000 7f5a4a59b700 1 --2- 172.21.15.37:0/2540892555 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a440b8430 0x7f5a4415f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:57.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.339+0000 7f5a4ad9c700 1 --2- 172.21.15.37:0/2540892555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a440d3730 0x7f5a440ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:57.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.339+0000 7f5a49d9a700 1 -- 172.21.15.37:0/2540892555 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a440b8430 msgr2=0x7f5a4415f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:57.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.339+0000 7f5a49d9a700 1 --2- 172.21.15.37:0/2540892555 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a440b8430 0x7f5a4415f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.339+0000 7f5a49d9a700 1 -- 172.21.15.37:0/2540892555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a440d3730 msgr2=0x7f5a440ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:57.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.339+0000 7f5a49d9a700 1 --2- 172.21.15.37:0/2540892555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a440d3730 0x7f5a440ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.339+0000 7f5a49d9a700 1 -- 172.21.15.37:0/2540892555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c009a70 con 0x7f5a440cfa90 2023-07-12T02:04:57.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.339+0000 7f5a4a59b700 1 --2- 172.21.15.37:0/2540892555 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a440b8430 0x7f5a4415f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:57.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.339+0000 7f5a4ad9c700 1 --2- 172.21.15.37:0/2540892555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a440d3730 0x7f5a440ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:57.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.339+0000 7f5a49d9a700 1 --2- 172.21.15.37:0/2540892555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a440cfa90 0x7f5a440c9c10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400d800 tx=0x7f5a3400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:57.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.339+0000 7f5a3affd700 1 -- 172.21.15.37:0/2540892555 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340125f0 con 0x7f5a440cfa90 2023-07-12T02:04:57.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.339+0000 7f5a3affd700 1 -- 172.21.15.37:0/2540892555 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a34012750 con 0x7f5a440cfa90 2023-07-12T02:04:57.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.339+0000 7f5a3affd700 1 -- 172.21.15.37:0/2540892555 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34012b00 con 0x7f5a440cfa90 2023-07-12T02:04:57.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.339+0000 7f5a4c7ff700 1 -- 172.21.15.37:0/2540892555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a440cad50 con 0x7f5a440cfa90 2023-07-12T02:04:57.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.339+0000 7f5a4c7ff700 1 -- 172.21.15.37:0/2540892555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4415a9a0 con 0x7f5a440cfa90 2023-07-12T02:04:57.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.340+0000 7f5a4c7ff700 1 -- 172.21.15.37:0/2540892555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a440cb0c0 con 0x7f5a440cfa90 2023-07-12T02:04:57.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.341+0000 7f5a3affd700 1 -- 172.21.15.37:0/2540892555 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5a34012c60 con 0x7f5a440cfa90 2023-07-12T02:04:57.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.342+0000 7f5a3affd700 1 --2- 172.21.15.37:0/2540892555 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5a2806ace0 0x7f5a2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:57.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.343+0000 7f5a3affd700 1 -- 172.21.15.37:0/2540892555 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5a34089c10 con 0x7f5a440cfa90 2023-07-12T02:04:57.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.343+0000 7f5a4a59b700 1 --2- 172.21.15.37:0/2540892555 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5a2806ace0 0x7f5a2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:57.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.344+0000 7f5a4a59b700 1 --2- 172.21.15.37:0/2540892555 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5a2806ace0 0x7f5a2806d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5a40000f60 tx=0x7f5a40009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:57.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.347+0000 7f5a3affd700 1 -- 172.21.15.37:0/2540892555 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5a340548f0 con 0x7f5a440cfa90 2023-07-12T02:04:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.557+0000 7f5a4c7ff700 1 -- 172.21.15.37:0/2540892555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5a44066e80 con 0x7f5a440cfa90 2023-07-12T02:04:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.558+0000 7f5a3affd700 1 -- 172.21.15.37:0/2540892555 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5a34057f10 con 0x7f5a440cfa90 2023-07-12T02:04:57.562 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:04:57.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.560+0000 7f5a4c7ff700 1 -- 172.21.15.37:0/2540892555 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5a2806ace0 msgr2=0x7f5a2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:57.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.560+0000 7f5a4c7ff700 1 --2- 172.21.15.37:0/2540892555 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5a2806ace0 0x7f5a2806d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5a40000f60 tx=0x7f5a40009040 comp rx=0 tx=0).stop 2023-07-12T02:04:57.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.560+0000 7f5a4c7ff700 1 -- 172.21.15.37:0/2540892555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a440cfa90 msgr2=0x7f5a440c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:57.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.560+0000 7f5a4c7ff700 1 --2- 172.21.15.37:0/2540892555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a440cfa90 0x7f5a440c9c10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400d800 tx=0x7f5a3400dbc0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.560+0000 7f5a4c7ff700 1 -- 172.21.15.37:0/2540892555 shutdown_connections 2023-07-12T02:04:57.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.560+0000 7f5a4c7ff700 1 --2- 172.21.15.37:0/2540892555 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5a2806ace0 0x7f5a2806d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.560+0000 7f5a4c7ff700 1 --2- 172.21.15.37:0/2540892555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a440d3730 0x7f5a440ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.560+0000 7f5a4c7ff700 1 --2- 172.21.15.37:0/2540892555 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a440b8430 0x7f5a4415f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.560+0000 7f5a4c7ff700 1 --2- 172.21.15.37:0/2540892555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a440cfa90 0x7f5a440c9c10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.560+0000 7f5a4c7ff700 1 -- 172.21.15.37:0/2540892555 >> 172.21.15.37:0/2540892555 conn(0x7f5a4406b3f0 msgr2=0x7f5a440b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:57.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.560+0000 7f5a4c7ff700 1 -- 172.21.15.37:0/2540892555 shutdown_connections 2023-07-12T02:04:57.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.560+0000 7f5a4c7ff700 1 -- 172.21.15.37:0/2540892555 wait complete. 2023-07-12T02:04:57.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:04:57.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.780+0000 7f91c19ff700 1 Processor -- start 2023-07-12T02:04:57.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.780+0000 7f91c19ff700 1 -- start start 2023-07-12T02:04:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.781+0000 7f91c19ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91bc15c460 0x7f91bc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.781+0000 7f91c19ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f91bc0d2640 0x7f91bc0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.781+0000 7f91c19ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91bc0cf720 0x7f91bc0cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.781+0000 7f91c19ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91bc0cedd0 con 0x7f91bc0cf720 2023-07-12T02:04:57.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.781+0000 7f91c19ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91bc0d1790 con 0x7f91bc0d2640 2023-07-12T02:04:57.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.781+0000 7f91c19ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc0cd950 con 0x7f91bc15c460 2023-07-12T02:04:57.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.782+0000 7f91bb7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91bc0cf720 0x7f91bc0cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:57.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.782+0000 7f91bb7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91bc0cf720 0x7f91bc0cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57606/0 (socket says 172.21.15.37:57606) 2023-07-12T02:04:57.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.782+0000 7f91bb7fe700 1 -- 172.21.15.37:0/849661417 learned_addr learned my addr 172.21.15.37:0/849661417 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:57.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.782+0000 7f91baffd700 1 --2- 172.21.15.37:0/849661417 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91bc15c460 0x7f91bc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:57.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.782+0000 7f91b3fff700 1 --2- 172.21.15.37:0/849661417 >> v2:172.21.15.196:3300/0 conn(0x7f91bc0d2640 0x7f91bc0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:57.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.782+0000 7f91bb7fe700 1 -- 172.21.15.37:0/849661417 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91bc15c460 msgr2=0x7f91bc0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:57.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.782+0000 7f91bb7fe700 1 --2- 172.21.15.37:0/849661417 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91bc15c460 0x7f91bc0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.782+0000 7f91bb7fe700 1 -- 172.21.15.37:0/849661417 >> v2:172.21.15.196:3300/0 conn(0x7f91bc0d2640 msgr2=0x7f91bc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:57.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.782+0000 7f91bb7fe700 1 --2- 172.21.15.37:0/849661417 >> v2:172.21.15.196:3300/0 conn(0x7f91bc0d2640 0x7f91bc0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.782+0000 7f91bb7fe700 1 -- 172.21.15.37:0/849661417 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc0d14b0 con 0x7f91bc0cf720 2023-07-12T02:04:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.782+0000 7f91bb7fe700 1 --2- 172.21.15.37:0/849661417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91bc0cf720 0x7f91bc0cfbc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0d3c50 tx=0x7f91b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd10c768bcf9639 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.782+0000 7f91ba7fc700 1 -- 172.21.15.37:0/849661417 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b400e070 con 0x7f91bc0cf720 2023-07-12T02:04:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.783+0000 7f91ba7fc700 1 -- 172.21.15.37:0/849661417 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b400b9c0 con 0x7f91bc0cf720 2023-07-12T02:04:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.783+0000 7f91ba7fc700 1 -- 172.21.15.37:0/849661417 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b400bd70 con 0x7f91bc0cf720 2023-07-12T02:04:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.783+0000 7f91c19ff700 1 -- 172.21.15.37:0/849661417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91bc0cf720 msgr2=0x7f91bc0cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.783+0000 7f91c19ff700 1 --2- 172.21.15.37:0/849661417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91bc0cf720 0x7f91bc0cfbc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0d3c50 tx=0x7f91b400b330 comp rx=0 tx=0).stop 2023-07-12T02:04:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.783+0000 7f91c19ff700 1 -- 172.21.15.37:0/849661417 shutdown_connections 2023-07-12T02:04:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.783+0000 7f91c19ff700 1 --2- 172.21.15.37:0/849661417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91bc0cf720 0x7f91bc0cfbc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.783+0000 7f91c19ff700 1 --2- 172.21.15.37:0/849661417 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91bc15c460 0x7f91bc0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.783+0000 7f91c19ff700 1 --2- 172.21.15.37:0/849661417 >> v2:172.21.15.196:3300/0 conn(0x7f91bc0d2640 0x7f91bc0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.783+0000 7f91c19ff700 1 -- 172.21.15.37:0/849661417 >> 172.21.15.37:0/849661417 conn(0x7f91bc071660 msgr2=0x7f91bc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.783+0000 7f91c19ff700 1 -- 172.21.15.37:0/849661417 shutdown_connections 2023-07-12T02:04:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.783+0000 7f91c19ff700 1 -- 172.21.15.37:0/849661417 wait complete. 2023-07-12T02:04:57.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.785+0000 7f91c19ff700 1 Processor -- start 2023-07-12T02:04:57.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.785+0000 7f91c19ff700 1 -- start start 2023-07-12T02:04:57.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.786+0000 7f91c19ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91bc0cf720 0x7f91bc14df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:57.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.786+0000 7f91c19ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91bc0d2640 0x7f91bc0cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:57.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.786+0000 7f91c19ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91bc15c460 0x7f91bc0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:57.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.786+0000 7f91c19ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc0c9c50 con 0x7f91bc0d2640 2023-07-12T02:04:57.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.786+0000 7f91c19ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc0c9f30 con 0x7f91bc15c460 2023-07-12T02:04:57.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.786+0000 7f91c19ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc15b930 con 0x7f91bc0cf720 2023-07-12T02:04:57.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.786+0000 7f91b3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91bc0d2640 0x7f91bc0cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:57.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.786+0000 7f91b3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91bc0d2640 0x7f91bc0cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57614/0 (socket says 172.21.15.37:57614) 2023-07-12T02:04:57.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.786+0000 7f91b3fff700 1 -- 172.21.15.37:0/2561776761 learned_addr learned my addr 172.21.15.37:0/2561776761 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:57.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.787+0000 7f91bb7fe700 1 --2- 172.21.15.37:0/2561776761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91bc15c460 0x7f91bc0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:57.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.787+0000 7f91baffd700 1 --2- 172.21.15.37:0/2561776761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91bc0cf720 0x7f91bc14df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:57.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.787+0000 7f91b3fff700 1 -- 172.21.15.37:0/2561776761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91bc0cf720 msgr2=0x7f91bc14df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:57.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.787+0000 7f91b3fff700 1 --2- 172.21.15.37:0/2561776761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91bc0cf720 0x7f91bc14df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.787+0000 7f91b3fff700 1 -- 172.21.15.37:0/2561776761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91bc15c460 msgr2=0x7f91bc0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:57.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.787+0000 7f91b3fff700 1 --2- 172.21.15.37:0/2561776761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91bc15c460 0x7f91bc0cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:57.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.787+0000 7f91b3fff700 1 -- 172.21.15.37:0/2561776761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b4009b30 con 0x7f91bc0d2640 2023-07-12T02:04:57.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.787+0000 7f91bb7fe700 1 --2- 172.21.15.37:0/2561776761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91bc15c460 0x7f91bc0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:57.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.787+0000 7f91baffd700 1 --2- 172.21.15.37:0/2561776761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91bc0cf720 0x7f91bc14df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:04:57.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.787+0000 7f91b3fff700 1 --2- 172.21.15.37:0/2561776761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91bc0d2640 0x7f91bc0cc220 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f91a400d830 tx=0x7f91a400dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:57.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.787+0000 7f91b8ff9700 1 -- 172.21.15.37:0/2561776761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40125f0 con 0x7f91bc0d2640 2023-07-12T02:04:57.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.787+0000 7f91b8ff9700 1 -- 172.21.15.37:0/2561776761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a4012750 con 0x7f91bc0d2640 2023-07-12T02:04:57.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.787+0000 7f91c19ff700 1 -- 172.21.15.37:0/2561776761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91bc1e6820 con 0x7f91bc0d2640 2023-07-12T02:04:57.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.787+0000 7f91b8ff9700 1 -- 172.21.15.37:0/2561776761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a4012ae0 con 0x7f91bc0d2640 2023-07-12T02:04:57.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.787+0000 7f91c19ff700 1 -- 172.21.15.37:0/2561776761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91bc1e6de0 con 0x7f91bc0d2640 2023-07-12T02:04:57.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.788+0000 7f91c19ff700 1 -- 172.21.15.37:0/2561776761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91bc15e840 con 0x7f91bc0d2640 2023-07-12T02:04:57.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.789+0000 7f91b8ff9700 1 -- 172.21.15.37:0/2561776761 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f91a4012c40 con 0x7f91bc0d2640 2023-07-12T02:04:57.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.791+0000 7f91b8ff9700 1 --2- 172.21.15.37:0/2561776761 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f919c06ace0 0x7f919c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:57.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.791+0000 7f91b8ff9700 1 -- 172.21.15.37:0/2561776761 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f91a4089b80 con 0x7f91bc0d2640 2023-07-12T02:04:57.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.791+0000 7f91baffd700 1 --2- 172.21.15.37:0/2561776761 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f919c06ace0 0x7f919c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:57.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.792+0000 7f91baffd700 1 --2- 172.21.15.37:0/2561776761 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f919c06ace0 0x7f919c06d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009820 tx=0x7f91ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:57.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.795+0000 7f91b8ff9700 1 -- 172.21.15.37:0/2561776761 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f91a40548f0 con 0x7f91bc0d2640 2023-07-12T02:04:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:57.999+0000 7f91c19ff700 1 -- 172.21.15.37:0/2561776761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91bc0c9a10 con 0x7f91bc0d2640 2023-07-12T02:04:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.000+0000 7f91b8ff9700 1 -- 172.21.15.37:0/2561776761 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20168 (secure 0 0 0) 0x7f91a4057f10 con 0x7f91bc0d2640 2023-07-12T02:04:58.004 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:04:58.004 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:39.032667+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:04:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.002+0000 7f91c19ff700 1 -- 172.21.15.37:0/2561776761 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f919c06ace0 msgr2=0x7f919c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.002+0000 7f91c19ff700 1 --2- 172.21.15.37:0/2561776761 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f919c06ace0 0x7f919c06d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009820 tx=0x7f91ac008040 comp rx=0 tx=0).stop 2023-07-12T02:04:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.002+0000 7f91c19ff700 1 -- 172.21.15.37:0/2561776761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91bc0d2640 msgr2=0x7f91bc0cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.002+0000 7f91c19ff700 1 --2- 172.21.15.37:0/2561776761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91bc0d2640 0x7f91bc0cc220 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f91a400d830 tx=0x7f91a400dbf0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.002+0000 7f91c19ff700 1 -- 172.21.15.37:0/2561776761 shutdown_connections 2023-07-12T02:04:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.002+0000 7f91c19ff700 1 --2- 172.21.15.37:0/2561776761 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f919c06ace0 0x7f919c06d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.002+0000 7f91c19ff700 1 --2- 172.21.15.37:0/2561776761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91bc15c460 0x7f91bc0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.002+0000 7f91c19ff700 1 --2- 172.21.15.37:0/2561776761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91bc0cf720 0x7f91bc14df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.002+0000 7f91c19ff700 1 --2- 172.21.15.37:0/2561776761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91bc0d2640 0x7f91bc0cc220 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.002+0000 7f91c19ff700 1 -- 172.21.15.37:0/2561776761 >> 172.21.15.37:0/2561776761 conn(0x7f91bc071660 msgr2=0x7f91bc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.002+0000 7f91c19ff700 1 -- 172.21.15.37:0/2561776761 shutdown_connections 2023-07-12T02:04:58.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.002+0000 7f91c19ff700 1 -- 172.21.15.37:0/2561776761 wait complete. 2023-07-12T02:04:58.024 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:03:56.039938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:03:56.612707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-12T02:04:00.200885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-12T02:04:58.024 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:04:58.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.230+0000 7f72e3dff700 1 Processor -- start 2023-07-12T02:04:58.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.230+0000 7f72e3dff700 1 -- start start 2023-07-12T02:04:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.231+0000 7f72e3dff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f72dc0b8430 0x7f72dc0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.231+0000 7f72e3dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72dc0d3730 0x7f72dc0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.231+0000 7f72e3dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72dc0cfa90 0x7f72dc15feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.231+0000 7f72e3dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc0b8800 con 0x7f72dc0cfa90 2023-07-12T02:04:58.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.231+0000 7f72e3dff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc0d0b20 con 0x7f72dc0b8430 2023-07-12T02:04:58.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.231+0000 7f72e3dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc0cfeb0 con 0x7f72dc0d3730 2023-07-12T02:04:58.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.232+0000 7f72e239c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72dc0cfa90 0x7f72dc15feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:58.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.232+0000 7f72e239c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72dc0cfa90 0x7f72dc15feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57624/0 (socket says 172.21.15.37:57624) 2023-07-12T02:04:58.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.232+0000 7f72e239c700 1 -- 172.21.15.37:0/2403342903 learned_addr learned my addr 172.21.15.37:0/2403342903 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:58.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.232+0000 7f72e1b9b700 1 --2- 172.21.15.37:0/2403342903 >> v2:172.21.15.196:3300/0 conn(0x7f72dc0b8430 0x7f72dc0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:58.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.232+0000 7f72e139a700 1 --2- 172.21.15.37:0/2403342903 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72dc0d3730 0x7f72dc0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:58.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.232+0000 7f72e239c700 1 -- 172.21.15.37:0/2403342903 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72dc0d3730 msgr2=0x7f72dc0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:58.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.232+0000 7f72e239c700 1 --2- 172.21.15.37:0/2403342903 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72dc0d3730 0x7f72dc0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.232+0000 7f72e239c700 1 -- 172.21.15.37:0/2403342903 >> v2:172.21.15.196:3300/0 conn(0x7f72dc0b8430 msgr2=0x7f72dc0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:58.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.232+0000 7f72e239c700 1 --2- 172.21.15.37:0/2403342903 >> v2:172.21.15.196:3300/0 conn(0x7f72dc0b8430 0x7f72dc0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.232+0000 7f72e239c700 1 -- 172.21.15.37:0/2403342903 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc0b4ee0 con 0x7f72dc0cfa90 2023-07-12T02:04:58.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.232+0000 7f72e239c700 1 --2- 172.21.15.37:0/2403342903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72dc0cfa90 0x7f72dc15feb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0cf520 tx=0x7f72d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f19f4afc5bc4d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:58.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.232+0000 7f72e0b99700 1 -- 172.21.15.37:0/2403342903 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d400e070 con 0x7f72dc0cfa90 2023-07-12T02:04:58.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.233+0000 7f72e0b99700 1 -- 172.21.15.37:0/2403342903 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d400b9c0 con 0x7f72dc0cfa90 2023-07-12T02:04:58.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.233+0000 7f72e0b99700 1 -- 172.21.15.37:0/2403342903 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d400bd70 con 0x7f72dc0cfa90 2023-07-12T02:04:58.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.233+0000 7f72e3dff700 1 -- 172.21.15.37:0/2403342903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72dc0cfa90 msgr2=0x7f72dc15feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:58.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.233+0000 7f72e3dff700 1 --2- 172.21.15.37:0/2403342903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72dc0cfa90 0x7f72dc15feb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0cf520 tx=0x7f72d400b330 comp rx=0 tx=0).stop 2023-07-12T02:04:58.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.233+0000 7f72e3dff700 1 -- 172.21.15.37:0/2403342903 shutdown_connections 2023-07-12T02:04:58.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.233+0000 7f72e3dff700 1 --2- 172.21.15.37:0/2403342903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72dc0cfa90 0x7f72dc15feb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.233+0000 7f72e3dff700 1 --2- 172.21.15.37:0/2403342903 >> v2:172.21.15.196:3300/0 conn(0x7f72dc0b8430 0x7f72dc0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.233+0000 7f72e3dff700 1 --2- 172.21.15.37:0/2403342903 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72dc0d3730 0x7f72dc0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.233+0000 7f72e3dff700 1 -- 172.21.15.37:0/2403342903 >> 172.21.15.37:0/2403342903 conn(0x7f72dc06b3f0 msgr2=0x7f72dc06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:58.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.233+0000 7f72e3dff700 1 -- 172.21.15.37:0/2403342903 shutdown_connections 2023-07-12T02:04:58.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.233+0000 7f72e3dff700 1 -- 172.21.15.37:0/2403342903 wait complete. 2023-07-12T02:04:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.236+0000 7f72e3dff700 1 Processor -- start 2023-07-12T02:04:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.236+0000 7f72e3dff700 1 -- start start 2023-07-12T02:04:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.237+0000 7f72e3dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72dc0b8430 0x7f72dc15cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.237+0000 7f72e3dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72dc0cfa90 0x7f72dc0c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.237+0000 7f72e3dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72dc0d3730 0x7f72dc0c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.237+0000 7f72e3dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc15d010 con 0x7f72dc0cfa90 2023-07-12T02:04:58.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.237+0000 7f72e3dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc0c7320 con 0x7f72dc0d3730 2023-07-12T02:04:58.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.237+0000 7f72e3dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc0c6710 con 0x7f72dc0b8430 2023-07-12T02:04:58.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.237+0000 7f72e139a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72dc0cfa90 0x7f72dc0c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:58.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.238+0000 7f72e239c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72dc0d3730 0x7f72dc0c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:58.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.238+0000 7f72e139a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72dc0cfa90 0x7f72dc0c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57640/0 (socket says 172.21.15.37:57640) 2023-07-12T02:04:58.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.238+0000 7f72e139a700 1 -- 172.21.15.37:0/70500946 learned_addr learned my addr 172.21.15.37:0/70500946 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:58.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.238+0000 7f72e1b9b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72dc0b8430 0x7f72dc15cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.238+0000 7f72e239c700 1 -- 172.21.15.37:0/70500946 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72dc0b8430 msgr2=0x7f72dc15cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.238+0000 7f72e239c700 1 --2- 172.21.15.37:0/70500946 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72dc0b8430 0x7f72dc15cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.238+0000 7f72e239c700 1 -- 172.21.15.37:0/70500946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72dc0cfa90 msgr2=0x7f72dc0c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.238+0000 7f72e239c700 1 --2- 172.21.15.37:0/70500946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72dc0cfa90 0x7f72dc0c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.238+0000 7f72e239c700 1 -- 172.21.15.37:0/70500946 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d4009b30 con 0x7f72dc0d3730 2023-07-12T02:04:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.238+0000 7f72e139a700 1 --2- 172.21.15.37:0/70500946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72dc0cfa90 0x7f72dc0c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:04:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.238+0000 7f72e239c700 1 --2- 172.21.15.37:0/70500946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72dc0d3730 0x7f72dc0c9080 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f72d4015000 tx=0x7f72d4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:58.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.239+0000 7f72d27fc700 1 -- 172.21.15.37:0/70500946 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d40099b0 con 0x7f72dc0d3730 2023-07-12T02:04:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.239+0000 7f72d27fc700 1 -- 172.21.15.37:0/70500946 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d4004250 con 0x7f72dc0d3730 2023-07-12T02:04:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.239+0000 7f72e3dff700 1 -- 172.21.15.37:0/70500946 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72dc0c69f0 con 0x7f72dc0d3730 2023-07-12T02:04:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.239+0000 7f72d27fc700 1 -- 172.21.15.37:0/70500946 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4004600 con 0x7f72dc0d3730 2023-07-12T02:04:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.239+0000 7f72e3dff700 1 -- 172.21.15.37:0/70500946 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72dc0c6fb0 con 0x7f72dc0d3730 2023-07-12T02:04:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.240+0000 7f72e3dff700 1 -- 172.21.15.37:0/70500946 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72dc0c7490 con 0x7f72dc0d3730 2023-07-12T02:04:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.241+0000 7f72d27fc700 1 -- 172.21.15.37:0/70500946 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f72d4004760 con 0x7f72dc0d3730 2023-07-12T02:04:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.242+0000 7f72d27fc700 1 --2- 172.21.15.37:0/70500946 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f72c006ace0 0x7f72c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.242+0000 7f72d27fc700 1 -- 172.21.15.37:0/70500946 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f72d408a840 con 0x7f72dc0d3730 2023-07-12T02:04:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.242+0000 7f72e1b9b700 1 --2- 172.21.15.37:0/70500946 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f72c006ace0 0x7f72c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.243+0000 7f72e1b9b700 1 --2- 172.21.15.37:0/70500946 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f72c006ace0 0x7f72c006d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f72d8006b20 tx=0x7f72d8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:58.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.247+0000 7f72d27fc700 1 -- 172.21.15.37:0/70500946 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f72d40555b0 con 0x7f72dc0d3730 2023-07-12T02:04:58.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.454+0000 7f72e3dff700 1 -- 172.21.15.37:0/70500946 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72dc04ea60 con 0x7f72dc0d3730 2023-07-12T02:04:58.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.454+0000 7f72d27fc700 1 -- 172.21.15.37:0/70500946 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f72d4058bd0 con 0x7f72dc0d3730 2023-07-12T02:04:58.458 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:04:58.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.457+0000 7f72e3dff700 1 -- 172.21.15.37:0/70500946 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f72c006ace0 msgr2=0x7f72c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:58.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.457+0000 7f72e3dff700 1 --2- 172.21.15.37:0/70500946 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f72c006ace0 0x7f72c006d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f72d8006b20 tx=0x7f72d8008040 comp rx=0 tx=0).stop 2023-07-12T02:04:58.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.457+0000 7f72e3dff700 1 -- 172.21.15.37:0/70500946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72dc0d3730 msgr2=0x7f72dc0c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:58.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.457+0000 7f72e3dff700 1 --2- 172.21.15.37:0/70500946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72dc0d3730 0x7f72dc0c9080 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f72d4015000 tx=0x7f72d4004ad0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.457+0000 7f72e3dff700 1 -- 172.21.15.37:0/70500946 shutdown_connections 2023-07-12T02:04:58.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.457+0000 7f72e3dff700 1 --2- 172.21.15.37:0/70500946 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f72c006ace0 0x7f72c006d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.457+0000 7f72e3dff700 1 --2- 172.21.15.37:0/70500946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72dc0d3730 0x7f72dc0c9080 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.457+0000 7f72e3dff700 1 --2- 172.21.15.37:0/70500946 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72dc0b8430 0x7f72dc15cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.457+0000 7f72e3dff700 1 --2- 172.21.15.37:0/70500946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72dc0cfa90 0x7f72dc0c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.457+0000 7f72e3dff700 1 -- 172.21.15.37:0/70500946 >> 172.21.15.37:0/70500946 conn(0x7f72dc06b3f0 msgr2=0x7f72dc0b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:58.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.457+0000 7f72e3dff700 1 -- 172.21.15.37:0/70500946 shutdown_connections 2023-07-12T02:04:58.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.457+0000 7f72e3dff700 1 -- 172.21.15.37:0/70500946 wait complete. 2023-07-12T02:04:58.478 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:04:58.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.679+0000 7f7382dff700 1 Processor -- start 2023-07-12T02:04:58.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.679+0000 7f7382dff700 1 -- start start 2023-07-12T02:04:58.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.680+0000 7f7382dff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f737c0b8430 0x7f737c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:58.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.680+0000 7f7382dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737c0d0b20 con 0x7f737c0d3730 2023-07-12T02:04:58.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.680+0000 7f7382dff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737c0b4ee0 con 0x7f737c0cfc60 2023-07-12T02:04:58.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.680+0000 7f7382dff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737c0b8800 con 0x7f737c0b8430 2023-07-12T02:04:58.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.680+0000 7f737bfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f737c0d3730 0x7f737c0cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52736/0 (socket says 172.21.15.37:52736) 2023-07-12T02:04:58.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.681+0000 7f737bfff700 1 -- 172.21.15.37:0/2902944954 learned_addr learned my addr 172.21.15.37:0/2902944954 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.681+0000 7f7380b9b700 1 --2- 172.21.15.37:0/2902944954 >> v2:172.21.15.196:3300/0 conn(0x7f737c0b8430 0x7f737c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.681+0000 7f737b7fe700 1 -- 172.21.15.37:0/2902944954 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085133374 0 0) 0x7f737c0d0b20 con 0x7f737c0d3730 2023-07-12T02:04:58.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.681+0000 7f737b7fe700 1 -- 172.21.15.37:0/2902944954 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f736c0035b0 con 0x7f737c0d3730 2023-07-12T02:04:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.681+0000 7f737b7fe700 1 -- 172.21.15.37:0/2902944954 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4053563112 0 0) 0x7f736c0035b0 con 0x7f737c0d3730 2023-07-12T02:04:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.681+0000 7f737b7fe700 1 -- 172.21.15.37:0/2902944954 >> v2:172.21.15.196:3300/0 conn(0x7f737c0b8430 msgr2=0x7f737c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.681+0000 7f737b7fe700 1 --2- 172.21.15.37:0/2902944954 >> v2:172.21.15.196:3300/0 conn(0x7f737c0b8430 0x7f737c0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.681+0000 7f737b7fe700 1 -- 172.21.15.37:0/2902944954 >> v1:172.21.15.196:6789/0 conn(0x7f737c0cfc60 legacy=0x7f737c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.681+0000 7f737b7fe700 1 -- 172.21.15.37:0/2902944954 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c0b51c0 con 0x7f737c0d3730 2023-07-12T02:04:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.681+0000 7f737b7fe700 1 -- 172.21.15.37:0/2902944954 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7f7368001670 con 0x7f737c0d3730 2023-07-12T02:04:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.681+0000 7f737b7fe700 1 -- 172.21.15.37:0/2902944954 >> v1:172.21.15.37:6789/0 conn(0x7f737c0d3730 legacy=0x7f737c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:58.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.681+0000 7f737b7fe700 1 --2- 172.21.15.37:0/2902944954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f736c003a00 0x7f736c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:58.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.681+0000 7f737b7fe700 1 --2- 172.21.15.37:0/2902944954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f736c004850 0x7f736c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:58.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.682+0000 7f737b7fe700 1 --2- 172.21.15.37:0/2902944954 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f736c005200 0x7f736c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:58.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.682+0000 7f737b7fe700 1 -- 172.21.15.37:0/2902944954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0b8800 con 0x7f736c003a00 2023-07-12T02:04:58.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.682+0000 7f737b7fe700 1 -- 172.21.15.37:0/2902944954 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c00c080 con 0x7f736c004850 2023-07-12T02:04:58.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.682+0000 7f737b7fe700 1 -- 172.21.15.37:0/2902944954 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c00c240 con 0x7f736c005200 2023-07-12T02:04:58.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.682+0000 7f7380b9b700 1 --2- 172.21.15.37:0/2902944954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f736c003a00 0x7f736c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:58.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.682+0000 7f737bfff700 1 --2- 172.21.15.37:0/2902944954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f736c004850 0x7f736c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:58.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.682+0000 7f738139c700 1 --2- 172.21.15.37:0/2902944954 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f736c005200 0x7f736c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:58.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.682+0000 7f7380b9b700 1 -- 172.21.15.37:0/2902944954 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f736c005200 msgr2=0x7f736c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:58.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.682+0000 7f7380b9b700 1 --2- 172.21.15.37:0/2902944954 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f736c005200 0x7f736c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.682+0000 7f7380b9b700 1 -- 172.21.15.37:0/2902944954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f736c004850 msgr2=0x7f736c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:58.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.682+0000 7f7380b9b700 1 --2- 172.21.15.37:0/2902944954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f736c004850 0x7f736c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.682+0000 7f7380b9b700 1 -- 172.21.15.37:0/2902944954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c0035b0 con 0x7f736c003a00 2023-07-12T02:04:58.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.682+0000 7f738139c700 1 -- 172.21.15.37:0/2902944954 reap_dead start 2023-07-12T02:04:58.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.682+0000 7f737bfff700 1 --2- 172.21.15.37:0/2902944954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f736c004850 0x7f736c004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:04:58.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.683+0000 7f7380b9b700 1 --2- 172.21.15.37:0/2902944954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f736c003a00 0x7f736c003e10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7370009b60 tx=0x7f736c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebaed6489834ce58 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:58.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.683+0000 7f737b7fe700 1 -- 172.21.15.37:0/2902944954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737000e6c0 con 0x7f736c003a00 2023-07-12T02:04:58.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.683+0000 7f737b7fe700 1 -- 172.21.15.37:0/2902944954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737000e820 con 0x7f736c003a00 2023-07-12T02:04:58.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.683+0000 7f737b7fe700 1 -- 172.21.15.37:0/2902944954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737000eb90 con 0x7f736c003a00 2023-07-12T02:04:58.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.683+0000 7f7382dff700 1 -- 172.21.15.37:0/2902944954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f736c003a00 msgr2=0x7f736c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.683+0000 7f7382dff700 1 --2- 172.21.15.37:0/2902944954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f736c003a00 0x7f736c003e10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7370009b60 tx=0x7f736c005880 comp rx=0 tx=0).stop 2023-07-12T02:04:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.683+0000 7f7382dff700 1 -- 172.21.15.37:0/2902944954 shutdown_connections 2023-07-12T02:04:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.683+0000 7f7382dff700 1 --2- 172.21.15.37:0/2902944954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f736c003a00 0x7f736c003e10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.683+0000 7f7382dff700 1 -- 172.21.15.37:0/2902944954 >> 172.21.15.37:0/2902944954 conn(0x7f737c06b3f0 msgr2=0x7f737c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.684+0000 7f7382dff700 1 -- 172.21.15.37:0/2902944954 shutdown_connections 2023-07-12T02:04:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.684+0000 7f7382dff700 1 -- 172.21.15.37:0/2902944954 wait complete. 2023-07-12T02:04:58.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.686+0000 7f7382dff700 1 Processor -- start 2023-07-12T02:04:58.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.686+0000 7f7382dff700 1 -- start start 2023-07-12T02:04:58.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.687+0000 7f7382dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f736c003a00 0x7f737c15f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:58.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.687+0000 7f7382dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f737c0cb060 0x7f737c0cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:58.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.688+0000 7f7382dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f737c0b35c0 0x7f737c0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:58.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.688+0000 7f7382dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0b3fa0 con 0x7f737c0cb060 2023-07-12T02:04:58.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.688+0000 7f7382dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c15fa10 con 0x7f736c003a00 2023-07-12T02:04:58.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.688+0000 7f7382dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0cbb60 con 0x7f737c0b35c0 2023-07-12T02:04:58.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.688+0000 7f737bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f737c0cb060 0x7f737c0cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:58.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.688+0000 7f737bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f737c0cb060 0x7f737c0cb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57658/0 (socket says 172.21.15.37:57658) 2023-07-12T02:04:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.688+0000 7f737bfff700 1 -- 172.21.15.37:0/4278600588 learned_addr learned my addr 172.21.15.37:0/4278600588 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.688+0000 7f738139c700 1 --2- 172.21.15.37:0/4278600588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f737c0b35c0 0x7f737c0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.688+0000 7f7380b9b700 1 --2- 172.21.15.37:0/4278600588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f736c003a00 0x7f737c15f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.688+0000 7f737bfff700 1 -- 172.21.15.37:0/4278600588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f737c0b35c0 msgr2=0x7f737c0b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.688+0000 7f737bfff700 1 --2- 172.21.15.37:0/4278600588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f737c0b35c0 0x7f737c0b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.688+0000 7f737bfff700 1 -- 172.21.15.37:0/4278600588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f736c003a00 msgr2=0x7f737c15f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.688+0000 7f737bfff700 1 --2- 172.21.15.37:0/4278600588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f736c003a00 0x7f737c15f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.688+0000 7f737bfff700 1 -- 172.21.15.37:0/4278600588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c0cbe40 con 0x7f737c0cb060 2023-07-12T02:04:58.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.689+0000 7f737bfff700 1 --2- 172.21.15.37:0/4278600588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f737c0cb060 0x7f737c0cb4d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7368007fd0 tx=0x7f7368007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:58.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.689+0000 7f73797fa700 1 -- 172.21.15.37:0/4278600588 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736800f820 con 0x7f737c0cb060 2023-07-12T02:04:58.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.689+0000 7f73797fa700 1 -- 172.21.15.37:0/4278600588 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736800f9a0 con 0x7f737c0cb060 2023-07-12T02:04:58.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.689+0000 7f73797fa700 1 -- 172.21.15.37:0/4278600588 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736800fd50 con 0x7f737c0cb060 2023-07-12T02:04:58.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.689+0000 7f7382dff700 1 -- 172.21.15.37:0/4278600588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737c0cc120 con 0x7f737c0cb060 2023-07-12T02:04:58.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.689+0000 7f7382dff700 1 -- 172.21.15.37:0/4278600588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737c0cc6e0 con 0x7f737c0cb060 2023-07-12T02:04:58.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.690+0000 7f7382dff700 1 -- 172.21.15.37:0/4278600588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737c04ea60 con 0x7f737c0cb060 2023-07-12T02:04:58.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.691+0000 7f73797fa700 1 -- 172.21.15.37:0/4278600588 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f736801d460 con 0x7f737c0cb060 2023-07-12T02:04:58.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.692+0000 7f73797fa700 1 --2- 172.21.15.37:0/4278600588 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f736006ace0 0x7f736006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:58.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.692+0000 7f73797fa700 1 -- 172.21.15.37:0/4278600588 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7368089690 con 0x7f737c0cb060 2023-07-12T02:04:58.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.693+0000 7f7380b9b700 1 --2- 172.21.15.37:0/4278600588 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f736006ace0 0x7f736006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:58.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.693+0000 7f7380b9b700 1 --2- 172.21.15.37:0/4278600588 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f736006ace0 0x7f736006d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f73700090b0 tx=0x7f7370008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:58.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.697+0000 7f73797fa700 1 -- 172.21.15.37:0/4278600588 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7368054400 con 0x7f737c0cb060 2023-07-12T02:04:58.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.900+0000 7f7382dff700 1 -- 172.21.15.37:0/4278600588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f737c0cc8a0 con 0x7f737c0cb060 2023-07-12T02:04:58.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.900+0000 7f73797fa700 1 -- 172.21.15.37:0/4278600588 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7368007d70 con 0x7f737c0cb060 2023-07-12T02:04:58.904 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:04:58.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.902+0000 7f7382dff700 1 -- 172.21.15.37:0/4278600588 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f736006ace0 msgr2=0x7f736006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:58.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.902+0000 7f7382dff700 1 --2- 172.21.15.37:0/4278600588 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f736006ace0 0x7f736006d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f73700090b0 tx=0x7f7370008030 comp rx=0 tx=0).stop 2023-07-12T02:04:58.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.902+0000 7f7382dff700 1 -- 172.21.15.37:0/4278600588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f737c0cb060 msgr2=0x7f737c0cb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:58.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.902+0000 7f7382dff700 1 --2- 172.21.15.37:0/4278600588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f737c0cb060 0x7f737c0cb4d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7368007fd0 tx=0x7f7368007620 comp rx=0 tx=0).stop 2023-07-12T02:04:58.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.903+0000 7f7382dff700 1 -- 172.21.15.37:0/4278600588 shutdown_connections 2023-07-12T02:04:58.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.903+0000 7f7382dff700 1 --2- 172.21.15.37:0/4278600588 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f736006ace0 0x7f736006d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.903+0000 7f7382dff700 1 --2- 172.21.15.37:0/4278600588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f737c0b35c0 0x7f737c0b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.903+0000 7f7382dff700 1 --2- 172.21.15.37:0/4278600588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f736c003a00 0x7f737c15f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.903+0000 7f7382dff700 1 --2- 172.21.15.37:0/4278600588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f737c0cb060 0x7f737c0cb4d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:58.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.903+0000 7f7382dff700 1 -- 172.21.15.37:0/4278600588 >> 172.21.15.37:0/4278600588 conn(0x7f737c06b3f0 msgr2=0x7f737c0b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:58.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.903+0000 7f7382dff700 1 -- 172.21.15.37:0/4278600588 shutdown_connections 2023-07-12T02:04:58.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:58.903+0000 7f7382dff700 1 -- 172.21.15.37:0/4278600588 wait complete. 2023-07-12T02:04:58.924 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:04:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.124+0000 7f14b63ff700 1 Processor -- start 2023-07-12T02:04:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.125+0000 7f14b63ff700 1 -- start start 2023-07-12T02:04:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.126+0000 7f14b63ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14b00cfc60 0x7f14b0167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.126+0000 7f14b63ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b00d0b20 con 0x7f14b00b8430 2023-07-12T02:04:59.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.126+0000 7f14b63ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b00b4ee0 con 0x7f14b00d3730 2023-07-12T02:04:59.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.126+0000 7f14b63ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00cda30 con 0x7f14b00cfc60 2023-07-12T02:04:59.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.126+0000 7f14affff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f14b00b8430 0x7f14b00cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52748/0 (socket says 172.21.15.37:52748) 2023-07-12T02:04:59.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.126+0000 7f14affff700 1 -- 172.21.15.37:0/996178188 learned_addr learned my addr 172.21.15.37:0/996178188 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:04:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.126+0000 7f14af7fe700 1 -- 172.21.15.37:0/996178188 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193089862 0 0) 0x7f14b00d0b20 con 0x7f14b00b8430 2023-07-12T02:04:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.126+0000 7f14af7fe700 1 -- 172.21.15.37:0/996178188 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f149c0035b0 con 0x7f14b00b8430 2023-07-12T02:04:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.126+0000 7f14b499c700 1 --2- 172.21.15.37:0/996178188 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14b00cfc60 0x7f14b0167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.127+0000 7f14af7fe700 1 -- 172.21.15.37:0/996178188 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3094189102 0 0) 0x7f149c0035b0 con 0x7f14b00b8430 2023-07-12T02:04:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.127+0000 7f14af7fe700 1 -- 172.21.15.37:0/996178188 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14b00cfc60 msgr2=0x7f14b0167010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.127+0000 7f14af7fe700 1 --2- 172.21.15.37:0/996178188 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14b00cfc60 0x7f14b0167010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.127+0000 7f14af7fe700 1 -- 172.21.15.37:0/996178188 >> v1:172.21.15.196:6789/0 conn(0x7f14b00d3730 legacy=0x7f14b00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.127+0000 7f14af7fe700 1 -- 172.21.15.37:0/996178188 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b00b51c0 con 0x7f14b00b8430 2023-07-12T02:04:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.127+0000 7f14af7fe700 1 -- 172.21.15.37:0/996178188 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7f14a0001670 con 0x7f14b00b8430 2023-07-12T02:04:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.127+0000 7f14af7fe700 1 -- 172.21.15.37:0/996178188 >> v1:172.21.15.37:6789/0 conn(0x7f14b00b8430 legacy=0x7f14b00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.127+0000 7f14af7fe700 1 --2- 172.21.15.37:0/996178188 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f149c003a30 0x7f149c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.127+0000 7f14af7fe700 1 --2- 172.21.15.37:0/996178188 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14b00cfc60 0x7f149c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.127+0000 7f14af7fe700 1 --2- 172.21.15.37:0/996178188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f149c004d90 0x7f149c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.127+0000 7f14af7fe700 1 -- 172.21.15.37:0/996178188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c00bac0 con 0x7f149c004d90 2023-07-12T02:04:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.127+0000 7f14af7fe700 1 -- 172.21.15.37:0/996178188 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c00bc00 con 0x7f149c003a30 2023-07-12T02:04:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.127+0000 7f14af7fe700 1 -- 172.21.15.37:0/996178188 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c00bd90 con 0x7f14b00cfc60 2023-07-12T02:04:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.127+0000 7f14affff700 1 --2- 172.21.15.37:0/996178188 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f149c003a30 0x7f149c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.127+0000 7f14b499c700 1 --2- 172.21.15.37:0/996178188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f149c004d90 0x7f149c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.127+0000 7f14a7fff700 1 --2- 172.21.15.37:0/996178188 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14b00cfc60 0x7f149c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.128+0000 7f14b499c700 1 -- 172.21.15.37:0/996178188 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14b00cfc60 msgr2=0x7f149c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.128+0000 7f14b499c700 1 --2- 172.21.15.37:0/996178188 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14b00cfc60 0x7f149c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.128+0000 7f14b499c700 1 -- 172.21.15.37:0/996178188 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f149c003a30 msgr2=0x7f149c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.128+0000 7f14b499c700 1 --2- 172.21.15.37:0/996178188 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f149c003a30 0x7f149c003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.128+0000 7f14b499c700 1 -- 172.21.15.37:0/996178188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c0035b0 con 0x7f149c004d90 2023-07-12T02:04:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.128+0000 7f14b499c700 1 --2- 172.21.15.37:0/996178188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f149c004d90 0x7f149c005200 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009fc0 tx=0x7f149c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67927d63e6c1676 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.128+0000 7f14af7fe700 1 -- 172.21.15.37:0/996178188 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a800ec30 con 0x7f149c004d90 2023-07-12T02:04:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.128+0000 7f14af7fe700 1 -- 172.21.15.37:0/996178188 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a800f040 con 0x7f149c004d90 2023-07-12T02:04:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.128+0000 7f14af7fe700 1 -- 172.21.15.37:0/996178188 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a8014480 con 0x7f149c004d90 2023-07-12T02:04:59.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.129+0000 7f14b63ff700 1 -- 172.21.15.37:0/996178188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f149c004d90 msgr2=0x7f149c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:59.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.129+0000 7f14b63ff700 1 --2- 172.21.15.37:0/996178188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f149c004d90 0x7f149c005200 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009fc0 tx=0x7f149c005880 comp rx=0 tx=0).stop 2023-07-12T02:04:59.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.129+0000 7f14b499c700 1 -- 172.21.15.37:0/996178188 reap_dead start 2023-07-12T02:04:59.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.129+0000 7f14b63ff700 1 -- 172.21.15.37:0/996178188 shutdown_connections 2023-07-12T02:04:59.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.129+0000 7f14b63ff700 1 -- 172.21.15.37:0/996178188 >> 172.21.15.37:0/996178188 conn(0x7f14b006b3f0 msgr2=0x7f14b006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:59.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.129+0000 7f14b63ff700 1 -- 172.21.15.37:0/996178188 shutdown_connections 2023-07-12T02:04:59.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.129+0000 7f14b63ff700 1 -- 172.21.15.37:0/996178188 wait complete. 2023-07-12T02:04:59.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.131+0000 7f14b63ff700 1 Processor -- start 2023-07-12T02:04:59.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.131+0000 7f14b63ff700 1 -- start start 2023-07-12T02:04:59.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.132+0000 7f14b63ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f149c004d90 0x7f14b0157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:59.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.132+0000 7f14b63ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b00cab00 0x7f14b00cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:59.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.132+0000 7f14b63ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b00caf70 0x7f14b00cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:59.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.132+0000 7f14b63ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b015c430 con 0x7f14b00cab00 2023-07-12T02:04:59.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.132+0000 7f14b63ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00cb510 con 0x7f14b00caf70 2023-07-12T02:04:59.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.132+0000 7f14b63ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b015bde0 con 0x7f149c004d90 2023-07-12T02:04:59.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.132+0000 7f14a7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b00cab00 0x7f14b00cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:59.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.132+0000 7f14a7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b00cab00 0x7f14b00cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57674/0 (socket says 172.21.15.37:57674) 2023-07-12T02:04:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.132+0000 7f14a7fff700 1 -- 172.21.15.37:0/4143307229 learned_addr learned my addr 172.21.15.37:0/4143307229 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.132+0000 7f14affff700 1 --2- 172.21.15.37:0/4143307229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f149c004d90 0x7f14b0157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.132+0000 7f14b499c700 1 --2- 172.21.15.37:0/4143307229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b00caf70 0x7f14b00cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.132+0000 7f14a7fff700 1 -- 172.21.15.37:0/4143307229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f149c004d90 msgr2=0x7f14b0157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.132+0000 7f14a7fff700 1 --2- 172.21.15.37:0/4143307229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f149c004d90 0x7f14b0157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.132+0000 7f14a7fff700 1 -- 172.21.15.37:0/4143307229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b00caf70 msgr2=0x7f14b00cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.132+0000 7f14a7fff700 1 --2- 172.21.15.37:0/4143307229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b00caf70 0x7f14b00cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.132+0000 7f14a7fff700 1 -- 172.21.15.37:0/4143307229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b015c0c0 con 0x7f14b00cab00 2023-07-12T02:04:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.133+0000 7f14a7fff700 1 --2- 172.21.15.37:0/4143307229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b00cab00 0x7f14b00cc270 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f149800f7f0 tx=0x7f149800fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.133+0000 7f14ad7fa700 1 -- 172.21.15.37:0/4143307229 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14980052e0 con 0x7f14b00cab00 2023-07-12T02:04:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.133+0000 7f14ad7fa700 1 -- 172.21.15.37:0/4143307229 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1498005440 con 0x7f14b00cab00 2023-07-12T02:04:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.133+0000 7f14b63ff700 1 -- 172.21.15.37:0/4143307229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b0157cd0 con 0x7f14b00cab00 2023-07-12T02:04:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.133+0000 7f14ad7fa700 1 -- 172.21.15.37:0/4143307229 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14980038c0 con 0x7f14b00cab00 2023-07-12T02:04:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.133+0000 7f14b63ff700 1 -- 172.21.15.37:0/4143307229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b00c9f40 con 0x7f14b00cab00 2023-07-12T02:04:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.134+0000 7f14b63ff700 1 -- 172.21.15.37:0/4143307229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b015c5a0 con 0x7f14b00cab00 2023-07-12T02:04:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.135+0000 7f14ad7fa700 1 -- 172.21.15.37:0/4143307229 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1498003a20 con 0x7f14b00cab00 2023-07-12T02:04:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.136+0000 7f14ad7fa700 1 --2- 172.21.15.37:0/4143307229 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f149006ace0 0x7f149006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.136+0000 7f14ad7fa700 1 -- 172.21.15.37:0/4143307229 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f14980894f0 con 0x7f14b00cab00 2023-07-12T02:04:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.137+0000 7f14affff700 1 --2- 172.21.15.37:0/4143307229 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f149006ace0 0x7f149006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.137+0000 7f14affff700 1 --2- 172.21.15.37:0/4143307229 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f149006ace0 0x7f149006d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f14a0001050 tx=0x7f14a0000f80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.141+0000 7f14ad7fa700 1 -- 172.21.15.37:0/4143307229 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f14980541d0 con 0x7f14b00cab00 2023-07-12T02:04:59.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.352+0000 7f14b63ff700 1 -- 172.21.15.37:0/4143307229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f14b004ea60 con 0x7f14b00cab00 2023-07-12T02:04:59.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.353+0000 7f14ad7fa700 1 -- 172.21.15.37:0/4143307229 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f14980577f0 con 0x7f14b00cab00 2023-07-12T02:04:59.356 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:04:59.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.355+0000 7f14b63ff700 1 -- 172.21.15.37:0/4143307229 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f149006ace0 msgr2=0x7f149006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:59.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.355+0000 7f14b63ff700 1 --2- 172.21.15.37:0/4143307229 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f149006ace0 0x7f149006d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f14a0001050 tx=0x7f14a0000f80 comp rx=0 tx=0).stop 2023-07-12T02:04:59.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.355+0000 7f14b63ff700 1 -- 172.21.15.37:0/4143307229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b00cab00 msgr2=0x7f14b00cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:59.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.355+0000 7f14b63ff700 1 --2- 172.21.15.37:0/4143307229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b00cab00 0x7f14b00cc270 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f149800f7f0 tx=0x7f149800fb00 comp rx=0 tx=0).stop 2023-07-12T02:04:59.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.355+0000 7f14b63ff700 1 -- 172.21.15.37:0/4143307229 shutdown_connections 2023-07-12T02:04:59.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.355+0000 7f14b63ff700 1 --2- 172.21.15.37:0/4143307229 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f149006ace0 0x7f149006d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.355+0000 7f14b63ff700 1 --2- 172.21.15.37:0/4143307229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14b00caf70 0x7f14b00cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.355+0000 7f14b63ff700 1 --2- 172.21.15.37:0/4143307229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f149c004d90 0x7f14b0157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.355+0000 7f14b63ff700 1 --2- 172.21.15.37:0/4143307229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b00cab00 0x7f14b00cc270 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.355+0000 7f14b63ff700 1 -- 172.21.15.37:0/4143307229 >> 172.21.15.37:0/4143307229 conn(0x7f14b006b3f0 msgr2=0x7f14b015fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:59.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.355+0000 7f14b63ff700 1 -- 172.21.15.37:0/4143307229 shutdown_connections 2023-07-12T02:04:59.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.355+0000 7f14b63ff700 1 -- 172.21.15.37:0/4143307229 wait complete. 2023-07-12T02:04:59.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:04:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.578+0000 7fc77dbff700 1 Processor -- start 2023-07-12T02:04:59.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.578+0000 7fc77dbff700 1 -- start start 2023-07-12T02:04:59.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.579+0000 7fc77dbff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7780b8430 0x7fc7780cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:59.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.579+0000 7fc77dbff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc7780cfc60 0x7fc7780d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:59.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.579+0000 7fc77dbff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7780d0b20 con 0x7fc7780d3730 2023-07-12T02:04:59.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.579+0000 7fc77dbff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7780b8800 con 0x7fc7780cfc60 2023-07-12T02:04:59.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.579+0000 7fc77dbff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780b4ee0 con 0x7fc7780b8430 2023-07-12T02:04:59.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.580+0000 7fc7777fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7780b8430 0x7fc7780cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:59.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.580+0000 7fc777fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc7780cfc60 0x7fc7780d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:59.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.580+0000 7fc7777fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7780b8430 0x7fc7780cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:37466/0 (socket says 172.21.15.37:37466) 2023-07-12T02:04:59.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.580+0000 7fc777fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc7780cfc60 0x7fc7780d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:56676/0 (socket says 172.21.15.37:56676) 2023-07-12T02:04:59.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.580+0000 7fc7777fe700 1 -- 172.21.15.37:0/620906770 learned_addr learned my addr 172.21.15.37:0/620906770 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:59.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.580+0000 7fc7777fe700 1 -- 172.21.15.37:0/620906770 >> v2:172.21.15.196:3300/0 conn(0x7fc7780cfc60 msgr2=0x7fc7780d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:04:59.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.580+0000 7fc7777fe700 1 --2- 172.21.15.37:0/620906770 >> v2:172.21.15.196:3300/0 conn(0x7fc7780cfc60 0x7fc7780d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.580+0000 7fc7777fe700 1 -- 172.21.15.37:0/620906770 >> v1:172.21.15.196:6789/0 conn(0x7fc7780d3730 legacy=0x7fc7780cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:59.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.580+0000 7fc7777fe700 1 -- 172.21.15.37:0/620906770 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7780b51c0 con 0x7fc7780b8430 2023-07-12T02:04:59.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.580+0000 7fc777fff700 1 --2- 172.21.15.37:0/620906770 >> v2:172.21.15.196:3300/0 conn(0x7fc7780cfc60 0x7fc7780d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:04:59.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.580+0000 7fc7777fe700 1 --2- 172.21.15.37:0/620906770 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7780b8430 0x7fc7780cd320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc7680098f0 tx=0x7fc768009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1832f1651040d0ab server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:59.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.581+0000 7fc7767fc700 1 -- 172.21.15.37:0/620906770 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768011830 con 0x7fc7780b8430 2023-07-12T02:04:59.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.581+0000 7fc7767fc700 1 -- 172.21.15.37:0/620906770 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc768011990 con 0x7fc7780b8430 2023-07-12T02:04:59.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.581+0000 7fc7767fc700 1 -- 172.21.15.37:0/620906770 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768011d20 con 0x7fc7780b8430 2023-07-12T02:04:59.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.581+0000 7fc77dbff700 1 -- 172.21.15.37:0/620906770 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7780b8430 msgr2=0x7fc7780cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:59.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.581+0000 7fc77dbff700 1 --2- 172.21.15.37:0/620906770 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7780b8430 0x7fc7780cd320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc7680098f0 tx=0x7fc768009c00 comp rx=0 tx=0).stop 2023-07-12T02:04:59.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.581+0000 7fc77dbff700 1 -- 172.21.15.37:0/620906770 shutdown_connections 2023-07-12T02:04:59.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.581+0000 7fc77dbff700 1 --2- 172.21.15.37:0/620906770 >> v2:172.21.15.196:3300/0 conn(0x7fc7780cfc60 0x7fc7780d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.581+0000 7fc77dbff700 1 --2- 172.21.15.37:0/620906770 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7780b8430 0x7fc7780cd320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.581+0000 7fc77dbff700 1 -- 172.21.15.37:0/620906770 >> 172.21.15.37:0/620906770 conn(0x7fc77806b3f0 msgr2=0x7fc77806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:59.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.581+0000 7fc77dbff700 1 -- 172.21.15.37:0/620906770 shutdown_connections 2023-07-12T02:04:59.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.582+0000 7fc77dbff700 1 -- 172.21.15.37:0/620906770 wait complete. 2023-07-12T02:04:59.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.583+0000 7fc77dbff700 1 Processor -- start 2023-07-12T02:04:59.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.583+0000 7fc77dbff700 1 -- start start 2023-07-12T02:04:59.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.584+0000 7fc77dbff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7780b8430 0x7fc778151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:59.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.584+0000 7fc77dbff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7780cfc60 0x7fc7780c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:59.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.584+0000 7fc77dbff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7780d3730 0x7fc7780b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:59.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.584+0000 7fc77dbff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780c9c10 con 0x7fc7780d3730 2023-07-12T02:04:59.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.584+0000 7fc77dbff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780c9ef0 con 0x7fc7780b8430 2023-07-12T02:04:59.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.584+0000 7fc77dbff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780ca1d0 con 0x7fc7780cfc60 2023-07-12T02:04:59.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.585+0000 7fc777fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7780d3730 0x7fc7780b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:59.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.585+0000 7fc777fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7780d3730 0x7fc7780b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57680/0 (socket says 172.21.15.37:57680) 2023-07-12T02:04:59.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.585+0000 7fc777fff700 1 -- 172.21.15.37:0/378082117 learned_addr learned my addr 172.21.15.37:0/378082117 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:04:59.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.585+0000 7fc7777fe700 1 --2- 172.21.15.37:0/378082117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7780b8430 0x7fc778151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:59.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.585+0000 7fc776ffd700 1 --2- 172.21.15.37:0/378082117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7780cfc60 0x7fc7780c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:59.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.585+0000 7fc777fff700 1 -- 172.21.15.37:0/378082117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7780cfc60 msgr2=0x7fc7780c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:59.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.585+0000 7fc777fff700 1 --2- 172.21.15.37:0/378082117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7780cfc60 0x7fc7780c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.585+0000 7fc777fff700 1 -- 172.21.15.37:0/378082117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7780b8430 msgr2=0x7fc778151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:59.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.585+0000 7fc777fff700 1 --2- 172.21.15.37:0/378082117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7780b8430 0x7fc778151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.585+0000 7fc777fff700 1 -- 172.21.15.37:0/378082117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc770009a70 con 0x7fc7780d3730 2023-07-12T02:04:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.585+0000 7fc7777fe700 1 --2- 172.21.15.37:0/378082117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7780b8430 0x7fc778151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:04:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.585+0000 7fc777fff700 1 --2- 172.21.15.37:0/378082117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7780d3730 0x7fc7780b3600 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc77000efc0 tx=0x7fc77000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.586+0000 7fc75ffff700 1 -- 172.21.15.37:0/378082117 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77000ca90 con 0x7fc7780d3730 2023-07-12T02:04:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.586+0000 7fc75ffff700 1 -- 172.21.15.37:0/378082117 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77000f040 con 0x7fc7780d3730 2023-07-12T02:04:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.586+0000 7fc75ffff700 1 -- 172.21.15.37:0/378082117 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77000ce10 con 0x7fc7780d3730 2023-07-12T02:04:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.586+0000 7fc77dbff700 1 -- 172.21.15.37:0/378082117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc768009550 con 0x7fc7780d3730 2023-07-12T02:04:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.586+0000 7fc77dbff700 1 -- 172.21.15.37:0/378082117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7780ca790 con 0x7fc7780d3730 2023-07-12T02:04:59.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.587+0000 7fc77dbff700 1 -- 172.21.15.37:0/378082117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77804ea60 con 0x7fc7780d3730 2023-07-12T02:04:59.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.588+0000 7fc75ffff700 1 -- 172.21.15.37:0/378082117 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc770014480 con 0x7fc7780d3730 2023-07-12T02:04:59.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.589+0000 7fc75ffff700 1 --2- 172.21.15.37:0/378082117 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc76406ace0 0x7fc76406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:04:59.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.589+0000 7fc75ffff700 1 -- 172.21.15.37:0/378082117 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc770089ea0 con 0x7fc7780d3730 2023-07-12T02:04:59.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.589+0000 7fc7777fe700 1 --2- 172.21.15.37:0/378082117 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc76406ace0 0x7fc76406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:04:59.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.590+0000 7fc7777fe700 1 --2- 172.21.15.37:0/378082117 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc76406ace0 0x7fc76406d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc768009c40 tx=0x7fc768008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:04:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.593+0000 7fc75ffff700 1 -- 172.21.15.37:0/378082117 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc770058610 con 0x7fc7780d3730 2023-07-12T02:04:59.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.799+0000 7fc77dbff700 1 -- 172.21.15.37:0/378082117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc7780ce700 con 0x7fc7780d3730 2023-07-12T02:04:59.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.800+0000 7fc75ffff700 1 -- 172.21.15.37:0/378082117 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc770009d70 con 0x7fc7780d3730 2023-07-12T02:04:59.804 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-12T02:04:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.802+0000 7fc77dbff700 1 -- 172.21.15.37:0/378082117 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc76406ace0 msgr2=0x7fc76406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.802+0000 7fc77dbff700 1 --2- 172.21.15.37:0/378082117 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc76406ace0 0x7fc76406d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc768009c40 tx=0x7fc768008030 comp rx=0 tx=0).stop 2023-07-12T02:04:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.802+0000 7fc77dbff700 1 -- 172.21.15.37:0/378082117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7780d3730 msgr2=0x7fc7780b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:04:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.802+0000 7fc77dbff700 1 --2- 172.21.15.37:0/378082117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7780d3730 0x7fc7780b3600 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc77000efc0 tx=0x7fc77000c3a0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.802+0000 7fc77dbff700 1 -- 172.21.15.37:0/378082117 shutdown_connections 2023-07-12T02:04:59.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.802+0000 7fc77dbff700 1 --2- 172.21.15.37:0/378082117 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc76406ace0 0x7fc76406d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.802+0000 7fc77dbff700 1 --2- 172.21.15.37:0/378082117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7780d3730 0x7fc7780b3600 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.802+0000 7fc77dbff700 1 --2- 172.21.15.37:0/378082117 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7780b8430 0x7fc778151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.802+0000 7fc77dbff700 1 --2- 172.21.15.37:0/378082117 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7780cfc60 0x7fc7780c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:04:59.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.802+0000 7fc77dbff700 1 -- 172.21.15.37:0/378082117 >> 172.21.15.37:0/378082117 conn(0x7fc77806b3f0 msgr2=0x7fc7780d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:04:59.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.802+0000 7fc77dbff700 1 -- 172.21.15.37:0/378082117 shutdown_connections 2023-07-12T02:04:59.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:04:59.802+0000 7fc77dbff700 1 -- 172.21.15.37:0/378082117 wait complete. 2023-07-12T02:04:59.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-12T02:05:00.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.024+0000 7f79bb9ff700 1 Processor -- start 2023-07-12T02:05:00.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.025+0000 7f79bb9ff700 1 -- start start 2023-07-12T02:05:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.026+0000 7f79bb9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79b40d3730 0x7f79b40cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.026+0000 7f79bb9ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f79b40cfa90 0x7f79b40d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.026+0000 7f79bb9ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b40d0b20 con 0x7f79b40b8430 2023-07-12T02:05:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.026+0000 7f79bb9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b40cda30 con 0x7f79b40d3730 2023-07-12T02:05:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.026+0000 7f79bb9ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b40b8800 con 0x7f79b40cfa90 2023-07-12T02:05:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.026+0000 7f79b8f9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79b40d3730 0x7f79b40cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.026+0000 7f79b8f9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79b40d3730 0x7f79b40cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57692/0 (socket says 172.21.15.37:57692) 2023-07-12T02:05:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.026+0000 7f79b8f9a700 1 -- 172.21.15.37:0/4087650463 learned_addr learned my addr 172.21.15.37:0/4087650463 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.026+0000 7f79b9f9c700 1 --2- 172.21.15.37:0/4087650463 >> v2:172.21.15.196:3300/0 conn(0x7f79b40cfa90 0x7f79b40d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.027+0000 7f79b8f9a700 1 -- 172.21.15.37:0/4087650463 >> v2:172.21.15.196:3300/0 conn(0x7f79b40cfa90 msgr2=0x7f79b40d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.027+0000 7f79b8f9a700 1 --2- 172.21.15.37:0/4087650463 >> v2:172.21.15.196:3300/0 conn(0x7f79b40cfa90 0x7f79b40d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.027+0000 7f79b8f9a700 1 -- 172.21.15.37:0/4087650463 >> v1:172.21.15.196:6789/0 conn(0x7f79b40b8430 legacy=0x7f79b40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.027+0000 7f79b8f9a700 1 -- 172.21.15.37:0/4087650463 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b40cfe90 con 0x7f79b40d3730 2023-07-12T02:05:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.027+0000 7f79b8f9a700 1 --2- 172.21.15.37:0/4087650463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b40d3730 0x7f79b40cf550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f79b40b2100 tx=0x7f79a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b207e56380acfd11 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.027+0000 7f79abfff700 1 -- 172.21.15.37:0/4087650463 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a400b870 con 0x7f79b40d3730 2023-07-12T02:05:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.027+0000 7f79abfff700 1 -- 172.21.15.37:0/4087650463 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a400b9d0 con 0x7f79b40d3730 2023-07-12T02:05:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.027+0000 7f79abfff700 1 -- 172.21.15.37:0/4087650463 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a400bd60 con 0x7f79b40d3730 2023-07-12T02:05:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.028+0000 7f79bb9ff700 1 -- 172.21.15.37:0/4087650463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b40d3730 msgr2=0x7f79b40cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.028+0000 7f79bb9ff700 1 --2- 172.21.15.37:0/4087650463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b40d3730 0x7f79b40cf550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f79b40b2100 tx=0x7f79a4009bd0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.028+0000 7f79bb9ff700 1 -- 172.21.15.37:0/4087650463 shutdown_connections 2023-07-12T02:05:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.028+0000 7f79bb9ff700 1 --2- 172.21.15.37:0/4087650463 >> v2:172.21.15.196:3300/0 conn(0x7f79b40cfa90 0x7f79b40d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.028+0000 7f79bb9ff700 1 --2- 172.21.15.37:0/4087650463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b40d3730 0x7f79b40cf550 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.028+0000 7f79bb9ff700 1 -- 172.21.15.37:0/4087650463 >> 172.21.15.37:0/4087650463 conn(0x7f79b406b3f0 msgr2=0x7f79b406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.028+0000 7f79bb9ff700 1 -- 172.21.15.37:0/4087650463 shutdown_connections 2023-07-12T02:05:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.028+0000 7f79bb9ff700 1 -- 172.21.15.37:0/4087650463 wait complete. 2023-07-12T02:05:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.029+0000 7f79bb9ff700 1 Processor -- start 2023-07-12T02:05:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.030+0000 7f79bb9ff700 1 -- start start 2023-07-12T02:05:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79bb9ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79b40b8430 0x7f79b40b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79bb9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79b40cfa90 0x7f79b40b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79bb9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b40d3730 0x7f79b41f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79bb9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40c68d0 con 0x7f79b40d3730 2023-07-12T02:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79bb9ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40c6e50 con 0x7f79b40b8430 2023-07-12T02:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79bb9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b415d7c0 con 0x7f79b40cfa90 2023-07-12T02:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79b9f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b40d3730 0x7f79b41f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79b9f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b40d3730 0x7f79b41f5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57708/0 (socket says 172.21.15.37:57708) 2023-07-12T02:05:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79b9f9c700 1 -- 172.21.15.37:0/2251696480 learned_addr learned my addr 172.21.15.37:0/2251696480 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79b979b700 1 --2- 172.21.15.37:0/2251696480 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79b40b8430 0x7f79b40b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79b8f9a700 1 --2- 172.21.15.37:0/2251696480 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79b40cfa90 0x7f79b40b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79b9f9c700 1 -- 172.21.15.37:0/2251696480 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79b40cfa90 msgr2=0x7f79b40b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79b9f9c700 1 --2- 172.21.15.37:0/2251696480 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79b40cfa90 0x7f79b40b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79b9f9c700 1 -- 172.21.15.37:0/2251696480 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79b40b8430 msgr2=0x7f79b40b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79b9f9c700 1 --2- 172.21.15.37:0/2251696480 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79b40b8430 0x7f79b40b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79b9f9c700 1 -- 172.21.15.37:0/2251696480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a4009550 con 0x7f79b40d3730 2023-07-12T02:05:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79b979b700 1 --2- 172.21.15.37:0/2251696480 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79b40b8430 0x7f79b40b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.031+0000 7f79b8f9a700 1 --2- 172.21.15.37:0/2251696480 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79b40cfa90 0x7f79b40b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.032+0000 7f79b9f9c700 1 --2- 172.21.15.37:0/2251696480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b40d3730 0x7f79b41f5370 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f79ac007e70 tx=0x7f79ac00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.032+0000 7f79a9ffb700 1 -- 172.21.15.37:0/2251696480 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac00ee50 con 0x7f79b40d3730 2023-07-12T02:05:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.032+0000 7f79a9ffb700 1 -- 172.21.15.37:0/2251696480 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac014420 con 0x7f79b40d3730 2023-07-12T02:05:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.032+0000 7f79bb9ff700 1 -- 172.21.15.37:0/2251696480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b415daa0 con 0x7f79b40d3730 2023-07-12T02:05:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.032+0000 7f79a9ffb700 1 -- 172.21.15.37:0/2251696480 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0147d0 con 0x7f79b40d3730 2023-07-12T02:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.032+0000 7f79bb9ff700 1 -- 172.21.15.37:0/2251696480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b40c97c0 con 0x7f79b40d3730 2023-07-12T02:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.033+0000 7f79bb9ff700 1 -- 172.21.15.37:0/2251696480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b40c6fe0 con 0x7f79b40d3730 2023-07-12T02:05:00.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.034+0000 7f79a9ffb700 1 -- 172.21.15.37:0/2251696480 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f79ac014930 con 0x7f79b40d3730 2023-07-12T02:05:00.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.035+0000 7f79a9ffb700 1 --2- 172.21.15.37:0/2251696480 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f799806ace0 0x7f799806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.035+0000 7f79a9ffb700 1 -- 172.21.15.37:0/2251696480 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f79ac089ff0 con 0x7f79b40d3730 2023-07-12T02:05:00.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.035+0000 7f79b979b700 1 --2- 172.21.15.37:0/2251696480 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f799806ace0 0x7f799806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.036+0000 7f79b979b700 1 --2- 172.21.15.37:0/2251696480 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f799806ace0 0x7f799806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f79b0000f60 tx=0x7f79b0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.040+0000 7f79a9ffb700 1 -- 172.21.15.37:0/2251696480 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f79ac0bc380 con 0x7f79b40d3730 2023-07-12T02:05:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.247+0000 7f79bb9ff700 1 -- 172.21.15.37:0/2251696480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f79b404ea60 con 0x7f79b40d3730 2023-07-12T02:05:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.247+0000 7f79a9ffb700 1 -- 172.21.15.37:0/2251696480 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f79ac054d80 con 0x7f79b40d3730 2023-07-12T02:05:00.251 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:05:00.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.249+0000 7f79bb9ff700 1 -- 172.21.15.37:0/2251696480 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f799806ace0 msgr2=0x7f799806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.250+0000 7f79bb9ff700 1 --2- 172.21.15.37:0/2251696480 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f799806ace0 0x7f799806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f79b0000f60 tx=0x7f79b0009040 comp rx=0 tx=0).stop 2023-07-12T02:05:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.250+0000 7f79bb9ff700 1 -- 172.21.15.37:0/2251696480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b40d3730 msgr2=0x7f79b41f5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.250+0000 7f79bb9ff700 1 --2- 172.21.15.37:0/2251696480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b40d3730 0x7f79b41f5370 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f79ac007e70 tx=0x7f79ac00e3c0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.250+0000 7f79bb9ff700 1 -- 172.21.15.37:0/2251696480 shutdown_connections 2023-07-12T02:05:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.250+0000 7f79bb9ff700 1 --2- 172.21.15.37:0/2251696480 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f799806ace0 0x7f799806d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.250+0000 7f79bb9ff700 1 --2- 172.21.15.37:0/2251696480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79b40d3730 0x7f79b41f5370 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.250+0000 7f79bb9ff700 1 --2- 172.21.15.37:0/2251696480 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79b40b8430 0x7f79b40b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.250+0000 7f79bb9ff700 1 --2- 172.21.15.37:0/2251696480 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79b40cfa90 0x7f79b40b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.250+0000 7f79bb9ff700 1 -- 172.21.15.37:0/2251696480 >> 172.21.15.37:0/2251696480 conn(0x7f79b406b3f0 msgr2=0x7f79b40b6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:00.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.250+0000 7f79bb9ff700 1 -- 172.21.15.37:0/2251696480 shutdown_connections 2023-07-12T02:05:00.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.250+0000 7f79bb9ff700 1 -- 172.21.15.37:0/2251696480 wait complete. 2023-07-12T02:05:00.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:05:00.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.469+0000 7fba15bff700 1 Processor -- start 2023-07-12T02:05:00.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.470+0000 7fba15bff700 1 -- start start 2023-07-12T02:05:00.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.471+0000 7fba15bff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fba1015c460 0x7fba100b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.471+0000 7fba15bff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba100d2640 0x7fba100cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.471+0000 7fba15bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba100d1790 con 0x7fba100cf720 2023-07-12T02:05:00.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.471+0000 7fba15bff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba100cedd0 con 0x7fba1015c460 2023-07-12T02:05:00.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.471+0000 7fba15bff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba100cd950 con 0x7fba100d2640 2023-07-12T02:05:00.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.471+0000 7fba0ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fba100cf720 0x7fba100d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52754/0 (socket says 172.21.15.37:52754) 2023-07-12T02:05:00.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.471+0000 7fba0ffff700 1 -- 172.21.15.37:0/2064231627 learned_addr learned my addr 172.21.15.37:0/2064231627 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:00.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.471+0000 7fba07fff700 1 --2- 172.21.15.37:0/2064231627 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba100d2640 0x7fba100cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.471+0000 7fba0f7fe700 1 --2- 172.21.15.37:0/2064231627 >> v2:172.21.15.196:3300/0 conn(0x7fba1015c460 0x7fba100b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.471+0000 7fba0effd700 1 -- 172.21.15.37:0/2064231627 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071985358 0 0) 0x7fba100d1790 con 0x7fba100cf720 2023-07-12T02:05:00.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.472+0000 7fba0effd700 1 -- 172.21.15.37:0/2064231627 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9fc0035b0 con 0x7fba100cf720 2023-07-12T02:05:00.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.472+0000 7fba07fff700 1 -- 172.21.15.37:0/2064231627 >> v2:172.21.15.196:3300/0 conn(0x7fba1015c460 msgr2=0x7fba100b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:00.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.472+0000 7fba07fff700 1 --2- 172.21.15.37:0/2064231627 >> v2:172.21.15.196:3300/0 conn(0x7fba1015c460 0x7fba100b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.472+0000 7fba07fff700 1 -- 172.21.15.37:0/2064231627 >> v1:172.21.15.37:6789/0 conn(0x7fba100cf720 legacy=0x7fba100d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:00.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.472+0000 7fba07fff700 1 -- 172.21.15.37:0/2064231627 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba100d14b0 con 0x7fba100d2640 2023-07-12T02:05:00.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.472+0000 7fba0f7fe700 1 --2- 172.21.15.37:0/2064231627 >> v2:172.21.15.196:3300/0 conn(0x7fba1015c460 0x7fba100b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:00.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.472+0000 7fba07fff700 1 --2- 172.21.15.37:0/2064231627 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba100d2640 0x7fba100cf1e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009840 tx=0x7fb9f8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26fc6e34715d63f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:00.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.472+0000 7fba0effd700 1 -- 172.21.15.37:0/2064231627 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8011830 con 0x7fba100d2640 2023-07-12T02:05:00.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.472+0000 7fba0effd700 1 -- 172.21.15.37:0/2064231627 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f8011990 con 0x7fba100d2640 2023-07-12T02:05:00.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.472+0000 7fba0effd700 1 -- 172.21.15.37:0/2064231627 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8011d00 con 0x7fba100d2640 2023-07-12T02:05:00.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.473+0000 7fba15bff700 1 -- 172.21.15.37:0/2064231627 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba100d2640 msgr2=0x7fba100cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:00.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.473+0000 7fba15bff700 1 --2- 172.21.15.37:0/2064231627 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba100d2640 0x7fba100cf1e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009840 tx=0x7fb9f8009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:00.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.473+0000 7fba15bff700 1 -- 172.21.15.37:0/2064231627 shutdown_connections 2023-07-12T02:05:00.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.473+0000 7fba15bff700 1 --2- 172.21.15.37:0/2064231627 >> v2:172.21.15.196:3300/0 conn(0x7fba1015c460 0x7fba100b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.473+0000 7fba15bff700 1 --2- 172.21.15.37:0/2064231627 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba100d2640 0x7fba100cf1e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.473+0000 7fba15bff700 1 -- 172.21.15.37:0/2064231627 >> 172.21.15.37:0/2064231627 conn(0x7fba10071660 msgr2=0x7fba10071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:00.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.473+0000 7fba15bff700 1 -- 172.21.15.37:0/2064231627 shutdown_connections 2023-07-12T02:05:00.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.473+0000 7fba15bff700 1 -- 172.21.15.37:0/2064231627 wait complete. 2023-07-12T02:05:00.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.475+0000 7fba15bff700 1 Processor -- start 2023-07-12T02:05:00.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.475+0000 7fba15bff700 1 -- start start 2023-07-12T02:05:00.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.476+0000 7fba15bff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba100cf720 0x7fba100c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.476+0000 7fba15bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba100d2640 0x7fba100c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.476+0000 7fba15bff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba1015c460 0x7fba1014c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.476+0000 7fba15bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1014cfe0 con 0x7fba100d2640 2023-07-12T02:05:00.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.476+0000 7fba15bff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba100c77a0 con 0x7fba1015c460 2023-07-12T02:05:00.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.476+0000 7fba15bff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba101e6940 con 0x7fba100cf720 2023-07-12T02:05:00.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.476+0000 7fba07fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba100d2640 0x7fba100c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.476+0000 7fba07fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba100d2640 0x7fba100c70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57714/0 (socket says 172.21.15.37:57714) 2023-07-12T02:05:00.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.476+0000 7fba07fff700 1 -- 172.21.15.37:0/2251549491 learned_addr learned my addr 172.21.15.37:0/2251549491 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:00.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.476+0000 7fba0ffff700 1 --2- 172.21.15.37:0/2251549491 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba1015c460 0x7fba1014c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.476+0000 7fba0f7fe700 1 --2- 172.21.15.37:0/2251549491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba100cf720 0x7fba100c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.477+0000 7fba07fff700 1 -- 172.21.15.37:0/2251549491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba100cf720 msgr2=0x7fba100c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:00.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.477+0000 7fba07fff700 1 --2- 172.21.15.37:0/2251549491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba100cf720 0x7fba100c6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.477+0000 7fba07fff700 1 -- 172.21.15.37:0/2251549491 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba1015c460 msgr2=0x7fba1014c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:00.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.477+0000 7fba07fff700 1 --2- 172.21.15.37:0/2251549491 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba1015c460 0x7fba1014c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.477+0000 7fba07fff700 1 -- 172.21.15.37:0/2251549491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba000094a0 con 0x7fba100d2640 2023-07-12T02:05:00.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.477+0000 7fba07fff700 1 --2- 172.21.15.37:0/2251549491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba100d2640 0x7fba100c70c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8000c00 tx=0x7fb9f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:00.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.477+0000 7fba0cff9700 1 -- 172.21.15.37:0/2251549491 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8004550 con 0x7fba100d2640 2023-07-12T02:05:00.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.477+0000 7fba15bff700 1 -- 172.21.15.37:0/2251549491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f80094a0 con 0x7fba100d2640 2023-07-12T02:05:00.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.477+0000 7fba0cff9700 1 -- 172.21.15.37:0/2251549491 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f801e070 con 0x7fba100d2640 2023-07-12T02:05:00.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.477+0000 7fba0cff9700 1 -- 172.21.15.37:0/2251549491 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f80038e0 con 0x7fba100d2640 2023-07-12T02:05:00.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.477+0000 7fba15bff700 1 -- 172.21.15.37:0/2251549491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba101e6e70 con 0x7fba100d2640 2023-07-12T02:05:00.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.478+0000 7fba15bff700 1 -- 172.21.15.37:0/2251549491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1004ea60 con 0x7fba100d2640 2023-07-12T02:05:00.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.479+0000 7fba0cff9700 1 -- 172.21.15.37:0/2251549491 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb9f8003a40 con 0x7fba100d2640 2023-07-12T02:05:00.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.481+0000 7fba0cff9700 1 --2- 172.21.15.37:0/2251549491 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb9f006ace0 0x7fb9f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.481+0000 7fba0cff9700 1 -- 172.21.15.37:0/2251549491 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb9f808a710 con 0x7fba100d2640 2023-07-12T02:05:00.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.481+0000 7fba0f7fe700 1 --2- 172.21.15.37:0/2251549491 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb9f006ace0 0x7fb9f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.482+0000 7fba0f7fe700 1 --2- 172.21.15.37:0/2251549491 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb9f006ace0 0x7fb9f006d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fba101f57a0 tx=0x7fba00009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.485+0000 7fba0cff9700 1 -- 172.21.15.37:0/2251549491 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb9f8055400 con 0x7fba100d2640 2023-07-12T02:05:00.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.699+0000 7fba15bff700 1 -- 172.21.15.37:0/2251549491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba100c6450 con 0x7fba100d2640 2023-07-12T02:05:00.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.700+0000 7fba0cff9700 1 -- 172.21.15.37:0/2251549491 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20168 (secure 0 0 0) 0x7fb9f8077e60 con 0x7fba100d2640 2023-07-12T02:05:00.704 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:00.704 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:39.032667+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:05:00.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.703+0000 7fba15bff700 1 -- 172.21.15.37:0/2251549491 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb9f006ace0 msgr2=0x7fb9f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:00.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.703+0000 7fba15bff700 1 --2- 172.21.15.37:0/2251549491 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb9f006ace0 0x7fb9f006d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fba101f57a0 tx=0x7fba00009210 comp rx=0 tx=0).stop 2023-07-12T02:05:00.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.703+0000 7fba15bff700 1 -- 172.21.15.37:0/2251549491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba100d2640 msgr2=0x7fba100c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:00.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.703+0000 7fba15bff700 1 --2- 172.21.15.37:0/2251549491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba100d2640 0x7fba100c70c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8000c00 tx=0x7fb9f8004750 comp rx=0 tx=0).stop 2023-07-12T02:05:00.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.703+0000 7fba15bff700 1 -- 172.21.15.37:0/2251549491 shutdown_connections 2023-07-12T02:05:00.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.703+0000 7fba15bff700 1 --2- 172.21.15.37:0/2251549491 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb9f006ace0 0x7fb9f006d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.703+0000 7fba15bff700 1 --2- 172.21.15.37:0/2251549491 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba1015c460 0x7fba1014c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.703+0000 7fba15bff700 1 --2- 172.21.15.37:0/2251549491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba100cf720 0x7fba100c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.703+0000 7fba15bff700 1 --2- 172.21.15.37:0/2251549491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba100d2640 0x7fba100c70c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.703+0000 7fba15bff700 1 -- 172.21.15.37:0/2251549491 >> 172.21.15.37:0/2251549491 conn(0x7fba10071660 msgr2=0x7fba10071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:00.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.703+0000 7fba15bff700 1 -- 172.21.15.37:0/2251549491 shutdown_connections 2023-07-12T02:05:00.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.703+0000 7fba15bff700 1 -- 172.21.15.37:0/2251549491 wait complete. 2023-07-12T02:05:00.724 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:03:56.039938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:03:56.612707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-12T02:04:00.200885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-12T02:05:00.725 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:05:00.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.925+0000 7f215c3ff700 1 Processor -- start 2023-07-12T02:05:00.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.926+0000 7f215c3ff700 1 -- start start 2023-07-12T02:05:00.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.927+0000 7f215c3ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21540b8430 0x7f21540cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.927+0000 7f215c3ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21540d3730 0x7f21540cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.927+0000 7f215c3ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f21540cfa90 0x7f215415feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.927+0000 7f215c3ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21540b8800 con 0x7f21540b8430 2023-07-12T02:05:00.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.927+0000 7f215c3ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21540d0b20 con 0x7f21540cfa90 2023-07-12T02:05:00.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.927+0000 7f215c3ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21540cfeb0 con 0x7f21540d3730 2023-07-12T02:05:00.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.927+0000 7f215a19b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21540b8430 0x7f21540cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.927+0000 7f215a19b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21540b8430 0x7f21540cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57718/0 (socket says 172.21.15.37:57718) 2023-07-12T02:05:00.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.927+0000 7f215a19b700 1 -- 172.21.15.37:0/718609920 learned_addr learned my addr 172.21.15.37:0/718609920 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:00.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.927+0000 7f215999a700 1 --2- 172.21.15.37:0/718609920 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21540d3730 0x7f21540cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.927+0000 7f215a99c700 1 --2- 172.21.15.37:0/718609920 >> v2:172.21.15.196:3300/0 conn(0x7f21540cfa90 0x7f215415feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.927+0000 7f215a19b700 1 -- 172.21.15.37:0/718609920 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21540d3730 msgr2=0x7f21540cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:00.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.927+0000 7f215a19b700 1 --2- 172.21.15.37:0/718609920 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21540d3730 0x7f21540cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.927+0000 7f215a19b700 1 -- 172.21.15.37:0/718609920 >> v2:172.21.15.196:3300/0 conn(0x7f21540cfa90 msgr2=0x7f215415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:00.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.927+0000 7f215a19b700 1 --2- 172.21.15.37:0/718609920 >> v2:172.21.15.196:3300/0 conn(0x7f21540cfa90 0x7f215415feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.927+0000 7f215a19b700 1 -- 172.21.15.37:0/718609920 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21540b4ee0 con 0x7f21540b8430 2023-07-12T02:05:00.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.928+0000 7f215a19b700 1 --2- 172.21.15.37:0/718609920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21540b8430 0x7f21540cd320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f215406c570 tx=0x7f2150009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3a9b9990923f28 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:00.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.928+0000 7f2159199700 1 -- 172.21.15.37:0/718609920 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215000b870 con 0x7f21540b8430 2023-07-12T02:05:00.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.928+0000 7f2159199700 1 -- 172.21.15.37:0/718609920 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215000b9d0 con 0x7f21540b8430 2023-07-12T02:05:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.928+0000 7f2159199700 1 -- 172.21.15.37:0/718609920 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215000bd60 con 0x7f21540b8430 2023-07-12T02:05:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.928+0000 7f215c3ff700 1 -- 172.21.15.37:0/718609920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21540b8430 msgr2=0x7f21540cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.928+0000 7f215c3ff700 1 --2- 172.21.15.37:0/718609920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21540b8430 0x7f21540cd320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f215406c570 tx=0x7f2150009bd0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.929+0000 7f215c3ff700 1 -- 172.21.15.37:0/718609920 shutdown_connections 2023-07-12T02:05:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.929+0000 7f215c3ff700 1 --2- 172.21.15.37:0/718609920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21540b8430 0x7f21540cd320 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.929+0000 7f215c3ff700 1 --2- 172.21.15.37:0/718609920 >> v2:172.21.15.196:3300/0 conn(0x7f21540cfa90 0x7f215415feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.929+0000 7f215c3ff700 1 --2- 172.21.15.37:0/718609920 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21540d3730 0x7f21540cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.929+0000 7f215c3ff700 1 -- 172.21.15.37:0/718609920 >> 172.21.15.37:0/718609920 conn(0x7f215406b3f0 msgr2=0x7f215406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:00.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.929+0000 7f215c3ff700 1 -- 172.21.15.37:0/718609920 shutdown_connections 2023-07-12T02:05:00.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.929+0000 7f215c3ff700 1 -- 172.21.15.37:0/718609920 wait complete. 2023-07-12T02:05:00.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.930+0000 7f215c3ff700 1 Processor -- start 2023-07-12T02:05:00.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.931+0000 7f215c3ff700 1 -- start start 2023-07-12T02:05:00.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.931+0000 7f215c3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21540b8430 0x7f21541498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.931+0000 7f215c3ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21540cfa90 0x7f215415d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.931+0000 7f215c3ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21540d3730 0x7f215415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.932+0000 7f215c3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21541f2c60 con 0x7f21540b8430 2023-07-12T02:05:00.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.932+0000 7f215c3ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21541f1d20 con 0x7f21540cfa90 2023-07-12T02:05:00.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.932+0000 7f215c3ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21541f1fe0 con 0x7f21540d3730 2023-07-12T02:05:00.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.932+0000 7f215a19b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21540b8430 0x7f21541498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.932+0000 7f215a19b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21540b8430 0x7f21541498d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57734/0 (socket says 172.21.15.37:57734) 2023-07-12T02:05:00.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.932+0000 7f215a19b700 1 -- 172.21.15.37:0/129868633 learned_addr learned my addr 172.21.15.37:0/129868633 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:00.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.932+0000 7f215999a700 1 --2- 172.21.15.37:0/129868633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21540cfa90 0x7f215415d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.932+0000 7f215a99c700 1 --2- 172.21.15.37:0/129868633 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21540d3730 0x7f215415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.932+0000 7f215a19b700 1 -- 172.21.15.37:0/129868633 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21540d3730 msgr2=0x7f215415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:00.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.932+0000 7f215a19b700 1 --2- 172.21.15.37:0/129868633 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21540d3730 0x7f215415eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.932+0000 7f215a19b700 1 -- 172.21.15.37:0/129868633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21540cfa90 msgr2=0x7f215415d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:00.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.932+0000 7f215a19b700 1 --2- 172.21.15.37:0/129868633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21540cfa90 0x7f215415d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:00.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.932+0000 7f215a19b700 1 -- 172.21.15.37:0/129868633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2150009550 con 0x7f21540b8430 2023-07-12T02:05:00.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.932+0000 7f215a19b700 1 --2- 172.21.15.37:0/129868633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21540b8430 0x7f21541498d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2150000c00 tx=0x7f2150004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:00.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.933+0000 7f214affd700 1 -- 172.21.15.37:0/129868633 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2150004520 con 0x7f21540b8430 2023-07-12T02:05:00.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.933+0000 7f214affd700 1 -- 172.21.15.37:0/129868633 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215001e070 con 0x7f21540b8430 2023-07-12T02:05:00.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.933+0000 7f214affd700 1 -- 172.21.15.37:0/129868633 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21500038c0 con 0x7f21540b8430 2023-07-12T02:05:00.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.933+0000 7f215c3ff700 1 -- 172.21.15.37:0/129868633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21541f22c0 con 0x7f21540b8430 2023-07-12T02:05:00.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.933+0000 7f215c3ff700 1 -- 172.21.15.37:0/129868633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21541f2880 con 0x7f21540b8430 2023-07-12T02:05:00.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.934+0000 7f215c3ff700 1 -- 172.21.15.37:0/129868633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215404ea60 con 0x7f21540b8430 2023-07-12T02:05:00.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.935+0000 7f214affd700 1 -- 172.21.15.37:0/129868633 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2150003a20 con 0x7f21540b8430 2023-07-12T02:05:00.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.936+0000 7f214affd700 1 --2- 172.21.15.37:0/129868633 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f213806ace0 0x7f213806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:00.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.936+0000 7f214affd700 1 -- 172.21.15.37:0/129868633 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2150020070 con 0x7f21540b8430 2023-07-12T02:05:00.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.936+0000 7f215999a700 1 --2- 172.21.15.37:0/129868633 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f213806ace0 0x7f213806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:00.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.937+0000 7f215999a700 1 --2- 172.21.15.37:0/129868633 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f213806ace0 0x7f213806d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f21440098b0 tx=0x7f2144008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:00.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:00.941+0000 7f214affd700 1 -- 172.21.15.37:0/129868633 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2150055af0 con 0x7f21540b8430 2023-07-12T02:05:01.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.152+0000 7f215c3ff700 1 -- 172.21.15.37:0/129868633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f215415b5d0 con 0x7f21540b8430 2023-07-12T02:05:01.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.152+0000 7f214affd700 1 -- 172.21.15.37:0/129868633 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2150059110 con 0x7f21540b8430 2023-07-12T02:05:01.156 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:05:01.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.155+0000 7f215c3ff700 1 -- 172.21.15.37:0/129868633 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f213806ace0 msgr2=0x7f213806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:01.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.155+0000 7f215c3ff700 1 --2- 172.21.15.37:0/129868633 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f213806ace0 0x7f213806d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f21440098b0 tx=0x7f2144008040 comp rx=0 tx=0).stop 2023-07-12T02:05:01.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.155+0000 7f215c3ff700 1 -- 172.21.15.37:0/129868633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21540b8430 msgr2=0x7f21541498d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:01.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.155+0000 7f215c3ff700 1 --2- 172.21.15.37:0/129868633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21540b8430 0x7f21541498d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2150000c00 tx=0x7f2150004750 comp rx=0 tx=0).stop 2023-07-12T02:05:01.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.155+0000 7f215c3ff700 1 -- 172.21.15.37:0/129868633 shutdown_connections 2023-07-12T02:05:01.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.155+0000 7f215c3ff700 1 --2- 172.21.15.37:0/129868633 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f213806ace0 0x7f213806d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.155+0000 7f215c3ff700 1 --2- 172.21.15.37:0/129868633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21540b8430 0x7f21541498d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.155+0000 7f215c3ff700 1 --2- 172.21.15.37:0/129868633 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f21540d3730 0x7f215415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.155+0000 7f215c3ff700 1 --2- 172.21.15.37:0/129868633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21540cfa90 0x7f215415d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.155+0000 7f215c3ff700 1 -- 172.21.15.37:0/129868633 >> 172.21.15.37:0/129868633 conn(0x7f215406b3f0 msgr2=0x7f21540b62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:01.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.155+0000 7f215c3ff700 1 -- 172.21.15.37:0/129868633 shutdown_connections 2023-07-12T02:05:01.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.155+0000 7f215c3ff700 1 -- 172.21.15.37:0/129868633 wait complete. 2023-07-12T02:05:01.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:05:01.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.377+0000 7f0a677ff700 1 Processor -- start 2023-07-12T02:05:01.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.377+0000 7f0a677ff700 1 -- start start 2023-07-12T02:05:01.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.379+0000 7f0a677ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a600d3730 0x7f0a600cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:01.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.379+0000 7f0a677ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0a600cfa90 0x7f0a600d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:01.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.379+0000 7f0a677ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a600d0b20 con 0x7f0a600b8430 2023-07-12T02:05:01.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.379+0000 7f0a677ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a600cda30 con 0x7f0a600cfa90 2023-07-12T02:05:01.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.379+0000 7f0a677ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a600b8800 con 0x7f0a600d3730 2023-07-12T02:05:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.379+0000 7f0a64d9a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a600d3730 0x7f0a600cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.379+0000 7f0a65d9c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0a600cfa90 0x7f0a600d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.379+0000 7f0a6559b700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0a600b8430 0x7f0a600cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:43154/0 (socket says 172.21.15.37:43154) 2023-07-12T02:05:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.379+0000 7f0a6559b700 1 -- 172.21.15.37:0/1691178714 learned_addr learned my addr 172.21.15.37:0/1691178714 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.380+0000 7f0a57fff700 1 -- 172.21.15.37:0/1691178714 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674862697 0 0) 0x7f0a600d0b20 con 0x7f0a600b8430 2023-07-12T02:05:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.380+0000 7f0a64d9a700 1 -- 172.21.15.37:0/1691178714 >> v2:172.21.15.196:3300/0 conn(0x7f0a600cfa90 msgr2=0x7f0a600d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.380+0000 7f0a64d9a700 1 --2- 172.21.15.37:0/1691178714 >> v2:172.21.15.196:3300/0 conn(0x7f0a600cfa90 0x7f0a600d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.380+0000 7f0a64d9a700 1 -- 172.21.15.37:0/1691178714 >> v1:172.21.15.196:6789/0 conn(0x7f0a600b8430 legacy=0x7f0a600cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.380+0000 7f0a64d9a700 1 -- 172.21.15.37:0/1691178714 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a600cfeb0 con 0x7f0a600d3730 2023-07-12T02:05:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.380+0000 7f0a65d9c700 1 --2- 172.21.15.37:0/1691178714 >> v2:172.21.15.196:3300/0 conn(0x7f0a600cfa90 0x7f0a600d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.380+0000 7f0a64d9a700 1 --2- 172.21.15.37:0/1691178714 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a600d3730 0x7f0a600cf550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009840 tx=0x7f0a50009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1446cc971728bf19 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.380+0000 7f0a57fff700 1 -- 172.21.15.37:0/1691178714 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50011830 con 0x7f0a600d3730 2023-07-12T02:05:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.380+0000 7f0a57fff700 1 -- 172.21.15.37:0/1691178714 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a50011990 con 0x7f0a600d3730 2023-07-12T02:05:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.380+0000 7f0a57fff700 1 -- 172.21.15.37:0/1691178714 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50011d20 con 0x7f0a600d3730 2023-07-12T02:05:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.381+0000 7f0a677ff700 1 -- 172.21.15.37:0/1691178714 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a600d3730 msgr2=0x7f0a600cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.381+0000 7f0a677ff700 1 --2- 172.21.15.37:0/1691178714 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a600d3730 0x7f0a600cf550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009840 tx=0x7f0a50009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.381+0000 7f0a677ff700 1 -- 172.21.15.37:0/1691178714 shutdown_connections 2023-07-12T02:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.381+0000 7f0a677ff700 1 --2- 172.21.15.37:0/1691178714 >> v2:172.21.15.196:3300/0 conn(0x7f0a600cfa90 0x7f0a600d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.381+0000 7f0a677ff700 1 --2- 172.21.15.37:0/1691178714 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a600d3730 0x7f0a600cf550 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.381+0000 7f0a677ff700 1 -- 172.21.15.37:0/1691178714 >> 172.21.15.37:0/1691178714 conn(0x7f0a6006b3f0 msgr2=0x7f0a6006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.381+0000 7f0a677ff700 1 -- 172.21.15.37:0/1691178714 shutdown_connections 2023-07-12T02:05:01.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.381+0000 7f0a677ff700 1 -- 172.21.15.37:0/1691178714 wait complete. 2023-07-12T02:05:01.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.383+0000 7f0a677ff700 1 Processor -- start 2023-07-12T02:05:01.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.383+0000 7f0a677ff700 1 -- start start 2023-07-12T02:05:01.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.384+0000 7f0a677ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a600b8430 0x7f0a60153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:01.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.384+0000 7f0a677ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a600cfa90 0x7f0a6015c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:01.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.384+0000 7f0a677ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a600d3730 0x7f0a60154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:01.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.384+0000 7f0a677ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a60154480 con 0x7f0a600cfa90 2023-07-12T02:05:01.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.384+0000 7f0a677ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a600cb330 con 0x7f0a600d3730 2023-07-12T02:05:01.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.384+0000 7f0a677ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a600cb610 con 0x7f0a600b8430 2023-07-12T02:05:01.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.384+0000 7f0a64d9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a600cfa90 0x7f0a6015c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:01.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.384+0000 7f0a64d9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a600cfa90 0x7f0a6015c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57750/0 (socket says 172.21.15.37:57750) 2023-07-12T02:05:01.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.384+0000 7f0a64d9a700 1 -- 172.21.15.37:0/3800387653 learned_addr learned my addr 172.21.15.37:0/3800387653 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:01.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.384+0000 7f0a65d9c700 1 --2- 172.21.15.37:0/3800387653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a600d3730 0x7f0a60154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:01.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.385+0000 7f0a64d9a700 1 -- 172.21.15.37:0/3800387653 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a600b8430 msgr2=0x7f0a60153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:01.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.385+0000 7f0a64d9a700 1 --2- 172.21.15.37:0/3800387653 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a600b8430 0x7f0a60153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.385+0000 7f0a64d9a700 1 -- 172.21.15.37:0/3800387653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a600d3730 msgr2=0x7f0a60154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:01.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.385+0000 7f0a64d9a700 1 --2- 172.21.15.37:0/3800387653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a600d3730 0x7f0a60154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.385+0000 7f0a64d9a700 1 -- 172.21.15.37:0/3800387653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a58009a70 con 0x7f0a600cfa90 2023-07-12T02:05:01.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.385+0000 7f0a64d9a700 1 --2- 172.21.15.37:0/3800387653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a600cfa90 0x7f0a6015c910 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009fd0 tx=0x7f0a50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:01.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.385+0000 7f0a55ffb700 1 -- 172.21.15.37:0/3800387653 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a500038a0 con 0x7f0a600cfa90 2023-07-12T02:05:01.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.385+0000 7f0a55ffb700 1 -- 172.21.15.37:0/3800387653 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5001f070 con 0x7f0a600cfa90 2023-07-12T02:05:01.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.385+0000 7f0a677ff700 1 -- 172.21.15.37:0/3800387653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a500094a0 con 0x7f0a600cfa90 2023-07-12T02:05:01.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.385+0000 7f0a55ffb700 1 -- 172.21.15.37:0/3800387653 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50003c40 con 0x7f0a600cfa90 2023-07-12T02:05:01.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.385+0000 7f0a677ff700 1 -- 172.21.15.37:0/3800387653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a600c8750 con 0x7f0a600cfa90 2023-07-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.386+0000 7f0a677ff700 1 -- 172.21.15.37:0/3800387653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6004ea60 con 0x7f0a600cfa90 2023-07-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.387+0000 7f0a55ffb700 1 -- 172.21.15.37:0/3800387653 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a50026480 con 0x7f0a600cfa90 2023-07-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.388+0000 7f0a55ffb700 1 --2- 172.21.15.37:0/3800387653 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0a4406ace0 0x7f0a4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:01.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.388+0000 7f0a55ffb700 1 -- 172.21.15.37:0/3800387653 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0a50021070 con 0x7f0a600cfa90 2023-07-12T02:05:01.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.388+0000 7f0a6559b700 1 --2- 172.21.15.37:0/3800387653 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0a4406ace0 0x7f0a4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:01.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.389+0000 7f0a6559b700 1 --2- 172.21.15.37:0/3800387653 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0a4406ace0 0x7f0a4406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c0011e0 tx=0x7f0a5c0079b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:01.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.392+0000 7f0a55ffb700 1 -- 172.21.15.37:0/3800387653 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0a50055dc0 con 0x7f0a600cfa90 2023-07-12T02:05:01.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.597+0000 7f0a677ff700 1 -- 172.21.15.37:0/3800387653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0a600b3c90 con 0x7f0a600cfa90 2023-07-12T02:05:01.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.597+0000 7f0a55ffb700 1 -- 172.21.15.37:0/3800387653 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0a500593e0 con 0x7f0a600cfa90 2023-07-12T02:05:01.601 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:05:01.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.600+0000 7f0a677ff700 1 -- 172.21.15.37:0/3800387653 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0a4406ace0 msgr2=0x7f0a4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:01.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.600+0000 7f0a677ff700 1 --2- 172.21.15.37:0/3800387653 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0a4406ace0 0x7f0a4406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c0011e0 tx=0x7f0a5c0079b0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.600+0000 7f0a677ff700 1 -- 172.21.15.37:0/3800387653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a600cfa90 msgr2=0x7f0a6015c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:01.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.600+0000 7f0a677ff700 1 --2- 172.21.15.37:0/3800387653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a600cfa90 0x7f0a6015c910 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009fd0 tx=0x7f0a50004750 comp rx=0 tx=0).stop 2023-07-12T02:05:01.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.600+0000 7f0a677ff700 1 -- 172.21.15.37:0/3800387653 shutdown_connections 2023-07-12T02:05:01.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.600+0000 7f0a677ff700 1 --2- 172.21.15.37:0/3800387653 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0a4406ace0 0x7f0a4406d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.600+0000 7f0a677ff700 1 --2- 172.21.15.37:0/3800387653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a600d3730 0x7f0a60154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.600+0000 7f0a677ff700 1 --2- 172.21.15.37:0/3800387653 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a600b8430 0x7f0a60153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.600+0000 7f0a677ff700 1 --2- 172.21.15.37:0/3800387653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a600cfa90 0x7f0a6015c910 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.600+0000 7f0a677ff700 1 -- 172.21.15.37:0/3800387653 >> 172.21.15.37:0/3800387653 conn(0x7f0a6006b3f0 msgr2=0x7f0a6015bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:01.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.600+0000 7f0a677ff700 1 -- 172.21.15.37:0/3800387653 shutdown_connections 2023-07-12T02:05:01.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.600+0000 7f0a677ff700 1 -- 172.21.15.37:0/3800387653 wait complete. 2023-07-12T02:05:01.621 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:05:01.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.821+0000 7f08bf9ff700 1 Processor -- start 2023-07-12T02:05:01.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.822+0000 7f08bf9ff700 1 -- start start 2023-07-12T02:05:01.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.823+0000 7f08bf9ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f08b80b8430 0x7f08b80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:01.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.823+0000 7f08bf9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08b80d3730 0x7f08b80cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:01.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.823+0000 7f08bf9ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b80d0b20 con 0x7f08b80cfa90 2023-07-12T02:05:01.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.823+0000 7f08bf9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b80b8800 con 0x7f08b80d3730 2023-07-12T02:05:01.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.823+0000 7f08bf9ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b80cfe90 con 0x7f08b80b8430 2023-07-12T02:05:01.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.823+0000 7f08bcf9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08b80d3730 0x7f08b80cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:01.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.823+0000 7f08bdf9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f08b80cfa90 0x7f08b815feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52760/0 (socket says 172.21.15.37:52760) 2023-07-12T02:05:01.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.823+0000 7f08bdf9c700 1 -- 172.21.15.37:0/1484078093 learned_addr learned my addr 172.21.15.37:0/1484078093 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:01.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.823+0000 7f08bd79b700 1 --2- 172.21.15.37:0/1484078093 >> v2:172.21.15.196:3300/0 conn(0x7f08b80b8430 0x7f08b80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.823+0000 7f08bcf9a700 1 -- 172.21.15.37:0/1484078093 >> v2:172.21.15.196:3300/0 conn(0x7f08b80b8430 msgr2=0x7f08b80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.823+0000 7f08bcf9a700 1 --2- 172.21.15.37:0/1484078093 >> v2:172.21.15.196:3300/0 conn(0x7f08b80b8430 0x7f08b80cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.823+0000 7f08bcf9a700 1 -- 172.21.15.37:0/1484078093 >> v1:172.21.15.37:6789/0 conn(0x7f08b80cfa90 legacy=0x7f08b815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:01.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.824+0000 7f08bcf9a700 1 -- 172.21.15.37:0/1484078093 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b80b4ee0 con 0x7f08b80d3730 2023-07-12T02:05:01.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.824+0000 7f08affff700 1 -- 172.21.15.37:0/1484078093 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832811415 0 0) 0x7f08b80d0b20 con 0x7f08b80cfa90 2023-07-12T02:05:01.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.824+0000 7f08bcf9a700 1 --2- 172.21.15.37:0/1484078093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b80d3730 0x7f08b80cf550 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f08b80cf520 tx=0x7f08a8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d8a411e0971aea server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:01.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.824+0000 7f08affff700 1 -- 172.21.15.37:0/1484078093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8011830 con 0x7f08b80d3730 2023-07-12T02:05:01.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.824+0000 7f08affff700 1 -- 172.21.15.37:0/1484078093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a8011990 con 0x7f08b80d3730 2023-07-12T02:05:01.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.824+0000 7f08affff700 1 -- 172.21.15.37:0/1484078093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8011d20 con 0x7f08b80d3730 2023-07-12T02:05:01.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.825+0000 7f08bf9ff700 1 -- 172.21.15.37:0/1484078093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b80d3730 msgr2=0x7f08b80cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:01.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.825+0000 7f08bf9ff700 1 --2- 172.21.15.37:0/1484078093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b80d3730 0x7f08b80cf550 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f08b80cf520 tx=0x7f08a8009b20 comp rx=0 tx=0).stop 2023-07-12T02:05:01.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.825+0000 7f08bf9ff700 1 -- 172.21.15.37:0/1484078093 shutdown_connections 2023-07-12T02:05:01.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.825+0000 7f08bf9ff700 1 --2- 172.21.15.37:0/1484078093 >> v2:172.21.15.196:3300/0 conn(0x7f08b80b8430 0x7f08b80cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.825+0000 7f08bf9ff700 1 --2- 172.21.15.37:0/1484078093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b80d3730 0x7f08b80cf550 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.825+0000 7f08bf9ff700 1 -- 172.21.15.37:0/1484078093 >> 172.21.15.37:0/1484078093 conn(0x7f08b806b3f0 msgr2=0x7f08b806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:01.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.825+0000 7f08bf9ff700 1 -- 172.21.15.37:0/1484078093 shutdown_connections 2023-07-12T02:05:01.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.825+0000 7f08bf9ff700 1 -- 172.21.15.37:0/1484078093 wait complete. 2023-07-12T02:05:01.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.827+0000 7f08bf9ff700 1 Processor -- start 2023-07-12T02:05:01.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.827+0000 7f08bf9ff700 1 -- start start 2023-07-12T02:05:01.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bf9ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08b80b8430 0x7f08b8155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:01.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bf9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b80cfa90 0x7f08b80b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:01.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bf9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08b80d3730 0x7f08b80b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:01.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bf9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b8155640 con 0x7f08b80cfa90 2023-07-12T02:05:01.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bf9ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b815d120 con 0x7f08b80b8430 2023-07-12T02:05:01.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bf9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b815d5e0 con 0x7f08b80d3730 2023-07-12T02:05:01.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bcf9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b80cfa90 0x7f08b80b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:01.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bcf9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b80cfa90 0x7f08b80b6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57760/0 (socket says 172.21.15.37:57760) 2023-07-12T02:05:01.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bcf9a700 1 -- 172.21.15.37:0/2389386610 learned_addr learned my addr 172.21.15.37:0/2389386610 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:01.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bdf9c700 1 --2- 172.21.15.37:0/2389386610 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08b80d3730 0x7f08b80b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:01.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bd79b700 1 --2- 172.21.15.37:0/2389386610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08b80b8430 0x7f08b8155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:01.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bcf9a700 1 -- 172.21.15.37:0/2389386610 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08b80d3730 msgr2=0x7f08b80b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:01.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bcf9a700 1 --2- 172.21.15.37:0/2389386610 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08b80d3730 0x7f08b80b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bcf9a700 1 -- 172.21.15.37:0/2389386610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08b80b8430 msgr2=0x7f08b8155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bcf9a700 1 --2- 172.21.15.37:0/2389386610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08b80b8430 0x7f08b8155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bcf9a700 1 -- 172.21.15.37:0/2389386610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a80094a0 con 0x7f08b80cfa90 2023-07-12T02:05:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.828+0000 7f08bd79b700 1 --2- 172.21.15.37:0/2389386610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08b80b8430 0x7f08b8155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.829+0000 7f08bcf9a700 1 --2- 172.21.15.37:0/2389386610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b80cfa90 0x7f08b80b6e90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f08a80090b0 tx=0x7f08a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.829+0000 7f08adffb700 1 -- 172.21.15.37:0/2389386610 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a80038a0 con 0x7f08b80cfa90 2023-07-12T02:05:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.829+0000 7f08adffb700 1 -- 172.21.15.37:0/2389386610 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a801f070 con 0x7f08b80cfa90 2023-07-12T02:05:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.829+0000 7f08adffb700 1 -- 172.21.15.37:0/2389386610 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8003c20 con 0x7f08b80cfa90 2023-07-12T02:05:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.829+0000 7f08bf9ff700 1 -- 172.21.15.37:0/2389386610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b815d880 con 0x7f08b80cfa90 2023-07-12T02:05:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.829+0000 7f08bf9ff700 1 -- 172.21.15.37:0/2389386610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b815de40 con 0x7f08b80cfa90 2023-07-12T02:05:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.830+0000 7f08bf9ff700 1 -- 172.21.15.37:0/2389386610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b804ea60 con 0x7f08b80cfa90 2023-07-12T02:05:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.831+0000 7f08adffb700 1 -- 172.21.15.37:0/2389386610 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f08a801a430 con 0x7f08b80cfa90 2023-07-12T02:05:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.832+0000 7f08adffb700 1 --2- 172.21.15.37:0/2389386610 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f089c06ace0 0x7f089c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.832+0000 7f08adffb700 1 -- 172.21.15.37:0/2389386610 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f08a8021070 con 0x7f08b80cfa90 2023-07-12T02:05:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.832+0000 7f08bd79b700 1 --2- 172.21.15.37:0/2389386610 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f089c06ace0 0x7f089c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.833+0000 7f08bd79b700 1 --2- 172.21.15.37:0/2389386610 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f089c06ace0 0x7f089c06d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009ac0 tx=0x7f08b4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:01.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:01.836+0000 7f08adffb700 1 -- 172.21.15.37:0/2389386610 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f08a8055e60 con 0x7f08b80cfa90 2023-07-12T02:05:02.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.043+0000 7f08bf9ff700 1 -- 172.21.15.37:0/2389386610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08b815bce0 con 0x7f08b80cfa90 2023-07-12T02:05:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.043+0000 7f08adffb700 1 -- 172.21.15.37:0/2389386610 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f08a8015020 con 0x7f08b80cfa90 2023-07-12T02:05:02.047 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:05:02.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.046+0000 7f08bf9ff700 1 -- 172.21.15.37:0/2389386610 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f089c06ace0 msgr2=0x7f089c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:02.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.046+0000 7f08bf9ff700 1 --2- 172.21.15.37:0/2389386610 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f089c06ace0 0x7f089c06d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009ac0 tx=0x7f08b4008040 comp rx=0 tx=0).stop 2023-07-12T02:05:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.046+0000 7f08bf9ff700 1 -- 172.21.15.37:0/2389386610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b80cfa90 msgr2=0x7f08b80b6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.046+0000 7f08bf9ff700 1 --2- 172.21.15.37:0/2389386610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b80cfa90 0x7f08b80b6e90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f08a80090b0 tx=0x7f08a8004750 comp rx=0 tx=0).stop 2023-07-12T02:05:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.046+0000 7f08bf9ff700 1 -- 172.21.15.37:0/2389386610 shutdown_connections 2023-07-12T02:05:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.046+0000 7f08bf9ff700 1 --2- 172.21.15.37:0/2389386610 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f089c06ace0 0x7f089c06d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.046+0000 7f08bf9ff700 1 --2- 172.21.15.37:0/2389386610 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08b80d3730 0x7f08b80b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.046+0000 7f08bf9ff700 1 --2- 172.21.15.37:0/2389386610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08b80b8430 0x7f08b8155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.046+0000 7f08bf9ff700 1 --2- 172.21.15.37:0/2389386610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b80cfa90 0x7f08b80b6e90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.046+0000 7f08bf9ff700 1 -- 172.21.15.37:0/2389386610 >> 172.21.15.37:0/2389386610 conn(0x7f08b806b3f0 msgr2=0x7f08b80d18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:02.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.046+0000 7f08bf9ff700 1 -- 172.21.15.37:0/2389386610 shutdown_connections 2023-07-12T02:05:02.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.046+0000 7f08bf9ff700 1 -- 172.21.15.37:0/2389386610 wait complete. 2023-07-12T02:05:02.067 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:05:02.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.271+0000 7fb0653ff700 1 Processor -- start 2023-07-12T02:05:02.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.271+0000 7fb0653ff700 1 -- start start 2023-07-12T02:05:02.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.272+0000 7fb0653ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb06015fcf0 0x7fb0600b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:02.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.272+0000 7fb0653ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0601600c0 0x7fb06015ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:02.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.272+0000 7fb0653ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0600ceec0 con 0x7fb06015d370 2023-07-12T02:05:02.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.272+0000 7fb0653ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0600cd1e0 con 0x7fb06015fcf0 2023-07-12T02:05:02.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.272+0000 7fb0653ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0600cd4c0 con 0x7fb0601600c0 2023-07-12T02:05:02.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.273+0000 7fb05effd700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb06015fcf0 0x7fb0600b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:02.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.273+0000 7fb057fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0601600c0 0x7fb06015ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:02.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.273+0000 7fb05effd700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb06015fcf0 0x7fb0600b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:56286/0 (socket says 172.21.15.37:56286) 2023-07-12T02:05:02.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.273+0000 7fb05effd700 1 -- 172.21.15.37:0/2313019067 learned_addr learned my addr 172.21.15.37:0/2313019067 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:02.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.273+0000 7fb05e7fc700 1 -- 172.21.15.37:0/2313019067 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689093853 0 0) 0x7fb0600ceec0 con 0x7fb06015d370 2023-07-12T02:05:02.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.273+0000 7fb05e7fc700 1 -- 172.21.15.37:0/2313019067 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb04c0035b0 con 0x7fb06015d370 2023-07-12T02:05:02.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.273+0000 7fb05effd700 1 -- 172.21.15.37:0/2313019067 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0601600c0 msgr2=0x7fb06015ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:02.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.273+0000 7fb05effd700 1 --2- 172.21.15.37:0/2313019067 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0601600c0 0x7fb06015ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.273+0000 7fb05effd700 1 -- 172.21.15.37:0/2313019067 >> v1:172.21.15.196:6789/0 conn(0x7fb06015d370 legacy=0x7fb0600cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:02.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.273+0000 7fb05effd700 1 -- 172.21.15.37:0/2313019067 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0600cf160 con 0x7fb06015fcf0 2023-07-12T02:05:02.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.273+0000 7fb057fff700 1 --2- 172.21.15.37:0/2313019067 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0601600c0 0x7fb06015ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:02.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.274+0000 7fb05effd700 1 --2- 172.21.15.37:0/2313019067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb06015fcf0 0x7fb0600b1e30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb0500098f0 tx=0x7fb050009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a8a2ea0c1cff58b server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:02.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.274+0000 7fb05e7fc700 1 -- 172.21.15.37:0/2313019067 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050011830 con 0x7fb06015fcf0 2023-07-12T02:05:02.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.274+0000 7fb05e7fc700 1 -- 172.21.15.37:0/2313019067 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb050011990 con 0x7fb06015fcf0 2023-07-12T02:05:02.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.274+0000 7fb05e7fc700 1 -- 172.21.15.37:0/2313019067 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050011d20 con 0x7fb06015fcf0 2023-07-12T02:05:02.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.274+0000 7fb0653ff700 1 -- 172.21.15.37:0/2313019067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb06015fcf0 msgr2=0x7fb0600b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:02.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.274+0000 7fb0653ff700 1 --2- 172.21.15.37:0/2313019067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb06015fcf0 0x7fb0600b1e30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb0500098f0 tx=0x7fb050009c00 comp rx=0 tx=0).stop 2023-07-12T02:05:02.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.275+0000 7fb0653ff700 1 -- 172.21.15.37:0/2313019067 shutdown_connections 2023-07-12T02:05:02.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.275+0000 7fb0653ff700 1 --2- 172.21.15.37:0/2313019067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb06015fcf0 0x7fb0600b1e30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.275+0000 7fb0653ff700 1 --2- 172.21.15.37:0/2313019067 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0601600c0 0x7fb06015ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.275+0000 7fb0653ff700 1 -- 172.21.15.37:0/2313019067 >> 172.21.15.37:0/2313019067 conn(0x7fb060071660 msgr2=0x7fb060071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:02.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.275+0000 7fb0653ff700 1 -- 172.21.15.37:0/2313019067 shutdown_connections 2023-07-12T02:05:02.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.275+0000 7fb0653ff700 1 -- 172.21.15.37:0/2313019067 wait complete. 2023-07-12T02:05:02.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.276+0000 7fb0653ff700 1 Processor -- start 2023-07-12T02:05:02.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.277+0000 7fb0653ff700 1 -- start start 2023-07-12T02:05:02.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.277+0000 7fb0653ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06015d370 0x7fb0600c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.277+0000 7fb0653ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb06015fcf0 0x7fb0600c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.278+0000 7fb0653ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0601600c0 0x7fb0600d1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.278+0000 7fb0653ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0600ca2e0 con 0x7fb06015d370 2023-07-12T02:05:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.278+0000 7fb0653ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0600c7230 con 0x7fb06015fcf0 2023-07-12T02:05:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.278+0000 7fb0653ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0600c6620 con 0x7fb0601600c0 2023-07-12T02:05:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.278+0000 7fb05effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06015d370 0x7fb0600c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:02.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.278+0000 7fb05effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06015d370 0x7fb0600c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33892/0 (socket says 172.21.15.37:33892) 2023-07-12T02:05:02.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.278+0000 7fb05effd700 1 -- 172.21.15.37:0/1830900554 learned_addr learned my addr 172.21.15.37:0/1830900554 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:02.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.278+0000 7fb057fff700 1 --2- 172.21.15.37:0/1830900554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb06015fcf0 0x7fb0600c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:02.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.278+0000 7fb05f7fe700 1 --2- 172.21.15.37:0/1830900554 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0601600c0 0x7fb0600d1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:02.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.278+0000 7fb05effd700 1 -- 172.21.15.37:0/1830900554 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0601600c0 msgr2=0x7fb0600d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:02.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.278+0000 7fb05effd700 1 --2- 172.21.15.37:0/1830900554 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0601600c0 0x7fb0600d1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.278+0000 7fb05effd700 1 -- 172.21.15.37:0/1830900554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb06015fcf0 msgr2=0x7fb0600c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.278+0000 7fb05effd700 1 --2- 172.21.15.37:0/1830900554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb06015fcf0 0x7fb0600c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.278+0000 7fb05effd700 1 -- 172.21.15.37:0/1830900554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0480094a0 con 0x7fb06015d370 2023-07-12T02:05:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.279+0000 7fb05effd700 1 --2- 172.21.15.37:0/1830900554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06015d370 0x7fb0600c9da0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb050000c00 tx=0x7fb050004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.279+0000 7fb0577fe700 1 -- 172.21.15.37:0/1830900554 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050004380 con 0x7fb06015d370 2023-07-12T02:05:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.279+0000 7fb0577fe700 1 -- 172.21.15.37:0/1830900554 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05001f070 con 0x7fb06015d370 2023-07-12T02:05:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.279+0000 7fb0653ff700 1 -- 172.21.15.37:0/1830900554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb050009550 con 0x7fb06015d370 2023-07-12T02:05:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.279+0000 7fb0577fe700 1 -- 172.21.15.37:0/1830900554 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0500036a0 con 0x7fb06015d370 2023-07-12T02:05:02.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.279+0000 7fb0653ff700 1 -- 172.21.15.37:0/1830900554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0600cff10 con 0x7fb06015d370 2023-07-12T02:05:02.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.280+0000 7fb0653ff700 1 -- 172.21.15.37:0/1830900554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06004ea60 con 0x7fb06015d370 2023-07-12T02:05:02.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.281+0000 7fb0577fe700 1 -- 172.21.15.37:0/1830900554 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb050021030 con 0x7fb06015d370 2023-07-12T02:05:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.282+0000 7fb0577fe700 1 --2- 172.21.15.37:0/1830900554 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb04006ace0 0x7fb04006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.282+0000 7fb0577fe700 1 -- 172.21.15.37:0/1830900554 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb05008af90 con 0x7fb06015d370 2023-07-12T02:05:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.283+0000 7fb057fff700 1 --2- 172.21.15.37:0/1830900554 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb04006ace0 0x7fb04006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.283+0000 7fb057fff700 1 --2- 172.21.15.37:0/1830900554 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb04006ace0 0x7fb04006d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb06015c6f0 tx=0x7fb048009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.285+0000 7fb0577fe700 1 -- 172.21.15.37:0/1830900554 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb050055ea0 con 0x7fb06015d370 2023-07-12T02:05:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.493+0000 7fb0653ff700 1 -- 172.21.15.37:0/1830900554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0600d0170 con 0x7fb06015d370 2023-07-12T02:05:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.493+0000 7fb0577fe700 1 -- 172.21.15.37:0/1830900554 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb0500150a0 con 0x7fb06015d370 2023-07-12T02:05:02.497 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-12T02:05:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.495+0000 7fb0653ff700 1 -- 172.21.15.37:0/1830900554 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb04006ace0 msgr2=0x7fb04006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.495+0000 7fb0653ff700 1 --2- 172.21.15.37:0/1830900554 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb04006ace0 0x7fb04006d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb06015c6f0 tx=0x7fb048009210 comp rx=0 tx=0).stop 2023-07-12T02:05:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.495+0000 7fb0653ff700 1 -- 172.21.15.37:0/1830900554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06015d370 msgr2=0x7fb0600c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:02.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.495+0000 7fb0653ff700 1 --2- 172.21.15.37:0/1830900554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06015d370 0x7fb0600c9da0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb050000c00 tx=0x7fb050004750 comp rx=0 tx=0).stop 2023-07-12T02:05:02.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.495+0000 7fb0653ff700 1 -- 172.21.15.37:0/1830900554 shutdown_connections 2023-07-12T02:05:02.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.495+0000 7fb0653ff700 1 --2- 172.21.15.37:0/1830900554 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb04006ace0 0x7fb04006d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.495+0000 7fb0653ff700 1 --2- 172.21.15.37:0/1830900554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06015d370 0x7fb0600c9da0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.495+0000 7fb0653ff700 1 --2- 172.21.15.37:0/1830900554 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0601600c0 0x7fb0600d1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.495+0000 7fb0653ff700 1 --2- 172.21.15.37:0/1830900554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb06015fcf0 0x7fb0600c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.495+0000 7fb0653ff700 1 -- 172.21.15.37:0/1830900554 >> 172.21.15.37:0/1830900554 conn(0x7fb060071660 msgr2=0x7fb0600d05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.495+0000 7fb0653ff700 1 -- 172.21.15.37:0/1830900554 shutdown_connections 2023-07-12T02:05:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.495+0000 7fb0653ff700 1 -- 172.21.15.37:0/1830900554 wait complete. 2023-07-12T02:05:02.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-12T02:05:02.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.717+0000 7fcf243ff700 1 Processor -- start 2023-07-12T02:05:02.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.717+0000 7fcf243ff700 1 -- start start 2023-07-12T02:05:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.719+0000 7fcf243ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcf1c0d3730 0x7fcf1c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.719+0000 7fcf243ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf1c0cfa90 0x7fcf1c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.719+0000 7fcf243ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c0d0b20 con 0x7fcf1c0b8430 2023-07-12T02:05:02.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.719+0000 7fcf243ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c0cda30 con 0x7fcf1c0d3730 2023-07-12T02:05:02.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.719+0000 7fcf243ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0b8800 con 0x7fcf1c0cfa90 2023-07-12T02:05:02.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.719+0000 7fcf2199a700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcf1c0d3730 0x7fcf1c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:02.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.719+0000 7fcf2299c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf1c0cfa90 0x7fcf1c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:02.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.719+0000 7fcf2219b700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fcf1c0b8430 0x7fcf1c0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:41812/0 (socket says 172.21.15.37:41812) 2023-07-12T02:05:02.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.719+0000 7fcf2219b700 1 -- 172.21.15.37:0/2313606964 learned_addr learned my addr 172.21.15.37:0/2313606964 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:02.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.719+0000 7fcf2299c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf1c0cfa90 0x7fcf1c0d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:58110/0 (socket says 172.21.15.37:58110) 2023-07-12T02:05:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.719+0000 7fcf2199a700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcf1c0d3730 0x7fcf1c0cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:56310/0 (socket says 172.21.15.37:56310) 2023-07-12T02:05:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.720+0000 7fcf2199a700 1 -- 172.21.15.37:0/2313606964 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf1c0cfa90 msgr2=0x7fcf1c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.720+0000 7fcf2199a700 1 --2- 172.21.15.37:0/2313606964 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf1c0cfa90 0x7fcf1c0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.720+0000 7fcf2199a700 1 -- 172.21.15.37:0/2313606964 >> v1:172.21.15.196:6789/0 conn(0x7fcf1c0b8430 legacy=0x7fcf1c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.720+0000 7fcf2199a700 1 -- 172.21.15.37:0/2313606964 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c0cfeb0 con 0x7fcf1c0d3730 2023-07-12T02:05:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.720+0000 7fcf21199700 1 -- 172.21.15.37:0/2313606964 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220908142 0 0) 0x7fcf1c0d0b20 con 0x7fcf1c0b8430 2023-07-12T02:05:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.720+0000 7fcf2299c700 1 --2- 172.21.15.37:0/2313606964 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf1c0cfa90 0x7fcf1c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:02.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.720+0000 7fcf2199a700 1 --2- 172.21.15.37:0/2313606964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf1c0d3730 0x7fcf1c0cf550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009840 tx=0x7fcf0c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c15266090c0b7064 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:02.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.720+0000 7fcf21199700 1 -- 172.21.15.37:0/2313606964 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c011830 con 0x7fcf1c0d3730 2023-07-12T02:05:02.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.720+0000 7fcf21199700 1 -- 172.21.15.37:0/2313606964 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0c011990 con 0x7fcf1c0d3730 2023-07-12T02:05:02.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.720+0000 7fcf21199700 1 -- 172.21.15.37:0/2313606964 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c011d20 con 0x7fcf1c0d3730 2023-07-12T02:05:02.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.721+0000 7fcf243ff700 1 -- 172.21.15.37:0/2313606964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf1c0d3730 msgr2=0x7fcf1c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:02.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.721+0000 7fcf243ff700 1 --2- 172.21.15.37:0/2313606964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf1c0d3730 0x7fcf1c0cf550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009840 tx=0x7fcf0c009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:02.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.721+0000 7fcf243ff700 1 -- 172.21.15.37:0/2313606964 shutdown_connections 2023-07-12T02:05:02.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.721+0000 7fcf243ff700 1 --2- 172.21.15.37:0/2313606964 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf1c0cfa90 0x7fcf1c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.721+0000 7fcf243ff700 1 --2- 172.21.15.37:0/2313606964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf1c0d3730 0x7fcf1c0cf550 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.721+0000 7fcf243ff700 1 -- 172.21.15.37:0/2313606964 >> 172.21.15.37:0/2313606964 conn(0x7fcf1c06b3f0 msgr2=0x7fcf1c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:02.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.721+0000 7fcf243ff700 1 -- 172.21.15.37:0/2313606964 shutdown_connections 2023-07-12T02:05:02.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.721+0000 7fcf243ff700 1 -- 172.21.15.37:0/2313606964 wait complete. 2023-07-12T02:05:02.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.723+0000 7fcf243ff700 1 Processor -- start 2023-07-12T02:05:02.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.723+0000 7fcf243ff700 1 -- start start 2023-07-12T02:05:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.724+0000 7fcf243ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf1c0b8430 0x7fcf1c15dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.724+0000 7fcf243ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf1c0cfa90 0x7fcf1c0c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.724+0000 7fcf243ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf1c0d3730 0x7fcf1c0cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.724+0000 7fcf243ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c15d940 con 0x7fcf1c0b8430 2023-07-12T02:05:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.724+0000 7fcf243ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c15c930 con 0x7fcf1c0cfa90 2023-07-12T02:05:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.724+0000 7fcf243ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c15cb80 con 0x7fcf1c0d3730 2023-07-12T02:05:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.724+0000 7fcf2219b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf1c0b8430 0x7fcf1c15dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.724+0000 7fcf2219b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf1c0b8430 0x7fcf1c15dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33902/0 (socket says 172.21.15.37:33902) 2023-07-12T02:05:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.724+0000 7fcf2219b700 1 -- 172.21.15.37:0/1905715936 learned_addr learned my addr 172.21.15.37:0/1905715936 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.724+0000 7fcf2199a700 1 --2- 172.21.15.37:0/1905715936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf1c0cfa90 0x7fcf1c0c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.725+0000 7fcf2299c700 1 --2- 172.21.15.37:0/1905715936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf1c0d3730 0x7fcf1c0cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:02.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.725+0000 7fcf2219b700 1 -- 172.21.15.37:0/1905715936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf1c0d3730 msgr2=0x7fcf1c0cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:02.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.725+0000 7fcf2219b700 1 --2- 172.21.15.37:0/1905715936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf1c0d3730 0x7fcf1c0cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.725+0000 7fcf2219b700 1 -- 172.21.15.37:0/1905715936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf1c0cfa90 msgr2=0x7fcf1c0c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:02.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.725+0000 7fcf2219b700 1 --2- 172.21.15.37:0/1905715936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf1c0cfa90 0x7fcf1c0c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.725+0000 7fcf2219b700 1 -- 172.21.15.37:0/1905715936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf14009a70 con 0x7fcf1c0b8430 2023-07-12T02:05:02.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.725+0000 7fcf2299c700 1 --2- 172.21.15.37:0/1905715936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf1c0d3730 0x7fcf1c0cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:02.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.725+0000 7fcf2219b700 1 --2- 172.21.15.37:0/1905715936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf1c0b8430 0x7fcf1c15dcc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcf180011e0 tx=0x7fcf1800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:02.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.725+0000 7fcf12ffd700 1 -- 172.21.15.37:0/1905715936 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18004c80 con 0x7fcf1c0b8430 2023-07-12T02:05:02.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.725+0000 7fcf12ffd700 1 -- 172.21.15.37:0/1905715936 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf18004de0 con 0x7fcf1c0b8430 2023-07-12T02:05:02.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.725+0000 7fcf12ffd700 1 -- 172.21.15.37:0/1905715936 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18007310 con 0x7fcf1c0b8430 2023-07-12T02:05:02.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.725+0000 7fcf243ff700 1 -- 172.21.15.37:0/1905715936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0c0094a0 con 0x7fcf1c0b8430 2023-07-12T02:05:02.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.725+0000 7fcf243ff700 1 -- 172.21.15.37:0/1905715936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c15d140 con 0x7fcf1c0b8430 2023-07-12T02:05:02.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.727+0000 7fcf243ff700 1 -- 172.21.15.37:0/1905715936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c04ea60 con 0x7fcf1c0b8430 2023-07-12T02:05:02.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.728+0000 7fcf12ffd700 1 -- 172.21.15.37:0/1905715936 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf18007470 con 0x7fcf1c0b8430 2023-07-12T02:05:02.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.729+0000 7fcf12ffd700 1 --2- 172.21.15.37:0/1905715936 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcf0006ace0 0x7fcf0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:02.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.729+0000 7fcf12ffd700 1 -- 172.21.15.37:0/1905715936 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcf180893f0 con 0x7fcf1c0b8430 2023-07-12T02:05:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.730+0000 7fcf2199a700 1 --2- 172.21.15.37:0/1905715936 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcf0006ace0 0x7fcf0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.730+0000 7fcf2199a700 1 --2- 172.21.15.37:0/1905715936 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcf0006ace0 0x7fcf0006d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0090b0 tx=0x7fcf0c01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:02.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.734+0000 7fcf12ffd700 1 -- 172.21.15.37:0/1905715936 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fcf18054200 con 0x7fcf1c0b8430 2023-07-12T02:05:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.943+0000 7fcf243ff700 1 -- 172.21.15.37:0/1905715936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcf1c160bc0 con 0x7fcf1c0b8430 2023-07-12T02:05:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.944+0000 7fcf12ffd700 1 -- 172.21.15.37:0/1905715936 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcf18057820 con 0x7fcf1c0b8430 2023-07-12T02:05:02.948 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:05:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.946+0000 7fcf243ff700 1 -- 172.21.15.37:0/1905715936 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcf0006ace0 msgr2=0x7fcf0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.946+0000 7fcf243ff700 1 --2- 172.21.15.37:0/1905715936 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcf0006ace0 0x7fcf0006d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0090b0 tx=0x7fcf0c01c040 comp rx=0 tx=0).stop 2023-07-12T02:05:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.946+0000 7fcf243ff700 1 -- 172.21.15.37:0/1905715936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf1c0b8430 msgr2=0x7fcf1c15dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.946+0000 7fcf243ff700 1 --2- 172.21.15.37:0/1905715936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf1c0b8430 0x7fcf1c15dcc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcf180011e0 tx=0x7fcf1800ca30 comp rx=0 tx=0).stop 2023-07-12T02:05:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.946+0000 7fcf243ff700 1 -- 172.21.15.37:0/1905715936 shutdown_connections 2023-07-12T02:05:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.946+0000 7fcf243ff700 1 --2- 172.21.15.37:0/1905715936 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcf0006ace0 0x7fcf0006d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.946+0000 7fcf243ff700 1 --2- 172.21.15.37:0/1905715936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf1c0b8430 0x7fcf1c15dcc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.946+0000 7fcf243ff700 1 --2- 172.21.15.37:0/1905715936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf1c0d3730 0x7fcf1c0cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.946+0000 7fcf243ff700 1 --2- 172.21.15.37:0/1905715936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf1c0cfa90 0x7fcf1c0c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.946+0000 7fcf243ff700 1 -- 172.21.15.37:0/1905715936 >> 172.21.15.37:0/1905715936 conn(0x7fcf1c06b3f0 msgr2=0x7fcf1c06b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.946+0000 7fcf243ff700 1 -- 172.21.15.37:0/1905715936 shutdown_connections 2023-07-12T02:05:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:02.947+0000 7fcf243ff700 1 -- 172.21.15.37:0/1905715936 wait complete. 2023-07-12T02:05:02.968 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:05:03.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.166+0000 7f2631bff700 1 Processor -- start 2023-07-12T02:05:03.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.166+0000 7f2631bff700 1 -- start start 2023-07-12T02:05:03.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.167+0000 7f2631bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f262c0b59d0 0x7f262c1671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:03.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.167+0000 7f2631bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262c0d1790 con 0x7f262c0d2640 2023-07-12T02:05:03.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.167+0000 7f2631bff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262c0cd950 con 0x7f262c15c460 2023-07-12T02:05:03.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.167+0000 7f2631bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c0b5e10 con 0x7f262c0b59d0 2023-07-12T02:05:03.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.167+0000 7f262affd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f262c0d2640 0x7f262c0cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51694/0 (socket says 172.21.15.37:51694) 2023-07-12T02:05:03.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.167+0000 7f262affd700 1 -- 172.21.15.37:0/1311352916 learned_addr learned my addr 172.21.15.37:0/1311352916 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:03.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.167+0000 7f262bfff700 1 --2- 172.21.15.37:0/1311352916 >> v2:172.21.15.37:3300/0 conn(0x7f262c0b59d0 0x7f262c1671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.168+0000 7f262a7fc700 1 -- 172.21.15.37:0/1311352916 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894756991 0 0) 0x7f262c0d1790 con 0x7f262c0d2640 2023-07-12T02:05:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.168+0000 7f262a7fc700 1 -- 172.21.15.37:0/1311352916 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26140035b0 con 0x7f262c0d2640 2023-07-12T02:05:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.168+0000 7f262bfff700 1 -- 172.21.15.37:0/1311352916 >> v1:172.21.15.196:6789/0 conn(0x7f262c15c460 legacy=0x7f262c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.168+0000 7f262bfff700 1 -- 172.21.15.37:0/1311352916 >> v1:172.21.15.37:6789/0 conn(0x7f262c0d2640 legacy=0x7f262c0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.168+0000 7f262bfff700 1 -- 172.21.15.37:0/1311352916 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c0d14b0 con 0x7f262c0b59d0 2023-07-12T02:05:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.168+0000 7f262bfff700 1 --2- 172.21.15.37:0/1311352916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262c0b59d0 0x7f262c1671b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2624009d90 tx=0x7f262400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b553dd3ad475eb3e server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.168+0000 7f262a7fc700 1 -- 172.21.15.37:0/1311352916 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262400e070 con 0x7f262c0b59d0 2023-07-12T02:05:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.168+0000 7f262a7fc700 1 -- 172.21.15.37:0/1311352916 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262400bb20 con 0x7f262c0b59d0 2023-07-12T02:05:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.168+0000 7f262a7fc700 1 -- 172.21.15.37:0/1311352916 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2624012430 con 0x7f262c0b59d0 2023-07-12T02:05:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.169+0000 7f2631bff700 1 -- 172.21.15.37:0/1311352916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262c0b59d0 msgr2=0x7f262c1671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.169+0000 7f2631bff700 1 --2- 172.21.15.37:0/1311352916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262c0b59d0 0x7f262c1671b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2624009d90 tx=0x7f262400b330 comp rx=0 tx=0).stop 2023-07-12T02:05:03.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.169+0000 7f2631bff700 1 -- 172.21.15.37:0/1311352916 shutdown_connections 2023-07-12T02:05:03.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.169+0000 7f2631bff700 1 --2- 172.21.15.37:0/1311352916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262c0b59d0 0x7f262c1671b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.169+0000 7f2631bff700 1 -- 172.21.15.37:0/1311352916 >> 172.21.15.37:0/1311352916 conn(0x7f262c071660 msgr2=0x7f262c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:03.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.169+0000 7f2631bff700 1 -- 172.21.15.37:0/1311352916 shutdown_connections 2023-07-12T02:05:03.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.169+0000 7f2631bff700 1 -- 172.21.15.37:0/1311352916 wait complete. 2023-07-12T02:05:03.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.171+0000 7f2631bff700 1 Processor -- start 2023-07-12T02:05:03.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.171+0000 7f2631bff700 1 -- start start 2023-07-12T02:05:03.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.172+0000 7f2631bff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f262c0b59d0 0x7f262c0c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:03.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.172+0000 7f2631bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262c0d2640 0x7f262c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.172+0000 7f2631bff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f262c15c460 0x7f262c15f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.172+0000 7f2631bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c0caca0 con 0x7f262c0d2640 2023-07-12T02:05:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.172+0000 7f2631bff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c15f6d0 con 0x7f262c0b59d0 2023-07-12T02:05:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.172+0000 7f2631bff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c1f6060 con 0x7f262c15c460 2023-07-12T02:05:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.172+0000 7f262affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262c0d2640 0x7f262c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.172+0000 7f262affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262c0d2640 0x7f262c15ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33918/0 (socket says 172.21.15.37:33918) 2023-07-12T02:05:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.172+0000 7f262affd700 1 -- 172.21.15.37:0/2350132448 learned_addr learned my addr 172.21.15.37:0/2350132448 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.172+0000 7f262b7fe700 1 --2- 172.21.15.37:0/2350132448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f262c0b59d0 0x7f262c0c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.172+0000 7f262bfff700 1 --2- 172.21.15.37:0/2350132448 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f262c15c460 0x7f262c15f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.173+0000 7f262affd700 1 -- 172.21.15.37:0/2350132448 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f262c15c460 msgr2=0x7f262c15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.173+0000 7f262affd700 1 --2- 172.21.15.37:0/2350132448 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f262c15c460 0x7f262c15f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.173+0000 7f262affd700 1 -- 172.21.15.37:0/2350132448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f262c0b59d0 msgr2=0x7f262c0c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.173+0000 7f262affd700 1 --2- 172.21.15.37:0/2350132448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f262c0b59d0 0x7f262c0c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.173+0000 7f262affd700 1 -- 172.21.15.37:0/2350132448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2624009a70 con 0x7f262c0d2640 2023-07-12T02:05:03.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.173+0000 7f262affd700 1 --2- 172.21.15.37:0/2350132448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262c0d2640 0x7f262c15ec50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f262000c700 tx=0x7f262000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:03.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.173+0000 7f2613fff700 1 -- 172.21.15.37:0/2350132448 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620005d70 con 0x7f262c0d2640 2023-07-12T02:05:03.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.173+0000 7f2613fff700 1 -- 172.21.15.37:0/2350132448 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26200070d0 con 0x7f262c0d2640 2023-07-12T02:05:03.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.173+0000 7f2613fff700 1 -- 172.21.15.37:0/2350132448 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620007460 con 0x7f262c0d2640 2023-07-12T02:05:03.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.173+0000 7f2631bff700 1 -- 172.21.15.37:0/2350132448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262c0caef0 con 0x7f262c0d2640 2023-07-12T02:05:03.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.173+0000 7f2631bff700 1 -- 172.21.15.37:0/2350132448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262c0cb4b0 con 0x7f262c0d2640 2023-07-12T02:05:03.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.174+0000 7f2631bff700 1 -- 172.21.15.37:0/2350132448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262c04ea60 con 0x7f262c0d2640 2023-07-12T02:05:03.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.175+0000 7f2613fff700 1 -- 172.21.15.37:0/2350132448 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f26200075c0 con 0x7f262c0d2640 2023-07-12T02:05:03.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.176+0000 7f2613fff700 1 --2- 172.21.15.37:0/2350132448 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f261806ace0 0x7f261806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:03.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.176+0000 7f2613fff700 1 -- 172.21.15.37:0/2350132448 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2620088e20 con 0x7f262c0d2640 2023-07-12T02:05:03.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.177+0000 7f262b7fe700 1 --2- 172.21.15.37:0/2350132448 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f261806ace0 0x7f261806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:03.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.178+0000 7f262b7fe700 1 --2- 172.21.15.37:0/2350132448 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f261806ace0 0x7f261806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f261c000f60 tx=0x7f261c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.181+0000 7f2613fff700 1 -- 172.21.15.37:0/2350132448 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2620053b10 con 0x7f262c0d2640 2023-07-12T02:05:03.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.392+0000 7f2631bff700 1 -- 172.21.15.37:0/2350132448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f262c0b4fa0 con 0x7f262c0d2640 2023-07-12T02:05:03.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.393+0000 7f2613fff700 1 -- 172.21.15.37:0/2350132448 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20168 (secure 0 0 0) 0x7f2620057130 con 0x7f262c0d2640 2023-07-12T02:05:03.397 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:03.397 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:39.032667+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:05:03.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.396+0000 7f2631bff700 1 -- 172.21.15.37:0/2350132448 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f261806ace0 msgr2=0x7f261806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:03.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.396+0000 7f2631bff700 1 --2- 172.21.15.37:0/2350132448 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f261806ace0 0x7f261806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f261c000f60 tx=0x7f261c009040 comp rx=0 tx=0).stop 2023-07-12T02:05:03.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.396+0000 7f2631bff700 1 -- 172.21.15.37:0/2350132448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262c0d2640 msgr2=0x7f262c15ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:03.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.396+0000 7f2631bff700 1 --2- 172.21.15.37:0/2350132448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262c0d2640 0x7f262c15ec50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f262000c700 tx=0x7f262000cac0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.396+0000 7f2631bff700 1 -- 172.21.15.37:0/2350132448 shutdown_connections 2023-07-12T02:05:03.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.396+0000 7f2631bff700 1 --2- 172.21.15.37:0/2350132448 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f261806ace0 0x7f261806d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.396+0000 7f2631bff700 1 --2- 172.21.15.37:0/2350132448 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f262c15c460 0x7f262c15f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.396+0000 7f2631bff700 1 --2- 172.21.15.37:0/2350132448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f262c0b59d0 0x7f262c0c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.396+0000 7f2631bff700 1 --2- 172.21.15.37:0/2350132448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262c0d2640 0x7f262c15ec50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.396+0000 7f2631bff700 1 -- 172.21.15.37:0/2350132448 >> 172.21.15.37:0/2350132448 conn(0x7f262c071660 msgr2=0x7f262c157490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.396+0000 7f2631bff700 1 -- 172.21.15.37:0/2350132448 shutdown_connections 2023-07-12T02:05:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.396+0000 7f2631bff700 1 -- 172.21.15.37:0/2350132448 wait complete. 2023-07-12T02:05:03.418 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:03:56.039938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:03:56.612707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-12T02:04:00.200885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-12T02:05:03.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:05:03.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.618+0000 7efd1e1ff700 1 Processor -- start 2023-07-12T02:05:03.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.618+0000 7efd1e1ff700 1 -- start start 2023-07-12T02:05:03.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.619+0000 7efd1e1ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd180d3730 0x7efd180cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:03.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.619+0000 7efd1e1ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7efd180cfa90 0x7efd180d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:03.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.619+0000 7efd1e1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd180d0b20 con 0x7efd180b8430 2023-07-12T02:05:03.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.619+0000 7efd1e1ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd180cda30 con 0x7efd180cfa90 2023-07-12T02:05:03.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.619+0000 7efd1e1ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd180b8800 con 0x7efd180d3730 2023-07-12T02:05:03.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.620+0000 7efd177fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efd180b8430 0x7efd180cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51700/0 (socket says 172.21.15.37:51700) 2023-07-12T02:05:03.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.620+0000 7efd177fe700 1 -- 172.21.15.37:0/2728499830 learned_addr learned my addr 172.21.15.37:0/2728499830 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:03.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.620+0000 7efd17fff700 1 --2- 172.21.15.37:0/2728499830 >> v2:172.21.15.196:3300/0 conn(0x7efd180cfa90 0x7efd180d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:03.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.620+0000 7efd16ffd700 1 --2- 172.21.15.37:0/2728499830 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd180d3730 0x7efd180cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:03.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.620+0000 7efd167fc700 1 -- 172.21.15.37:0/2728499830 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493118270 0 0) 0x7efd180d0b20 con 0x7efd180b8430 2023-07-12T02:05:03.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.620+0000 7efd167fc700 1 -- 172.21.15.37:0/2728499830 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd000035b0 con 0x7efd180b8430 2023-07-12T02:05:03.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.620+0000 7efd17fff700 1 -- 172.21.15.37:0/2728499830 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd180d3730 msgr2=0x7efd180cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:03.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.620+0000 7efd17fff700 1 --2- 172.21.15.37:0/2728499830 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd180d3730 0x7efd180cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.620+0000 7efd17fff700 1 -- 172.21.15.37:0/2728499830 >> v1:172.21.15.37:6789/0 conn(0x7efd180b8430 legacy=0x7efd180cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:03.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.620+0000 7efd17fff700 1 -- 172.21.15.37:0/2728499830 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd180cfeb0 con 0x7efd180cfa90 2023-07-12T02:05:03.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.621+0000 7efd17fff700 1 --2- 172.21.15.37:0/2728499830 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd180cfa90 0x7efd180d0fb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efd10009d90 tx=0x7efd1000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=921790fa4a02794f server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:03.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.621+0000 7efd167fc700 1 -- 172.21.15.37:0/2728499830 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1000e070 con 0x7efd180cfa90 2023-07-12T02:05:03.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.621+0000 7efd167fc700 1 -- 172.21.15.37:0/2728499830 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1000bb20 con 0x7efd180cfa90 2023-07-12T02:05:03.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.621+0000 7efd167fc700 1 -- 172.21.15.37:0/2728499830 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd10012430 con 0x7efd180cfa90 2023-07-12T02:05:03.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.621+0000 7efd1e1ff700 1 -- 172.21.15.37:0/2728499830 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd180cfa90 msgr2=0x7efd180d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:03.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.621+0000 7efd1e1ff700 1 --2- 172.21.15.37:0/2728499830 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd180cfa90 0x7efd180d0fb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efd10009d90 tx=0x7efd1000b330 comp rx=0 tx=0).stop 2023-07-12T02:05:03.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.622+0000 7efd1e1ff700 1 -- 172.21.15.37:0/2728499830 shutdown_connections 2023-07-12T02:05:03.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.622+0000 7efd1e1ff700 1 --2- 172.21.15.37:0/2728499830 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd180cfa90 0x7efd180d0fb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.622+0000 7efd1e1ff700 1 --2- 172.21.15.37:0/2728499830 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd180d3730 0x7efd180cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.622+0000 7efd1e1ff700 1 -- 172.21.15.37:0/2728499830 >> 172.21.15.37:0/2728499830 conn(0x7efd1806b3f0 msgr2=0x7efd1806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:03.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.622+0000 7efd1e1ff700 1 -- 172.21.15.37:0/2728499830 shutdown_connections 2023-07-12T02:05:03.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.622+0000 7efd1e1ff700 1 -- 172.21.15.37:0/2728499830 wait complete. 2023-07-12T02:05:03.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.624+0000 7efd1e1ff700 1 Processor -- start 2023-07-12T02:05:03.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.624+0000 7efd1e1ff700 1 -- start start 2023-07-12T02:05:03.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.625+0000 7efd1e1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd180b8430 0x7efd180c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:03.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd1e1ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd180cfa90 0x7efd1815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:03.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd1e1ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd180d3730 0x7efd181f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:03.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd1e1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1815c160 con 0x7efd180b8430 2023-07-12T02:05:03.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd1e1ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd181f25b0 con 0x7efd180d3730 2023-07-12T02:05:03.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd1e1ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd181f2890 con 0x7efd180cfa90 2023-07-12T02:05:03.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd177fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd180b8430 0x7efd180c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:03.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd177fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd180b8430 0x7efd180c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33922/0 (socket says 172.21.15.37:33922) 2023-07-12T02:05:03.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd177fe700 1 -- 172.21.15.37:0/1861881505 learned_addr learned my addr 172.21.15.37:0/1861881505 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:03.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd17fff700 1 --2- 172.21.15.37:0/1861881505 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd180d3730 0x7efd181f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:03.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd177fe700 1 -- 172.21.15.37:0/1861881505 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd180cfa90 msgr2=0x7efd1815bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:03.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd16ffd700 1 --2- 172.21.15.37:0/1861881505 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd180cfa90 0x7efd1815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:03.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd177fe700 1 --2- 172.21.15.37:0/1861881505 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd180cfa90 0x7efd1815bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd177fe700 1 -- 172.21.15.37:0/1861881505 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd180d3730 msgr2=0x7efd181f1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:03.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd177fe700 1 --2- 172.21.15.37:0/1861881505 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd180d3730 0x7efd181f1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd177fe700 1 -- 172.21.15.37:0/1861881505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd10009a70 con 0x7efd180b8430 2023-07-12T02:05:03.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd17fff700 1 --2- 172.21.15.37:0/1861881505 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd180d3730 0x7efd181f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:03.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.626+0000 7efd16ffd700 1 --2- 172.21.15.37:0/1861881505 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd180cfa90 0x7efd1815bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:03.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.627+0000 7efd177fe700 1 --2- 172.21.15.37:0/1861881505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd180b8430 0x7efd180c6670 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efd0800c700 tx=0x7efd0800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:03.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.627+0000 7efcfffff700 1 -- 172.21.15.37:0/1861881505 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd08005d70 con 0x7efd180b8430 2023-07-12T02:05:03.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.627+0000 7efcfffff700 1 -- 172.21.15.37:0/1861881505 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd080070d0 con 0x7efd180b8430 2023-07-12T02:05:03.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.627+0000 7efcfffff700 1 -- 172.21.15.37:0/1861881505 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd08007460 con 0x7efd180b8430 2023-07-12T02:05:03.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.627+0000 7efd1e1ff700 1 -- 172.21.15.37:0/1861881505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd181f2b70 con 0x7efd180b8430 2023-07-12T02:05:03.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.627+0000 7efd1e1ff700 1 -- 172.21.15.37:0/1861881505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd180c9f90 con 0x7efd180b8430 2023-07-12T02:05:03.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.628+0000 7efd1e1ff700 1 -- 172.21.15.37:0/1861881505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1804ea60 con 0x7efd180b8430 2023-07-12T02:05:03.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.629+0000 7efcfffff700 1 -- 172.21.15.37:0/1861881505 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd080075c0 con 0x7efd180b8430 2023-07-12T02:05:03.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.630+0000 7efcfffff700 1 --2- 172.21.15.37:0/1861881505 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efd0406ace0 0x7efd0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:03.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.630+0000 7efcfffff700 1 -- 172.21.15.37:0/1861881505 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efd08088dc0 con 0x7efd180b8430 2023-07-12T02:05:03.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.630+0000 7efd16ffd700 1 --2- 172.21.15.37:0/1861881505 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efd0406ace0 0x7efd0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:03.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.631+0000 7efd16ffd700 1 --2- 172.21.15.37:0/1861881505 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efd0406ace0 0x7efd0406d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efd180b06f0 tx=0x7efd0c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:03.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.634+0000 7efcfffff700 1 -- 172.21.15.37:0/1861881505 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7efd08053b50 con 0x7efd180b8430 2023-07-12T02:05:03.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.841+0000 7efd1e1ff700 1 -- 172.21.15.37:0/1861881505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efd180d07a0 con 0x7efd180b8430 2023-07-12T02:05:03.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.841+0000 7efcfffff700 1 -- 172.21.15.37:0/1861881505 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7efd08057170 con 0x7efd180b8430 2023-07-12T02:05:03.845 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:05:03.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.844+0000 7efd1e1ff700 1 -- 172.21.15.37:0/1861881505 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efd0406ace0 msgr2=0x7efd0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:03.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.844+0000 7efd1e1ff700 1 --2- 172.21.15.37:0/1861881505 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efd0406ace0 0x7efd0406d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efd180b06f0 tx=0x7efd0c008040 comp rx=0 tx=0).stop 2023-07-12T02:05:03.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.844+0000 7efd1e1ff700 1 -- 172.21.15.37:0/1861881505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd180b8430 msgr2=0x7efd180c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:03.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.844+0000 7efd1e1ff700 1 --2- 172.21.15.37:0/1861881505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd180b8430 0x7efd180c6670 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efd0800c700 tx=0x7efd0800cac0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.844+0000 7efd1e1ff700 1 -- 172.21.15.37:0/1861881505 shutdown_connections 2023-07-12T02:05:03.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.844+0000 7efd1e1ff700 1 --2- 172.21.15.37:0/1861881505 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efd0406ace0 0x7efd0406d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.844+0000 7efd1e1ff700 1 --2- 172.21.15.37:0/1861881505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd180b8430 0x7efd180c6670 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.844+0000 7efd1e1ff700 1 --2- 172.21.15.37:0/1861881505 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efd180d3730 0x7efd181f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.844+0000 7efd1e1ff700 1 --2- 172.21.15.37:0/1861881505 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efd180cfa90 0x7efd1815bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:03.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.844+0000 7efd1e1ff700 1 -- 172.21.15.37:0/1861881505 >> 172.21.15.37:0/1861881505 conn(0x7efd1806b3f0 msgr2=0x7efd180b6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:03.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.844+0000 7efd1e1ff700 1 -- 172.21.15.37:0/1861881505 shutdown_connections 2023-07-12T02:05:03.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:03.844+0000 7efd1e1ff700 1 -- 172.21.15.37:0/1861881505 wait complete. 2023-07-12T02:05:03.865 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:05:04.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.067+0000 7f29943ff700 1 Processor -- start 2023-07-12T02:05:04.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.067+0000 7f29943ff700 1 -- start start 2023-07-12T02:05:04.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.068+0000 7f29943ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f298c0b8430 0x7f298c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.068+0000 7f29943ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f298c0d3730 0x7f298c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.068+0000 7f29943ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298c0d0b20 con 0x7f298c0cfa90 2023-07-12T02:05:04.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.068+0000 7f29943ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298c0b8800 con 0x7f298c0b8430 2023-07-12T02:05:04.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.068+0000 7f29943ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298c0cfe90 con 0x7f298c0d3730 2023-07-12T02:05:04.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.069+0000 7f299219b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f298c0b8430 0x7f298c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:04.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.069+0000 7f299219b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f298c0b8430 0x7f298c0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33928/0 (socket says 172.21.15.37:33928) 2023-07-12T02:05:04.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.069+0000 7f299219b700 1 -- 172.21.15.37:0/3653952881 learned_addr learned my addr 172.21.15.37:0/3653952881 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:04.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.069+0000 7f299199a700 1 --2- 172.21.15.37:0/3653952881 >> v2:172.21.15.196:3300/0 conn(0x7f298c0d3730 0x7f298c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:04.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.069+0000 7f299219b700 1 -- 172.21.15.37:0/3653952881 >> v2:172.21.15.196:3300/0 conn(0x7f298c0d3730 msgr2=0x7f298c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:04.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.069+0000 7f299219b700 1 --2- 172.21.15.37:0/3653952881 >> v2:172.21.15.196:3300/0 conn(0x7f298c0d3730 0x7f298c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.069+0000 7f299219b700 1 -- 172.21.15.37:0/3653952881 >> v1:172.21.15.196:6789/0 conn(0x7f298c0cfa90 legacy=0x7f298c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.069+0000 7f299219b700 1 -- 172.21.15.37:0/3653952881 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c0b4ee0 con 0x7f298c0b8430 2023-07-12T02:05:04.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.069+0000 7f299219b700 1 --2- 172.21.15.37:0/3653952881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f298c0b8430 0x7f298c0cd320 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f298c160f50 tx=0x7f2988009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2421da0dc49be2c server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:04.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.070+0000 7f2991199700 1 -- 172.21.15.37:0/3653952881 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988011830 con 0x7f298c0b8430 2023-07-12T02:05:04.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.070+0000 7f2991199700 1 -- 172.21.15.37:0/3653952881 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2988011990 con 0x7f298c0b8430 2023-07-12T02:05:04.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.070+0000 7f2991199700 1 -- 172.21.15.37:0/3653952881 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988011d20 con 0x7f298c0b8430 2023-07-12T02:05:04.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.070+0000 7f29943ff700 1 -- 172.21.15.37:0/3653952881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f298c0b8430 msgr2=0x7f298c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.070+0000 7f29943ff700 1 --2- 172.21.15.37:0/3653952881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f298c0b8430 0x7f298c0cd320 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f298c160f50 tx=0x7f2988009bd0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.070+0000 7f29943ff700 1 -- 172.21.15.37:0/3653952881 shutdown_connections 2023-07-12T02:05:04.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.070+0000 7f29943ff700 1 --2- 172.21.15.37:0/3653952881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f298c0b8430 0x7f298c0cd320 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.070+0000 7f29943ff700 1 --2- 172.21.15.37:0/3653952881 >> v2:172.21.15.196:3300/0 conn(0x7f298c0d3730 0x7f298c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.070+0000 7f29943ff700 1 -- 172.21.15.37:0/3653952881 >> 172.21.15.37:0/3653952881 conn(0x7f298c06b3f0 msgr2=0x7f298c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:04.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.070+0000 7f29943ff700 1 -- 172.21.15.37:0/3653952881 shutdown_connections 2023-07-12T02:05:04.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.070+0000 7f29943ff700 1 -- 172.21.15.37:0/3653952881 wait complete. 2023-07-12T02:05:04.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.072+0000 7f29943ff700 1 Processor -- start 2023-07-12T02:05:04.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.072+0000 7f29943ff700 1 -- start start 2023-07-12T02:05:04.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.073+0000 7f29943ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f298c0b8430 0x7f298c0cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.073+0000 7f29943ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f298c0cfa90 0x7f298c0c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.073+0000 7f29943ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f298c0d3730 0x7f298c0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.073+0000 7f29943ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c15b020 con 0x7f298c0d3730 2023-07-12T02:05:04.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.073+0000 7f29943ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0c7bf0 con 0x7f298c0b8430 2023-07-12T02:05:04.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.073+0000 7f29943ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0c7ed0 con 0x7f298c0cfa90 2023-07-12T02:05:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.073+0000 7f299299c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f298c0d3730 0x7f298c0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.073+0000 7f299299c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f298c0d3730 0x7f298c0c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33934/0 (socket says 172.21.15.37:33934) 2023-07-12T02:05:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.073+0000 7f299299c700 1 -- 172.21.15.37:0/1287191120 learned_addr learned my addr 172.21.15.37:0/1287191120 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.074+0000 7f299219b700 1 --2- 172.21.15.37:0/1287191120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f298c0b8430 0x7f298c0cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.074+0000 7f299199a700 1 --2- 172.21.15.37:0/1287191120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f298c0cfa90 0x7f298c0c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.074+0000 7f299299c700 1 -- 172.21.15.37:0/1287191120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f298c0cfa90 msgr2=0x7f298c0c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.074+0000 7f299299c700 1 --2- 172.21.15.37:0/1287191120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f298c0cfa90 0x7f298c0c7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.074+0000 7f299299c700 1 -- 172.21.15.37:0/1287191120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f298c0b8430 msgr2=0x7f298c0cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.074+0000 7f299299c700 1 --2- 172.21.15.37:0/1287191120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f298c0b8430 0x7f298c0cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.074+0000 7f299299c700 1 -- 172.21.15.37:0/1287191120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2988009550 con 0x7f298c0d3730 2023-07-12T02:05:04.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.074+0000 7f299299c700 1 --2- 172.21.15.37:0/1287191120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f298c0d3730 0x7f298c0c75c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f298400cc50 tx=0x7f298400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:04.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.074+0000 7f2982ffd700 1 -- 172.21.15.37:0/1287191120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2984003c00 con 0x7f298c0d3730 2023-07-12T02:05:04.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.074+0000 7f2982ffd700 1 -- 172.21.15.37:0/1287191120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2984003d60 con 0x7f298c0d3730 2023-07-12T02:05:04.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.074+0000 7f29943ff700 1 -- 172.21.15.37:0/1287191120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c14abc0 con 0x7f298c0d3730 2023-07-12T02:05:04.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.074+0000 7f2982ffd700 1 -- 172.21.15.37:0/1287191120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298400ab60 con 0x7f298c0d3730 2023-07-12T02:05:04.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.074+0000 7f29943ff700 1 -- 172.21.15.37:0/1287191120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c14b180 con 0x7f298c0d3730 2023-07-12T02:05:04.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.075+0000 7f29943ff700 1 -- 172.21.15.37:0/1287191120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298c14b370 con 0x7f298c0d3730 2023-07-12T02:05:04.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.076+0000 7f2982ffd700 1 -- 172.21.15.37:0/1287191120 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f298400acc0 con 0x7f298c0d3730 2023-07-12T02:05:04.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.077+0000 7f2982ffd700 1 --2- 172.21.15.37:0/1287191120 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f297006ad10 0x7f297006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.078+0000 7f2982ffd700 1 -- 172.21.15.37:0/1287191120 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2984089880 con 0x7f298c0d3730 2023-07-12T02:05:04.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.078+0000 7f299219b700 1 --2- 172.21.15.37:0/1287191120 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f297006ad10 0x7f297006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:04.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.079+0000 7f299219b700 1 --2- 172.21.15.37:0/1287191120 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f297006ad10 0x7f297006d1c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2988014040 tx=0x7f2988008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:04.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.081+0000 7f2982ffd700 1 -- 172.21.15.37:0/1287191120 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f29840545f0 con 0x7f298c0d3730 2023-07-12T02:05:04.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.289+0000 7f29943ff700 1 -- 172.21.15.37:0/1287191120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f298c04ea60 con 0x7f298c0d3730 2023-07-12T02:05:04.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.289+0000 7f2982ffd700 1 -- 172.21.15.37:0/1287191120 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2984057c10 con 0x7f298c0d3730 2023-07-12T02:05:04.293 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:05:04.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.291+0000 7f29943ff700 1 -- 172.21.15.37:0/1287191120 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f297006ad10 msgr2=0x7f297006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.291+0000 7f29943ff700 1 --2- 172.21.15.37:0/1287191120 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f297006ad10 0x7f297006d1c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2988014040 tx=0x7f2988008030 comp rx=0 tx=0).stop 2023-07-12T02:05:04.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.291+0000 7f29943ff700 1 -- 172.21.15.37:0/1287191120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f298c0d3730 msgr2=0x7f298c0c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.291+0000 7f29943ff700 1 --2- 172.21.15.37:0/1287191120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f298c0d3730 0x7f298c0c75c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f298400cc50 tx=0x7f298400cf60 comp rx=0 tx=0).stop 2023-07-12T02:05:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.291+0000 7f29943ff700 1 -- 172.21.15.37:0/1287191120 shutdown_connections 2023-07-12T02:05:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.291+0000 7f29943ff700 1 --2- 172.21.15.37:0/1287191120 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f297006ad10 0x7f297006d1c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.291+0000 7f29943ff700 1 --2- 172.21.15.37:0/1287191120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f298c0d3730 0x7f298c0c75c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.291+0000 7f29943ff700 1 --2- 172.21.15.37:0/1287191120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f298c0b8430 0x7f298c0cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.291+0000 7f29943ff700 1 --2- 172.21.15.37:0/1287191120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f298c0cfa90 0x7f298c0c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.291+0000 7f29943ff700 1 -- 172.21.15.37:0/1287191120 >> 172.21.15.37:0/1287191120 conn(0x7f298c06b3f0 msgr2=0x7f298c0b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:04.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.291+0000 7f29943ff700 1 -- 172.21.15.37:0/1287191120 shutdown_connections 2023-07-12T02:05:04.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.291+0000 7f29943ff700 1 -- 172.21.15.37:0/1287191120 wait complete. 2023-07-12T02:05:04.313 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:05:04.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.514+0000 7f90955ff700 1 Processor -- start 2023-07-12T02:05:04.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.514+0000 7f90955ff700 1 -- start start 2023-07-12T02:05:04.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.515+0000 7f90955ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90900b8430 0x7f90900cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.515+0000 7f90955ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90900d3730 0x7f90900cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.515+0000 7f90955ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90900d0b20 con 0x7f90900cfa90 2023-07-12T02:05:04.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.515+0000 7f90955ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90900b8800 con 0x7f90900b8430 2023-07-12T02:05:04.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.515+0000 7f90955ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90900cfeb0 con 0x7f90900d3730 2023-07-12T02:05:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.515+0000 7f908effd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90900b8430 0x7f90900cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.515+0000 7f908effd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90900b8430 0x7f90900cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33942/0 (socket says 172.21.15.37:33942) 2023-07-12T02:05:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.515+0000 7f908effd700 1 -- 172.21.15.37:0/2467109829 learned_addr learned my addr 172.21.15.37:0/2467109829 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.515+0000 7f908e7fc700 1 --2- 172.21.15.37:0/2467109829 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90900d3730 0x7f90900cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:04.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.516+0000 7f908effd700 1 -- 172.21.15.37:0/2467109829 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90900d3730 msgr2=0x7f90900cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:04.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.516+0000 7f908effd700 1 --2- 172.21.15.37:0/2467109829 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90900d3730 0x7f90900cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.516+0000 7f908effd700 1 -- 172.21.15.37:0/2467109829 >> v1:172.21.15.196:6789/0 conn(0x7f90900cfa90 legacy=0x7f909015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.516+0000 7f908effd700 1 -- 172.21.15.37:0/2467109829 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90900b4ee0 con 0x7f90900b8430 2023-07-12T02:05:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.516+0000 7f908effd700 1 --2- 172.21.15.37:0/2467109829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90900b8430 0x7f90900cd320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f90800098f0 tx=0x7f9080009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8347831d8ac6513b server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.516+0000 7f908dffb700 1 -- 172.21.15.37:0/2467109829 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908000b8a0 con 0x7f90900b8430 2023-07-12T02:05:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.516+0000 7f908dffb700 1 -- 172.21.15.37:0/2467109829 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908000ba00 con 0x7f90900b8430 2023-07-12T02:05:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.516+0000 7f908dffb700 1 -- 172.21.15.37:0/2467109829 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908000bd90 con 0x7f90900b8430 2023-07-12T02:05:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.517+0000 7f90955ff700 1 -- 172.21.15.37:0/2467109829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90900b8430 msgr2=0x7f90900cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.517+0000 7f90955ff700 1 --2- 172.21.15.37:0/2467109829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90900b8430 0x7f90900cd320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f90800098f0 tx=0x7f9080009c00 comp rx=0 tx=0).stop 2023-07-12T02:05:04.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.517+0000 7f90955ff700 1 -- 172.21.15.37:0/2467109829 shutdown_connections 2023-07-12T02:05:04.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.517+0000 7f90955ff700 1 --2- 172.21.15.37:0/2467109829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90900b8430 0x7f90900cd320 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.517+0000 7f90955ff700 1 --2- 172.21.15.37:0/2467109829 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90900d3730 0x7f90900cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.517+0000 7f90955ff700 1 -- 172.21.15.37:0/2467109829 >> 172.21.15.37:0/2467109829 conn(0x7f909006b3f0 msgr2=0x7f909006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:04.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.517+0000 7f90955ff700 1 -- 172.21.15.37:0/2467109829 shutdown_connections 2023-07-12T02:05:04.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.517+0000 7f90955ff700 1 -- 172.21.15.37:0/2467109829 wait complete. 2023-07-12T02:05:04.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.519+0000 7f90955ff700 1 Processor -- start 2023-07-12T02:05:04.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.519+0000 7f90955ff700 1 -- start start 2023-07-12T02:05:04.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.520+0000 7f90955ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90900b8430 0x7f90900c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.520+0000 7f90955ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90900cfa90 0x7f90900c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.520+0000 7f90955ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90900d3730 0x7f9090142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.520+0000 7f90955ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90900cc590 con 0x7f90900cfa90 2023-07-12T02:05:04.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.520+0000 7f90955ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90900cb910 con 0x7f90900b8430 2023-07-12T02:05:04.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.520+0000 7f90955ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90900cbbf0 con 0x7f90900d3730 2023-07-12T02:05:04.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.520+0000 7f908e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90900cfa90 0x7f90900c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:04.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.520+0000 7f908e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90900cfa90 0x7f90900c7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33954/0 (socket says 172.21.15.37:33954) 2023-07-12T02:05:04.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.520+0000 7f908e7fc700 1 -- 172.21.15.37:0/3695535217 learned_addr learned my addr 172.21.15.37:0/3695535217 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:04.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.520+0000 7f908effd700 1 --2- 172.21.15.37:0/3695535217 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90900b8430 0x7f90900c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:04.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.520+0000 7f908f7fe700 1 --2- 172.21.15.37:0/3695535217 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90900d3730 0x7f9090142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:04.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.520+0000 7f908e7fc700 1 -- 172.21.15.37:0/3695535217 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90900d3730 msgr2=0x7f9090142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.520+0000 7f908e7fc700 1 --2- 172.21.15.37:0/3695535217 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90900d3730 0x7f9090142ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.520+0000 7f908e7fc700 1 -- 172.21.15.37:0/3695535217 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90900b8430 msgr2=0x7f90900c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.520+0000 7f908e7fc700 1 --2- 172.21.15.37:0/3695535217 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90900b8430 0x7f90900c7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.520+0000 7f908e7fc700 1 -- 172.21.15.37:0/3695535217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9080009550 con 0x7f90900cfa90 2023-07-12T02:05:04.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.521+0000 7f908e7fc700 1 --2- 172.21.15.37:0/3695535217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90900cfa90 0x7f90900c7c60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f908400e810 tx=0x7f908400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:04.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.521+0000 7f90777fe700 1 -- 172.21.15.37:0/3695535217 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084013610 con 0x7f90900cfa90 2023-07-12T02:05:04.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.521+0000 7f90777fe700 1 -- 172.21.15.37:0/3695535217 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9084013770 con 0x7f90900cfa90 2023-07-12T02:05:04.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.521+0000 7f90955ff700 1 -- 172.21.15.37:0/3695535217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90900cbed0 con 0x7f90900cfa90 2023-07-12T02:05:04.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.521+0000 7f90777fe700 1 -- 172.21.15.37:0/3695535217 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084013b20 con 0x7f90900cfa90 2023-07-12T02:05:04.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.521+0000 7f90955ff700 1 -- 172.21.15.37:0/3695535217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90900cc9b0 con 0x7f90900cfa90 2023-07-12T02:05:04.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.522+0000 7f90955ff700 1 -- 172.21.15.37:0/3695535217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90900cc6d0 con 0x7f90900cfa90 2023-07-12T02:05:04.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.523+0000 7f90777fe700 1 -- 172.21.15.37:0/3695535217 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9084013c80 con 0x7f90900cfa90 2023-07-12T02:05:04.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.524+0000 7f90777fe700 1 --2- 172.21.15.37:0/3695535217 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f907c06ace0 0x7f907c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.524+0000 7f90777fe700 1 -- 172.21.15.37:0/3695535217 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9084089560 con 0x7f90900cfa90 2023-07-12T02:05:04.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.525+0000 7f908effd700 1 --2- 172.21.15.37:0/3695535217 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f907c06ace0 0x7f907c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:04.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.525+0000 7f908effd700 1 --2- 172.21.15.37:0/3695535217 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f907c06ace0 0x7f907c06d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9080014040 tx=0x7f9080008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:04.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.528+0000 7f90777fe700 1 -- 172.21.15.37:0/3695535217 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f90900cc6d0 con 0x7f90900cfa90 2023-07-12T02:05:04.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.733+0000 7f90955ff700 1 -- 172.21.15.37:0/3695535217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90900cc6d0 con 0x7f90900cfa90 2023-07-12T02:05:04.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.733+0000 7f90777fe700 1 -- 172.21.15.37:0/3695535217 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f90900cc6d0 con 0x7f90900cfa90 2023-07-12T02:05:04.737 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:05:04.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.736+0000 7f90955ff700 1 -- 172.21.15.37:0/3695535217 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f907c06ace0 msgr2=0x7f907c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.736+0000 7f90955ff700 1 --2- 172.21.15.37:0/3695535217 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f907c06ace0 0x7f907c06d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9080014040 tx=0x7f9080008030 comp rx=0 tx=0).stop 2023-07-12T02:05:04.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.736+0000 7f90955ff700 1 -- 172.21.15.37:0/3695535217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90900cfa90 msgr2=0x7f90900c7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.736+0000 7f90955ff700 1 --2- 172.21.15.37:0/3695535217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90900cfa90 0x7f90900c7c60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f908400e810 tx=0x7f908400ebd0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.736+0000 7f90955ff700 1 -- 172.21.15.37:0/3695535217 shutdown_connections 2023-07-12T02:05:04.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.736+0000 7f90955ff700 1 --2- 172.21.15.37:0/3695535217 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f907c06ace0 0x7f907c06d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.736+0000 7f90955ff700 1 --2- 172.21.15.37:0/3695535217 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90900d3730 0x7f9090142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.736+0000 7f90955ff700 1 --2- 172.21.15.37:0/3695535217 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90900b8430 0x7f90900c7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.736+0000 7f90955ff700 1 --2- 172.21.15.37:0/3695535217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90900cfa90 0x7f90900c7c60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.736+0000 7f90955ff700 1 -- 172.21.15.37:0/3695535217 >> 172.21.15.37:0/3695535217 conn(0x7f909006b3f0 msgr2=0x7f90900b62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:04.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.736+0000 7f90955ff700 1 -- 172.21.15.37:0/3695535217 shutdown_connections 2023-07-12T02:05:04.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.736+0000 7f90955ff700 1 -- 172.21.15.37:0/3695535217 wait complete. 2023-07-12T02:05:04.757 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:05:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.957+0000 7f6b0d5ff700 1 Processor -- start 2023-07-12T02:05:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.957+0000 7f6b0d5ff700 1 -- start start 2023-07-12T02:05:04.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.959+0000 7f6b0d5ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6b080d3730 0x7f6b080cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.959+0000 7f6b0d5ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b080d0b20 con 0x7f6b080cfa90 2023-07-12T02:05:04.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.959+0000 7f6b0d5ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b080cfe90 con 0x7f6b080b8430 2023-07-12T02:05:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.959+0000 7f6b0d5ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b080cda30 con 0x7f6b080d3730 2023-07-12T02:05:04.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.959+0000 7f6b077fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6b080cfa90 0x7f6b080d0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51712/0 (socket says 172.21.15.37:51712) 2023-07-12T02:05:04.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.959+0000 7f6b077fe700 1 -- 172.21.15.37:0/4116889231 learned_addr learned my addr 172.21.15.37:0/4116889231 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:04.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.959+0000 7f6b067fc700 1 --2- 172.21.15.37:0/4116889231 >> v2:172.21.15.196:3300/0 conn(0x7f6b080d3730 0x7f6b080cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:04.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.959+0000 7f6b05ffb700 1 -- 172.21.15.37:0/4116889231 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87352208 0 0) 0x7f6b080d0b20 con 0x7f6b080cfa90 2023-07-12T02:05:04.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.959+0000 7f6b05ffb700 1 -- 172.21.15.37:0/4116889231 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6af00035b0 con 0x7f6b080cfa90 2023-07-12T02:05:04.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.960+0000 7f6b067fc700 1 -- 172.21.15.37:0/4116889231 >> v1:172.21.15.196:6789/0 conn(0x7f6b080b8430 legacy=0x7f6b080cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.960+0000 7f6b067fc700 1 -- 172.21.15.37:0/4116889231 >> v1:172.21.15.37:6789/0 conn(0x7f6b080cfa90 legacy=0x7f6b080d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.960+0000 7f6b067fc700 1 -- 172.21.15.37:0/4116889231 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b080b4ee0 con 0x7f6b080d3730 2023-07-12T02:05:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.960+0000 7f6b067fc700 1 --2- 172.21.15.37:0/4116889231 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b080d3730 0x7f6b080cf550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009840 tx=0x7f6afc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2200da56442663e server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.960+0000 7f6b05ffb700 1 -- 172.21.15.37:0/4116889231 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc011830 con 0x7f6b080d3730 2023-07-12T02:05:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.960+0000 7f6b05ffb700 1 -- 172.21.15.37:0/4116889231 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc011990 con 0x7f6b080d3730 2023-07-12T02:05:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.960+0000 7f6b05ffb700 1 -- 172.21.15.37:0/4116889231 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc011d20 con 0x7f6b080d3730 2023-07-12T02:05:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.961+0000 7f6b0d5ff700 1 -- 172.21.15.37:0/4116889231 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b080d3730 msgr2=0x7f6b080cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.961+0000 7f6b0d5ff700 1 --2- 172.21.15.37:0/4116889231 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b080d3730 0x7f6b080cf550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009840 tx=0x7f6afc009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.961+0000 7f6b0d5ff700 1 -- 172.21.15.37:0/4116889231 shutdown_connections 2023-07-12T02:05:04.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.961+0000 7f6b0d5ff700 1 --2- 172.21.15.37:0/4116889231 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b080d3730 0x7f6b080cf550 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.961+0000 7f6b0d5ff700 1 -- 172.21.15.37:0/4116889231 >> 172.21.15.37:0/4116889231 conn(0x7f6b0806b3f0 msgr2=0x7f6b0806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:04.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.961+0000 7f6b0d5ff700 1 -- 172.21.15.37:0/4116889231 shutdown_connections 2023-07-12T02:05:04.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.961+0000 7f6b0d5ff700 1 -- 172.21.15.37:0/4116889231 wait complete. 2023-07-12T02:05:04.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.963+0000 7f6b0d5ff700 1 Processor -- start 2023-07-12T02:05:04.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.963+0000 7f6b0d5ff700 1 -- start start 2023-07-12T02:05:04.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.964+0000 7f6b0d5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b080b8430 0x7f6b080cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.964+0000 7f6b0d5ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b080cfa90 0x7f6b081f12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.964+0000 7f6b0d5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b080d3730 0x7f6b0815e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.964+0000 7f6b0d5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b080c69c0 con 0x7f6b080b8430 2023-07-12T02:05:04.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.964+0000 7f6b0d5ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b080c6670 con 0x7f6b080cfa90 2023-07-12T02:05:04.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.964+0000 7f6b0d5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b080cb3b0 con 0x7f6b080d3730 2023-07-12T02:05:04.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.964+0000 7f6b06ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b080b8430 0x7f6b080cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:04.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.964+0000 7f6b06ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b080b8430 0x7f6b080cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33958/0 (socket says 172.21.15.37:33958) 2023-07-12T02:05:04.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.964+0000 7f6b06ffd700 1 -- 172.21.15.37:0/2015570012 learned_addr learned my addr 172.21.15.37:0/2015570012 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:04.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.964+0000 7f6b067fc700 1 --2- 172.21.15.37:0/2015570012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b080cfa90 0x7f6b081f12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:04.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.964+0000 7f6b06ffd700 1 -- 172.21.15.37:0/2015570012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b080d3730 msgr2=0x7f6b0815e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.964+0000 7f6b06ffd700 1 --2- 172.21.15.37:0/2015570012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b080d3730 0x7f6b0815e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.964+0000 7f6b06ffd700 1 -- 172.21.15.37:0/2015570012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b080cfa90 msgr2=0x7f6b081f12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:04.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.964+0000 7f6b06ffd700 1 --2- 172.21.15.37:0/2015570012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b080cfa90 0x7f6b081f12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:04.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.964+0000 7f6b06ffd700 1 -- 172.21.15.37:0/2015570012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc0094a0 con 0x7f6b080b8430 2023-07-12T02:05:04.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.964+0000 7f6b067fc700 1 --2- 172.21.15.37:0/2015570012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b080cfa90 0x7f6b081f12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:04.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.965+0000 7f6b06ffd700 1 --2- 172.21.15.37:0/2015570012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b080b8430 0x7f6b080cc3d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6af800c4e0 tx=0x7f6af800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:04.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.965+0000 7f6aef7fe700 1 -- 172.21.15.37:0/2015570012 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af80052d0 con 0x7f6b080b8430 2023-07-12T02:05:04.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.965+0000 7f6aef7fe700 1 -- 172.21.15.37:0/2015570012 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af8005430 con 0x7f6b080b8430 2023-07-12T02:05:04.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.965+0000 7f6aef7fe700 1 -- 172.21.15.37:0/2015570012 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af80038c0 con 0x7f6b080b8430 2023-07-12T02:05:04.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.965+0000 7f6b0d5ff700 1 -- 172.21.15.37:0/2015570012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b080cb690 con 0x7f6b080b8430 2023-07-12T02:05:04.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.965+0000 7f6b0d5ff700 1 -- 172.21.15.37:0/2015570012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b080cc910 con 0x7f6b080b8430 2023-07-12T02:05:04.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.966+0000 7f6b0d5ff700 1 -- 172.21.15.37:0/2015570012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b080c6b00 con 0x7f6b080b8430 2023-07-12T02:05:04.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.967+0000 7f6aef7fe700 1 -- 172.21.15.37:0/2015570012 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6af8003a20 con 0x7f6b080b8430 2023-07-12T02:05:04.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.968+0000 7f6aef7fe700 1 --2- 172.21.15.37:0/2015570012 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6af406ace0 0x7f6af406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:04.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.968+0000 7f6aef7fe700 1 -- 172.21.15.37:0/2015570012 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6af8088ce0 con 0x7f6b080b8430 2023-07-12T02:05:04.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.968+0000 7f6b067fc700 1 --2- 172.21.15.37:0/2015570012 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6af406ace0 0x7f6af406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:04.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.969+0000 7f6b067fc700 1 --2- 172.21.15.37:0/2015570012 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6af406ace0 0x7f6af406d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6b080b14d0 tx=0x7f6afc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:04.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:04.973+0000 7f6aef7fe700 1 -- 172.21.15.37:0/2015570012 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6b080c6b00 con 0x7f6b080b8430 2023-07-12T02:05:05.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.180+0000 7f6b0d5ff700 1 -- 172.21.15.37:0/2015570012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b080c6b00 con 0x7f6b080b8430 2023-07-12T02:05:05.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.181+0000 7f6aef7fe700 1 -- 172.21.15.37:0/2015570012 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6af8017020 con 0x7f6b080b8430 2023-07-12T02:05:05.185 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-12T02:05:05.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.183+0000 7f6b0d5ff700 1 -- 172.21.15.37:0/2015570012 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6af406ace0 msgr2=0x7f6af406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:05.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.183+0000 7f6b0d5ff700 1 --2- 172.21.15.37:0/2015570012 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6af406ace0 0x7f6af406d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6b080b14d0 tx=0x7f6afc008030 comp rx=0 tx=0).stop 2023-07-12T02:05:05.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.183+0000 7f6b0d5ff700 1 -- 172.21.15.37:0/2015570012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b080b8430 msgr2=0x7f6b080cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:05.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.183+0000 7f6b0d5ff700 1 --2- 172.21.15.37:0/2015570012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b080b8430 0x7f6b080cc3d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6af800c4e0 tx=0x7f6af800c8a0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.183+0000 7f6b0d5ff700 1 -- 172.21.15.37:0/2015570012 shutdown_connections 2023-07-12T02:05:05.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.183+0000 7f6b0d5ff700 1 --2- 172.21.15.37:0/2015570012 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f6af406ace0 0x7f6af406d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.183+0000 7f6b0d5ff700 1 --2- 172.21.15.37:0/2015570012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b080b8430 0x7f6b080cc3d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.183+0000 7f6b0d5ff700 1 --2- 172.21.15.37:0/2015570012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b080d3730 0x7f6b0815e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.183+0000 7f6b0d5ff700 1 --2- 172.21.15.37:0/2015570012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b080cfa90 0x7f6b081f12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.183+0000 7f6b0d5ff700 1 -- 172.21.15.37:0/2015570012 >> 172.21.15.37:0/2015570012 conn(0x7f6b0806b3f0 msgr2=0x7f6b080d19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:05.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.183+0000 7f6b0d5ff700 1 -- 172.21.15.37:0/2015570012 shutdown_connections 2023-07-12T02:05:05.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.183+0000 7f6b0d5ff700 1 -- 172.21.15.37:0/2015570012 wait complete. 2023-07-12T02:05:05.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-12T02:05:05.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.404+0000 7f74911ff700 1 Processor -- start 2023-07-12T02:05:05.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.404+0000 7f74911ff700 1 -- start start 2023-07-12T02:05:05.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.405+0000 7f74911ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f748c0b8430 0x7f748c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:05.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.406+0000 7f74911ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748c0d0b20 con 0x7f748c0d3730 2023-07-12T02:05:05.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.406+0000 7f74911ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748c0b4ee0 con 0x7f748c0cfc60 2023-07-12T02:05:05.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.406+0000 7f74911ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748c0b8800 con 0x7f748c0b8430 2023-07-12T02:05:05.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.406+0000 7f748ad9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f748c0b8430 0x7f748c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:05.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.406+0000 7f748ad9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f748c0b8430 0x7f748c0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33966/0 (socket says 172.21.15.37:33966) 2023-07-12T02:05:05.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.406+0000 7f748ad9d700 1 -- 172.21.15.37:0/344354363 learned_addr learned my addr 172.21.15.37:0/344354363 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:05.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.406+0000 7f748ad9d700 1 -- 172.21.15.37:0/344354363 >> v1:172.21.15.196:6789/0 conn(0x7f748c0cfc60 legacy=0x7f748c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:05.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.406+0000 7f748ad9d700 1 -- 172.21.15.37:0/344354363 >> v1:172.21.15.37:6789/0 conn(0x7f748c0d3730 legacy=0x7f748c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:05.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.406+0000 7f7489d9b700 1 -- 172.21.15.37:0/344354363 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529416108 0 0) 0x7f748c0d0b20 con 0x7f748c0d3730 2023-07-12T02:05:05.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.406+0000 7f748ad9d700 1 -- 172.21.15.37:0/344354363 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c0b51c0 con 0x7f748c0b8430 2023-07-12T02:05:05.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.407+0000 7f748ad9d700 1 --2- 172.21.15.37:0/344354363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f748c0b8430 0x7f748c0cd320 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f747c0098f0 tx=0x7f747c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51df721401f8905c server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:05.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.407+0000 7f7489d9b700 1 -- 172.21.15.37:0/344354363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c004230 con 0x7f748c0b8430 2023-07-12T02:05:05.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.407+0000 7f7489d9b700 1 -- 172.21.15.37:0/344354363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747c004390 con 0x7f748c0b8430 2023-07-12T02:05:05.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.407+0000 7f7489d9b700 1 -- 172.21.15.37:0/344354363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c0036a0 con 0x7f748c0b8430 2023-07-12T02:05:05.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.407+0000 7f74911ff700 1 -- 172.21.15.37:0/344354363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f748c0b8430 msgr2=0x7f748c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:05.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.407+0000 7f74911ff700 1 --2- 172.21.15.37:0/344354363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f748c0b8430 0x7f748c0cd320 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f747c0098f0 tx=0x7f747c009c00 comp rx=0 tx=0).stop 2023-07-12T02:05:05.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.407+0000 7f74911ff700 1 -- 172.21.15.37:0/344354363 shutdown_connections 2023-07-12T02:05:05.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.407+0000 7f74911ff700 1 --2- 172.21.15.37:0/344354363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f748c0b8430 0x7f748c0cd320 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.407+0000 7f74911ff700 1 -- 172.21.15.37:0/344354363 >> 172.21.15.37:0/344354363 conn(0x7f748c06b3f0 msgr2=0x7f748c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:05.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.407+0000 7f74911ff700 1 -- 172.21.15.37:0/344354363 shutdown_connections 2023-07-12T02:05:05.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.408+0000 7f74911ff700 1 -- 172.21.15.37:0/344354363 wait complete. 2023-07-12T02:05:05.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.409+0000 7f74911ff700 1 Processor -- start 2023-07-12T02:05:05.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.409+0000 7f74911ff700 1 -- start start 2023-07-12T02:05:05.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.410+0000 7f74911ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f748c0b8430 0x7f748c0c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:05.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.410+0000 7f74911ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f748c0cfc60 0x7f748c15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:05.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.410+0000 7f74911ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f748c0d3730 0x7f748c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:05.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.410+0000 7f74911ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c1f1c10 con 0x7f748c0cfc60 2023-07-12T02:05:05.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.410+0000 7f74911ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c1f1e10 con 0x7f748c0b8430 2023-07-12T02:05:05.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.410+0000 7f74911ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c1f20b0 con 0x7f748c0d3730 2023-07-12T02:05:05.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.410+0000 7f748a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f748c0cfc60 0x7f748c15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:05.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.410+0000 7f748a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f748c0cfc60 0x7f748c15acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33974/0 (socket says 172.21.15.37:33974) 2023-07-12T02:05:05.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.410+0000 7f748a59c700 1 -- 172.21.15.37:0/2874761041 learned_addr learned my addr 172.21.15.37:0/2874761041 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:05.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.411+0000 7f748a59c700 1 -- 172.21.15.37:0/2874761041 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f748c0d3730 msgr2=0x7f748c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:05.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.411+0000 7f748a59c700 1 --2- 172.21.15.37:0/2874761041 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f748c0d3730 0x7f748c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.411+0000 7f748ad9d700 1 --2- 172.21.15.37:0/2874761041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f748c0b8430 0x7f748c0c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:05.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.411+0000 7f748a59c700 1 -- 172.21.15.37:0/2874761041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f748c0b8430 msgr2=0x7f748c0c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:05.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.411+0000 7f748a59c700 1 --2- 172.21.15.37:0/2874761041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f748c0b8430 0x7f748c0c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.411+0000 7f748a59c700 1 -- 172.21.15.37:0/2874761041 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c009550 con 0x7f748c0cfc60 2023-07-12T02:05:05.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.411+0000 7f748ad9d700 1 --2- 172.21.15.37:0/2874761041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f748c0b8430 0x7f748c0c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:05.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.411+0000 7f748a59c700 1 --2- 172.21.15.37:0/2874761041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f748c0cfc60 0x7f748c15acc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f748000c450 tx=0x7f748000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:05.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.411+0000 7f74737fe700 1 -- 172.21.15.37:0/2874761041 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74800054e0 con 0x7f748c0cfc60 2023-07-12T02:05:05.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.411+0000 7f74737fe700 1 -- 172.21.15.37:0/2874761041 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7480003680 con 0x7f748c0cfc60 2023-07-12T02:05:05.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.411+0000 7f74911ff700 1 -- 172.21.15.37:0/2874761041 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c1f2390 con 0x7f748c0cfc60 2023-07-12T02:05:05.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.411+0000 7f74737fe700 1 -- 172.21.15.37:0/2874761041 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7480003a30 con 0x7f748c0cfc60 2023-07-12T02:05:05.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.412+0000 7f74911ff700 1 -- 172.21.15.37:0/2874761041 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c1f2950 con 0x7f748c0cfc60 2023-07-12T02:05:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.413+0000 7f74911ff700 1 -- 172.21.15.37:0/2874761041 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748c066e80 con 0x7f748c0cfc60 2023-07-12T02:05:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.414+0000 7f74737fe700 1 -- 172.21.15.37:0/2874761041 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7480003b90 con 0x7f748c0cfc60 2023-07-12T02:05:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.415+0000 7f74737fe700 1 --2- 172.21.15.37:0/2874761041 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f747806ace0 0x7f747806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.415+0000 7f74737fe700 1 -- 172.21.15.37:0/2874761041 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7480088c50 con 0x7f748c0cfc60 2023-07-12T02:05:05.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.415+0000 7f748ad9d700 1 --2- 172.21.15.37:0/2874761041 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f747806ace0 0x7f747806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:05.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.416+0000 7f748ad9d700 1 --2- 172.21.15.37:0/2874761041 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f747806ace0 0x7f747806d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f747c009c40 tx=0x7f747c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:05.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.419+0000 7f74737fe700 1 -- 172.21.15.37:0/2874761041 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f74800539d0 con 0x7f748c0cfc60 2023-07-12T02:05:05.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.625+0000 7f74911ff700 1 -- 172.21.15.37:0/2874761041 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f748c04ea60 con 0x7f748c0cfc60 2023-07-12T02:05:05.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.626+0000 7f74737fe700 1 -- 172.21.15.37:0/2874761041 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f74800170a0 con 0x7f748c0cfc60 2023-07-12T02:05:05.629 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:05:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.628+0000 7f74911ff700 1 -- 172.21.15.37:0/2874761041 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f747806ace0 msgr2=0x7f747806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.628+0000 7f74911ff700 1 --2- 172.21.15.37:0/2874761041 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f747806ace0 0x7f747806d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f747c009c40 tx=0x7f747c008030 comp rx=0 tx=0).stop 2023-07-12T02:05:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.628+0000 7f74911ff700 1 -- 172.21.15.37:0/2874761041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f748c0cfc60 msgr2=0x7f748c15acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:05.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.628+0000 7f74911ff700 1 --2- 172.21.15.37:0/2874761041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f748c0cfc60 0x7f748c15acc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f748000c450 tx=0x7f748000c810 comp rx=0 tx=0).stop 2023-07-12T02:05:05.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.628+0000 7f74911ff700 1 -- 172.21.15.37:0/2874761041 shutdown_connections 2023-07-12T02:05:05.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.628+0000 7f74911ff700 1 --2- 172.21.15.37:0/2874761041 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f747806ace0 0x7f747806d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.628+0000 7f74911ff700 1 --2- 172.21.15.37:0/2874761041 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f748c0d3730 0x7f748c15b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.628+0000 7f74911ff700 1 --2- 172.21.15.37:0/2874761041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f748c0b8430 0x7f748c0c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.628+0000 7f74911ff700 1 --2- 172.21.15.37:0/2874761041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f748c0cfc60 0x7f748c15acc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.628+0000 7f74911ff700 1 -- 172.21.15.37:0/2874761041 >> 172.21.15.37:0/2874761041 conn(0x7f748c06b3f0 msgr2=0x7f748c06b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:05.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.628+0000 7f74911ff700 1 -- 172.21.15.37:0/2874761041 shutdown_connections 2023-07-12T02:05:05.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.628+0000 7f74911ff700 1 -- 172.21.15.37:0/2874761041 wait complete. 2023-07-12T02:05:05.660 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-12T02:05:05.661 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-07-12T02:05:05.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.859+0000 7fc6ab3ff700 1 Processor -- start 2023-07-12T02:05:05.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.859+0000 7fc6ab3ff700 1 -- start start 2023-07-12T02:05:05.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.860+0000 7fc6ab3ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc6a40d2640 0x7fc6a40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:05.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.860+0000 7fc6ab3ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc6a40cf8f0 0x7fc6a415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:05.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.860+0000 7fc6ab3ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a40d1790 con 0x7fc6a415c460 2023-07-12T02:05:05.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.860+0000 7fc6ab3ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a40cedd0 con 0x7fc6a40cf8f0 2023-07-12T02:05:05.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.860+0000 7fc6ab3ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a40cd950 con 0x7fc6a40d2640 2023-07-12T02:05:05.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.860+0000 7fc6a999c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc6a40cf8f0 0x7fc6a415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:05.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.860+0000 7fc6a999c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc6a40cf8f0 0x7fc6a415fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33986/0 (socket says 172.21.15.37:33986) 2023-07-12T02:05:05.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.860+0000 7fc6a999c700 1 -- 172.21.15.37:0/4225256345 learned_addr learned my addr 172.21.15.37:0/4225256345 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:05.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.860+0000 7fc6a899a700 1 --2- 172.21.15.37:0/4225256345 >> v2:172.21.15.196:3300/0 conn(0x7fc6a40d2640 0x7fc6a40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:05.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.861+0000 7fc6a999c700 1 -- 172.21.15.37:0/4225256345 >> v2:172.21.15.196:3300/0 conn(0x7fc6a40d2640 msgr2=0x7fc6a40b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:05.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.861+0000 7fc6a999c700 1 --2- 172.21.15.37:0/4225256345 >> v2:172.21.15.196:3300/0 conn(0x7fc6a40d2640 0x7fc6a40b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.861+0000 7fc6a999c700 1 -- 172.21.15.37:0/4225256345 >> v1:172.21.15.196:6789/0 conn(0x7fc6a415c460 legacy=0x7fc6a40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:05.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.861+0000 7fc6a999c700 1 -- 172.21.15.37:0/4225256345 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40d14b0 con 0x7fc6a40cf8f0 2023-07-12T02:05:05.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.861+0000 7fc6a999c700 1 --2- 172.21.15.37:0/4225256345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6a40cf8f0 0x7fc6a415fe20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc6a415fd80 tx=0x7fc69c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5afbfe9340561ad server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:05.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.861+0000 7fc69bfff700 1 -- 172.21.15.37:0/4225256345 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00e070 con 0x7fc6a40cf8f0 2023-07-12T02:05:05.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.861+0000 7fc69bfff700 1 -- 172.21.15.37:0/4225256345 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c00b9c0 con 0x7fc6a40cf8f0 2023-07-12T02:05:05.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.861+0000 7fc69bfff700 1 -- 172.21.15.37:0/4225256345 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00bd70 con 0x7fc6a40cf8f0 2023-07-12T02:05:05.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.862+0000 7fc6ab3ff700 1 -- 172.21.15.37:0/4225256345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6a40cf8f0 msgr2=0x7fc6a415fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:05.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.862+0000 7fc6ab3ff700 1 --2- 172.21.15.37:0/4225256345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6a40cf8f0 0x7fc6a415fe20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc6a415fd80 tx=0x7fc69c00b330 comp rx=0 tx=0).stop 2023-07-12T02:05:05.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.862+0000 7fc6ab3ff700 1 -- 172.21.15.37:0/4225256345 shutdown_connections 2023-07-12T02:05:05.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.862+0000 7fc6ab3ff700 1 --2- 172.21.15.37:0/4225256345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6a40cf8f0 0x7fc6a415fe20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.862+0000 7fc6ab3ff700 1 --2- 172.21.15.37:0/4225256345 >> v2:172.21.15.196:3300/0 conn(0x7fc6a40d2640 0x7fc6a40b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.862+0000 7fc6ab3ff700 1 -- 172.21.15.37:0/4225256345 >> 172.21.15.37:0/4225256345 conn(0x7fc6a4071660 msgr2=0x7fc6a4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:05.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.862+0000 7fc6ab3ff700 1 -- 172.21.15.37:0/4225256345 shutdown_connections 2023-07-12T02:05:05.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.862+0000 7fc6ab3ff700 1 -- 172.21.15.37:0/4225256345 wait complete. 2023-07-12T02:05:05.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.864+0000 7fc6ab3ff700 1 Processor -- start 2023-07-12T02:05:05.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.864+0000 7fc6ab3ff700 1 -- start start 2023-07-12T02:05:05.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.865+0000 7fc6ab3ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a40cf8f0 0x7fc6a40c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:05.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.865+0000 7fc6ab3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6a40d2640 0x7fc6a40c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:05.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.865+0000 7fc6ab3ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6a415c460 0x7fc6a414e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:05.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.865+0000 7fc6ab3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40c7600 con 0x7fc6a40d2640 2023-07-12T02:05:05.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.865+0000 7fc6ab3ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40c8050 con 0x7fc6a415c460 2023-07-12T02:05:05.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.865+0000 7fc6ab3ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40c8330 con 0x7fc6a40cf8f0 2023-07-12T02:05:05.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.865+0000 7fc6a899a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6a40d2640 0x7fc6a40c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:05.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.865+0000 7fc6a899a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6a40d2640 0x7fc6a40c70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34000/0 (socket says 172.21.15.37:34000) 2023-07-12T02:05:05.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.865+0000 7fc6a899a700 1 -- 172.21.15.37:0/1831953035 learned_addr learned my addr 172.21.15.37:0/1831953035 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:05.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.865+0000 7fc6a899a700 1 -- 172.21.15.37:0/1831953035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a40cf8f0 msgr2=0x7fc6a40c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:05.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.865+0000 7fc6a899a700 1 --2- 172.21.15.37:0/1831953035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a40cf8f0 0x7fc6a40c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.865+0000 7fc6a899a700 1 -- 172.21.15.37:0/1831953035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6a415c460 msgr2=0x7fc6a414e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:05.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.865+0000 7fc6a899a700 1 --2- 172.21.15.37:0/1831953035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6a415c460 0x7fc6a414e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:05.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.865+0000 7fc6a899a700 1 -- 172.21.15.37:0/1831953035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c009b30 con 0x7fc6a40d2640 2023-07-12T02:05:05.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.866+0000 7fc6a899a700 1 --2- 172.21.15.37:0/1831953035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6a40d2640 0x7fc6a40c70c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc69400d800 tx=0x7fc69400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:05.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.866+0000 7fc699ffb700 1 -- 172.21.15.37:0/1831953035 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6940125f0 con 0x7fc6a40d2640 2023-07-12T02:05:05.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.866+0000 7fc699ffb700 1 -- 172.21.15.37:0/1831953035 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694012750 con 0x7fc6a40d2640 2023-07-12T02:05:05.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.866+0000 7fc699ffb700 1 -- 172.21.15.37:0/1831953035 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694012b00 con 0x7fc6a40d2640 2023-07-12T02:05:05.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.866+0000 7fc6ab3ff700 1 -- 172.21.15.37:0/1831953035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a40c8610 con 0x7fc6a40d2640 2023-07-12T02:05:05.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.866+0000 7fc6ab3ff700 1 -- 172.21.15.37:0/1831953035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a40c8bd0 con 0x7fc6a40d2640 2023-07-12T02:05:05.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.867+0000 7fc6ab3ff700 1 -- 172.21.15.37:0/1831953035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a40c8d60 con 0x7fc6a40d2640 2023-07-12T02:05:05.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.868+0000 7fc699ffb700 1 -- 172.21.15.37:0/1831953035 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc694012c60 con 0x7fc6a40d2640 2023-07-12T02:05:05.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.869+0000 7fc699ffb700 1 --2- 172.21.15.37:0/1831953035 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc68806ace0 0x7fc68806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:05.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.869+0000 7fc699ffb700 1 -- 172.21.15.37:0/1831953035 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc694089bb0 con 0x7fc6a40d2640 2023-07-12T02:05:05.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.869+0000 7fc6a919b700 1 --2- 172.21.15.37:0/1831953035 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc68806ace0 0x7fc68806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:05.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.870+0000 7fc6a919b700 1 --2- 172.21.15.37:0/1831953035 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc68806ace0 0x7fc68806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0000f60 tx=0x7fc6a0007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:05.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:05.873+0000 7fc699ffb700 1 -- 172.21.15.37:0/1831953035 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc694054920 con 0x7fc6a40d2640 2023-07-12T02:05:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:06.161+0000 7fc6ab3ff700 1 -- 172.21.15.37:0/1831953035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fc6a404ea60 con 0x7fc6a40d2640 2023-07-12T02:05:07.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.140+0000 7fc699ffb700 1 -- 172.21.15.37:0/1831953035 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v84) v1 ==== 147+0+0 (secure 0 0 0) 0x7fc694057f40 con 0x7fc6a40d2640 2023-07-12T02:05:07.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.143+0000 7fc6ab3ff700 1 -- 172.21.15.37:0/1831953035 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc68806ace0 msgr2=0x7fc68806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:07.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.143+0000 7fc6ab3ff700 1 --2- 172.21.15.37:0/1831953035 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc68806ace0 0x7fc68806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0000f60 tx=0x7fc6a0007a40 comp rx=0 tx=0).stop 2023-07-12T02:05:07.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.143+0000 7fc6ab3ff700 1 -- 172.21.15.37:0/1831953035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6a40d2640 msgr2=0x7fc6a40c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:07.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.143+0000 7fc6ab3ff700 1 --2- 172.21.15.37:0/1831953035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6a40d2640 0x7fc6a40c70c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc69400d800 tx=0x7fc69400dbc0 comp rx=0 tx=0).stop 2023-07-12T02:05:07.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.143+0000 7fc6ab3ff700 1 -- 172.21.15.37:0/1831953035 shutdown_connections 2023-07-12T02:05:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.143+0000 7fc6ab3ff700 1 --2- 172.21.15.37:0/1831953035 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc68806ace0 0x7fc68806d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.143+0000 7fc6ab3ff700 1 --2- 172.21.15.37:0/1831953035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6a415c460 0x7fc6a414e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.143+0000 7fc6ab3ff700 1 --2- 172.21.15.37:0/1831953035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6a40cf8f0 0x7fc6a40c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.143+0000 7fc6ab3ff700 1 --2- 172.21.15.37:0/1831953035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6a40d2640 0x7fc6a40c70c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.143+0000 7fc6ab3ff700 1 -- 172.21.15.37:0/1831953035 >> 172.21.15.37:0/1831953035 conn(0x7fc6a4071660 msgr2=0x7fc6a40cf070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.143+0000 7fc6ab3ff700 1 -- 172.21.15.37:0/1831953035 shutdown_connections 2023-07-12T02:05:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.144+0000 7fc6ab3ff700 1 -- 172.21.15.37:0/1831953035 wait complete. 2023-07-12T02:05:07.167 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-12T02:05:07.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.374+0000 7f535adff700 1 Processor -- start 2023-07-12T02:05:07.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.374+0000 7f535adff700 1 -- start start 2023-07-12T02:05:07.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.375+0000 7f535adff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f53540cfc60 0x7f5354167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.375+0000 7f535adff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53540d0b20 con 0x7f53540b8430 2023-07-12T02:05:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.375+0000 7f535adff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53540b4ee0 con 0x7f53540d3730 2023-07-12T02:05:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.375+0000 7f535adff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53540cda30 con 0x7f53540cfc60 2023-07-12T02:05:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.375+0000 7f5358b9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f53540b8430 0x7f53540cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51730/0 (socket says 172.21.15.37:51730) 2023-07-12T02:05:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.375+0000 7f5358b9b700 1 -- 172.21.15.37:0/2673162707 learned_addr learned my addr 172.21.15.37:0/2673162707 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.375+0000 7f535939c700 1 --2- 172.21.15.37:0/2673162707 >> v2:172.21.15.196:3300/0 conn(0x7f53540cfc60 0x7f5354167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:07.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.376+0000 7f53537fe700 1 -- 172.21.15.37:0/2673162707 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779673371 0 0) 0x7f53540d0b20 con 0x7f53540b8430 2023-07-12T02:05:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.376+0000 7f53537fe700 1 -- 172.21.15.37:0/2673162707 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53440035b0 con 0x7f53540b8430 2023-07-12T02:05:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.376+0000 7f535939c700 1 -- 172.21.15.37:0/2673162707 >> v1:172.21.15.196:6789/0 conn(0x7f53540d3730 legacy=0x7f53540cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.376+0000 7f535939c700 1 -- 172.21.15.37:0/2673162707 >> v1:172.21.15.37:6789/0 conn(0x7f53540b8430 legacy=0x7f53540cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.376+0000 7f535939c700 1 -- 172.21.15.37:0/2673162707 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53540b51c0 con 0x7f53540cfc60 2023-07-12T02:05:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.376+0000 7f535939c700 1 --2- 172.21.15.37:0/2673162707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53540cfc60 0x7f5354167010 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f534c009d90 tx=0x7f534c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=870ec3cd987917fb server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.376+0000 7f53537fe700 1 -- 172.21.15.37:0/2673162707 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c00e070 con 0x7f53540cfc60 2023-07-12T02:05:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.377+0000 7f53537fe700 1 -- 172.21.15.37:0/2673162707 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c00bb20 con 0x7f53540cfc60 2023-07-12T02:05:07.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.377+0000 7f53537fe700 1 -- 172.21.15.37:0/2673162707 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c012430 con 0x7f53540cfc60 2023-07-12T02:05:07.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.377+0000 7f535adff700 1 -- 172.21.15.37:0/2673162707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53540cfc60 msgr2=0x7f5354167010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:07.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.377+0000 7f535adff700 1 --2- 172.21.15.37:0/2673162707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53540cfc60 0x7f5354167010 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f534c009d90 tx=0x7f534c00b330 comp rx=0 tx=0).stop 2023-07-12T02:05:07.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.377+0000 7f535adff700 1 -- 172.21.15.37:0/2673162707 shutdown_connections 2023-07-12T02:05:07.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.377+0000 7f535adff700 1 --2- 172.21.15.37:0/2673162707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53540cfc60 0x7f5354167010 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:07.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.377+0000 7f535adff700 1 -- 172.21.15.37:0/2673162707 >> 172.21.15.37:0/2673162707 conn(0x7f535406b3f0 msgr2=0x7f535406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:07.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.377+0000 7f535adff700 1 -- 172.21.15.37:0/2673162707 shutdown_connections 2023-07-12T02:05:07.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.377+0000 7f535adff700 1 -- 172.21.15.37:0/2673162707 wait complete. 2023-07-12T02:05:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.379+0000 7f535adff700 1 Processor -- start 2023-07-12T02:05:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.379+0000 7f535adff700 1 -- start start 2023-07-12T02:05:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.380+0000 7f535adff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53540b8430 0x7f53540c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.380+0000 7f535adff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53540cfc60 0x7f53540a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.380+0000 7f535adff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53540d3730 0x7f53540a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.380+0000 7f535adff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535415f810 con 0x7f53540cfc60 2023-07-12T02:05:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.380+0000 7f535adff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535415f530 con 0x7f53540d3730 2023-07-12T02:05:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.380+0000 7f535adff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53540c7120 con 0x7f53540b8430 2023-07-12T02:05:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.380+0000 7f5353fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53540cfc60 0x7f53540a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.380+0000 7f5353fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53540cfc60 0x7f53540a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34016/0 (socket says 172.21.15.37:34016) 2023-07-12T02:05:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.380+0000 7f5353fff700 1 -- 172.21.15.37:0/409790693 learned_addr learned my addr 172.21.15.37:0/409790693 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.380+0000 7f5358b9b700 1 --2- 172.21.15.37:0/409790693 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53540b8430 0x7f53540c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.380+0000 7f535939c700 1 --2- 172.21.15.37:0/409790693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53540d3730 0x7f53540a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:07.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.381+0000 7f5353fff700 1 -- 172.21.15.37:0/409790693 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53540b8430 msgr2=0x7f53540c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:07.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.381+0000 7f5353fff700 1 --2- 172.21.15.37:0/409790693 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53540b8430 0x7f53540c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:07.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.381+0000 7f5353fff700 1 -- 172.21.15.37:0/409790693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53540d3730 msgr2=0x7f53540a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:07.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.381+0000 7f5353fff700 1 --2- 172.21.15.37:0/409790693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53540d3730 0x7f53540a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:07.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.381+0000 7f5353fff700 1 -- 172.21.15.37:0/409790693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c009a70 con 0x7f53540cfc60 2023-07-12T02:05:07.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.381+0000 7f5353fff700 1 --2- 172.21.15.37:0/409790693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53540cfc60 0x7f53540a9480 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f534000c450 tx=0x7f534000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:07.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.381+0000 7f53517fa700 1 -- 172.21.15.37:0/409790693 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53400052d0 con 0x7f53540cfc60 2023-07-12T02:05:07.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.381+0000 7f535adff700 1 -- 172.21.15.37:0/409790693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53540c7400 con 0x7f53540cfc60 2023-07-12T02:05:07.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.381+0000 7f53517fa700 1 -- 172.21.15.37:0/409790693 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5340005430 con 0x7f53540cfc60 2023-07-12T02:05:07.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.381+0000 7f53517fa700 1 -- 172.21.15.37:0/409790693 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53400038c0 con 0x7f53540cfc60 2023-07-12T02:05:07.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.381+0000 7f535adff700 1 -- 172.21.15.37:0/409790693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535415f200 con 0x7f53540cfc60 2023-07-12T02:05:07.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.383+0000 7f535adff700 1 -- 172.21.15.37:0/409790693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53540c7920 con 0x7f53540cfc60 2023-07-12T02:05:07.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.384+0000 7f53517fa700 1 -- 172.21.15.37:0/409790693 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5340003a20 con 0x7f53540cfc60 2023-07-12T02:05:07.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.385+0000 7f53517fa700 1 --2- 172.21.15.37:0/409790693 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f533806ace0 0x7f533806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:07.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.385+0000 7f53517fa700 1 -- 172.21.15.37:0/409790693 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5340088ba0 con 0x7f53540cfc60 2023-07-12T02:05:07.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.385+0000 7f5358b9b700 1 --2- 172.21.15.37:0/409790693 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f533806ace0 0x7f533806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:07.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.386+0000 7f5358b9b700 1 --2- 172.21.15.37:0/409790693 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f533806ace0 0x7f533806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5348007fd0 tx=0x7f5348007dc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:07.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.389+0000 7f53517fa700 1 -- 172.21.15.37:0/409790693 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f53540c7920 con 0x7f53540cfc60 2023-07-12T02:05:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.599+0000 7f535adff700 1 -- 172.21.15.37:0/409790693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f53540c7920 con 0x7f53540cfc60 2023-07-12T02:05:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.605+0000 7f53517fa700 1 -- 172.21.15.37:0/409790693 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f53540c7920 con 0x7f53540cfc60 2023-07-12T02:05:07.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.607+0000 7f535adff700 1 -- 172.21.15.37:0/409790693 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f533806ace0 msgr2=0x7f533806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:07.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.607+0000 7f535adff700 1 --2- 172.21.15.37:0/409790693 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f533806ace0 0x7f533806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5348007fd0 tx=0x7f5348007dc0 comp rx=0 tx=0).stop 2023-07-12T02:05:07.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.607+0000 7f535adff700 1 -- 172.21.15.37:0/409790693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53540cfc60 msgr2=0x7f53540a9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:07.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.607+0000 7f535adff700 1 --2- 172.21.15.37:0/409790693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53540cfc60 0x7f53540a9480 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f534000c450 tx=0x7f534000c760 comp rx=0 tx=0).stop 2023-07-12T02:05:07.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.607+0000 7f535adff700 1 -- 172.21.15.37:0/409790693 shutdown_connections 2023-07-12T02:05:07.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.607+0000 7f535adff700 1 --2- 172.21.15.37:0/409790693 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f533806ace0 0x7f533806d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:07.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.607+0000 7f535adff700 1 --2- 172.21.15.37:0/409790693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53540d3730 0x7f53540a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:07.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.607+0000 7f535adff700 1 --2- 172.21.15.37:0/409790693 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53540b8430 0x7f53540c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:07.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.607+0000 7f535adff700 1 --2- 172.21.15.37:0/409790693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53540cfc60 0x7f53540a9480 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:07.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.607+0000 7f535adff700 1 -- 172.21.15.37:0/409790693 >> 172.21.15.37:0/409790693 conn(0x7f535406b3f0 msgr2=0x7f535406b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:07.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.607+0000 7f535adff700 1 -- 172.21.15.37:0/409790693 shutdown_connections 2023-07-12T02:05:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:07.607+0000 7f535adff700 1 -- 172.21.15.37:0/409790693 wait complete. 2023-07-12T02:05:07.629 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-12T02:05:07.629 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-12T02:05:07.730 DEBUG:teuthology.orchestra.run.smithi196:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-12T02:05:07.834 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-12T02:05:07.834 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:05:07.834 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:05:07.880 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:05:07.880 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:05:07.965 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:05:07.965 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:05:08.050 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:05:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.289+0000 7f2c405ff700 1 Processor -- start 2023-07-12T02:05:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.289+0000 7f2c405ff700 1 -- start start 2023-07-12T02:05:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.290+0000 7f2c405ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c380b59d0 0x7f2c381671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.290+0000 7f2c405ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c380d1790 con 0x7f2c380d2640 2023-07-12T02:05:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.290+0000 7f2c405ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c380cd950 con 0x7f2c3815c460 2023-07-12T02:05:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.290+0000 7f2c405ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c380cedd0 con 0x7f2c380b59d0 2023-07-12T02:05:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.290+0000 7f2c3db9a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2c380d2640 0x7f2c380cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51746/0 (socket says 172.21.15.37:51746) 2023-07-12T02:05:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.290+0000 7f2c3db9a700 1 -- 172.21.15.37:0/1917481950 learned_addr learned my addr 172.21.15.37:0/1917481950 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.291+0000 7f2c3eb9c700 1 --2- 172.21.15.37:0/1917481950 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c380b59d0 0x7f2c381671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.291+0000 7f2c3d399700 1 -- 172.21.15.37:0/1917481950 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983909728 0 0) 0x7f2c380d1790 con 0x7f2c380d2640 2023-07-12T02:05:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.291+0000 7f2c3d399700 1 -- 172.21.15.37:0/1917481950 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c240035b0 con 0x7f2c380d2640 2023-07-12T02:05:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.291+0000 7f2c3d399700 1 -- 172.21.15.37:0/1917481950 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953827756 0 0) 0x7f2c380cd950 con 0x7f2c3815c460 2023-07-12T02:05:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.291+0000 7f2c3d399700 1 -- 172.21.15.37:0/1917481950 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c380d1790 con 0x7f2c3815c460 2023-07-12T02:05:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.291+0000 7f2c3eb9c700 1 -- 172.21.15.37:0/1917481950 >> v1:172.21.15.196:6789/0 conn(0x7f2c3815c460 legacy=0x7f2c380cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.291+0000 7f2c3eb9c700 1 -- 172.21.15.37:0/1917481950 >> v1:172.21.15.37:6789/0 conn(0x7f2c380d2640 legacy=0x7f2c380cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.291+0000 7f2c3eb9c700 1 -- 172.21.15.37:0/1917481950 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c380d14b0 con 0x7f2c380b59d0 2023-07-12T02:05:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.291+0000 7f2c3eb9c700 1 --2- 172.21.15.37:0/1917481950 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c380b59d0 0x7f2c381671b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009dc0 tx=0x7f2c3000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=313d3f1992feffad server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.292+0000 7f2c3d399700 1 -- 172.21.15.37:0/1917481950 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3000e070 con 0x7f2c380b59d0 2023-07-12T02:05:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.292+0000 7f2c3d399700 1 -- 172.21.15.37:0/1917481950 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3000bb20 con 0x7f2c380b59d0 2023-07-12T02:05:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.292+0000 7f2c3d399700 1 -- 172.21.15.37:0/1917481950 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30012430 con 0x7f2c380b59d0 2023-07-12T02:05:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.292+0000 7f2c405ff700 1 -- 172.21.15.37:0/1917481950 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c380b59d0 msgr2=0x7f2c381671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.292+0000 7f2c405ff700 1 --2- 172.21.15.37:0/1917481950 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c380b59d0 0x7f2c381671b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009dc0 tx=0x7f2c3000b330 comp rx=0 tx=0).stop 2023-07-12T02:05:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.292+0000 7f2c405ff700 1 -- 172.21.15.37:0/1917481950 shutdown_connections 2023-07-12T02:05:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.292+0000 7f2c405ff700 1 --2- 172.21.15.37:0/1917481950 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c380b59d0 0x7f2c381671b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.292+0000 7f2c405ff700 1 -- 172.21.15.37:0/1917481950 >> 172.21.15.37:0/1917481950 conn(0x7f2c38071660 msgr2=0x7f2c38071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.292+0000 7f2c405ff700 1 -- 172.21.15.37:0/1917481950 shutdown_connections 2023-07-12T02:05:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.292+0000 7f2c405ff700 1 -- 172.21.15.37:0/1917481950 wait complete. 2023-07-12T02:05:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.295+0000 7f2c405ff700 1 Processor -- start 2023-07-12T02:05:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.295+0000 7f2c405ff700 1 -- start start 2023-07-12T02:05:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.296+0000 7f2c405ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c380b59d0 0x7f2c38154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.296+0000 7f2c405ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c380d2640 0x7f2c38153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.296+0000 7f2c405ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c3815c460 0x7f2c3815f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.296+0000 7f2c405ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c38153c40 con 0x7f2c380b59d0 2023-07-12T02:05:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.296+0000 7f2c405ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c381545e0 con 0x7f2c3815c460 2023-07-12T02:05:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.296+0000 7f2c405ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3815e060 con 0x7f2c380d2640 2023-07-12T02:05:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.296+0000 7f2c3e39b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c380b59d0 0x7f2c38154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.297+0000 7f2c3e39b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c380b59d0 0x7f2c38154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34024/0 (socket says 172.21.15.37:34024) 2023-07-12T02:05:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.297+0000 7f2c3e39b700 1 -- 172.21.15.37:0/2789217823 learned_addr learned my addr 172.21.15.37:0/2789217823 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:08.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.297+0000 7f2c3eb9c700 1 --2- 172.21.15.37:0/2789217823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c3815c460 0x7f2c3815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:08.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.297+0000 7f2c3db9a700 1 --2- 172.21.15.37:0/2789217823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c380d2640 0x7f2c38153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:08.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.297+0000 7f2c3e39b700 1 -- 172.21.15.37:0/2789217823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c380d2640 msgr2=0x7f2c38153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:08.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.297+0000 7f2c3e39b700 1 --2- 172.21.15.37:0/2789217823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c380d2640 0x7f2c38153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.297+0000 7f2c3e39b700 1 -- 172.21.15.37:0/2789217823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c3815c460 msgr2=0x7f2c3815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:08.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.297+0000 7f2c3e39b700 1 --2- 172.21.15.37:0/2789217823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c3815c460 0x7f2c3815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.297+0000 7f2c3e39b700 1 -- 172.21.15.37:0/2789217823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c30009a70 con 0x7f2c380b59d0 2023-07-12T02:05:08.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.297+0000 7f2c3db9a700 1 --2- 172.21.15.37:0/2789217823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c380d2640 0x7f2c38153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.297+0000 7f2c3e39b700 1 --2- 172.21.15.37:0/2789217823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c380b59d0 0x7f2c38154970 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400c520 tx=0x7f2c3400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.297+0000 7f2c2effd700 1 -- 172.21.15.37:0/2789217823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c340052d0 con 0x7f2c380b59d0 2023-07-12T02:05:08.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.297+0000 7f2c2effd700 1 -- 172.21.15.37:0/2789217823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c34005430 con 0x7f2c380b59d0 2023-07-12T02:05:08.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.297+0000 7f2c2effd700 1 -- 172.21.15.37:0/2789217823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c340038a0 con 0x7f2c380b59d0 2023-07-12T02:05:08.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.297+0000 7f2c405ff700 1 -- 172.21.15.37:0/2789217823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3815e340 con 0x7f2c380b59d0 2023-07-12T02:05:08.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.298+0000 7f2c405ff700 1 -- 172.21.15.37:0/2789217823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3815e900 con 0x7f2c380b59d0 2023-07-12T02:05:08.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.299+0000 7f2c405ff700 1 -- 172.21.15.37:0/2789217823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c38066a00 con 0x7f2c380b59d0 2023-07-12T02:05:08.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.300+0000 7f2c2effd700 1 -- 172.21.15.37:0/2789217823 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2c34003a00 con 0x7f2c380b59d0 2023-07-12T02:05:08.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.301+0000 7f2c2effd700 1 --2- 172.21.15.37:0/2789217823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2c1c06ace0 0x7f2c1c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:08.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.301+0000 7f2c2effd700 1 -- 172.21.15.37:0/2789217823 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2c34088d80 con 0x7f2c380b59d0 2023-07-12T02:05:08.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.301+0000 7f2c3db9a700 1 --2- 172.21.15.37:0/2789217823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2c1c06ace0 0x7f2c1c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:08.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.302+0000 7f2c3db9a700 1 --2- 172.21.15.37:0/2789217823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2c1c06ace0 0x7f2c1c06d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2c380cdd30 tx=0x7f2c28009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:08.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.305+0000 7f2c2effd700 1 -- 172.21.15.37:0/2789217823 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2c38066a00 con 0x7f2c380b59d0 2023-07-12T02:05:08.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.512+0000 7f2c405ff700 1 -- 172.21.15.37:0/2789217823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c38066a00 con 0x7f2c380b59d0 2023-07-12T02:05:08.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.513+0000 7f2c2effd700 1 -- 172.21.15.37:0/2789217823 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20168 (secure 0 0 0) 0x7f2c38066a00 con 0x7f2c380b59d0 2023-07-12T02:05:08.517 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:39.032667+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:05:08.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.516+0000 7f2c405ff700 1 -- 172.21.15.37:0/2789217823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2c1c06ace0 msgr2=0x7f2c1c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:08.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.516+0000 7f2c405ff700 1 --2- 172.21.15.37:0/2789217823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2c1c06ace0 0x7f2c1c06d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2c380cdd30 tx=0x7f2c28009040 comp rx=0 tx=0).stop 2023-07-12T02:05:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.516+0000 7f2c405ff700 1 -- 172.21.15.37:0/2789217823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c380b59d0 msgr2=0x7f2c38154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.516+0000 7f2c405ff700 1 --2- 172.21.15.37:0/2789217823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c380b59d0 0x7f2c38154970 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400c520 tx=0x7f2c3400c830 comp rx=0 tx=0).stop 2023-07-12T02:05:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.516+0000 7f2c405ff700 1 -- 172.21.15.37:0/2789217823 shutdown_connections 2023-07-12T02:05:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.516+0000 7f2c405ff700 1 --2- 172.21.15.37:0/2789217823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2c1c06ace0 0x7f2c1c06d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.516+0000 7f2c405ff700 1 --2- 172.21.15.37:0/2789217823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c380b59d0 0x7f2c38154970 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.516+0000 7f2c405ff700 1 --2- 172.21.15.37:0/2789217823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c3815c460 0x7f2c3815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.516+0000 7f2c405ff700 1 --2- 172.21.15.37:0/2789217823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c380d2640 0x7f2c38153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.516+0000 7f2c405ff700 1 -- 172.21.15.37:0/2789217823 >> 172.21.15.37:0/2789217823 conn(0x7f2c38071660 msgr2=0x7f2c380d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:08.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.516+0000 7f2c405ff700 1 -- 172.21.15.37:0/2789217823 shutdown_connections 2023-07-12T02:05:08.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.516+0000 7f2c405ff700 1 -- 172.21.15.37:0/2789217823 wait complete. 2023-07-12T02:05:08.537 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:03:56.039938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:03:56.612707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-12T02:04:00.200885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-12T02:05:08.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:05:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.738+0000 7f2ee81ff700 1 Processor -- start 2023-07-12T02:05:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.739+0000 7f2ee81ff700 1 -- start start 2023-07-12T02:05:08.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.740+0000 7f2ee81ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee00b8430 0x7f2ee00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.740+0000 7f2ee81ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2ee00cfc60 0x7f2ee00d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.740+0000 7f2ee81ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee00d0b20 con 0x7f2ee00d3730 2023-07-12T02:05:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.740+0000 7f2ee81ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee00b8800 con 0x7f2ee00cfc60 2023-07-12T02:05:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.740+0000 7f2ee81ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee00b4ee0 con 0x7f2ee00b8430 2023-07-12T02:05:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.740+0000 7f2ee579a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2ee00d3730 0x7f2ee00cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51762/0 (socket says 172.21.15.37:51762) 2023-07-12T02:05:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.740+0000 7f2ee579a700 1 -- 172.21.15.37:0/1983474848 learned_addr learned my addr 172.21.15.37:0/1983474848 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:08.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.740+0000 7f2ee5f9b700 1 --2- 172.21.15.37:0/1983474848 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee00b8430 0x7f2ee00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:08.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.740+0000 7f2ee679c700 1 --2- 172.21.15.37:0/1983474848 >> v2:172.21.15.196:3300/0 conn(0x7f2ee00cfc60 0x7f2ee00d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:08.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.741+0000 7f2ee4f99700 1 -- 172.21.15.37:0/1983474848 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540303644 0 0) 0x7f2ee00d0b20 con 0x7f2ee00d3730 2023-07-12T02:05:08.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.741+0000 7f2ee4f99700 1 -- 172.21.15.37:0/1983474848 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ecc0035b0 con 0x7f2ee00d3730 2023-07-12T02:05:08.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.741+0000 7f2ee5f9b700 1 -- 172.21.15.37:0/1983474848 >> v2:172.21.15.196:3300/0 conn(0x7f2ee00cfc60 msgr2=0x7f2ee00d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:08.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.741+0000 7f2ee5f9b700 1 --2- 172.21.15.37:0/1983474848 >> v2:172.21.15.196:3300/0 conn(0x7f2ee00cfc60 0x7f2ee00d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.741+0000 7f2ee5f9b700 1 -- 172.21.15.37:0/1983474848 >> v1:172.21.15.37:6789/0 conn(0x7f2ee00d3730 legacy=0x7f2ee00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.741+0000 7f2ee5f9b700 1 -- 172.21.15.37:0/1983474848 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee00b51c0 con 0x7f2ee00b8430 2023-07-12T02:05:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.741+0000 7f2ee679c700 1 --2- 172.21.15.37:0/1983474848 >> v2:172.21.15.196:3300/0 conn(0x7f2ee00cfc60 0x7f2ee00d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.741+0000 7f2ee5f9b700 1 --2- 172.21.15.37:0/1983474848 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee00b8430 0x7f2ee00cd320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009840 tx=0x7f2edc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a49283868bad609 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.742+0000 7f2ee4f99700 1 -- 172.21.15.37:0/1983474848 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc011830 con 0x7f2ee00b8430 2023-07-12T02:05:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.742+0000 7f2ee4f99700 1 -- 172.21.15.37:0/1983474848 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2edc011990 con 0x7f2ee00b8430 2023-07-12T02:05:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.742+0000 7f2ee4f99700 1 -- 172.21.15.37:0/1983474848 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc011d20 con 0x7f2ee00b8430 2023-07-12T02:05:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.742+0000 7f2ee81ff700 1 -- 172.21.15.37:0/1983474848 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee00b8430 msgr2=0x7f2ee00cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.742+0000 7f2ee81ff700 1 --2- 172.21.15.37:0/1983474848 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee00b8430 0x7f2ee00cd320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009840 tx=0x7f2edc009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.742+0000 7f2ee81ff700 1 -- 172.21.15.37:0/1983474848 shutdown_connections 2023-07-12T02:05:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.742+0000 7f2ee81ff700 1 --2- 172.21.15.37:0/1983474848 >> v2:172.21.15.196:3300/0 conn(0x7f2ee00cfc60 0x7f2ee00d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.742+0000 7f2ee81ff700 1 --2- 172.21.15.37:0/1983474848 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee00b8430 0x7f2ee00cd320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.742+0000 7f2ee81ff700 1 -- 172.21.15.37:0/1983474848 >> 172.21.15.37:0/1983474848 conn(0x7f2ee006b3f0 msgr2=0x7f2ee006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.742+0000 7f2ee81ff700 1 -- 172.21.15.37:0/1983474848 shutdown_connections 2023-07-12T02:05:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.742+0000 7f2ee81ff700 1 -- 172.21.15.37:0/1983474848 wait complete. 2023-07-12T02:05:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.744+0000 7f2ee81ff700 1 Processor -- start 2023-07-12T02:05:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.744+0000 7f2ee81ff700 1 -- start start 2023-07-12T02:05:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.745+0000 7f2ee81ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee00b8430 0x7f2ee014d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.745+0000 7f2ee81ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee00cfc60 0x7f2ee00cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.745+0000 7f2ee81ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ee00d3730 0x7f2ee00c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.745+0000 7f2ee81ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee00c9a20 con 0x7f2ee00d3730 2023-07-12T02:05:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.745+0000 7f2ee81ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee00cb360 con 0x7f2ee00cfc60 2023-07-12T02:05:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.745+0000 7f2ee81ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee00cb640 con 0x7f2ee00b8430 2023-07-12T02:05:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.745+0000 7f2ee679c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ee00d3730 0x7f2ee00c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.745+0000 7f2ee5f9b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee00b8430 0x7f2ee014d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.745+0000 7f2ee679c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ee00d3730 0x7f2ee00c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34036/0 (socket says 172.21.15.37:34036) 2023-07-12T02:05:08.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.745+0000 7f2ee679c700 1 -- 172.21.15.37:0/1689513306 learned_addr learned my addr 172.21.15.37:0/1689513306 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:08.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.745+0000 7f2ee5f9b700 1 --2- 172.21.15.37:0/1689513306 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee00b8430 0x7f2ee014d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:58276/0 (socket says 172.21.15.37:58276) 2023-07-12T02:05:08.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.746+0000 7f2ee579a700 1 --2- 172.21.15.37:0/1689513306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee00cfc60 0x7f2ee00cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:08.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.746+0000 7f2ee679c700 1 -- 172.21.15.37:0/1689513306 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee00b8430 msgr2=0x7f2ee014d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:08.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.746+0000 7f2ee679c700 1 --2- 172.21.15.37:0/1689513306 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee00b8430 0x7f2ee014d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.746+0000 7f2ee679c700 1 -- 172.21.15.37:0/1689513306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee00cfc60 msgr2=0x7f2ee00cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:08.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.746+0000 7f2ee679c700 1 --2- 172.21.15.37:0/1689513306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee00cfc60 0x7f2ee00cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.746+0000 7f2ee679c700 1 -- 172.21.15.37:0/1689513306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed8009a70 con 0x7f2ee00d3730 2023-07-12T02:05:08.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.746+0000 7f2ee679c700 1 --2- 172.21.15.37:0/1689513306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ee00d3730 0x7f2ee00c94e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800efc0 tx=0x7f2ed800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:08.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.746+0000 7f2ed67fc700 1 -- 172.21.15.37:0/1689513306 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed800ca90 con 0x7f2ee00d3730 2023-07-12T02:05:08.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.746+0000 7f2ed67fc700 1 -- 172.21.15.37:0/1689513306 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed800f040 con 0x7f2ee00d3730 2023-07-12T02:05:08.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.746+0000 7f2ee81ff700 1 -- 172.21.15.37:0/1689513306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2edc0094a0 con 0x7f2ee00d3730 2023-07-12T02:05:08.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.746+0000 7f2ed67fc700 1 -- 172.21.15.37:0/1689513306 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed800ce10 con 0x7f2ee00d3730 2023-07-12T02:05:08.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.747+0000 7f2ee81ff700 1 -- 172.21.15.37:0/1689513306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee00cbc00 con 0x7f2ee00d3730 2023-07-12T02:05:08.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.747+0000 7f2ee81ff700 1 -- 172.21.15.37:0/1689513306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee004ea60 con 0x7f2ee00d3730 2023-07-12T02:05:08.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.748+0000 7f2ed67fc700 1 -- 172.21.15.37:0/1689513306 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2ed8014480 con 0x7f2ee00d3730 2023-07-12T02:05:08.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.749+0000 7f2ed67fc700 1 --2- 172.21.15.37:0/1689513306 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2ec406ace0 0x7f2ec406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:08.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.750+0000 7f2ed67fc700 1 -- 172.21.15.37:0/1689513306 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2ed8089e90 con 0x7f2ee00d3730 2023-07-12T02:05:08.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.750+0000 7f2ee5f9b700 1 --2- 172.21.15.37:0/1689513306 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2ec406ace0 0x7f2ec406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:08.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.751+0000 7f2ee5f9b700 1 --2- 172.21.15.37:0/1689513306 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2ec406ace0 0x7f2ec406d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2edc000c00 tx=0x7f2edc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:08.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.754+0000 7f2ed67fc700 1 -- 172.21.15.37:0/1689513306 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2ed8058600 con 0x7f2ee00d3730 2023-07-12T02:05:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.963+0000 7f2ee81ff700 1 -- 172.21.15.37:0/1689513306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ee00d2250 con 0x7f2ee00d3730 2023-07-12T02:05:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.963+0000 7f2ed67fc700 1 -- 172.21.15.37:0/1689513306 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ed8009d70 con 0x7f2ee00d3730 2023-07-12T02:05:08.967 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:05:08.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.965+0000 7f2ee81ff700 1 -- 172.21.15.37:0/1689513306 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2ec406ace0 msgr2=0x7f2ec406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:08.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.965+0000 7f2ee81ff700 1 --2- 172.21.15.37:0/1689513306 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2ec406ace0 0x7f2ec406d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2edc000c00 tx=0x7f2edc008030 comp rx=0 tx=0).stop 2023-07-12T02:05:08.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.965+0000 7f2ee81ff700 1 -- 172.21.15.37:0/1689513306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ee00d3730 msgr2=0x7f2ee00c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:08.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.965+0000 7f2ee81ff700 1 --2- 172.21.15.37:0/1689513306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ee00d3730 0x7f2ee00c94e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800efc0 tx=0x7f2ed800c3a0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.965+0000 7f2ee81ff700 1 -- 172.21.15.37:0/1689513306 shutdown_connections 2023-07-12T02:05:08.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.965+0000 7f2ee81ff700 1 --2- 172.21.15.37:0/1689513306 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2ec406ace0 0x7f2ec406d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.965+0000 7f2ee81ff700 1 --2- 172.21.15.37:0/1689513306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ee00d3730 0x7f2ee00c94e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.965+0000 7f2ee81ff700 1 --2- 172.21.15.37:0/1689513306 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee00b8430 0x7f2ee014d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.965+0000 7f2ee81ff700 1 --2- 172.21.15.37:0/1689513306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee00cfc60 0x7f2ee00cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:08.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.965+0000 7f2ee81ff700 1 -- 172.21.15.37:0/1689513306 >> 172.21.15.37:0/1689513306 conn(0x7f2ee006b3f0 msgr2=0x7f2ee00d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:08.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.966+0000 7f2ee81ff700 1 -- 172.21.15.37:0/1689513306 shutdown_connections 2023-07-12T02:05:08.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:08.966+0000 7f2ee81ff700 1 -- 172.21.15.37:0/1689513306 wait complete. 2023-07-12T02:05:08.987 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:05:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.189+0000 7f54675ff700 1 Processor -- start 2023-07-12T02:05:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.189+0000 7f54675ff700 1 -- start start 2023-07-12T02:05:09.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.190+0000 7f54675ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f54600b8430 0x7f54600cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:09.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.190+0000 7f54675ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54600d3730 0x7f54600cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:09.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.190+0000 7f54675ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54600d0b20 con 0x7f54600cfa90 2023-07-12T02:05:09.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.190+0000 7f54675ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54600b8800 con 0x7f54600d3730 2023-07-12T02:05:09.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.190+0000 7f54675ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54600cfe90 con 0x7f54600b8430 2023-07-12T02:05:09.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.191+0000 7f5464b9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54600d3730 0x7f54600cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:09.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.191+0000 7f5464b9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54600d3730 0x7f54600cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34052/0 (socket says 172.21.15.37:34052) 2023-07-12T02:05:09.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.191+0000 7f5464b9a700 1 -- 172.21.15.37:0/1319376511 learned_addr learned my addr 172.21.15.37:0/1319376511 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:09.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.191+0000 7f546539b700 1 --2- 172.21.15.37:0/1319376511 >> v2:172.21.15.196:3300/0 conn(0x7f54600b8430 0x7f54600cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:09.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.191+0000 7f5464b9a700 1 -- 172.21.15.37:0/1319376511 >> v2:172.21.15.196:3300/0 conn(0x7f54600b8430 msgr2=0x7f54600cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:09.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.191+0000 7f5464b9a700 1 --2- 172.21.15.37:0/1319376511 >> v2:172.21.15.196:3300/0 conn(0x7f54600b8430 0x7f54600cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.191+0000 7f5464b9a700 1 -- 172.21.15.37:0/1319376511 >> v1:172.21.15.196:6789/0 conn(0x7f54600cfa90 legacy=0x7f546015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:09.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.191+0000 7f5464b9a700 1 -- 172.21.15.37:0/1319376511 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54600b4ee0 con 0x7f54600d3730 2023-07-12T02:05:09.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.191+0000 7f5464b9a700 1 --2- 172.21.15.37:0/1319376511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54600d3730 0x7f54600cf550 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f54600cf520 tx=0x7f5450009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775b36422d237966 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:09.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.192+0000 7f5457fff700 1 -- 172.21.15.37:0/1319376511 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450011830 con 0x7f54600d3730 2023-07-12T02:05:09.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.192+0000 7f5457fff700 1 -- 172.21.15.37:0/1319376511 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5450011990 con 0x7f54600d3730 2023-07-12T02:05:09.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.192+0000 7f5457fff700 1 -- 172.21.15.37:0/1319376511 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450011d20 con 0x7f54600d3730 2023-07-12T02:05:09.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.192+0000 7f54675ff700 1 -- 172.21.15.37:0/1319376511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54600d3730 msgr2=0x7f54600cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:09.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.192+0000 7f54675ff700 1 --2- 172.21.15.37:0/1319376511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54600d3730 0x7f54600cf550 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f54600cf520 tx=0x7f5450009bd0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.192+0000 7f54675ff700 1 -- 172.21.15.37:0/1319376511 shutdown_connections 2023-07-12T02:05:09.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.192+0000 7f54675ff700 1 --2- 172.21.15.37:0/1319376511 >> v2:172.21.15.196:3300/0 conn(0x7f54600b8430 0x7f54600cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.192+0000 7f54675ff700 1 --2- 172.21.15.37:0/1319376511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54600d3730 0x7f54600cf550 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.192+0000 7f54675ff700 1 -- 172.21.15.37:0/1319376511 >> 172.21.15.37:0/1319376511 conn(0x7f546006b3f0 msgr2=0x7f546006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.193+0000 7f54675ff700 1 -- 172.21.15.37:0/1319376511 shutdown_connections 2023-07-12T02:05:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.193+0000 7f54675ff700 1 -- 172.21.15.37:0/1319376511 wait complete. 2023-07-12T02:05:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.194+0000 7f54675ff700 1 Processor -- start 2023-07-12T02:05:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.194+0000 7f54675ff700 1 -- start start 2023-07-12T02:05:09.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.195+0000 7f54675ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54600b8430 0x7f54601e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:09.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.195+0000 7f54675ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54600cfa90 0x7f54601f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:09.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.195+0000 7f54675ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54600d3730 0x7f5460159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.195+0000 7f54675ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54600cb370 con 0x7f54600cfa90 2023-07-12T02:05:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.195+0000 7f54675ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54600cad80 con 0x7f54600d3730 2023-07-12T02:05:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.195+0000 7f54675ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54601e8490 con 0x7f54600b8430 2023-07-12T02:05:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.196+0000 7f5464b9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54600cfa90 0x7f54601f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.196+0000 7f5464b9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54600cfa90 0x7f54601f1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34064/0 (socket says 172.21.15.37:34064) 2023-07-12T02:05:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.196+0000 7f5464b9a700 1 -- 172.21.15.37:0/3057797330 learned_addr learned my addr 172.21.15.37:0/3057797330 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.196+0000 7f5465b9c700 1 --2- 172.21.15.37:0/3057797330 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54600d3730 0x7f5460159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.196+0000 7f546539b700 1 --2- 172.21.15.37:0/3057797330 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54600b8430 0x7f54601e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.196+0000 7f5464b9a700 1 -- 172.21.15.37:0/3057797330 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54600b8430 msgr2=0x7f54601e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.196+0000 7f5464b9a700 1 --2- 172.21.15.37:0/3057797330 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54600b8430 0x7f54601e6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.196+0000 7f5464b9a700 1 -- 172.21.15.37:0/3057797330 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54600d3730 msgr2=0x7f5460159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.196+0000 7f5464b9a700 1 --2- 172.21.15.37:0/3057797330 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54600d3730 0x7f5460159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.196+0000 7f5464b9a700 1 -- 172.21.15.37:0/3057797330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5450009550 con 0x7f54600cfa90 2023-07-12T02:05:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.196+0000 7f5464b9a700 1 --2- 172.21.15.37:0/3057797330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54600cfa90 0x7f54601f1f00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5450009c10 tx=0x7f5450004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.196+0000 7f5455ffb700 1 -- 172.21.15.37:0/3057797330 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450004380 con 0x7f54600cfa90 2023-07-12T02:05:09.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.197+0000 7f5455ffb700 1 -- 172.21.15.37:0/3057797330 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545001f070 con 0x7f54600cfa90 2023-07-12T02:05:09.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.197+0000 7f54675ff700 1 -- 172.21.15.37:0/3057797330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54601e8730 con 0x7f54600cfa90 2023-07-12T02:05:09.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.197+0000 7f5455ffb700 1 -- 172.21.15.37:0/3057797330 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54500036a0 con 0x7f54600cfa90 2023-07-12T02:05:09.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.197+0000 7f54675ff700 1 -- 172.21.15.37:0/3057797330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54600cb000 con 0x7f54600cfa90 2023-07-12T02:05:09.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.198+0000 7f54675ff700 1 -- 172.21.15.37:0/3057797330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54600cb520 con 0x7f54600cfa90 2023-07-12T02:05:09.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.199+0000 7f5455ffb700 1 -- 172.21.15.37:0/3057797330 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5450021030 con 0x7f54600cfa90 2023-07-12T02:05:09.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.200+0000 7f5455ffb700 1 --2- 172.21.15.37:0/3057797330 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f544406ace0 0x7f544406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:09.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.200+0000 7f5455ffb700 1 -- 172.21.15.37:0/3057797330 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f545008aa70 con 0x7f54600cfa90 2023-07-12T02:05:09.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.200+0000 7f546539b700 1 --2- 172.21.15.37:0/3057797330 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f544406ace0 0x7f544406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:09.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.201+0000 7f546539b700 1 --2- 172.21.15.37:0/3057797330 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f544406ace0 0x7f544406d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f545c009b40 tx=0x7f545c009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:09.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.204+0000 7f5455ffb700 1 -- 172.21.15.37:0/3057797330 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f54600cb520 con 0x7f54600cfa90 2023-07-12T02:05:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.413+0000 7f54675ff700 1 -- 172.21.15.37:0/3057797330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f54600cb520 con 0x7f54600cfa90 2023-07-12T02:05:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.414+0000 7f5455ffb700 1 -- 172.21.15.37:0/3057797330 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5450015020 con 0x7f54600cfa90 2023-07-12T02:05:09.417 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:05:09.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.416+0000 7f54675ff700 1 -- 172.21.15.37:0/3057797330 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f544406ace0 msgr2=0x7f544406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:09.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.416+0000 7f54675ff700 1 --2- 172.21.15.37:0/3057797330 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f544406ace0 0x7f544406d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f545c009b40 tx=0x7f545c009210 comp rx=0 tx=0).stop 2023-07-12T02:05:09.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.416+0000 7f54675ff700 1 -- 172.21.15.37:0/3057797330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54600cfa90 msgr2=0x7f54601f1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:09.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.416+0000 7f54675ff700 1 --2- 172.21.15.37:0/3057797330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54600cfa90 0x7f54601f1f00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5450009c10 tx=0x7f5450004750 comp rx=0 tx=0).stop 2023-07-12T02:05:09.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.416+0000 7f54675ff700 1 -- 172.21.15.37:0/3057797330 shutdown_connections 2023-07-12T02:05:09.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.416+0000 7f54675ff700 1 --2- 172.21.15.37:0/3057797330 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f544406ace0 0x7f544406d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.416+0000 7f54675ff700 1 --2- 172.21.15.37:0/3057797330 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54600d3730 0x7f5460159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.416+0000 7f54675ff700 1 --2- 172.21.15.37:0/3057797330 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54600b8430 0x7f54601e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.416+0000 7f54675ff700 1 --2- 172.21.15.37:0/3057797330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54600cfa90 0x7f54601f1f00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.416+0000 7f54675ff700 1 -- 172.21.15.37:0/3057797330 >> 172.21.15.37:0/3057797330 conn(0x7f546006b3f0 msgr2=0x7f54600b63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:09.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.416+0000 7f54675ff700 1 -- 172.21.15.37:0/3057797330 shutdown_connections 2023-07-12T02:05:09.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.416+0000 7f54675ff700 1 -- 172.21.15.37:0/3057797330 wait complete. 2023-07-12T02:05:09.437 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:05:09.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:05:09.598 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:05:09.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.639+0000 7f26a87ff700 1 Processor -- start 2023-07-12T02:05:09.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.639+0000 7f26a87ff700 1 -- start start 2023-07-12T02:05:09.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.640+0000 7f26a87ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f26a00d3730 0x7f26a00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:09.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.641+0000 7f26a87ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a00d0b20 con 0x7f26a00cfa90 2023-07-12T02:05:09.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.641+0000 7f26a87ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a00cfe90 con 0x7f26a00b8430 2023-07-12T02:05:09.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.641+0000 7f26a87ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a00cda30 con 0x7f26a00d3730 2023-07-12T02:05:09.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.641+0000 7f26a6d9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f26a00cfa90 0x7f26a00d0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51766/0 (socket says 172.21.15.37:51766) 2023-07-12T02:05:09.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.641+0000 7f26a6d9c700 1 -- 172.21.15.37:0/1552470422 learned_addr learned my addr 172.21.15.37:0/1552470422 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:09.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.641+0000 7f26a5d9a700 1 --2- 172.21.15.37:0/1552470422 >> v2:172.21.15.196:3300/0 conn(0x7f26a00d3730 0x7f26a00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:09.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.641+0000 7f26a5599700 1 -- 172.21.15.37:0/1552470422 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369896177 0 0) 0x7f26a00d0b20 con 0x7f26a00cfa90 2023-07-12T02:05:09.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.641+0000 7f26a5599700 1 -- 172.21.15.37:0/1552470422 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f268c0035b0 con 0x7f26a00cfa90 2023-07-12T02:05:09.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.641+0000 7f26a5599700 1 -- 172.21.15.37:0/1552470422 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238911540 0 0) 0x7f26a00cfe90 con 0x7f26a00b8430 2023-07-12T02:05:09.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.641+0000 7f26a5599700 1 -- 172.21.15.37:0/1552470422 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26a00d0b20 con 0x7f26a00b8430 2023-07-12T02:05:09.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.641+0000 7f26a5d9a700 1 -- 172.21.15.37:0/1552470422 >> v1:172.21.15.196:6789/0 conn(0x7f26a00b8430 legacy=0x7f26a00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:09.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.641+0000 7f26a5d9a700 1 -- 172.21.15.37:0/1552470422 >> v1:172.21.15.37:6789/0 conn(0x7f26a00cfa90 legacy=0x7f26a00d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:09.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.642+0000 7f26a5d9a700 1 -- 172.21.15.37:0/1552470422 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a00b4ee0 con 0x7f26a00d3730 2023-07-12T02:05:09.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.642+0000 7f26a5d9a700 1 --2- 172.21.15.37:0/1552470422 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26a00d3730 0x7f26a00cf550 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2690009840 tx=0x7f2690009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3632311e59a58935 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:09.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.642+0000 7f26a5599700 1 -- 172.21.15.37:0/1552470422 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690011830 con 0x7f26a00d3730 2023-07-12T02:05:09.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.642+0000 7f26a5599700 1 -- 172.21.15.37:0/1552470422 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2690011990 con 0x7f26a00d3730 2023-07-12T02:05:09.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.642+0000 7f26a5599700 1 -- 172.21.15.37:0/1552470422 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690011d20 con 0x7f26a00d3730 2023-07-12T02:05:09.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.643+0000 7f26a87ff700 1 -- 172.21.15.37:0/1552470422 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26a00d3730 msgr2=0x7f26a00cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:09.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.643+0000 7f26a87ff700 1 --2- 172.21.15.37:0/1552470422 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26a00d3730 0x7f26a00cf550 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2690009840 tx=0x7f2690009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:09.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.643+0000 7f26a87ff700 1 -- 172.21.15.37:0/1552470422 shutdown_connections 2023-07-12T02:05:09.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.643+0000 7f26a87ff700 1 --2- 172.21.15.37:0/1552470422 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26a00d3730 0x7f26a00cf550 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.643+0000 7f26a87ff700 1 -- 172.21.15.37:0/1552470422 >> 172.21.15.37:0/1552470422 conn(0x7f26a006b3f0 msgr2=0x7f26a006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:09.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.643+0000 7f26a87ff700 1 -- 172.21.15.37:0/1552470422 shutdown_connections 2023-07-12T02:05:09.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.643+0000 7f26a87ff700 1 -- 172.21.15.37:0/1552470422 wait complete. 2023-07-12T02:05:09.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.645+0000 7f26a87ff700 1 Processor -- start 2023-07-12T02:05:09.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.645+0000 7f26a87ff700 1 -- start start 2023-07-12T02:05:09.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.646+0000 7f26a87ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a00b8430 0x7f26a01ef340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.646+0000 7f26a87ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26a00cfa90 0x7f26a01f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.646+0000 7f26a87ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26a00d3730 0x7f26a015eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.646+0000 7f26a87ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a015c930 con 0x7f26a00b8430 2023-07-12T02:05:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.646+0000 7f26a87ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a015cb40 con 0x7f26a00d3730 2023-07-12T02:05:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.646+0000 7f26a87ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a015ce20 con 0x7f26a00cfa90 2023-07-12T02:05:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.646+0000 7f26a659b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a00b8430 0x7f26a01ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.646+0000 7f26a659b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a00b8430 0x7f26a01ef340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34074/0 (socket says 172.21.15.37:34074) 2023-07-12T02:05:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.646+0000 7f26a659b700 1 -- 172.21.15.37:0/2217502200 learned_addr learned my addr 172.21.15.37:0/2217502200 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.646+0000 7f26a5d9a700 1 --2- 172.21.15.37:0/2217502200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26a00cfa90 0x7f26a01f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.646+0000 7f26a6d9c700 1 --2- 172.21.15.37:0/2217502200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26a00d3730 0x7f26a015eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.646+0000 7f26a659b700 1 -- 172.21.15.37:0/2217502200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26a00cfa90 msgr2=0x7f26a01f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.646+0000 7f26a659b700 1 --2- 172.21.15.37:0/2217502200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26a00cfa90 0x7f26a01f3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.646+0000 7f26a659b700 1 -- 172.21.15.37:0/2217502200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26a00d3730 msgr2=0x7f26a015eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.646+0000 7f26a659b700 1 --2- 172.21.15.37:0/2217502200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26a00d3730 0x7f26a015eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.646+0000 7f26a659b700 1 -- 172.21.15.37:0/2217502200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26900094a0 con 0x7f26a00b8430 2023-07-12T02:05:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.647+0000 7f26a659b700 1 --2- 172.21.15.37:0/2217502200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a00b8430 0x7f26a01ef340 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f269c00c520 tx=0x7f269c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.647+0000 7f2696ffd700 1 -- 172.21.15.37:0/2217502200 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c0052d0 con 0x7f26a00b8430 2023-07-12T02:05:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.647+0000 7f2696ffd700 1 -- 172.21.15.37:0/2217502200 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c005430 con 0x7f26a00b8430 2023-07-12T02:05:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.647+0000 7f26a87ff700 1 -- 172.21.15.37:0/2217502200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a015d100 con 0x7f26a00b8430 2023-07-12T02:05:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.647+0000 7f2696ffd700 1 -- 172.21.15.37:0/2217502200 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c0038a0 con 0x7f26a00b8430 2023-07-12T02:05:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.647+0000 7f26a87ff700 1 -- 172.21.15.37:0/2217502200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a01ef880 con 0x7f26a00b8430 2023-07-12T02:05:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.648+0000 7f26a87ff700 1 -- 172.21.15.37:0/2217502200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a015d620 con 0x7f26a00b8430 2023-07-12T02:05:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.649+0000 7f2696ffd700 1 -- 172.21.15.37:0/2217502200 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f269c003a00 con 0x7f26a00b8430 2023-07-12T02:05:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.650+0000 7f2696ffd700 1 --2- 172.21.15.37:0/2217502200 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f268406ace0 0x7f268406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.650+0000 7f2696ffd700 1 -- 172.21.15.37:0/2217502200 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f269c088cf0 con 0x7f26a00b8430 2023-07-12T02:05:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.651+0000 7f26a5d9a700 1 --2- 172.21.15.37:0/2217502200 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f268406ace0 0x7f268406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.651+0000 7f26a5d9a700 1 --2- 172.21.15.37:0/2217502200 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f268406ace0 0x7f268406d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2690009fd0 tx=0x7f269001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:09.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.654+0000 7f2696ffd700 1 -- 172.21.15.37:0/2217502200 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f26a015d620 con 0x7f26a00b8430 2023-07-12T02:05:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.866+0000 7f26a87ff700 1 -- 172.21.15.37:0/2217502200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26a004ea60 con 0x7f26a00b8430 2023-07-12T02:05:09.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.866+0000 7f2696ffd700 1 -- 172.21.15.37:0/2217502200 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f269c053a60 con 0x7f26a00b8430 2023-07-12T02:05:09.870 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:05:09.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.869+0000 7f26a87ff700 1 -- 172.21.15.37:0/2217502200 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f268406ace0 msgr2=0x7f268406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.869+0000 7f26a87ff700 1 --2- 172.21.15.37:0/2217502200 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f268406ace0 0x7f268406d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2690009fd0 tx=0x7f269001c040 comp rx=0 tx=0).stop 2023-07-12T02:05:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.869+0000 7f26a87ff700 1 -- 172.21.15.37:0/2217502200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a00b8430 msgr2=0x7f26a01ef340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.869+0000 7f26a87ff700 1 --2- 172.21.15.37:0/2217502200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a00b8430 0x7f26a01ef340 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f269c00c520 tx=0x7f269c00c830 comp rx=0 tx=0).stop 2023-07-12T02:05:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.869+0000 7f26a87ff700 1 -- 172.21.15.37:0/2217502200 shutdown_connections 2023-07-12T02:05:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.869+0000 7f26a87ff700 1 --2- 172.21.15.37:0/2217502200 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f268406ace0 0x7f268406d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.869+0000 7f26a87ff700 1 --2- 172.21.15.37:0/2217502200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a00b8430 0x7f26a01ef340 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.869+0000 7f26a87ff700 1 --2- 172.21.15.37:0/2217502200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26a00d3730 0x7f26a015eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.869+0000 7f26a87ff700 1 --2- 172.21.15.37:0/2217502200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26a00cfa90 0x7f26a01f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.869+0000 7f26a87ff700 1 -- 172.21.15.37:0/2217502200 >> 172.21.15.37:0/2217502200 conn(0x7f26a006b3f0 msgr2=0x7f26a00b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.869+0000 7f26a87ff700 1 -- 172.21.15.37:0/2217502200 shutdown_connections 2023-07-12T02:05:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:09.869+0000 7f26a87ff700 1 -- 172.21.15.37:0/2217502200 wait complete. 2023-07-12T02:05:09.890 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:05:10.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.091+0000 7f7e415ff700 1 Processor -- start 2023-07-12T02:05:10.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.091+0000 7f7e415ff700 1 -- start start 2023-07-12T02:05:10.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.092+0000 7f7e415ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e3c0d3730 0x7f7e3c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.092+0000 7f7e415ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7e3c0cfa90 0x7f7e3c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.092+0000 7f7e415ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3c0d0b20 con 0x7f7e3c0b8430 2023-07-12T02:05:10.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.092+0000 7f7e415ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3c0cda30 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.092+0000 7f7e415ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c0b8800 con 0x7f7e3c0d3730 2023-07-12T02:05:10.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.093+0000 7f7e3a7fc700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e3c0d3730 0x7f7e3c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.093+0000 7f7e3b7fe700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7e3c0cfa90 0x7f7e3c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.093+0000 7f7e3b7fe700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7e3c0cfa90 0x7f7e3c0d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:56542/0 (socket says 172.21.15.37:56542) 2023-07-12T02:05:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.093+0000 7f7e3a7fc700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e3c0d3730 0x7f7e3c0cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:58308/0 (socket says 172.21.15.37:58308) 2023-07-12T02:05:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.093+0000 7f7e3affd700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f7e3c0b8430 0x7f7e3c0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:41906/0 (socket says 172.21.15.37:41906) 2023-07-12T02:05:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.093+0000 7f7e3b7fe700 1 -- 172.21.15.37:0/859864292 learned_addr learned my addr 172.21.15.37:0/859864292 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.093+0000 7f7e3b7fe700 1 -- 172.21.15.37:0/859864292 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e3c0d3730 msgr2=0x7f7e3c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.093+0000 7f7e3b7fe700 1 --2- 172.21.15.37:0/859864292 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e3c0d3730 0x7f7e3c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.093+0000 7f7e3b7fe700 1 -- 172.21.15.37:0/859864292 >> v1:172.21.15.196:6789/0 conn(0x7f7e3c0b8430 legacy=0x7f7e3c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.093+0000 7f7e3b7fe700 1 -- 172.21.15.37:0/859864292 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c0cfeb0 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.094+0000 7f7e3b7fe700 1 --2- 172.21.15.37:0/859864292 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e3c0cfa90 0x7f7e3c0d0fb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009e50 tx=0x7f7e3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70212d9ae3ef3b11 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.094+0000 7f7e39ffb700 1 -- 172.21.15.37:0/859864292 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3400e070 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.094+0000 7f7e39ffb700 1 -- 172.21.15.37:0/859864292 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e34003a20 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.094+0000 7f7e39ffb700 1 -- 172.21.15.37:0/859864292 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34003dd0 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.094+0000 7f7e415ff700 1 -- 172.21.15.37:0/859864292 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e3c0cfa90 msgr2=0x7f7e3c0d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.094+0000 7f7e415ff700 1 --2- 172.21.15.37:0/859864292 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e3c0cfa90 0x7f7e3c0d0fb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009e50 tx=0x7f7e3400b330 comp rx=0 tx=0).stop 2023-07-12T02:05:10.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.095+0000 7f7e415ff700 1 -- 172.21.15.37:0/859864292 shutdown_connections 2023-07-12T02:05:10.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.095+0000 7f7e415ff700 1 --2- 172.21.15.37:0/859864292 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e3c0cfa90 0x7f7e3c0d0fb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.095+0000 7f7e415ff700 1 --2- 172.21.15.37:0/859864292 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e3c0d3730 0x7f7e3c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.095+0000 7f7e415ff700 1 -- 172.21.15.37:0/859864292 >> 172.21.15.37:0/859864292 conn(0x7f7e3c06b3f0 msgr2=0x7f7e3c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:10.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.095+0000 7f7e415ff700 1 -- 172.21.15.37:0/859864292 shutdown_connections 2023-07-12T02:05:10.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.095+0000 7f7e415ff700 1 -- 172.21.15.37:0/859864292 wait complete. 2023-07-12T02:05:10.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.096+0000 7f7e415ff700 1 Processor -- start 2023-07-12T02:05:10.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.096+0000 7f7e415ff700 1 -- start start 2023-07-12T02:05:10.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.097+0000 7f7e415ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e3c0b8430 0x7f7e3c14de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.097+0000 7f7e415ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e3c0cfa90 0x7f7e3c0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.097+0000 7f7e415ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e3c0d3730 0x7f7e3c0cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.097+0000 7f7e415ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c0cbda0 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.097+0000 7f7e415ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c15ec10 con 0x7f7e3c0d3730 2023-07-12T02:05:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.097+0000 7f7e415ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c0cb190 con 0x7f7e3c0b8430 2023-07-12T02:05:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.098+0000 7f7e3a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e3c0cfa90 0x7f7e3c0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.098+0000 7f7e3a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e3c0cfa90 0x7f7e3c0ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34080/0 (socket says 172.21.15.37:34080) 2023-07-12T02:05:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.098+0000 7f7e3a7fc700 1 -- 172.21.15.37:0/1858525898 learned_addr learned my addr 172.21.15.37:0/1858525898 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.098+0000 7f7e3affd700 1 --2- 172.21.15.37:0/1858525898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e3c0b8430 0x7f7e3c14de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.098+0000 7f7e3b7fe700 1 --2- 172.21.15.37:0/1858525898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e3c0d3730 0x7f7e3c0cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.098+0000 7f7e3a7fc700 1 -- 172.21.15.37:0/1858525898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e3c0b8430 msgr2=0x7f7e3c14de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.098+0000 7f7e3a7fc700 1 --2- 172.21.15.37:0/1858525898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e3c0b8430 0x7f7e3c14de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.098+0000 7f7e3a7fc700 1 -- 172.21.15.37:0/1858525898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e3c0d3730 msgr2=0x7f7e3c0cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.098+0000 7f7e3a7fc700 1 --2- 172.21.15.37:0/1858525898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e3c0d3730 0x7f7e3c0cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.098+0000 7f7e3a7fc700 1 -- 172.21.15.37:0/1858525898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e34009b30 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.098+0000 7f7e3a7fc700 1 --2- 172.21.15.37:0/1858525898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e3c0cfa90 0x7f7e3c0ca620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000e870 tx=0x7f7e3000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.099+0000 7f7e237fe700 1 -- 172.21.15.37:0/1858525898 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30009590 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.099+0000 7f7e237fe700 1 -- 172.21.15.37:0/1858525898 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e30013680 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.099+0000 7f7e415ff700 1 -- 172.21.15.37:0/1858525898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3c0cb470 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.099+0000 7f7e237fe700 1 -- 172.21.15.37:0/1858525898 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e300139f0 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.099+0000 7f7e415ff700 1 -- 172.21.15.37:0/1858525898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3c0cba30 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.100+0000 7f7e415ff700 1 -- 172.21.15.37:0/1858525898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3c0cbf10 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.101+0000 7f7e237fe700 1 -- 172.21.15.37:0/1858525898 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7e30013b50 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.102+0000 7f7e237fe700 1 --2- 172.21.15.37:0/1858525898 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7e2806ace0 0x7f7e2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.102+0000 7f7e237fe700 1 -- 172.21.15.37:0/1858525898 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7e30089740 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.102+0000 7f7e3affd700 1 --2- 172.21.15.37:0/1858525898 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7e2806ace0 0x7f7e2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.103+0000 7f7e3affd700 1 --2- 172.21.15.37:0/1858525898 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7e2806ace0 0x7f7e2806d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c000f60 tx=0x7f7e2c004a50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:10.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.107+0000 7f7e237fe700 1 -- 172.21.15.37:0/1858525898 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7e30057e30 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.315+0000 7f7e415ff700 1 -- 172.21.15.37:0/1858525898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e3c04ea60 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.315+0000 7f7e237fe700 1 -- 172.21.15.37:0/1858525898 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e300579c0 con 0x7f7e3c0cfa90 2023-07-12T02:05:10.319 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-12T02:05:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.318+0000 7f7e415ff700 1 -- 172.21.15.37:0/1858525898 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7e2806ace0 msgr2=0x7f7e2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.318+0000 7f7e415ff700 1 --2- 172.21.15.37:0/1858525898 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7e2806ace0 0x7f7e2806d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c000f60 tx=0x7f7e2c004a50 comp rx=0 tx=0).stop 2023-07-12T02:05:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.318+0000 7f7e415ff700 1 -- 172.21.15.37:0/1858525898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e3c0cfa90 msgr2=0x7f7e3c0ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.318+0000 7f7e415ff700 1 --2- 172.21.15.37:0/1858525898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e3c0cfa90 0x7f7e3c0ca620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000e870 tx=0x7f7e3000eb80 comp rx=0 tx=0).stop 2023-07-12T02:05:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.318+0000 7f7e415ff700 1 -- 172.21.15.37:0/1858525898 shutdown_connections 2023-07-12T02:05:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.318+0000 7f7e415ff700 1 --2- 172.21.15.37:0/1858525898 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7e2806ace0 0x7f7e2806d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.318+0000 7f7e415ff700 1 --2- 172.21.15.37:0/1858525898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7e3c0d3730 0x7f7e3c0cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.318+0000 7f7e415ff700 1 --2- 172.21.15.37:0/1858525898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7e3c0b8430 0x7f7e3c14de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.318+0000 7f7e415ff700 1 --2- 172.21.15.37:0/1858525898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e3c0cfa90 0x7f7e3c0ca620 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.318+0000 7f7e415ff700 1 -- 172.21.15.37:0/1858525898 >> 172.21.15.37:0/1858525898 conn(0x7f7e3c06b3f0 msgr2=0x7f7e3c15bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.318+0000 7f7e415ff700 1 -- 172.21.15.37:0/1858525898 shutdown_connections 2023-07-12T02:05:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.318+0000 7f7e415ff700 1 -- 172.21.15.37:0/1858525898 wait complete. 2023-07-12T02:05:10.339 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-12T02:05:10.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.539+0000 7f897f5ff700 1 Processor -- start 2023-07-12T02:05:10.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.540+0000 7f897f5ff700 1 -- start start 2023-07-12T02:05:10.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.541+0000 7f897f5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89780d3730 0x7f89780cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.541+0000 7f897f5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f89780cfa90 0x7f89780d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.541+0000 7f897f5ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89780d0b20 con 0x7f89780b8430 2023-07-12T02:05:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.541+0000 7f897f5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89780cda30 con 0x7f89780cfa90 2023-07-12T02:05:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.541+0000 7f897f5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89780b8800 con 0x7f89780d3730 2023-07-12T02:05:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.541+0000 7f897db9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f89780cfa90 0x7f89780d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.541+0000 7f897db9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f89780cfa90 0x7f89780d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34094/0 (socket says 172.21.15.37:34094) 2023-07-12T02:05:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.541+0000 7f897cb9a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89780d3730 0x7f89780cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.541+0000 7f897db9c700 1 -- 172.21.15.37:0/2028769436 learned_addr learned my addr 172.21.15.37:0/2028769436 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.541+0000 7f897d39b700 1 --1- 172.21.15.37:0/2028769436 >> v1:172.21.15.196:6789/0 conn(0x7f89780b8430 0x7f89780cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:41914/0 (socket says 172.21.15.37:41914) 2023-07-12T02:05:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.542+0000 7f897db9c700 1 -- 172.21.15.37:0/2028769436 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89780d3730 msgr2=0x7f89780cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.542+0000 7f897db9c700 1 --2- 172.21.15.37:0/2028769436 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89780d3730 0x7f89780cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.542+0000 7f897db9c700 1 -- 172.21.15.37:0/2028769436 >> v1:172.21.15.196:6789/0 conn(0x7f89780b8430 legacy=0x7f89780cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.542+0000 7f897db9c700 1 -- 172.21.15.37:0/2028769436 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89780cfeb0 con 0x7f89780cfa90 2023-07-12T02:05:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.542+0000 7f896ffff700 1 -- 172.21.15.37:0/2028769436 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352664975 0 0) 0x7f89780d0b20 con 0x7f89780b8430 2023-07-12T02:05:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.542+0000 7f897db9c700 1 --2- 172.21.15.37:0/2028769436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89780cfa90 0x7f89780d0fb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8970009e50 tx=0x7f897000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288f63af99764c22 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.542+0000 7f896ffff700 1 -- 172.21.15.37:0/2028769436 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897000e070 con 0x7f89780cfa90 2023-07-12T02:05:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.542+0000 7f896ffff700 1 -- 172.21.15.37:0/2028769436 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897000b910 con 0x7f89780cfa90 2023-07-12T02:05:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.542+0000 7f896ffff700 1 -- 172.21.15.37:0/2028769436 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897000bcc0 con 0x7f89780cfa90 2023-07-12T02:05:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.543+0000 7f897f5ff700 1 -- 172.21.15.37:0/2028769436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89780cfa90 msgr2=0x7f89780d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.543+0000 7f897f5ff700 1 --2- 172.21.15.37:0/2028769436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89780cfa90 0x7f89780d0fb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8970009e50 tx=0x7f897000b330 comp rx=0 tx=0).stop 2023-07-12T02:05:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.543+0000 7f897f5ff700 1 -- 172.21.15.37:0/2028769436 shutdown_connections 2023-07-12T02:05:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.543+0000 7f897f5ff700 1 --2- 172.21.15.37:0/2028769436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89780cfa90 0x7f89780d0fb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.543+0000 7f897f5ff700 1 --2- 172.21.15.37:0/2028769436 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89780d3730 0x7f89780cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.543+0000 7f897f5ff700 1 -- 172.21.15.37:0/2028769436 >> 172.21.15.37:0/2028769436 conn(0x7f897806b3f0 msgr2=0x7f897806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.543+0000 7f897f5ff700 1 -- 172.21.15.37:0/2028769436 shutdown_connections 2023-07-12T02:05:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.543+0000 7f897f5ff700 1 -- 172.21.15.37:0/2028769436 wait complete. 2023-07-12T02:05:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.545+0000 7f897f5ff700 1 Processor -- start 2023-07-12T02:05:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.545+0000 7f897f5ff700 1 -- start start 2023-07-12T02:05:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.546+0000 7f897f5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89780b8430 0x7f89780c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.546+0000 7f897f5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89780cfa90 0x7f89780b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.546+0000 7f897f5ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89780d3730 0x7f89780b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.546+0000 7f897f5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897815e6c0 con 0x7f89780b8430 2023-07-12T02:05:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.546+0000 7f897f5ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89780c7ed0 con 0x7f89780d3730 2023-07-12T02:05:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.546+0000 7f897f5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89780c6430 con 0x7f89780cfa90 2023-07-12T02:05:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.546+0000 7f897d39b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89780b8430 0x7f89780c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.546+0000 7f897d39b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89780b8430 0x7f89780c5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34108/0 (socket says 172.21.15.37:34108) 2023-07-12T02:05:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.546+0000 7f897d39b700 1 -- 172.21.15.37:0/2503242110 learned_addr learned my addr 172.21.15.37:0/2503242110 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.546+0000 7f897cb9a700 1 --2- 172.21.15.37:0/2503242110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89780cfa90 0x7f89780b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.546+0000 7f897db9c700 1 --2- 172.21.15.37:0/2503242110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89780d3730 0x7f89780b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.547+0000 7f897d39b700 1 -- 172.21.15.37:0/2503242110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89780cfa90 msgr2=0x7f89780b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.547+0000 7f897d39b700 1 --2- 172.21.15.37:0/2503242110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89780cfa90 0x7f89780b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.547+0000 7f897d39b700 1 -- 172.21.15.37:0/2503242110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89780d3730 msgr2=0x7f89780b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.547+0000 7f897d39b700 1 --2- 172.21.15.37:0/2503242110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89780d3730 0x7f89780b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.547+0000 7f897d39b700 1 -- 172.21.15.37:0/2503242110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8970009b30 con 0x7f89780b8430 2023-07-12T02:05:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.547+0000 7f897d39b700 1 --2- 172.21.15.37:0/2503242110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89780b8430 0x7f89780c5ef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f89740011e0 tx=0x7f897400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.547+0000 7f896dffb700 1 -- 172.21.15.37:0/2503242110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974004c80 con 0x7f89780b8430 2023-07-12T02:05:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.547+0000 7f896dffb700 1 -- 172.21.15.37:0/2503242110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8974004e00 con 0x7f89780b8430 2023-07-12T02:05:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.547+0000 7f897f5ff700 1 -- 172.21.15.37:0/2503242110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89780c72c0 con 0x7f89780b8430 2023-07-12T02:05:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.547+0000 7f896dffb700 1 -- 172.21.15.37:0/2503242110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974007310 con 0x7f89780b8430 2023-07-12T02:05:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.547+0000 7f897f5ff700 1 -- 172.21.15.37:0/2503242110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89780c7880 con 0x7f89780b8430 2023-07-12T02:05:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.548+0000 7f897f5ff700 1 -- 172.21.15.37:0/2503242110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f897804ea60 con 0x7f89780b8430 2023-07-12T02:05:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.549+0000 7f896dffb700 1 -- 172.21.15.37:0/2503242110 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8974007470 con 0x7f89780b8430 2023-07-12T02:05:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.550+0000 7f896dffb700 1 --2- 172.21.15.37:0/2503242110 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f895c06ace0 0x7f895c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.550+0000 7f896dffb700 1 -- 172.21.15.37:0/2503242110 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8974089570 con 0x7f89780b8430 2023-07-12T02:05:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.551+0000 7f897cb9a700 1 --2- 172.21.15.37:0/2503242110 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f895c06ace0 0x7f895c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.551+0000 7f897cb9a700 1 --2- 172.21.15.37:0/2503242110 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f895c06ace0 0x7f895c06d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f897815c7d0 tx=0x7f8968009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.554+0000 7f896dffb700 1 -- 172.21.15.37:0/2503242110 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f89740541c0 con 0x7f89780b8430 2023-07-12T02:05:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.759+0000 7f897f5ff700 1 -- 172.21.15.37:0/2503242110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f897806b8f0 con 0x7f89780b8430 2023-07-12T02:05:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.760+0000 7f896dffb700 1 -- 172.21.15.37:0/2503242110 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f89740577e0 con 0x7f89780b8430 2023-07-12T02:05:10.764 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:05:10.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.762+0000 7f897f5ff700 1 -- 172.21.15.37:0/2503242110 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f895c06ace0 msgr2=0x7f895c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.762+0000 7f897f5ff700 1 --2- 172.21.15.37:0/2503242110 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f895c06ace0 0x7f895c06d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f897815c7d0 tx=0x7f8968009210 comp rx=0 tx=0).stop 2023-07-12T02:05:10.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.762+0000 7f897f5ff700 1 -- 172.21.15.37:0/2503242110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89780b8430 msgr2=0x7f89780c5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.762+0000 7f897f5ff700 1 --2- 172.21.15.37:0/2503242110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89780b8430 0x7f89780c5ef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f89740011e0 tx=0x7f897400ca30 comp rx=0 tx=0).stop 2023-07-12T02:05:10.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.763+0000 7f897f5ff700 1 -- 172.21.15.37:0/2503242110 shutdown_connections 2023-07-12T02:05:10.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.763+0000 7f897f5ff700 1 --2- 172.21.15.37:0/2503242110 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f895c06ace0 0x7f895c06d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.763+0000 7f897f5ff700 1 --2- 172.21.15.37:0/2503242110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89780b8430 0x7f89780c5ef0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.763+0000 7f897f5ff700 1 --2- 172.21.15.37:0/2503242110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89780d3730 0x7f89780b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.763+0000 7f897f5ff700 1 --2- 172.21.15.37:0/2503242110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89780cfa90 0x7f89780b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.763+0000 7f897f5ff700 1 -- 172.21.15.37:0/2503242110 >> 172.21.15.37:0/2503242110 conn(0x7f897806b3f0 msgr2=0x7f897815bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.763+0000 7f897f5ff700 1 -- 172.21.15.37:0/2503242110 shutdown_connections 2023-07-12T02:05:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.763+0000 7f897f5ff700 1 -- 172.21.15.37:0/2503242110 wait complete. 2023-07-12T02:05:10.784 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-12T02:05:10.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.982+0000 7fc6053ff700 1 Processor -- start 2023-07-12T02:05:10.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.982+0000 7fc6053ff700 1 -- start start 2023-07-12T02:05:10.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.983+0000 7fc6053ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc60015c1e0 0x7fc6000caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.983+0000 7fc6053ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6000ce6e0 con 0x7fc6000cb470 2023-07-12T02:05:10.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.983+0000 7fc6053ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6000ceb70 con 0x7fc60006c450 2023-07-12T02:05:10.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.983+0000 7fc6053ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000d06d0 con 0x7fc60015c1e0 2023-07-12T02:05:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.984+0000 7fc5fe7fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc6000cb470 0x7fc60006ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51772/0 (socket says 172.21.15.37:51772) 2023-07-12T02:05:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.984+0000 7fc5fe7fc700 1 -- 172.21.15.37:0/378498735 learned_addr learned my addr 172.21.15.37:0/378498735 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.984+0000 7fc5feffd700 1 --2- 172.21.15.37:0/378498735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc60015c1e0 0x7fc6000caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.984+0000 7fc5fdffb700 1 -- 172.21.15.37:0/378498735 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530558289 0 0) 0x7fc6000ce6e0 con 0x7fc6000cb470 2023-07-12T02:05:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.984+0000 7fc5fdffb700 1 -- 172.21.15.37:0/378498735 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5e80035b0 con 0x7fc6000cb470 2023-07-12T02:05:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.984+0000 7fc5fdffb700 1 -- 172.21.15.37:0/378498735 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251722586 0 0) 0x7fc6000ceb70 con 0x7fc60006c450 2023-07-12T02:05:10.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.984+0000 7fc5fdffb700 1 -- 172.21.15.37:0/378498735 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6000ce6e0 con 0x7fc60006c450 2023-07-12T02:05:10.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.984+0000 7fc5fdffb700 1 -- 172.21.15.37:0/378498735 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2307071887 0 0) 0x7fc5e80035b0 con 0x7fc6000cb470 2023-07-12T02:05:10.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.984+0000 7fc5fdffb700 1 -- 172.21.15.37:0/378498735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc60015c1e0 msgr2=0x7fc6000caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:10.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.984+0000 7fc5fdffb700 1 --2- 172.21.15.37:0/378498735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc60015c1e0 0x7fc6000caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.984+0000 7fc5fdffb700 1 -- 172.21.15.37:0/378498735 >> v1:172.21.15.196:6789/0 conn(0x7fc60006c450 legacy=0x7fc6000b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.984+0000 7fc5fdffb700 1 -- 172.21.15.37:0/378498735 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc600070b60 con 0x7fc6000cb470 2023-07-12T02:05:10.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.984+0000 7fc5fdffb700 1 -- 172.21.15.37:0/378498735 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7fc5f4001670 con 0x7fc6000cb470 2023-07-12T02:05:10.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.984+0000 7fc5fdffb700 1 -- 172.21.15.37:0/378498735 >> v1:172.21.15.37:6789/0 conn(0x7fc6000cb470 legacy=0x7fc60006ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.985+0000 7fc5fdffb700 1 --2- 172.21.15.37:0/378498735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e8003bc0 0x7fc5e8003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.985+0000 7fc5fdffb700 1 --2- 172.21.15.37:0/378498735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc60015c1e0 0x7fc5e8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.985+0000 7fc5fdffb700 1 --2- 172.21.15.37:0/378498735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc5e8004d90 0x7fc5e8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.985+0000 7fc5fdffb700 1 -- 172.21.15.37:0/378498735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000d06d0 con 0x7fc5e8003bc0 2023-07-12T02:05:10.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.985+0000 7fc5fdffb700 1 -- 172.21.15.37:0/378498735 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e800bac0 con 0x7fc5e8004d90 2023-07-12T02:05:10.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.985+0000 7fc5fdffb700 1 -- 172.21.15.37:0/378498735 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e800bc80 con 0x7fc60015c1e0 2023-07-12T02:05:10.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.985+0000 7fc5feffd700 1 --2- 172.21.15.37:0/378498735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e8003bc0 0x7fc5e8003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.985+0000 7fc5fe7fc700 1 --2- 172.21.15.37:0/378498735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc60015c1e0 0x7fc5e8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.985+0000 7fc5ff7fe700 1 --2- 172.21.15.37:0/378498735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc5e8004d90 0x7fc5e8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.985+0000 7fc5feffd700 1 -- 172.21.15.37:0/378498735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc60015c1e0 msgr2=0x7fc5e8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:10.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.985+0000 7fc5feffd700 1 --2- 172.21.15.37:0/378498735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc60015c1e0 0x7fc5e8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.985+0000 7fc5feffd700 1 -- 172.21.15.37:0/378498735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc5e8004d90 msgr2=0x7fc5e8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:10.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.985+0000 7fc5feffd700 1 --2- 172.21.15.37:0/378498735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc5e8004d90 0x7fc5e8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.985+0000 7fc5feffd700 1 -- 172.21.15.37:0/378498735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e80035b0 con 0x7fc5e8003bc0 2023-07-12T02:05:10.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.985+0000 7fc5feffd700 1 --2- 172.21.15.37:0/378498735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e8003bc0 0x7fc5e8003fb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009b30 tx=0x7fc5e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30780b337071180 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.986+0000 7fc5fdffb700 1 -- 172.21.15.37:0/378498735 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000e6c0 con 0x7fc5e8003bc0 2023-07-12T02:05:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.986+0000 7fc5fdffb700 1 -- 172.21.15.37:0/378498735 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f000e820 con 0x7fc5e8003bc0 2023-07-12T02:05:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.986+0000 7fc5fdffb700 1 -- 172.21.15.37:0/378498735 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000eb90 con 0x7fc5e8003bc0 2023-07-12T02:05:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.986+0000 7fc6053ff700 1 -- 172.21.15.37:0/378498735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e8003bc0 msgr2=0x7fc5e8003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.986+0000 7fc6053ff700 1 --2- 172.21.15.37:0/378498735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e8003bc0 0x7fc5e8003fb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009b30 tx=0x7fc5e8005880 comp rx=0 tx=0).stop 2023-07-12T02:05:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.986+0000 7fc5ff7fe700 1 -- 172.21.15.37:0/378498735 reap_dead start 2023-07-12T02:05:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.986+0000 7fc6053ff700 1 -- 172.21.15.37:0/378498735 shutdown_connections 2023-07-12T02:05:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.986+0000 7fc6053ff700 1 -- 172.21.15.37:0/378498735 >> 172.21.15.37:0/378498735 conn(0x7fc60006e550 msgr2=0x7fc60006e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.986+0000 7fc6053ff700 1 -- 172.21.15.37:0/378498735 shutdown_connections 2023-07-12T02:05:10.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.986+0000 7fc6053ff700 1 -- 172.21.15.37:0/378498735 wait complete. 2023-07-12T02:05:10.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.988+0000 7fc6053ff700 1 Processor -- start 2023-07-12T02:05:10.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.988+0000 7fc6053ff700 1 -- start start 2023-07-12T02:05:10.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.989+0000 7fc6053ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e8003bc0 0x7fc6000ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.989+0000 7fc6053ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6000b1b50 0x7fc600157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.989+0000 7fc6053ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc600157a10 0x7fc60015e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:10.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.989+0000 7fc6053ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000c9f10 con 0x7fc5e8003bc0 2023-07-12T02:05:10.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.989+0000 7fc6053ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000c9300 con 0x7fc6000b1b50 2023-07-12T02:05:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.989+0000 7fc6053ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000c95e0 con 0x7fc600157a10 2023-07-12T02:05:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.990+0000 7fc5feffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e8003bc0 0x7fc6000ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.990+0000 7fc5feffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e8003bc0 0x7fc6000ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34130/0 (socket says 172.21.15.37:34130) 2023-07-12T02:05:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.990+0000 7fc5feffd700 1 -- 172.21.15.37:0/3934320801 learned_addr learned my addr 172.21.15.37:0/3934320801 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.990+0000 7fc5fe7fc700 1 --2- 172.21.15.37:0/3934320801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6000b1b50 0x7fc600157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.990+0000 7fc5ff7fe700 1 --2- 172.21.15.37:0/3934320801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc600157a10 0x7fc60015e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.990+0000 7fc5feffd700 1 -- 172.21.15.37:0/3934320801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc600157a10 msgr2=0x7fc60015e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.990+0000 7fc5feffd700 1 --2- 172.21.15.37:0/3934320801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc600157a10 0x7fc60015e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.990+0000 7fc5feffd700 1 -- 172.21.15.37:0/3934320801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6000b1b50 msgr2=0x7fc600157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.990+0000 7fc5feffd700 1 --2- 172.21.15.37:0/3934320801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6000b1b50 0x7fc600157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.990+0000 7fc5feffd700 1 -- 172.21.15.37:0/3934320801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6000c98c0 con 0x7fc5e8003bc0 2023-07-12T02:05:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.990+0000 7fc5fe7fc700 1 --2- 172.21.15.37:0/3934320801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6000b1b50 0x7fc600157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.991+0000 7fc5feffd700 1 --2- 172.21.15.37:0/3934320801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e8003bc0 0x7fc6000ca3a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000e4b0 tx=0x7fc5f00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.991+0000 7fc5e77fe700 1 -- 172.21.15.37:0/3934320801 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0021070 con 0x7fc5e8003bc0 2023-07-12T02:05:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.991+0000 7fc5e77fe700 1 -- 172.21.15.37:0/3934320801 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f00044b0 con 0x7fc5e8003bc0 2023-07-12T02:05:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.991+0000 7fc5e77fe700 1 -- 172.21.15.37:0/3934320801 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000e6c0 con 0x7fc5e8003bc0 2023-07-12T02:05:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.991+0000 7fc6053ff700 1 -- 172.21.15.37:0/3934320801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6000c9ba0 con 0x7fc5e8003bc0 2023-07-12T02:05:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.991+0000 7fc6053ff700 1 -- 172.21.15.37:0/3934320801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc600157f10 con 0x7fc5e8003bc0 2023-07-12T02:05:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.992+0000 7fc6053ff700 1 -- 172.21.15.37:0/3934320801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6000ca8e0 con 0x7fc5e8003bc0 2023-07-12T02:05:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.993+0000 7fc5e77fe700 1 -- 172.21.15.37:0/3934320801 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc5f0025070 con 0x7fc5e8003bc0 2023-07-12T02:05:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.994+0000 7fc5e77fe700 1 --2- 172.21.15.37:0/3934320801 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc5ec06ace0 0x7fc5ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.994+0000 7fc5e77fe700 1 -- 172.21.15.37:0/3934320801 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc5f008aab0 con 0x7fc5e8003bc0 2023-07-12T02:05:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.995+0000 7fc5fe7fc700 1 --2- 172.21.15.37:0/3934320801 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc5ec06ace0 0x7fc5ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.995+0000 7fc5fe7fc700 1 --2- 172.21.15.37:0/3934320801 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc5ec06ace0 0x7fc5ec06d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4001eb0 tx=0x7fc5f4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:11.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:10.999+0000 7fc5e77fe700 1 -- 172.21.15.37:0/3934320801 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc5f0055940 con 0x7fc5e8003bc0 2023-07-12T02:05:11.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.222+0000 7fc6053ff700 1 -- 172.21.15.37:0/3934320801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc6000ca1f0 con 0x7fc5e8003bc0 2023-07-12T02:05:11.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.222+0000 7fc5e77fe700 1 -- 172.21.15.37:0/3934320801 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc5f0058f60 con 0x7fc5e8003bc0 2023-07-12T02:05:11.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.224+0000 7fc6053ff700 1 -- 172.21.15.37:0/3934320801 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc5ec06ace0 msgr2=0x7fc5ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:11.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.224+0000 7fc6053ff700 1 --2- 172.21.15.37:0/3934320801 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc5ec06ace0 0x7fc5ec06d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4001eb0 tx=0x7fc5f4009040 comp rx=0 tx=0).stop 2023-07-12T02:05:11.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.224+0000 7fc6053ff700 1 -- 172.21.15.37:0/3934320801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e8003bc0 msgr2=0x7fc6000ca3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:11.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.224+0000 7fc6053ff700 1 --2- 172.21.15.37:0/3934320801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e8003bc0 0x7fc6000ca3a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000e4b0 tx=0x7fc5f00047c0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.224+0000 7fc6053ff700 1 -- 172.21.15.37:0/3934320801 shutdown_connections 2023-07-12T02:05:11.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.224+0000 7fc6053ff700 1 --2- 172.21.15.37:0/3934320801 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc5ec06ace0 0x7fc5ec06d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.224+0000 7fc6053ff700 1 --2- 172.21.15.37:0/3934320801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e8003bc0 0x7fc6000ca3a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.224+0000 7fc6053ff700 1 --2- 172.21.15.37:0/3934320801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc600157a10 0x7fc60015e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.224+0000 7fc6053ff700 1 --2- 172.21.15.37:0/3934320801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6000b1b50 0x7fc600157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.224+0000 7fc6053ff700 1 -- 172.21.15.37:0/3934320801 >> 172.21.15.37:0/3934320801 conn(0x7fc60006e550 msgr2=0x7fc6000b5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:11.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.224+0000 7fc6053ff700 1 -- 172.21.15.37:0/3934320801 shutdown_connections 2023-07-12T02:05:11.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.225+0000 7fc6053ff700 1 -- 172.21.15.37:0/3934320801 wait complete. 2023-07-12T02:05:11.230 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-12T02:05:11.245 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-12T02:05:11.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:11.246 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-12T02:05:11.331 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-12T02:05:11.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:11.332 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-12T02:05:11.378 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:05:11.379 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:05:11.429 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:05:11.429 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:05:11.476 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:05:11.476 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:05:11.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:05:11.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.759+0000 7f60067ff700 1 Processor -- start 2023-07-12T02:05:11.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.760+0000 7f60067ff700 1 -- start start 2023-07-12T02:05:11.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.761+0000 7f60067ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f600015c460 0x7f60000b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:11.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.761+0000 7f60067ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60000d2640 0x7f60000cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:11.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.761+0000 7f60067ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f60000cf720 0x7f60000cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:11.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.761+0000 7f60067ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60000cedd0 con 0x7f60000d2640 2023-07-12T02:05:11.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.761+0000 7f60067ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60000d1790 con 0x7f60000cf720 2023-07-12T02:05:11.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.761+0000 7f60067ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60000cd950 con 0x7f600015c460 2023-07-12T02:05:11.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.761+0000 7f5fff7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60000d2640 0x7f60000cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:11.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.761+0000 7f5fff7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60000d2640 0x7f60000cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34144/0 (socket says 172.21.15.37:34144) 2023-07-12T02:05:11.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.761+0000 7f5fff7fe700 1 -- 172.21.15.37:0/20157044 learned_addr learned my addr 172.21.15.37:0/20157044 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:11.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.761+0000 7f6004d9c700 1 --2- 172.21.15.37:0/20157044 >> v2:172.21.15.196:3300/0 conn(0x7f60000cf720 0x7f60000cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:11.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.761+0000 7f5ffffff700 1 --2- 172.21.15.37:0/20157044 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f600015c460 0x7f60000b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:11.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.762+0000 7f5fff7fe700 1 -- 172.21.15.37:0/20157044 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f600015c460 msgr2=0x7f60000b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:11.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.762+0000 7f5fff7fe700 1 --2- 172.21.15.37:0/20157044 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f600015c460 0x7f60000b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.762+0000 7f5fff7fe700 1 -- 172.21.15.37:0/20157044 >> v2:172.21.15.196:3300/0 conn(0x7f60000cf720 msgr2=0x7f60000cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:11.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.762+0000 7f5fff7fe700 1 --2- 172.21.15.37:0/20157044 >> v2:172.21.15.196:3300/0 conn(0x7f60000cf720 0x7f60000cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.762+0000 7f5fff7fe700 1 -- 172.21.15.37:0/20157044 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60000d14b0 con 0x7f60000d2640 2023-07-12T02:05:11.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.762+0000 7f5fff7fe700 1 --2- 172.21.15.37:0/20157044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60000d2640 0x7f60000cf1e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f600008bf90 tx=0x7f5ff4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eafc4fd509f1818 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:11.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.762+0000 7f5ffeffd700 1 -- 172.21.15.37:0/20157044 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4011830 con 0x7f60000d2640 2023-07-12T02:05:11.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.762+0000 7f5ffeffd700 1 -- 172.21.15.37:0/20157044 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff4011990 con 0x7f60000d2640 2023-07-12T02:05:11.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.762+0000 7f5ffeffd700 1 -- 172.21.15.37:0/20157044 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4011d20 con 0x7f60000d2640 2023-07-12T02:05:11.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.763+0000 7f60067ff700 1 -- 172.21.15.37:0/20157044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60000d2640 msgr2=0x7f60000cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:11.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.763+0000 7f60067ff700 1 --2- 172.21.15.37:0/20157044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60000d2640 0x7f60000cf1e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f600008bf90 tx=0x7f5ff4009bd0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.763+0000 7f60067ff700 1 -- 172.21.15.37:0/20157044 shutdown_connections 2023-07-12T02:05:11.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.763+0000 7f60067ff700 1 --2- 172.21.15.37:0/20157044 >> v2:172.21.15.196:3300/0 conn(0x7f60000cf720 0x7f60000cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.763+0000 7f60067ff700 1 --2- 172.21.15.37:0/20157044 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f600015c460 0x7f60000b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.763+0000 7f60067ff700 1 --2- 172.21.15.37:0/20157044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60000d2640 0x7f60000cf1e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.763+0000 7f60067ff700 1 -- 172.21.15.37:0/20157044 >> 172.21.15.37:0/20157044 conn(0x7f6000071660 msgr2=0x7f6000071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:11.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.763+0000 7f60067ff700 1 -- 172.21.15.37:0/20157044 shutdown_connections 2023-07-12T02:05:11.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.763+0000 7f60067ff700 1 -- 172.21.15.37:0/20157044 wait complete. 2023-07-12T02:05:11.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.765+0000 7f60067ff700 1 Processor -- start 2023-07-12T02:05:11.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.765+0000 7f60067ff700 1 -- start start 2023-07-12T02:05:11.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.766+0000 7f60067ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60000cf720 0x7f60000cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:11.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.766+0000 7f60067ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60000d2640 0x7f60001e6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:11.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.766+0000 7f60067ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f600015c460 0x7f60001523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:11.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.766+0000 7f60067ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60001e6d50 con 0x7f600015c460 2023-07-12T02:05:11.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.766+0000 7f60067ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60001528e0 con 0x7f60000d2640 2023-07-12T02:05:11.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.766+0000 7f60067ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60000ccc80 con 0x7f60000cf720 2023-07-12T02:05:11.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.766+0000 7f6004d9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f600015c460 0x7f60001523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:11.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.766+0000 7f6004d9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f600015c460 0x7f60001523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34156/0 (socket says 172.21.15.37:34156) 2023-07-12T02:05:11.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.766+0000 7f6004d9c700 1 -- 172.21.15.37:0/413363825 learned_addr learned my addr 172.21.15.37:0/413363825 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.766+0000 7f5ffffff700 1 --2- 172.21.15.37:0/413363825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60000cf720 0x7f60000cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.766+0000 7f5fff7fe700 1 --2- 172.21.15.37:0/413363825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60000d2640 0x7f60001e6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.767+0000 7f6004d9c700 1 -- 172.21.15.37:0/413363825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60000cf720 msgr2=0x7f60000cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.767+0000 7f6004d9c700 1 --2- 172.21.15.37:0/413363825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60000cf720 0x7f60000cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.767+0000 7f6004d9c700 1 -- 172.21.15.37:0/413363825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60000d2640 msgr2=0x7f60001e6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.767+0000 7f6004d9c700 1 --2- 172.21.15.37:0/413363825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60000d2640 0x7f60001e6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.767+0000 7f6004d9c700 1 -- 172.21.15.37:0/413363825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff4009550 con 0x7f600015c460 2023-07-12T02:05:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.767+0000 7f6004d9c700 1 --2- 172.21.15.37:0/413363825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f600015c460 0x7f60001523a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800eed0 tx=0x7f5ff8009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.767+0000 7f5ffcff9700 1 -- 172.21.15.37:0/413363825 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8010040 con 0x7f600015c460 2023-07-12T02:05:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.767+0000 7f5ffcff9700 1 -- 172.21.15.37:0/413363825 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff800b9e0 con 0x7f600015c460 2023-07-12T02:05:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.767+0000 7f5ffcff9700 1 -- 172.21.15.37:0/413363825 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8009b20 con 0x7f600015c460 2023-07-12T02:05:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.767+0000 7f60067ff700 1 -- 172.21.15.37:0/413363825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60000c9c50 con 0x7f600015c460 2023-07-12T02:05:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.767+0000 7f60067ff700 1 -- 172.21.15.37:0/413363825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60000ca210 con 0x7f600015c460 2023-07-12T02:05:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.769+0000 7f60067ff700 1 -- 172.21.15.37:0/413363825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600004ea60 con 0x7f600015c460 2023-07-12T02:05:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.770+0000 7f5ffcff9700 1 -- 172.21.15.37:0/413363825 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5ff801d400 con 0x7f600015c460 2023-07-12T02:05:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.770+0000 7f5ffcff9700 1 --2- 172.21.15.37:0/413363825 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5fec06ace0 0x7f5fec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.770+0000 7f5ffcff9700 1 -- 172.21.15.37:0/413363825 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5ff8089de0 con 0x7f600015c460 2023-07-12T02:05:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.771+0000 7f5ffffff700 1 --2- 172.21.15.37:0/413363825 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5fec06ace0 0x7f5fec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:11.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.772+0000 7f5ffffff700 1 --2- 172.21.15.37:0/413363825 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5fec06ace0 0x7f5fec06d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009b40 tx=0x7f5ff0009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:11.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.775+0000 7f5ffcff9700 1 -- 172.21.15.37:0/413363825 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5ff8054b50 con 0x7f600015c460 2023-07-12T02:05:11.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.984+0000 7f60067ff700 1 -- 172.21.15.37:0/413363825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60000ccdf0 con 0x7f600015c460 2023-07-12T02:05:11.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.985+0000 7f5ffcff9700 1 -- 172.21.15.37:0/413363825 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20168 (secure 0 0 0) 0x7f60000ccdf0 con 0x7f600015c460 2023-07-12T02:05:11.989 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:11.990 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:39.032667+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:05:11.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.988+0000 7f60067ff700 1 -- 172.21.15.37:0/413363825 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5fec06ace0 msgr2=0x7f5fec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:11.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.988+0000 7f60067ff700 1 --2- 172.21.15.37:0/413363825 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5fec06ace0 0x7f5fec06d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009b40 tx=0x7f5ff0009210 comp rx=0 tx=0).stop 2023-07-12T02:05:11.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.988+0000 7f60067ff700 1 -- 172.21.15.37:0/413363825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f600015c460 msgr2=0x7f60001523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:11.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.988+0000 7f60067ff700 1 --2- 172.21.15.37:0/413363825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f600015c460 0x7f60001523a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800eed0 tx=0x7f5ff8009f60 comp rx=0 tx=0).stop 2023-07-12T02:05:11.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.988+0000 7f60067ff700 1 -- 172.21.15.37:0/413363825 shutdown_connections 2023-07-12T02:05:11.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.988+0000 7f60067ff700 1 --2- 172.21.15.37:0/413363825 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5fec06ace0 0x7f5fec06d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.988+0000 7f60067ff700 1 --2- 172.21.15.37:0/413363825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f600015c460 0x7f60001523a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.988+0000 7f60067ff700 1 --2- 172.21.15.37:0/413363825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60000cf720 0x7f60000cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.988+0000 7f60067ff700 1 --2- 172.21.15.37:0/413363825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60000d2640 0x7f60001e6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.988+0000 7f60067ff700 1 -- 172.21.15.37:0/413363825 >> 172.21.15.37:0/413363825 conn(0x7f6000071660 msgr2=0x7f60000b63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.988+0000 7f60067ff700 1 -- 172.21.15.37:0/413363825 shutdown_connections 2023-07-12T02:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:11.988+0000 7f60067ff700 1 -- 172.21.15.37:0/413363825 wait complete. 2023-07-12T02:05:12.010 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:03:56.039938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:03:56.612707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-12T02:04:00.200885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-12T02:05:12.011 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:05:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.213+0000 7faf679ff700 1 Processor -- start 2023-07-12T02:05:12.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.213+0000 7faf679ff700 1 -- start start 2023-07-12T02:05:12.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.214+0000 7faf679ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7faf600b8430 0x7faf600cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:12.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.214+0000 7faf679ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf600d3730 0x7faf600cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:12.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.214+0000 7faf679ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf600cfa90 0x7faf6015feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:12.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.214+0000 7faf679ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf600b8800 con 0x7faf600d3730 2023-07-12T02:05:12.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.214+0000 7faf679ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf600d0b20 con 0x7faf600b8430 2023-07-12T02:05:12.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.214+0000 7faf679ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf600cfeb0 con 0x7faf600cfa90 2023-07-12T02:05:12.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.215+0000 7faf64f9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf600d3730 0x7faf600cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:12.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.215+0000 7faf64f9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf600d3730 0x7faf600cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49666/0 (socket says 172.21.15.37:49666) 2023-07-12T02:05:12.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.215+0000 7faf64f9a700 1 -- 172.21.15.37:0/3601536554 learned_addr learned my addr 172.21.15.37:0/3601536554 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:12.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.215+0000 7faf6579b700 1 --2- 172.21.15.37:0/3601536554 >> v2:172.21.15.196:3300/0 conn(0x7faf600b8430 0x7faf600cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:12.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.215+0000 7faf65f9c700 1 --2- 172.21.15.37:0/3601536554 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf600cfa90 0x7faf6015feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:12.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.215+0000 7faf64f9a700 1 -- 172.21.15.37:0/3601536554 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf600cfa90 msgr2=0x7faf6015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:12.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.215+0000 7faf64f9a700 1 --2- 172.21.15.37:0/3601536554 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf600cfa90 0x7faf6015feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.215+0000 7faf64f9a700 1 -- 172.21.15.37:0/3601536554 >> v2:172.21.15.196:3300/0 conn(0x7faf600b8430 msgr2=0x7faf600cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:12.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.215+0000 7faf64f9a700 1 --2- 172.21.15.37:0/3601536554 >> v2:172.21.15.196:3300/0 conn(0x7faf600b8430 0x7faf600cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.215+0000 7faf64f9a700 1 -- 172.21.15.37:0/3601536554 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf600b4ee0 con 0x7faf600d3730 2023-07-12T02:05:12.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.215+0000 7faf6579b700 1 --2- 172.21.15.37:0/3601536554 >> v2:172.21.15.196:3300/0 conn(0x7faf600b8430 0x7faf600cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:12.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.215+0000 7faf65f9c700 1 --2- 172.21.15.37:0/3601536554 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf600cfa90 0x7faf6015feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:12.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.215+0000 7faf64f9a700 1 --2- 172.21.15.37:0/3601536554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf600d3730 0x7faf600cf550 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7faf600cf520 tx=0x7faf50009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e9e1a1c412e006 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:12.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.216+0000 7faf57fff700 1 -- 172.21.15.37:0/3601536554 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5000b870 con 0x7faf600d3730 2023-07-12T02:05:12.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.216+0000 7faf57fff700 1 -- 172.21.15.37:0/3601536554 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5000b9d0 con 0x7faf600d3730 2023-07-12T02:05:12.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.216+0000 7faf57fff700 1 -- 172.21.15.37:0/3601536554 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5000bd60 con 0x7faf600d3730 2023-07-12T02:05:12.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.216+0000 7faf679ff700 1 -- 172.21.15.37:0/3601536554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf600d3730 msgr2=0x7faf600cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:12.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.216+0000 7faf679ff700 1 --2- 172.21.15.37:0/3601536554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf600d3730 0x7faf600cf550 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7faf600cf520 tx=0x7faf50009bd0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.216+0000 7faf679ff700 1 -- 172.21.15.37:0/3601536554 shutdown_connections 2023-07-12T02:05:12.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.216+0000 7faf679ff700 1 --2- 172.21.15.37:0/3601536554 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf600cfa90 0x7faf6015feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.216+0000 7faf679ff700 1 --2- 172.21.15.37:0/3601536554 >> v2:172.21.15.196:3300/0 conn(0x7faf600b8430 0x7faf600cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.216+0000 7faf679ff700 1 --2- 172.21.15.37:0/3601536554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf600d3730 0x7faf600cf550 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.216+0000 7faf679ff700 1 -- 172.21.15.37:0/3601536554 >> 172.21.15.37:0/3601536554 conn(0x7faf6006b3f0 msgr2=0x7faf6006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:12.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.216+0000 7faf679ff700 1 -- 172.21.15.37:0/3601536554 shutdown_connections 2023-07-12T02:05:12.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.216+0000 7faf679ff700 1 -- 172.21.15.37:0/3601536554 wait complete. 2023-07-12T02:05:12.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.218+0000 7faf679ff700 1 Processor -- start 2023-07-12T02:05:12.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.218+0000 7faf679ff700 1 -- start start 2023-07-12T02:05:12.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.219+0000 7faf679ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf600b8430 0x7faf60149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:12.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.219+0000 7faf679ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf600cfa90 0x7faf60149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:12.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.219+0000 7faf679ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf600d3730 0x7faf600ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:12.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.219+0000 7faf679ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6014bbf0 con 0x7faf600b8430 2023-07-12T02:05:12.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.219+0000 7faf679ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6014bed0 con 0x7faf600d3730 2023-07-12T02:05:12.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.219+0000 7faf679ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6014c1b0 con 0x7faf600cfa90 2023-07-12T02:05:12.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.220+0000 7faf6579b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf600b8430 0x7faf60149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:12.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.220+0000 7faf6579b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf600b8430 0x7faf60149b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49672/0 (socket says 172.21.15.37:49672) 2023-07-12T02:05:12.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.220+0000 7faf6579b700 1 -- 172.21.15.37:0/2180863535 learned_addr learned my addr 172.21.15.37:0/2180863535 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:12.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.220+0000 7faf64f9a700 1 --2- 172.21.15.37:0/2180863535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf600cfa90 0x7faf60149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:12.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.220+0000 7faf65f9c700 1 --2- 172.21.15.37:0/2180863535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf600d3730 0x7faf600ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:12.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.220+0000 7faf6579b700 1 -- 172.21.15.37:0/2180863535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf600cfa90 msgr2=0x7faf60149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:12.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.220+0000 7faf6579b700 1 --2- 172.21.15.37:0/2180863535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf600cfa90 0x7faf60149260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.220+0000 7faf6579b700 1 -- 172.21.15.37:0/2180863535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf600d3730 msgr2=0x7faf600ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:12.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.220+0000 7faf6579b700 1 --2- 172.21.15.37:0/2180863535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf600d3730 0x7faf600ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.220+0000 7faf6579b700 1 -- 172.21.15.37:0/2180863535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf50009550 con 0x7faf600b8430 2023-07-12T02:05:12.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.220+0000 7faf65f9c700 1 --2- 172.21.15.37:0/2180863535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf600d3730 0x7faf600ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:12.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.220+0000 7faf6579b700 1 --2- 172.21.15.37:0/2180863535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf600b8430 0x7faf60149b60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00c7f0 tx=0x7faf5c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:12.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.221+0000 7faf55ffb700 1 -- 172.21.15.37:0/2180863535 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c011800 con 0x7faf600b8430 2023-07-12T02:05:12.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.221+0000 7faf55ffb700 1 -- 172.21.15.37:0/2180863535 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c011960 con 0x7faf600b8430 2023-07-12T02:05:12.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.221+0000 7faf679ff700 1 -- 172.21.15.37:0/2180863535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6014c490 con 0x7faf600b8430 2023-07-12T02:05:12.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.221+0000 7faf55ffb700 1 -- 172.21.15.37:0/2180863535 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c011d10 con 0x7faf600b8430 2023-07-12T02:05:12.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.221+0000 7faf679ff700 1 -- 172.21.15.37:0/2180863535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf601497a0 con 0x7faf600b8430 2023-07-12T02:05:12.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.222+0000 7faf679ff700 1 -- 172.21.15.37:0/2180863535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6004ea60 con 0x7faf600b8430 2023-07-12T02:05:12.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.223+0000 7faf55ffb700 1 -- 172.21.15.37:0/2180863535 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faf5c018360 con 0x7faf600b8430 2023-07-12T02:05:12.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.224+0000 7faf55ffb700 1 --2- 172.21.15.37:0/2180863535 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7faf4406ace0 0x7faf4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:12.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.224+0000 7faf55ffb700 1 -- 172.21.15.37:0/2180863535 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faf5c0897a0 con 0x7faf600b8430 2023-07-12T02:05:12.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.224+0000 7faf64f9a700 1 --2- 172.21.15.37:0/2180863535 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7faf4406ace0 0x7faf4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:12.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.225+0000 7faf64f9a700 1 --2- 172.21.15.37:0/2180863535 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7faf4406ace0 0x7faf4406d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faf50000c00 tx=0x7faf50008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:12.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.228+0000 7faf55ffb700 1 -- 172.21.15.37:0/2180863535 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7faf5c057fa0 con 0x7faf600b8430 2023-07-12T02:05:12.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.437+0000 7faf679ff700 1 -- 172.21.15.37:0/2180863535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf600d2090 con 0x7faf600b8430 2023-07-12T02:05:12.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.438+0000 7faf55ffb700 1 -- 172.21.15.37:0/2180863535 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf5c057b30 con 0x7faf600b8430 2023-07-12T02:05:12.441 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:05:12.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.440+0000 7faf679ff700 1 -- 172.21.15.37:0/2180863535 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7faf4406ace0 msgr2=0x7faf4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:12.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.440+0000 7faf679ff700 1 --2- 172.21.15.37:0/2180863535 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7faf4406ace0 0x7faf4406d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faf50000c00 tx=0x7faf50008030 comp rx=0 tx=0).stop 2023-07-12T02:05:12.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.440+0000 7faf679ff700 1 -- 172.21.15.37:0/2180863535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf600b8430 msgr2=0x7faf60149b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:12.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.440+0000 7faf679ff700 1 --2- 172.21.15.37:0/2180863535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf600b8430 0x7faf60149b60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00c7f0 tx=0x7faf5c00cbb0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.440+0000 7faf679ff700 1 -- 172.21.15.37:0/2180863535 shutdown_connections 2023-07-12T02:05:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.440+0000 7faf679ff700 1 --2- 172.21.15.37:0/2180863535 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7faf4406ace0 0x7faf4406d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.440+0000 7faf679ff700 1 --2- 172.21.15.37:0/2180863535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf600b8430 0x7faf60149b60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.440+0000 7faf679ff700 1 --2- 172.21.15.37:0/2180863535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf600d3730 0x7faf600ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.440+0000 7faf679ff700 1 --2- 172.21.15.37:0/2180863535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf600cfa90 0x7faf60149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.440+0000 7faf679ff700 1 -- 172.21.15.37:0/2180863535 >> 172.21.15.37:0/2180863535 conn(0x7faf6006b3f0 msgr2=0x7faf600d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.440+0000 7faf679ff700 1 -- 172.21.15.37:0/2180863535 shutdown_connections 2023-07-12T02:05:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.440+0000 7faf679ff700 1 -- 172.21.15.37:0/2180863535 wait complete. 2023-07-12T02:05:12.462 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:05:12.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.662+0000 7fd0133ff700 1 Processor -- start 2023-07-12T02:05:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.662+0000 7fd0133ff700 1 -- start start 2023-07-12T02:05:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.663+0000 7fd0133ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c160a40 0x7fd00c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.663+0000 7fd0133ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd00c06c300 0x7fd00c0caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.663+0000 7fd0133ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00c0b0070 con 0x7fd00c0afca0 2023-07-12T02:05:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.663+0000 7fd0133ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd00c160eb0 con 0x7fd00c06c300 2023-07-12T02:05:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.663+0000 7fd0133ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c06e880 con 0x7fd00c160a40 2023-07-12T02:05:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.664+0000 7fd01099a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c160a40 0x7fd00c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.664+0000 7fd01199c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd00c06c300 0x7fd00c0caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.664+0000 7fd01099a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c160a40 0x7fd00c06bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:59768/0 (socket says 172.21.15.37:59768) 2023-07-12T02:05:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.664+0000 7fd01099a700 1 -- 172.21.15.37:0/3651941197 learned_addr learned my addr 172.21.15.37:0/3651941197 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.664+0000 7fd01199c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd00c06c300 0x7fd00c0caee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:54274/0 (socket says 172.21.15.37:54274) 2023-07-12T02:05:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.664+0000 7fd01119b700 1 --1- 172.21.15.37:0/3651941197 >> v1:172.21.15.196:6789/0 conn(0x7fd00c0afca0 0x7fd00c06e0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:35190/0 (socket says 172.21.15.37:35190) 2023-07-12T02:05:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.664+0000 7fd003fff700 1 -- 172.21.15.37:0/3651941197 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031637643 0 0) 0x7fd00c0b0070 con 0x7fd00c0afca0 2023-07-12T02:05:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.664+0000 7fd01099a700 1 -- 172.21.15.37:0/3651941197 >> v2:172.21.15.196:3300/0 conn(0x7fd00c06c300 msgr2=0x7fd00c0caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.664+0000 7fd01099a700 1 --2- 172.21.15.37:0/3651941197 >> v2:172.21.15.196:3300/0 conn(0x7fd00c06c300 0x7fd00c0caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.664+0000 7fd01099a700 1 -- 172.21.15.37:0/3651941197 >> v1:172.21.15.196:6789/0 conn(0x7fd00c0afca0 legacy=0x7fd00c06e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.664+0000 7fd01099a700 1 -- 172.21.15.37:0/3651941197 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c06eb60 con 0x7fd00c160a40 2023-07-12T02:05:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.664+0000 7fd01199c700 1 --2- 172.21.15.37:0/3651941197 >> v2:172.21.15.196:3300/0 conn(0x7fd00c06c300 0x7fd00c0caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.665+0000 7fd01099a700 1 --2- 172.21.15.37:0/3651941197 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c160a40 0x7fd00c06bdc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcffc006fd0 tx=0x7fcffc009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b6af7f0e9cdc581 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.665+0000 7fd003fff700 1 -- 172.21.15.37:0/3651941197 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc005e30 con 0x7fd00c160a40 2023-07-12T02:05:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.665+0000 7fd003fff700 1 -- 172.21.15.37:0/3651941197 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc004030 con 0x7fd00c160a40 2023-07-12T02:05:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.665+0000 7fd003fff700 1 -- 172.21.15.37:0/3651941197 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0043e0 con 0x7fd00c160a40 2023-07-12T02:05:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.666+0000 7fd0133ff700 1 -- 172.21.15.37:0/3651941197 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c160a40 msgr2=0x7fd00c06bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.666+0000 7fd0133ff700 1 --2- 172.21.15.37:0/3651941197 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c160a40 0x7fd00c06bdc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcffc006fd0 tx=0x7fcffc009bd0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.666+0000 7fd0133ff700 1 -- 172.21.15.37:0/3651941197 shutdown_connections 2023-07-12T02:05:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.666+0000 7fd0133ff700 1 --2- 172.21.15.37:0/3651941197 >> v2:172.21.15.196:3300/0 conn(0x7fd00c06c300 0x7fd00c0caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.666+0000 7fd0133ff700 1 --2- 172.21.15.37:0/3651941197 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c160a40 0x7fd00c06bdc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.666+0000 7fd0133ff700 1 -- 172.21.15.37:0/3651941197 >> 172.21.15.37:0/3651941197 conn(0x7fd00c08a3b0 msgr2=0x7fd00c06a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.666+0000 7fd0133ff700 1 -- 172.21.15.37:0/3651941197 shutdown_connections 2023-07-12T02:05:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.666+0000 7fd0133ff700 1 -- 172.21.15.37:0/3651941197 wait complete. 2023-07-12T02:05:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.669+0000 7fd0133ff700 1 Processor -- start 2023-07-12T02:05:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.669+0000 7fd0133ff700 1 -- start start 2023-07-12T02:05:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.671+0000 7fd0133ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd00c06c300 0x7fd00c0ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.671+0000 7fd0133ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c0afca0 0x7fd00c1532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.671+0000 7fd0133ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd00c160a40 0x7fd00c15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.671+0000 7fd0133ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0ca7e0 con 0x7fd00c160a40 2023-07-12T02:05:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.671+0000 7fd0133ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0c8fb0 con 0x7fd00c06c300 2023-07-12T02:05:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.671+0000 7fd0133ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0c9290 con 0x7fd00c0afca0 2023-07-12T02:05:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.671+0000 7fd01199c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd00c160a40 0x7fd00c15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.671+0000 7fd01199c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd00c160a40 0x7fd00c15adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49674/0 (socket says 172.21.15.37:49674) 2023-07-12T02:05:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.671+0000 7fd01199c700 1 -- 172.21.15.37:0/3761656341 learned_addr learned my addr 172.21.15.37:0/3761656341 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.671+0000 7fd01099a700 1 --2- 172.21.15.37:0/3761656341 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c0afca0 0x7fd00c1532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.671+0000 7fd01119b700 1 --2- 172.21.15.37:0/3761656341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd00c06c300 0x7fd00c0ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.672+0000 7fd01199c700 1 -- 172.21.15.37:0/3761656341 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c0afca0 msgr2=0x7fd00c1532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.672+0000 7fd01199c700 1 --2- 172.21.15.37:0/3761656341 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c0afca0 0x7fd00c1532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.672+0000 7fd01199c700 1 -- 172.21.15.37:0/3761656341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd00c06c300 msgr2=0x7fd00c0ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.672+0000 7fd01199c700 1 --2- 172.21.15.37:0/3761656341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd00c06c300 0x7fd00c0ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.672+0000 7fd01199c700 1 -- 172.21.15.37:0/3761656341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd004009a70 con 0x7fd00c160a40 2023-07-12T02:05:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.672+0000 7fd01099a700 1 --2- 172.21.15.37:0/3761656341 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c0afca0 0x7fd00c1532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.672+0000 7fd01199c700 1 --2- 172.21.15.37:0/3761656341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd00c160a40 0x7fd00c15adb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd00400efb0 tx=0x7fd00400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.672+0000 7fd001ffb700 1 -- 172.21.15.37:0/3761656341 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400cc90 con 0x7fd00c160a40 2023-07-12T02:05:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.672+0000 7fd001ffb700 1 -- 172.21.15.37:0/3761656341 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00400f040 con 0x7fd00c160a40 2023-07-12T02:05:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.672+0000 7fd001ffb700 1 -- 172.21.15.37:0/3761656341 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004014480 con 0x7fd00c160a40 2023-07-12T02:05:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.672+0000 7fd0133ff700 1 -- 172.21.15.37:0/3761656341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcffc009500 con 0x7fd00c160a40 2023-07-12T02:05:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.672+0000 7fd0133ff700 1 -- 172.21.15.37:0/3761656341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c1540c0 con 0x7fd00c160a40 2023-07-12T02:05:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.674+0000 7fd0133ff700 1 -- 172.21.15.37:0/3761656341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00c0738f0 con 0x7fd00c160a40 2023-07-12T02:05:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.674+0000 7fd001ffb700 1 -- 172.21.15.37:0/3761656341 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd0040145e0 con 0x7fd00c160a40 2023-07-12T02:05:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.676+0000 7fd001ffb700 1 --2- 172.21.15.37:0/3761656341 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcff006ace0 0x7fcff006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.676+0000 7fd001ffb700 1 -- 172.21.15.37:0/3761656341 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd00408a3e0 con 0x7fd00c160a40 2023-07-12T02:05:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.677+0000 7fd01119b700 1 --2- 172.21.15.37:0/3761656341 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcff006ace0 0x7fcff006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.677+0000 7fd01119b700 1 --2- 172.21.15.37:0/3761656341 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcff006ace0 0x7fcff006d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd008000fb0 tx=0x7fd008007d70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:12.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.680+0000 7fd001ffb700 1 -- 172.21.15.37:0/3761656341 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd004058c80 con 0x7fd00c160a40 2023-07-12T02:05:12.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.898+0000 7fd0133ff700 1 -- 172.21.15.37:0/3761656341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd00c04ea60 con 0x7fd00c160a40 2023-07-12T02:05:12.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.899+0000 7fd001ffb700 1 -- 172.21.15.37:0/3761656341 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd004009d50 con 0x7fd00c160a40 2023-07-12T02:05:12.902 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:05:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.901+0000 7fd0133ff700 1 -- 172.21.15.37:0/3761656341 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcff006ace0 msgr2=0x7fcff006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.901+0000 7fd0133ff700 1 --2- 172.21.15.37:0/3761656341 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcff006ace0 0x7fcff006d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd008000fb0 tx=0x7fd008007d70 comp rx=0 tx=0).stop 2023-07-12T02:05:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.901+0000 7fd0133ff700 1 -- 172.21.15.37:0/3761656341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd00c160a40 msgr2=0x7fd00c15adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.901+0000 7fd0133ff700 1 --2- 172.21.15.37:0/3761656341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd00c160a40 0x7fd00c15adb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd00400efb0 tx=0x7fd00400c3a0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.901+0000 7fd0133ff700 1 -- 172.21.15.37:0/3761656341 shutdown_connections 2023-07-12T02:05:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.901+0000 7fd0133ff700 1 --2- 172.21.15.37:0/3761656341 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fcff006ace0 0x7fcff006d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.901+0000 7fd0133ff700 1 --2- 172.21.15.37:0/3761656341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd00c160a40 0x7fd00c15adb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.901+0000 7fd0133ff700 1 --2- 172.21.15.37:0/3761656341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd00c06c300 0x7fd00c0ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.901+0000 7fd0133ff700 1 --2- 172.21.15.37:0/3761656341 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00c0afca0 0x7fd00c1532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.901+0000 7fd0133ff700 1 -- 172.21.15.37:0/3761656341 >> 172.21.15.37:0/3761656341 conn(0x7fd00c08a3b0 msgr2=0x7fd00c0cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.901+0000 7fd0133ff700 1 -- 172.21.15.37:0/3761656341 shutdown_connections 2023-07-12T02:05:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:12.901+0000 7fd0133ff700 1 -- 172.21.15.37:0/3761656341 wait complete. 2023-07-12T02:05:12.922 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:05:13.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.123+0000 7fb1badff700 1 Processor -- start 2023-07-12T02:05:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.123+0000 7fb1badff700 1 -- start start 2023-07-12T02:05:13.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.124+0000 7fb1badff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1b40d3730 0x7fb1b40cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:13.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.124+0000 7fb1badff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b40d0b20 con 0x7fb1b40b8430 2023-07-12T02:05:13.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.124+0000 7fb1badff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b40cfeb0 con 0x7fb1b40cfa90 2023-07-12T02:05:13.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.124+0000 7fb1badff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b40cda30 con 0x7fb1b40d3730 2023-07-12T02:05:13.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.125+0000 7fb1b8b9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb1b40b8430 0x7fb1b40cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38782/0 (socket says 172.21.15.37:38782) 2023-07-12T02:05:13.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.125+0000 7fb1b8b9b700 1 -- 172.21.15.37:0/1755244443 learned_addr learned my addr 172.21.15.37:0/1755244443 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:13.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.125+0000 7fb1b3fff700 1 --2- 172.21.15.37:0/1755244443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1b40d3730 0x7fb1b40cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:13.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.125+0000 7fb1b37fe700 1 -- 172.21.15.37:0/1755244443 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312394681 0 0) 0x7fb1b40d0b20 con 0x7fb1b40b8430 2023-07-12T02:05:13.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.125+0000 7fb1b37fe700 1 -- 172.21.15.37:0/1755244443 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a40035b0 con 0x7fb1b40b8430 2023-07-12T02:05:13.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.125+0000 7fb1b37fe700 1 -- 172.21.15.37:0/1755244443 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4261679825 0 0) 0x7fb1a40035b0 con 0x7fb1b40b8430 2023-07-12T02:05:13.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.125+0000 7fb1b37fe700 1 -- 172.21.15.37:0/1755244443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1b40d3730 msgr2=0x7fb1b40cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:13.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.125+0000 7fb1b37fe700 1 --2- 172.21.15.37:0/1755244443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1b40d3730 0x7fb1b40cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.125+0000 7fb1b37fe700 1 -- 172.21.15.37:0/1755244443 >> v1:172.21.15.196:6789/0 conn(0x7fb1b40cfa90 legacy=0x7fb1b40d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:13.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.125+0000 7fb1b37fe700 1 -- 172.21.15.37:0/1755244443 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b40b4ee0 con 0x7fb1b40b8430 2023-07-12T02:05:13.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.125+0000 7fb1b37fe700 1 -- 172.21.15.37:0/1755244443 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7fb1a8001670 con 0x7fb1b40b8430 2023-07-12T02:05:13.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.126+0000 7fb1b37fe700 1 -- 172.21.15.37:0/1755244443 >> v1:172.21.15.37:6789/0 conn(0x7fb1b40b8430 legacy=0x7fb1b40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.126+0000 7fb1b37fe700 1 --2- 172.21.15.37:0/1755244443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1a4003a30 0x7fb1a4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.126+0000 7fb1b37fe700 1 --2- 172.21.15.37:0/1755244443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1b40d3730 0x7fb1a4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.126+0000 7fb1b37fe700 1 --2- 172.21.15.37:0/1755244443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a4004d90 0x7fb1a4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.126+0000 7fb1b37fe700 1 -- 172.21.15.37:0/1755244443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a400baf0 con 0x7fb1a4004d90 2023-07-12T02:05:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.126+0000 7fb1b37fe700 1 -- 172.21.15.37:0/1755244443 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a400bc60 con 0x7fb1a4003a30 2023-07-12T02:05:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.126+0000 7fb1b37fe700 1 -- 172.21.15.37:0/1755244443 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a400be20 con 0x7fb1b40d3730 2023-07-12T02:05:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.126+0000 7fb1b939c700 1 --2- 172.21.15.37:0/1755244443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a4004d90 0x7fb1a4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:13.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.126+0000 7fb1b3fff700 1 --2- 172.21.15.37:0/1755244443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1b40d3730 0x7fb1a4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:13.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.126+0000 7fb1b8b9b700 1 --2- 172.21.15.37:0/1755244443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1a4003a30 0x7fb1a4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:13.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.126+0000 7fb1b939c700 1 -- 172.21.15.37:0/1755244443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1b40d3730 msgr2=0x7fb1a4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:13.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.126+0000 7fb1b939c700 1 --2- 172.21.15.37:0/1755244443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1b40d3730 0x7fb1a4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.126+0000 7fb1b939c700 1 -- 172.21.15.37:0/1755244443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1a4003a30 msgr2=0x7fb1a4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:13.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.126+0000 7fb1b939c700 1 --2- 172.21.15.37:0/1755244443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1a4003a30 0x7fb1a4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.126+0000 7fb1b939c700 1 -- 172.21.15.37:0/1755244443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a40035b0 con 0x7fb1a4004d90 2023-07-12T02:05:13.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.127+0000 7fb1b939c700 1 --2- 172.21.15.37:0/1755244443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a4004d90 0x7fb1a4005200 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00c190 tx=0x7fb1a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80247c2336141a1a server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:13.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.127+0000 7fb1b37fe700 1 -- 172.21.15.37:0/1755244443 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac001db0 con 0x7fb1a4004d90 2023-07-12T02:05:13.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.127+0000 7fb1b37fe700 1 -- 172.21.15.37:0/1755244443 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac00ccd0 con 0x7fb1a4004d90 2023-07-12T02:05:13.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.127+0000 7fb1b37fe700 1 -- 172.21.15.37:0/1755244443 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac003c40 con 0x7fb1a4004d90 2023-07-12T02:05:13.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.127+0000 7fb1badff700 1 -- 172.21.15.37:0/1755244443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a4004d90 msgr2=0x7fb1a4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:13.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.127+0000 7fb1badff700 1 --2- 172.21.15.37:0/1755244443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a4004d90 0x7fb1a4005200 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00c190 tx=0x7fb1a4005880 comp rx=0 tx=0).stop 2023-07-12T02:05:13.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.127+0000 7fb1b939c700 1 -- 172.21.15.37:0/1755244443 reap_dead start 2023-07-12T02:05:13.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.127+0000 7fb1badff700 1 -- 172.21.15.37:0/1755244443 shutdown_connections 2023-07-12T02:05:13.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.127+0000 7fb1badff700 1 -- 172.21.15.37:0/1755244443 >> 172.21.15.37:0/1755244443 conn(0x7fb1b406b3f0 msgr2=0x7fb1b406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:13.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.128+0000 7fb1badff700 1 -- 172.21.15.37:0/1755244443 shutdown_connections 2023-07-12T02:05:13.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.128+0000 7fb1badff700 1 -- 172.21.15.37:0/1755244443 wait complete. 2023-07-12T02:05:13.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.129+0000 7fb1badff700 1 Processor -- start 2023-07-12T02:05:13.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.130+0000 7fb1badff700 1 -- start start 2023-07-12T02:05:13.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.130+0000 7fb1badff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1a4004d90 0x7fb1b41470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:13.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.130+0000 7fb1badff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1b4158fe0 0x7fb1b41f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:13.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.130+0000 7fb1badff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1b415abf0 0x7fb1b41534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:13.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.130+0000 7fb1badff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b41f5850 con 0x7fb1b4158fe0 2023-07-12T02:05:13.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.130+0000 7fb1badff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b41597a0 con 0x7fb1b415abf0 2023-07-12T02:05:13.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.130+0000 7fb1badff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b4159a80 con 0x7fb1a4004d90 2023-07-12T02:05:13.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.131+0000 7fb1b3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1b4158fe0 0x7fb1b41f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:13.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.131+0000 7fb1b3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1b4158fe0 0x7fb1b41f5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49694/0 (socket says 172.21.15.37:49694) 2023-07-12T02:05:13.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.131+0000 7fb1b3fff700 1 -- 172.21.15.37:0/2423330742 learned_addr learned my addr 172.21.15.37:0/2423330742 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:13.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.131+0000 7fb1b8b9b700 1 --2- 172.21.15.37:0/2423330742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1a4004d90 0x7fb1b41470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:13.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.131+0000 7fb1b939c700 1 --2- 172.21.15.37:0/2423330742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1b415abf0 0x7fb1b41534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:13.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.131+0000 7fb1b3fff700 1 -- 172.21.15.37:0/2423330742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1a4004d90 msgr2=0x7fb1b41470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:13.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.131+0000 7fb1b3fff700 1 --2- 172.21.15.37:0/2423330742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1a4004d90 0x7fb1b41470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.131+0000 7fb1b3fff700 1 -- 172.21.15.37:0/2423330742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1b415abf0 msgr2=0x7fb1b41534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:13.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.131+0000 7fb1b3fff700 1 --2- 172.21.15.37:0/2423330742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1b415abf0 0x7fb1b41534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.131+0000 7fb1b3fff700 1 -- 172.21.15.37:0/2423330742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b4159d60 con 0x7fb1b4158fe0 2023-07-12T02:05:13.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.132+0000 7fb1b3fff700 1 --2- 172.21.15.37:0/2423330742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1b4158fe0 0x7fb1b41f5ce0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0011aa0 tx=0x7fb1a0011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:13.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.132+0000 7fb1b17fa700 1 -- 172.21.15.37:0/2423330742 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0011ee0 con 0x7fb1b4158fe0 2023-07-12T02:05:13.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.132+0000 7fb1b17fa700 1 -- 172.21.15.37:0/2423330742 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a000f940 con 0x7fb1b4158fe0 2023-07-12T02:05:13.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.132+0000 7fb1b17fa700 1 -- 172.21.15.37:0/2423330742 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a000fcf0 con 0x7fb1b4158fe0 2023-07-12T02:05:13.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.132+0000 7fb1badff700 1 -- 172.21.15.37:0/2423330742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b41f54e0 con 0x7fb1b4158fe0 2023-07-12T02:05:13.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.132+0000 7fb1badff700 1 -- 172.21.15.37:0/2423330742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b41f6220 con 0x7fb1b4158fe0 2023-07-12T02:05:13.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.133+0000 7fb1badff700 1 -- 172.21.15.37:0/2423330742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b40b2130 con 0x7fb1b4158fe0 2023-07-12T02:05:13.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.134+0000 7fb1b17fa700 1 -- 172.21.15.37:0/2423330742 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb1a0014440 con 0x7fb1b4158fe0 2023-07-12T02:05:13.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.135+0000 7fb1b17fa700 1 --2- 172.21.15.37:0/2423330742 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb19806ace0 0x7fb19806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:13.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.135+0000 7fb1b17fa700 1 -- 172.21.15.37:0/2423330742 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb1a0089e30 con 0x7fb1b4158fe0 2023-07-12T02:05:13.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.136+0000 7fb1b8b9b700 1 --2- 172.21.15.37:0/2423330742 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb19806ace0 0x7fb19806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:13.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.136+0000 7fb1b8b9b700 1 --2- 172.21.15.37:0/2423330742 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb19806ace0 0x7fb19806d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8001050 tx=0x7fb1a8000f80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:13.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.139+0000 7fb1b17fa700 1 -- 172.21.15.37:0/2423330742 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb1a0058660 con 0x7fb1b4158fe0 2023-07-12T02:05:13.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.344+0000 7fb1badff700 1 -- 172.21.15.37:0/2423330742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1b404ea60 con 0x7fb1b4158fe0 2023-07-12T02:05:13.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.344+0000 7fb1b17fa700 1 -- 172.21.15.37:0/2423330742 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1a0022020 con 0x7fb1b4158fe0 2023-07-12T02:05:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:05:13.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.347+0000 7fb1badff700 1 -- 172.21.15.37:0/2423330742 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb19806ace0 msgr2=0x7fb19806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:13.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.347+0000 7fb1badff700 1 --2- 172.21.15.37:0/2423330742 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb19806ace0 0x7fb19806d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8001050 tx=0x7fb1a8000f80 comp rx=0 tx=0).stop 2023-07-12T02:05:13.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.347+0000 7fb1badff700 1 -- 172.21.15.37:0/2423330742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1b4158fe0 msgr2=0x7fb1b41f5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:13.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.347+0000 7fb1badff700 1 --2- 172.21.15.37:0/2423330742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1b4158fe0 0x7fb1b41f5ce0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0011aa0 tx=0x7fb1a0011db0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.347+0000 7fb1badff700 1 -- 172.21.15.37:0/2423330742 shutdown_connections 2023-07-12T02:05:13.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.347+0000 7fb1badff700 1 --2- 172.21.15.37:0/2423330742 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb19806ace0 0x7fb19806d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.347+0000 7fb1badff700 1 --2- 172.21.15.37:0/2423330742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1b415abf0 0x7fb1b41534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.347+0000 7fb1badff700 1 --2- 172.21.15.37:0/2423330742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1a4004d90 0x7fb1b41470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.347+0000 7fb1badff700 1 --2- 172.21.15.37:0/2423330742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1b4158fe0 0x7fb1b41f5ce0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.347+0000 7fb1badff700 1 -- 172.21.15.37:0/2423330742 >> 172.21.15.37:0/2423330742 conn(0x7fb1b406b3f0 msgr2=0x7fb1b40b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:13.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.347+0000 7fb1badff700 1 -- 172.21.15.37:0/2423330742 shutdown_connections 2023-07-12T02:05:13.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.347+0000 7fb1badff700 1 -- 172.21.15.37:0/2423330742 wait complete. 2023-07-12T02:05:13.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:05:13.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.569+0000 7f8b34bff700 1 Processor -- start 2023-07-12T02:05:13.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.569+0000 7f8b34bff700 1 -- start start 2023-07-12T02:05:13.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.570+0000 7f8b34bff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8b300b8430 0x7f8b300cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:13.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.570+0000 7f8b34bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b300cfc60 0x7f8b300d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:13.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.570+0000 7f8b34bff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b300d0b20 con 0x7f8b300d3730 2023-07-12T02:05:13.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.570+0000 7f8b34bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b300b8800 con 0x7f8b300cfc60 2023-07-12T02:05:13.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.570+0000 7f8b34bff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b300b4ee0 con 0x7f8b300b8430 2023-07-12T02:05:13.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.570+0000 7f8b2ed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b300cfc60 0x7f8b300d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:13.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.570+0000 7f8b2ed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b300cfc60 0x7f8b300d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49710/0 (socket says 172.21.15.37:49710) 2023-07-12T02:05:13.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.570+0000 7f8b2ed9d700 1 -- 172.21.15.37:0/3650007554 learned_addr learned my addr 172.21.15.37:0/3650007554 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.571+0000 7f8b2e59c700 1 --2- 172.21.15.37:0/3650007554 >> v2:172.21.15.196:3300/0 conn(0x7f8b300b8430 0x7f8b300cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.571+0000 7f8b2ed9d700 1 -- 172.21.15.37:0/3650007554 >> v2:172.21.15.196:3300/0 conn(0x7f8b300b8430 msgr2=0x7f8b300cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.571+0000 7f8b2ed9d700 1 --2- 172.21.15.37:0/3650007554 >> v2:172.21.15.196:3300/0 conn(0x7f8b300b8430 0x7f8b300cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.571+0000 7f8b2ed9d700 1 -- 172.21.15.37:0/3650007554 >> v1:172.21.15.196:6789/0 conn(0x7f8b300d3730 legacy=0x7f8b300cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.571+0000 7f8b2ed9d700 1 -- 172.21.15.37:0/3650007554 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b300b51c0 con 0x7f8b300cfc60 2023-07-12T02:05:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.571+0000 7f8b2ed9d700 1 --2- 172.21.15.37:0/3650007554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b300cfc60 0x7f8b300d0fb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8b300cf520 tx=0x7f8b2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e7eb67e081a5db server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.571+0000 7f8b2dd9b700 1 -- 172.21.15.37:0/3650007554 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2800e070 con 0x7f8b300cfc60 2023-07-12T02:05:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.571+0000 7f8b2dd9b700 1 -- 172.21.15.37:0/3650007554 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b28003a20 con 0x7f8b300cfc60 2023-07-12T02:05:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.571+0000 7f8b2dd9b700 1 -- 172.21.15.37:0/3650007554 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b28003dd0 con 0x7f8b300cfc60 2023-07-12T02:05:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.572+0000 7f8b34bff700 1 -- 172.21.15.37:0/3650007554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b300cfc60 msgr2=0x7f8b300d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.572+0000 7f8b34bff700 1 --2- 172.21.15.37:0/3650007554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b300cfc60 0x7f8b300d0fb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8b300cf520 tx=0x7f8b2800b330 comp rx=0 tx=0).stop 2023-07-12T02:05:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.572+0000 7f8b34bff700 1 -- 172.21.15.37:0/3650007554 shutdown_connections 2023-07-12T02:05:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.572+0000 7f8b34bff700 1 --2- 172.21.15.37:0/3650007554 >> v2:172.21.15.196:3300/0 conn(0x7f8b300b8430 0x7f8b300cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.572+0000 7f8b34bff700 1 --2- 172.21.15.37:0/3650007554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b300cfc60 0x7f8b300d0fb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.572+0000 7f8b34bff700 1 -- 172.21.15.37:0/3650007554 >> 172.21.15.37:0/3650007554 conn(0x7f8b3006b3f0 msgr2=0x7f8b3006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:13.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.572+0000 7f8b34bff700 1 -- 172.21.15.37:0/3650007554 shutdown_connections 2023-07-12T02:05:13.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.572+0000 7f8b34bff700 1 -- 172.21.15.37:0/3650007554 wait complete. 2023-07-12T02:05:13.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.574+0000 7f8b34bff700 1 Processor -- start 2023-07-12T02:05:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.575+0000 7f8b34bff700 1 -- start start 2023-07-12T02:05:13.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.576+0000 7f8b34bff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b300b8430 0x7f8b300c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:13.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.576+0000 7f8b34bff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b300cfc60 0x7f8b301f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:13.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.576+0000 7f8b34bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b300d3730 0x7f8b3014c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:13.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.576+0000 7f8b34bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b301f5750 con 0x7f8b300d3730 2023-07-12T02:05:13.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.576+0000 7f8b34bff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b301f5a20 con 0x7f8b300cfc60 2023-07-12T02:05:13.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.576+0000 7f8b34bff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b301f5d00 con 0x7f8b300b8430 2023-07-12T02:05:13.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.576+0000 7f8b2ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b300d3730 0x7f8b3014c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:13.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.576+0000 7f8b2ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b300d3730 0x7f8b3014c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49716/0 (socket says 172.21.15.37:49716) 2023-07-12T02:05:13.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.576+0000 7f8b2ed9d700 1 -- 172.21.15.37:0/2174530334 learned_addr learned my addr 172.21.15.37:0/2174530334 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:13.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.576+0000 7f8b2e59c700 1 --2- 172.21.15.37:0/2174530334 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b300b8430 0x7f8b300c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:13.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.577+0000 7f8b27fff700 1 --2- 172.21.15.37:0/2174530334 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b300cfc60 0x7f8b301f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.577+0000 7f8b2ed9d700 1 -- 172.21.15.37:0/2174530334 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b300b8430 msgr2=0x7f8b300c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.577+0000 7f8b2ed9d700 1 --2- 172.21.15.37:0/2174530334 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b300b8430 0x7f8b300c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.577+0000 7f8b2ed9d700 1 -- 172.21.15.37:0/2174530334 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b300cfc60 msgr2=0x7f8b301f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.577+0000 7f8b2ed9d700 1 --2- 172.21.15.37:0/2174530334 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b300cfc60 0x7f8b301f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.577+0000 7f8b2ed9d700 1 -- 172.21.15.37:0/2174530334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b28009b30 con 0x7f8b300d3730 2023-07-12T02:05:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.577+0000 7f8b2ed9d700 1 --2- 172.21.15.37:0/2174530334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b300d3730 0x7f8b3014c100 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8b2800b370 tx=0x7f8b28004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.577+0000 7f8b26ffd700 1 -- 172.21.15.37:0/2174530334 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b28004440 con 0x7f8b300d3730 2023-07-12T02:05:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.577+0000 7f8b26ffd700 1 -- 172.21.15.37:0/2174530334 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b280045c0 con 0x7f8b300d3730 2023-07-12T02:05:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.577+0000 7f8b26ffd700 1 -- 172.21.15.37:0/2174530334 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b28004970 con 0x7f8b300d3730 2023-07-12T02:05:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.577+0000 7f8b34bff700 1 -- 172.21.15.37:0/2174530334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3014c9d0 con 0x7f8b300d3730 2023-07-12T02:05:13.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.577+0000 7f8b34bff700 1 -- 172.21.15.37:0/2174530334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b301f5fe0 con 0x7f8b300d3730 2023-07-12T02:05:13.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.579+0000 7f8b34bff700 1 -- 172.21.15.37:0/2174530334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3014ce90 con 0x7f8b300d3730 2023-07-12T02:05:13.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.579+0000 7f8b26ffd700 1 -- 172.21.15.37:0/2174530334 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b28012430 con 0x7f8b300d3730 2023-07-12T02:05:13.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.581+0000 7f8b26ffd700 1 --2- 172.21.15.37:0/2174530334 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b1006ace0 0x7f8b1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:13.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.581+0000 7f8b26ffd700 1 -- 172.21.15.37:0/2174530334 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8b2808ab10 con 0x7f8b300d3730 2023-07-12T02:05:13.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.581+0000 7f8b2e59c700 1 --2- 172.21.15.37:0/2174530334 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b1006ace0 0x7f8b1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:13.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.582+0000 7f8b2e59c700 1 --2- 172.21.15.37:0/2174530334 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b1006ace0 0x7f8b1006d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8b20006b20 tx=0x7f8b20008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:13.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.585+0000 7f8b26ffd700 1 -- 172.21.15.37:0/2174530334 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8b280593b0 con 0x7f8b300d3730 2023-07-12T02:05:13.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.793+0000 7f8b34bff700 1 -- 172.21.15.37:0/2174530334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b3004ea60 con 0x7f8b300d3730 2023-07-12T02:05:13.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.794+0000 7f8b26ffd700 1 -- 172.21.15.37:0/2174530334 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b28058f40 con 0x7f8b300d3730 2023-07-12T02:05:13.797 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-12T02:05:13.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.796+0000 7f8b34bff700 1 -- 172.21.15.37:0/2174530334 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b1006ace0 msgr2=0x7f8b1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:13.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.796+0000 7f8b34bff700 1 --2- 172.21.15.37:0/2174530334 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b1006ace0 0x7f8b1006d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8b20006b20 tx=0x7f8b20008040 comp rx=0 tx=0).stop 2023-07-12T02:05:13.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.796+0000 7f8b34bff700 1 -- 172.21.15.37:0/2174530334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b300d3730 msgr2=0x7f8b3014c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:13.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.796+0000 7f8b34bff700 1 --2- 172.21.15.37:0/2174530334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b300d3730 0x7f8b3014c100 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8b2800b370 tx=0x7f8b28004ad0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.796+0000 7f8b34bff700 1 -- 172.21.15.37:0/2174530334 shutdown_connections 2023-07-12T02:05:13.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.796+0000 7f8b34bff700 1 --2- 172.21.15.37:0/2174530334 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8b1006ace0 0x7f8b1006d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.796+0000 7f8b34bff700 1 --2- 172.21.15.37:0/2174530334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b300d3730 0x7f8b3014c100 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.796+0000 7f8b34bff700 1 --2- 172.21.15.37:0/2174530334 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b300b8430 0x7f8b300c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.796+0000 7f8b34bff700 1 --2- 172.21.15.37:0/2174530334 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b300cfc60 0x7f8b301f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:13.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.796+0000 7f8b34bff700 1 -- 172.21.15.37:0/2174530334 >> 172.21.15.37:0/2174530334 conn(0x7f8b3006b3f0 msgr2=0x7f8b300d1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:13.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.796+0000 7f8b34bff700 1 -- 172.21.15.37:0/2174530334 shutdown_connections 2023-07-12T02:05:13.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:13.796+0000 7f8b34bff700 1 -- 172.21.15.37:0/2174530334 wait complete. 2023-07-12T02:05:13.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-12T02:05:14.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.017+0000 7fae2d1ff700 1 Processor -- start 2023-07-12T02:05:14.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.017+0000 7fae2d1ff700 1 -- start start 2023-07-12T02:05:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.018+0000 7fae2d1ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fae2815c3e0 0x7fae280b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.018+0000 7fae2d1ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae280ccd30 0x7fae280af150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.018+0000 7fae2d1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae280b0440 con 0x7fae2815fec0 2023-07-12T02:05:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.018+0000 7fae2d1ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae280cd180 con 0x7fae2815c3e0 2023-07-12T02:05:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.018+0000 7fae2d1ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2815c7b0 con 0x7fae280ccd30 2023-07-12T02:05:14.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.019+0000 7fae2759e700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fae2815fec0 0x7fae280c9e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38794/0 (socket says 172.21.15.37:38794) 2023-07-12T02:05:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.019+0000 7fae2759e700 1 -- 172.21.15.37:0/3620881339 learned_addr learned my addr 172.21.15.37:0/3620881339 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.019+0000 7fae26d9d700 1 --2- 172.21.15.37:0/3620881339 >> v2:172.21.15.196:3300/0 conn(0x7fae2815c3e0 0x7fae280b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.019+0000 7fae2659c700 1 --2- 172.21.15.37:0/3620881339 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae280ccd30 0x7fae280af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.019+0000 7fae25d9b700 1 -- 172.21.15.37:0/3620881339 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118259650 0 0) 0x7fae280b0440 con 0x7fae2815fec0 2023-07-12T02:05:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.019+0000 7fae25d9b700 1 -- 172.21.15.37:0/3620881339 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae100035b0 con 0x7fae2815fec0 2023-07-12T02:05:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.019+0000 7fae2659c700 1 -- 172.21.15.37:0/3620881339 >> v2:172.21.15.196:3300/0 conn(0x7fae2815c3e0 msgr2=0x7fae280b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.019+0000 7fae2659c700 1 --2- 172.21.15.37:0/3620881339 >> v2:172.21.15.196:3300/0 conn(0x7fae2815c3e0 0x7fae280b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.019+0000 7fae2659c700 1 -- 172.21.15.37:0/3620881339 >> v1:172.21.15.37:6789/0 conn(0x7fae2815fec0 legacy=0x7fae280c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.019+0000 7fae2659c700 1 -- 172.21.15.37:0/3620881339 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae280af830 con 0x7fae280ccd30 2023-07-12T02:05:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.020+0000 7fae2659c700 1 --2- 172.21.15.37:0/3620881339 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae280ccd30 0x7fae280af150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae1c009840 tx=0x7fae1c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5019e3fee728bd79 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.020+0000 7fae25d9b700 1 -- 172.21.15.37:0/3620881339 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c011830 con 0x7fae280ccd30 2023-07-12T02:05:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.020+0000 7fae25d9b700 1 -- 172.21.15.37:0/3620881339 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c011990 con 0x7fae280ccd30 2023-07-12T02:05:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.020+0000 7fae25d9b700 1 -- 172.21.15.37:0/3620881339 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c011d20 con 0x7fae280ccd30 2023-07-12T02:05:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.021+0000 7fae2d1ff700 1 -- 172.21.15.37:0/3620881339 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae280ccd30 msgr2=0x7fae280af150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.021+0000 7fae2d1ff700 1 --2- 172.21.15.37:0/3620881339 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae280ccd30 0x7fae280af150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae1c009840 tx=0x7fae1c009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.021+0000 7fae2d1ff700 1 -- 172.21.15.37:0/3620881339 shutdown_connections 2023-07-12T02:05:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.021+0000 7fae2d1ff700 1 --2- 172.21.15.37:0/3620881339 >> v2:172.21.15.196:3300/0 conn(0x7fae2815c3e0 0x7fae280b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.021+0000 7fae2d1ff700 1 --2- 172.21.15.37:0/3620881339 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae280ccd30 0x7fae280af150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.021+0000 7fae2d1ff700 1 -- 172.21.15.37:0/3620881339 >> 172.21.15.37:0/3620881339 conn(0x7fae2806b960 msgr2=0x7fae28098a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.021+0000 7fae2d1ff700 1 -- 172.21.15.37:0/3620881339 shutdown_connections 2023-07-12T02:05:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.021+0000 7fae2d1ff700 1 -- 172.21.15.37:0/3620881339 wait complete. 2023-07-12T02:05:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.022+0000 7fae2d1ff700 1 Processor -- start 2023-07-12T02:05:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.023+0000 7fae2d1ff700 1 -- start start 2023-07-12T02:05:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.023+0000 7fae2d1ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae280ccd30 0x7fae28157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.023+0000 7fae2d1ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae2815c3e0 0x7fae280b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.024+0000 7fae2d1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2815fec0 0x7fae28156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.024+0000 7fae2d1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae281e7200 con 0x7fae2815fec0 2023-07-12T02:05:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.024+0000 7fae2d1ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2815d220 con 0x7fae2815c3e0 2023-07-12T02:05:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.024+0000 7fae2d1ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae281e6f20 con 0x7fae280ccd30 2023-07-12T02:05:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.024+0000 7fae2759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2815fec0 0x7fae28156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.024+0000 7fae2759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2815fec0 0x7fae28156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49720/0 (socket says 172.21.15.37:49720) 2023-07-12T02:05:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.024+0000 7fae2759e700 1 -- 172.21.15.37:0/3785277180 learned_addr learned my addr 172.21.15.37:0/3785277180 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.024+0000 7fae26d9d700 1 --2- 172.21.15.37:0/3785277180 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae280ccd30 0x7fae28157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.024+0000 7fae2659c700 1 --2- 172.21.15.37:0/3785277180 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae2815c3e0 0x7fae280b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.024+0000 7fae2759e700 1 -- 172.21.15.37:0/3785277180 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae280ccd30 msgr2=0x7fae28157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.024+0000 7fae2759e700 1 --2- 172.21.15.37:0/3785277180 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae280ccd30 0x7fae28157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.024+0000 7fae2759e700 1 -- 172.21.15.37:0/3785277180 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae2815c3e0 msgr2=0x7fae280b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.024+0000 7fae2759e700 1 --2- 172.21.15.37:0/3785277180 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae2815c3e0 0x7fae280b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.024+0000 7fae2759e700 1 -- 172.21.15.37:0/3785277180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c0094a0 con 0x7fae2815fec0 2023-07-12T02:05:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.024+0000 7fae26d9d700 1 --2- 172.21.15.37:0/3785277180 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae280ccd30 0x7fae28157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.024+0000 7fae2759e700 1 --2- 172.21.15.37:0/3785277180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2815fec0 0x7fae28156960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fae2000caa0 tx=0x7fae2000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.025+0000 7fae0f7fe700 1 -- 172.21.15.37:0/3785277180 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2000a9e0 con 0x7fae2815fec0 2023-07-12T02:05:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.025+0000 7fae0f7fe700 1 -- 172.21.15.37:0/3785277180 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2000ab40 con 0x7fae2815fec0 2023-07-12T02:05:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.025+0000 7fae0f7fe700 1 -- 172.21.15.37:0/3785277180 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20012400 con 0x7fae2815fec0 2023-07-12T02:05:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.025+0000 7fae2d1ff700 1 -- 172.21.15.37:0/3785277180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2815cb60 con 0x7fae2815fec0 2023-07-12T02:05:14.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.025+0000 7fae2d1ff700 1 -- 172.21.15.37:0/3785277180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae28156ea0 con 0x7fae2815fec0 2023-07-12T02:05:14.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.026+0000 7fae2d1ff700 1 -- 172.21.15.37:0/3785277180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae280cd650 con 0x7fae2815fec0 2023-07-12T02:05:14.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.027+0000 7fae0f7fe700 1 -- 172.21.15.37:0/3785277180 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae2001b3b0 con 0x7fae2815fec0 2023-07-12T02:05:14.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.028+0000 7fae0f7fe700 1 --2- 172.21.15.37:0/3785277180 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fae1406ace0 0x7fae1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:14.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.028+0000 7fae0f7fe700 1 -- 172.21.15.37:0/3785277180 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fae200895a0 con 0x7fae2815fec0 2023-07-12T02:05:14.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.029+0000 7fae26d9d700 1 --2- 172.21.15.37:0/3785277180 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fae1406ace0 0x7fae1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:14.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.029+0000 7fae26d9d700 1 --2- 172.21.15.37:0/3785277180 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fae1406ace0 0x7fae1406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fae281e7b20 tx=0x7fae18008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:14.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.033+0000 7fae0f7fe700 1 -- 172.21.15.37:0/3785277180 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fae20054310 con 0x7fae2815fec0 2023-07-12T02:05:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.242+0000 7fae2d1ff700 1 -- 172.21.15.37:0/3785277180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fae2815c9c0 con 0x7fae2815fec0 2023-07-12T02:05:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.243+0000 7fae0f7fe700 1 -- 172.21.15.37:0/3785277180 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fae2815c9c0 con 0x7fae2815fec0 2023-07-12T02:05:14.247 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:05:14.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.245+0000 7fae2d1ff700 1 -- 172.21.15.37:0/3785277180 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fae1406ace0 msgr2=0x7fae1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:14.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.245+0000 7fae2d1ff700 1 --2- 172.21.15.37:0/3785277180 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fae1406ace0 0x7fae1406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fae281e7b20 tx=0x7fae18008040 comp rx=0 tx=0).stop 2023-07-12T02:05:14.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.245+0000 7fae2d1ff700 1 -- 172.21.15.37:0/3785277180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2815fec0 msgr2=0x7fae28156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:14.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.245+0000 7fae2d1ff700 1 --2- 172.21.15.37:0/3785277180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2815fec0 0x7fae28156960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fae2000caa0 tx=0x7fae2000cdb0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.245+0000 7fae2d1ff700 1 -- 172.21.15.37:0/3785277180 shutdown_connections 2023-07-12T02:05:14.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.245+0000 7fae2d1ff700 1 --2- 172.21.15.37:0/3785277180 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fae1406ace0 0x7fae1406d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.245+0000 7fae2d1ff700 1 --2- 172.21.15.37:0/3785277180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2815fec0 0x7fae28156960 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.245+0000 7fae2d1ff700 1 --2- 172.21.15.37:0/3785277180 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae280ccd30 0x7fae28157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.245+0000 7fae2d1ff700 1 --2- 172.21.15.37:0/3785277180 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae2815c3e0 0x7fae280b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.245+0000 7fae2d1ff700 1 -- 172.21.15.37:0/3785277180 >> 172.21.15.37:0/3785277180 conn(0x7fae2806b960 msgr2=0x7fae281602c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:14.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.245+0000 7fae2d1ff700 1 -- 172.21.15.37:0/3785277180 shutdown_connections 2023-07-12T02:05:14.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.245+0000 7fae2d1ff700 1 -- 172.21.15.37:0/3785277180 wait complete. 2023-07-12T02:05:14.267 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-12T02:05:14.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.465+0000 7fa8f81ff700 1 Processor -- start 2023-07-12T02:05:14.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.465+0000 7fa8f81ff700 1 -- start start 2023-07-12T02:05:14.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.466+0000 7fa8f81ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8f00d2640 0x7fa8f00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:14.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.466+0000 7fa8f81ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8f00cf8f0 0x7fa8f015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:14.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.466+0000 7fa8f81ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f00d1790 con 0x7fa8f015c460 2023-07-12T02:05:14.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.466+0000 7fa8f81ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f00cedd0 con 0x7fa8f00cf8f0 2023-07-12T02:05:14.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.466+0000 7fa8f81ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00cd950 con 0x7fa8f00d2640 2023-07-12T02:05:14.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.466+0000 7fa8f679c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8f00cf8f0 0x7fa8f015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:14.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.467+0000 7fa8f679c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8f00cf8f0 0x7fa8f015fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49722/0 (socket says 172.21.15.37:49722) 2023-07-12T02:05:14.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.467+0000 7fa8f679c700 1 -- 172.21.15.37:0/2431041548 learned_addr learned my addr 172.21.15.37:0/2431041548 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:14.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.467+0000 7fa8f579a700 1 --2- 172.21.15.37:0/2431041548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8f00d2640 0x7fa8f00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:14.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.467+0000 7fa8f679c700 1 -- 172.21.15.37:0/2431041548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8f00d2640 msgr2=0x7fa8f00b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:14.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.467+0000 7fa8f679c700 1 --2- 172.21.15.37:0/2431041548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8f00d2640 0x7fa8f00b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.467+0000 7fa8f679c700 1 -- 172.21.15.37:0/2431041548 >> v1:172.21.15.196:6789/0 conn(0x7fa8f015c460 legacy=0x7fa8f00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:14.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.467+0000 7fa8f679c700 1 -- 172.21.15.37:0/2431041548 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f00d14b0 con 0x7fa8f00cf8f0 2023-07-12T02:05:14.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.467+0000 7fa8f579a700 1 --2- 172.21.15.37:0/2431041548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8f00d2640 0x7fa8f00b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:14.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.467+0000 7fa8f679c700 1 --2- 172.21.15.37:0/2431041548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f00cf8f0 0x7fa8f015fe20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009e50 tx=0x7fa8e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6d3837e5574806 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:14.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.467+0000 7fa8f4f99700 1 -- 172.21.15.37:0/2431041548 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800e070 con 0x7fa8f00cf8f0 2023-07-12T02:05:14.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.467+0000 7fa8f4f99700 1 -- 172.21.15.37:0/2431041548 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e8003a20 con 0x7fa8f00cf8f0 2023-07-12T02:05:14.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.467+0000 7fa8f4f99700 1 -- 172.21.15.37:0/2431041548 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8003dd0 con 0x7fa8f00cf8f0 2023-07-12T02:05:14.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.468+0000 7fa8f81ff700 1 -- 172.21.15.37:0/2431041548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f00cf8f0 msgr2=0x7fa8f015fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.468+0000 7fa8f81ff700 1 --2- 172.21.15.37:0/2431041548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f00cf8f0 0x7fa8f015fe20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009e50 tx=0x7fa8e800b330 comp rx=0 tx=0).stop 2023-07-12T02:05:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.468+0000 7fa8f81ff700 1 -- 172.21.15.37:0/2431041548 shutdown_connections 2023-07-12T02:05:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.468+0000 7fa8f81ff700 1 --2- 172.21.15.37:0/2431041548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f00cf8f0 0x7fa8f015fe20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.468+0000 7fa8f81ff700 1 --2- 172.21.15.37:0/2431041548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8f00d2640 0x7fa8f00b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.468+0000 7fa8f81ff700 1 -- 172.21.15.37:0/2431041548 >> 172.21.15.37:0/2431041548 conn(0x7fa8f0071660 msgr2=0x7fa8f0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.468+0000 7fa8f81ff700 1 -- 172.21.15.37:0/2431041548 shutdown_connections 2023-07-12T02:05:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.468+0000 7fa8f81ff700 1 -- 172.21.15.37:0/2431041548 wait complete. 2023-07-12T02:05:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.470+0000 7fa8f81ff700 1 Processor -- start 2023-07-12T02:05:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.471+0000 7fa8f81ff700 1 -- start start 2023-07-12T02:05:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.472+0000 7fa8f81ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8f00cf8f0 0x7fa8f0145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.472+0000 7fa8f81ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8f00d2640 0x7fa8f00c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.472+0000 7fa8f81ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f015c460 0x7fa8f00c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.472+0000 7fa8f81ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f01e8750 con 0x7fa8f015c460 2023-07-12T02:05:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.472+0000 7fa8f81ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f0145a40 con 0x7fa8f00cf8f0 2023-07-12T02:05:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.472+0000 7fa8f81ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f01e8be0 con 0x7fa8f00d2640 2023-07-12T02:05:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.472+0000 7fa8f679c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f015c460 0x7fa8f00c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.472+0000 7fa8f679c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f015c460 0x7fa8f00c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49738/0 (socket says 172.21.15.37:49738) 2023-07-12T02:05:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.472+0000 7fa8f579a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8f00d2640 0x7fa8f00c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.472+0000 7fa8f679c700 1 -- 172.21.15.37:0/3414497100 learned_addr learned my addr 172.21.15.37:0/3414497100 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.472+0000 7fa8f5f9b700 1 --2- 172.21.15.37:0/3414497100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8f00cf8f0 0x7fa8f0145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:14.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.473+0000 7fa8f679c700 1 -- 172.21.15.37:0/3414497100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8f00d2640 msgr2=0x7fa8f00c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:14.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.473+0000 7fa8f679c700 1 --2- 172.21.15.37:0/3414497100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8f00d2640 0x7fa8f00c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.473+0000 7fa8f679c700 1 -- 172.21.15.37:0/3414497100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8f00cf8f0 msgr2=0x7fa8f0145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:14.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.473+0000 7fa8f679c700 1 --2- 172.21.15.37:0/3414497100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8f00cf8f0 0x7fa8f0145500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.473+0000 7fa8f679c700 1 -- 172.21.15.37:0/3414497100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e8009b30 con 0x7fa8f015c460 2023-07-12T02:05:14.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.473+0000 7fa8f679c700 1 --2- 172.21.15.37:0/3414497100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f015c460 0x7fa8f00c8da0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800b730 tx=0x7fa8e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:14.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.473+0000 7fa8e67fc700 1 -- 172.21.15.37:0/3414497100 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80094d0 con 0x7fa8f015c460 2023-07-12T02:05:14.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.473+0000 7fa8e67fc700 1 -- 172.21.15.37:0/3414497100 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e8004240 con 0x7fa8f015c460 2023-07-12T02:05:14.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.473+0000 7fa8f81ff700 1 -- 172.21.15.37:0/3414497100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f01f2930 con 0x7fa8f015c460 2023-07-12T02:05:14.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.473+0000 7fa8e67fc700 1 -- 172.21.15.37:0/3414497100 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80045f0 con 0x7fa8f015c460 2023-07-12T02:05:14.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.474+0000 7fa8f81ff700 1 -- 172.21.15.37:0/3414497100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f01e7e20 con 0x7fa8f015c460 2023-07-12T02:05:14.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.474+0000 7fa8f81ff700 1 -- 172.21.15.37:0/3414497100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f004ea60 con 0x7fa8f015c460 2023-07-12T02:05:14.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.476+0000 7fa8e67fc700 1 -- 172.21.15.37:0/3414497100 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa8e8019070 con 0x7fa8f015c460 2023-07-12T02:05:14.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.477+0000 7fa8e67fc700 1 --2- 172.21.15.37:0/3414497100 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa8d406ace0 0x7fa8d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.477+0000 7fa8e67fc700 1 -- 172.21.15.37:0/3414497100 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa8e808a9a0 con 0x7fa8f015c460 2023-07-12T02:05:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.477+0000 7fa8f5f9b700 1 --2- 172.21.15.37:0/3414497100 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa8d406ace0 0x7fa8d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.478+0000 7fa8f5f9b700 1 --2- 172.21.15.37:0/3414497100 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa8d406ace0 0x7fa8d406d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec007fd0 tx=0x7fa8ec007ec0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.481+0000 7fa8e67fc700 1 -- 172.21.15.37:0/3414497100 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa8e8055710 con 0x7fa8f015c460 2023-07-12T02:05:14.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.708+0000 7fa8f81ff700 1 -- 172.21.15.37:0/3414497100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa8f00b4fa0 con 0x7fa8f015c460 2023-07-12T02:05:14.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.708+0000 7fa8e67fc700 1 -- 172.21.15.37:0/3414497100 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa8e8058d30 con 0x7fa8f015c460 2023-07-12T02:05:14.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.710+0000 7fa8f81ff700 1 -- 172.21.15.37:0/3414497100 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa8d406ace0 msgr2=0x7fa8d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:14.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.710+0000 7fa8f81ff700 1 --2- 172.21.15.37:0/3414497100 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa8d406ace0 0x7fa8d406d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec007fd0 tx=0x7fa8ec007ec0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.710+0000 7fa8f81ff700 1 -- 172.21.15.37:0/3414497100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f015c460 msgr2=0x7fa8f00c8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:14.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.710+0000 7fa8f81ff700 1 --2- 172.21.15.37:0/3414497100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f015c460 0x7fa8f00c8da0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800b730 tx=0x7fa8e8004ad0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.711+0000 7fa8f81ff700 1 -- 172.21.15.37:0/3414497100 shutdown_connections 2023-07-12T02:05:14.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.711+0000 7fa8f81ff700 1 --2- 172.21.15.37:0/3414497100 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa8d406ace0 0x7fa8d406d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.711+0000 7fa8f81ff700 1 --2- 172.21.15.37:0/3414497100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f015c460 0x7fa8f00c8da0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.711+0000 7fa8f81ff700 1 --2- 172.21.15.37:0/3414497100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8f00cf8f0 0x7fa8f0145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.711+0000 7fa8f81ff700 1 --2- 172.21.15.37:0/3414497100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8f00d2640 0x7fa8f00c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:14.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.711+0000 7fa8f81ff700 1 -- 172.21.15.37:0/3414497100 >> 172.21.15.37:0/3414497100 conn(0x7fa8f0071660 msgr2=0x7fa8f00b6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:14.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.711+0000 7fa8f81ff700 1 -- 172.21.15.37:0/3414497100 shutdown_connections 2023-07-12T02:05:14.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:14.711+0000 7fa8f81ff700 1 -- 172.21.15.37:0/3414497100 wait complete. 2023-07-12T02:05:14.716 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-12T02:05:14.731 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-12T02:05:14.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:14.732 DEBUG:teuthology.orchestra.run.smithi196:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-12T02:05:14.822 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi196.front.sepia.ceph.com 2023-07-12T02:05:14.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:14.823 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-12T02:05:14.875 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:05:14.876 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:05:14.921 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:05:14.922 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:05:15.006 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:05:15.007 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:05:15.091 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:05:15.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.329+0000 7fb8a61ff700 1 Processor -- start 2023-07-12T02:05:15.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.329+0000 7fb8a61ff700 1 -- start start 2023-07-12T02:05:15.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.330+0000 7fb8a61ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8a015c460 0x7fb8a00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:15.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.330+0000 7fb8a61ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8a00d2640 0x7fb8a00cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:15.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.330+0000 7fb8a61ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a00d1790 con 0x7fb8a00cf720 2023-07-12T02:05:15.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.330+0000 7fb8a61ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a00cedd0 con 0x7fb8a00d2640 2023-07-12T02:05:15.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.330+0000 7fb8a61ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a00cd950 con 0x7fb8a015c460 2023-07-12T02:05:15.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.330+0000 7fb89effd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8a00d2640 0x7fb8a00cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:15.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.331+0000 7fb89effd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8a00d2640 0x7fb8a00cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49752/0 (socket says 172.21.15.37:49752) 2023-07-12T02:05:15.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.331+0000 7fb89effd700 1 -- 172.21.15.37:0/1035343408 learned_addr learned my addr 172.21.15.37:0/1035343408 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:15.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.331+0000 7fb89f7fe700 1 --2- 172.21.15.37:0/1035343408 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8a015c460 0x7fb8a00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:15.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.331+0000 7fb89effd700 1 -- 172.21.15.37:0/1035343408 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8a015c460 msgr2=0x7fb8a00b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:15.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.331+0000 7fb89effd700 1 --2- 172.21.15.37:0/1035343408 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8a015c460 0x7fb8a00b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.331+0000 7fb89effd700 1 -- 172.21.15.37:0/1035343408 >> v1:172.21.15.37:6789/0 conn(0x7fb8a00cf720 legacy=0x7fb8a00d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:15.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.331+0000 7fb89effd700 1 -- 172.21.15.37:0/1035343408 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a00d14b0 con 0x7fb8a00d2640 2023-07-12T02:05:15.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.331+0000 7fb89f7fe700 1 --2- 172.21.15.37:0/1035343408 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8a015c460 0x7fb8a00b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:15.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.331+0000 7fb89effd700 1 --2- 172.21.15.37:0/1035343408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8a00d2640 0x7fb8a00cf1e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb8940098f0 tx=0x7fb894009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27f38d192dd5b86 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:15.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.332+0000 7fb89e7fc700 1 -- 172.21.15.37:0/1035343408 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89400b8a0 con 0x7fb8a00d2640 2023-07-12T02:05:15.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.332+0000 7fb89e7fc700 1 -- 172.21.15.37:0/1035343408 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89400ba00 con 0x7fb8a00d2640 2023-07-12T02:05:15.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.332+0000 7fb89e7fc700 1 -- 172.21.15.37:0/1035343408 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89400bd90 con 0x7fb8a00d2640 2023-07-12T02:05:15.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.332+0000 7fb8a61ff700 1 -- 172.21.15.37:0/1035343408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8a00d2640 msgr2=0x7fb8a00cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:15.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.332+0000 7fb8a61ff700 1 --2- 172.21.15.37:0/1035343408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8a00d2640 0x7fb8a00cf1e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb8940098f0 tx=0x7fb894009c00 comp rx=0 tx=0).stop 2023-07-12T02:05:15.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.332+0000 7fb8a61ff700 1 -- 172.21.15.37:0/1035343408 shutdown_connections 2023-07-12T02:05:15.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.332+0000 7fb8a61ff700 1 --2- 172.21.15.37:0/1035343408 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8a015c460 0x7fb8a00b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.332+0000 7fb8a61ff700 1 --2- 172.21.15.37:0/1035343408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8a00d2640 0x7fb8a00cf1e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.332+0000 7fb8a61ff700 1 -- 172.21.15.37:0/1035343408 >> 172.21.15.37:0/1035343408 conn(0x7fb8a0071660 msgr2=0x7fb8a0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.332+0000 7fb8a61ff700 1 -- 172.21.15.37:0/1035343408 shutdown_connections 2023-07-12T02:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.332+0000 7fb8a61ff700 1 -- 172.21.15.37:0/1035343408 wait complete. 2023-07-12T02:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.334+0000 7fb8a61ff700 1 Processor -- start 2023-07-12T02:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.334+0000 7fb8a61ff700 1 -- start start 2023-07-12T02:05:15.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.335+0000 7fb8a61ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8a00cf720 0x7fb8a014db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:15.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.335+0000 7fb8a61ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8a00d2640 0x7fb8a00c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:15.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.335+0000 7fb8a61ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8a015c460 0x7fb8a00ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:15.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.335+0000 7fb8a61ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a014e770 con 0x7fb8a00cf720 2023-07-12T02:05:15.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.335+0000 7fb8a61ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a00c7e60 con 0x7fb8a015c460 2023-07-12T02:05:15.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.335+0000 7fb8a61ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a00c7b80 con 0x7fb8a00d2640 2023-07-12T02:05:15.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.335+0000 7fb89f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8a00cf720 0x7fb8a014db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:15.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.335+0000 7fb89f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8a00cf720 0x7fb8a014db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49756/0 (socket says 172.21.15.37:49756) 2023-07-12T02:05:15.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.335+0000 7fb89f7fe700 1 -- 172.21.15.37:0/1778740362 learned_addr learned my addr 172.21.15.37:0/1778740362 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:15.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.336+0000 7fb89effd700 1 --2- 172.21.15.37:0/1778740362 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8a00d2640 0x7fb8a00c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:15.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.336+0000 7fb89ffff700 1 --2- 172.21.15.37:0/1778740362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8a015c460 0x7fb8a00ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:15.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.336+0000 7fb89f7fe700 1 -- 172.21.15.37:0/1778740362 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8a00d2640 msgr2=0x7fb8a00c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:15.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.336+0000 7fb89f7fe700 1 --2- 172.21.15.37:0/1778740362 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8a00d2640 0x7fb8a00c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.336+0000 7fb89f7fe700 1 -- 172.21.15.37:0/1778740362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8a015c460 msgr2=0x7fb8a00ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:15.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.336+0000 7fb89f7fe700 1 --2- 172.21.15.37:0/1778740362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8a015c460 0x7fb8a00ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.336+0000 7fb89f7fe700 1 -- 172.21.15.37:0/1778740362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb894009550 con 0x7fb8a00cf720 2023-07-12T02:05:15.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.336+0000 7fb89effd700 1 --2- 172.21.15.37:0/1778740362 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8a00d2640 0x7fb8a00c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:15.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.336+0000 7fb89f7fe700 1 --2- 172.21.15.37:0/1778740362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8a00cf720 0x7fb8a014db80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb89000e810 tx=0x7fb89000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:15.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.336+0000 7fb887fff700 1 -- 172.21.15.37:0/1778740362 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb890004230 con 0x7fb8a00cf720 2023-07-12T02:05:15.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.336+0000 7fb887fff700 1 -- 172.21.15.37:0/1778740362 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb890004390 con 0x7fb8a00cf720 2023-07-12T02:05:15.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.336+0000 7fb8a61ff700 1 -- 172.21.15.37:0/1778740362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a0151320 con 0x7fb8a00cf720 2023-07-12T02:05:15.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.336+0000 7fb887fff700 1 -- 172.21.15.37:0/1778740362 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8900036a0 con 0x7fb8a00cf720 2023-07-12T02:05:15.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.336+0000 7fb8a61ff700 1 -- 172.21.15.37:0/1778740362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a01518e0 con 0x7fb8a00cf720 2023-07-12T02:05:15.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.337+0000 7fb8a61ff700 1 -- 172.21.15.37:0/1778740362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a0151ad0 con 0x7fb8a00cf720 2023-07-12T02:05:15.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.338+0000 7fb887fff700 1 -- 172.21.15.37:0/1778740362 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb890003800 con 0x7fb8a00cf720 2023-07-12T02:05:15.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.339+0000 7fb887fff700 1 --2- 172.21.15.37:0/1778740362 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb88c06ace0 0x7fb88c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:15.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.339+0000 7fb887fff700 1 -- 172.21.15.37:0/1778740362 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb890089300 con 0x7fb8a00cf720 2023-07-12T02:05:15.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.340+0000 7fb89effd700 1 --2- 172.21.15.37:0/1778740362 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb88c06ace0 0x7fb88c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:15.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.341+0000 7fb89effd700 1 --2- 172.21.15.37:0/1778740362 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb88c06ace0 0x7fb88c06d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb894000c00 tx=0x7fb894008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:15.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.344+0000 7fb887fff700 1 -- 172.21.15.37:0/1778740362 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb890054070 con 0x7fb8a00cf720 2023-07-12T02:05:15.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.554+0000 7fb8a61ff700 1 -- 172.21.15.37:0/1778740362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8a004ea60 con 0x7fb8a00cf720 2023-07-12T02:05:15.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.555+0000 7fb887fff700 1 -- 172.21.15.37:0/1778740362 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20168 (secure 0 0 0) 0x7fb890057690 con 0x7fb8a00cf720 2023-07-12T02:05:15.559 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:15.560 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:39.032667+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:05:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.558+0000 7fb8a61ff700 1 -- 172.21.15.37:0/1778740362 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb88c06ace0 msgr2=0x7fb88c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.558+0000 7fb8a61ff700 1 --2- 172.21.15.37:0/1778740362 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb88c06ace0 0x7fb88c06d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb894000c00 tx=0x7fb894008030 comp rx=0 tx=0).stop 2023-07-12T02:05:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.558+0000 7fb8a61ff700 1 -- 172.21.15.37:0/1778740362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8a00cf720 msgr2=0x7fb8a014db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.558+0000 7fb8a61ff700 1 --2- 172.21.15.37:0/1778740362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8a00cf720 0x7fb8a014db80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb89000e810 tx=0x7fb89000ebd0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.558+0000 7fb8a61ff700 1 -- 172.21.15.37:0/1778740362 shutdown_connections 2023-07-12T02:05:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.558+0000 7fb8a61ff700 1 --2- 172.21.15.37:0/1778740362 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb88c06ace0 0x7fb88c06d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.558+0000 7fb8a61ff700 1 --2- 172.21.15.37:0/1778740362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8a00cf720 0x7fb8a014db80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.558+0000 7fb8a61ff700 1 --2- 172.21.15.37:0/1778740362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8a015c460 0x7fb8a00ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.558+0000 7fb8a61ff700 1 --2- 172.21.15.37:0/1778740362 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8a00d2640 0x7fb8a00c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.558+0000 7fb8a61ff700 1 -- 172.21.15.37:0/1778740362 >> 172.21.15.37:0/1778740362 conn(0x7fb8a0071660 msgr2=0x7fb8a015c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.558+0000 7fb8a61ff700 1 -- 172.21.15.37:0/1778740362 shutdown_connections 2023-07-12T02:05:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.558+0000 7fb8a61ff700 1 -- 172.21.15.37:0/1778740362 wait complete. 2023-07-12T02:05:15.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:03:56.039938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:03:56.612707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-12T02:04:00.200885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-12T02:05:15.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:05:15.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.783+0000 7f13741ff700 1 Processor -- start 2023-07-12T02:05:15.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.783+0000 7f13741ff700 1 -- start start 2023-07-12T02:05:15.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.784+0000 7f13741ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f136c0b4590 0x7f136c0b4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:15.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.784+0000 7f13741ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f136c06bda0 0x7f136c0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:15.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.784+0000 7f13741ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f136c06c210 0x7f136c0d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:15.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.784+0000 7f13741ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136c06b390 con 0x7f136c0b4590 2023-07-12T02:05:15.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.784+0000 7f13741ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136c0d1490 con 0x7f136c06c210 2023-07-12T02:05:15.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.784+0000 7f13741ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0b4ea0 con 0x7f136c06bda0 2023-07-12T02:05:15.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.784+0000 7f1371f9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f136c0b4590 0x7f136c0b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:15.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.784+0000 7f1371f9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f136c0b4590 0x7f136c0b4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49772/0 (socket says 172.21.15.37:49772) 2023-07-12T02:05:15.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.784+0000 7f1371f9b700 1 -- 172.21.15.37:0/1727296372 learned_addr learned my addr 172.21.15.37:0/1727296372 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.785+0000 7f137279c700 1 --2- 172.21.15.37:0/1727296372 >> v2:172.21.15.196:3300/0 conn(0x7f136c06c210 0x7f136c0d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.785+0000 7f137179a700 1 --2- 172.21.15.37:0/1727296372 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f136c06bda0 0x7f136c0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.785+0000 7f1371f9b700 1 -- 172.21.15.37:0/1727296372 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f136c06bda0 msgr2=0x7f136c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.785+0000 7f1371f9b700 1 --2- 172.21.15.37:0/1727296372 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f136c06bda0 0x7f136c0d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.785+0000 7f1371f9b700 1 -- 172.21.15.37:0/1727296372 >> v2:172.21.15.196:3300/0 conn(0x7f136c06c210 msgr2=0x7f136c0d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:15.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.785+0000 7f1371f9b700 1 --2- 172.21.15.37:0/1727296372 >> v2:172.21.15.196:3300/0 conn(0x7f136c06c210 0x7f136c0d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.785+0000 7f1371f9b700 1 -- 172.21.15.37:0/1727296372 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c15d3d0 con 0x7f136c0b4590 2023-07-12T02:05:15.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.785+0000 7f1371f9b700 1 --2- 172.21.15.37:0/1727296372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f136c0b4590 0x7f136c0b4960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f136c15fdd0 tx=0x7f1368009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27869fb3d0a3b03a server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:15.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.785+0000 7f1370f99700 1 -- 172.21.15.37:0/1727296372 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136800b870 con 0x7f136c0b4590 2023-07-12T02:05:15.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.785+0000 7f1370f99700 1 -- 172.21.15.37:0/1727296372 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136800b9d0 con 0x7f136c0b4590 2023-07-12T02:05:15.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.785+0000 7f1370f99700 1 -- 172.21.15.37:0/1727296372 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136800bd60 con 0x7f136c0b4590 2023-07-12T02:05:15.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.786+0000 7f13741ff700 1 -- 172.21.15.37:0/1727296372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f136c0b4590 msgr2=0x7f136c0b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:15.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.786+0000 7f13741ff700 1 --2- 172.21.15.37:0/1727296372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f136c0b4590 0x7f136c0b4960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f136c15fdd0 tx=0x7f1368009bd0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.786+0000 7f13741ff700 1 -- 172.21.15.37:0/1727296372 shutdown_connections 2023-07-12T02:05:15.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.786+0000 7f13741ff700 1 --2- 172.21.15.37:0/1727296372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f136c0b4590 0x7f136c0b4960 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.786+0000 7f13741ff700 1 --2- 172.21.15.37:0/1727296372 >> v2:172.21.15.196:3300/0 conn(0x7f136c06c210 0x7f136c0d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.786+0000 7f13741ff700 1 --2- 172.21.15.37:0/1727296372 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f136c06bda0 0x7f136c0d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.786+0000 7f13741ff700 1 -- 172.21.15.37:0/1727296372 >> 172.21.15.37:0/1727296372 conn(0x7f136c0cf590 msgr2=0x7f136c0cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:15.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.786+0000 7f13741ff700 1 -- 172.21.15.37:0/1727296372 shutdown_connections 2023-07-12T02:05:15.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.786+0000 7f13741ff700 1 -- 172.21.15.37:0/1727296372 wait complete. 2023-07-12T02:05:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.788+0000 7f13741ff700 1 Processor -- start 2023-07-12T02:05:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.788+0000 7f13741ff700 1 -- start start 2023-07-12T02:05:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f13741ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f136c06bda0 0x7f136c1513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f13741ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f136c06c210 0x7f136c1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:15.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f13741ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f136c0b4590 0x7f136c15b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:15.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f13741ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0cc1e0 con 0x7f136c06bda0 2023-07-12T02:05:15.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f13741ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0cb330 con 0x7f136c0b4590 2023-07-12T02:05:15.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f13741ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0cb560 con 0x7f136c06c210 2023-07-12T02:05:15.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f1371f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f136c06bda0 0x7f136c1513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:15.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f1371f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f136c06bda0 0x7f136c1513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49788/0 (socket says 172.21.15.37:49788) 2023-07-12T02:05:15.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f1371f9b700 1 -- 172.21.15.37:0/2438078456 learned_addr learned my addr 172.21.15.37:0/2438078456 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f137179a700 1 --2- 172.21.15.37:0/2438078456 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f136c06c210 0x7f136c1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f137279c700 1 --2- 172.21.15.37:0/2438078456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f136c0b4590 0x7f136c15b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f1371f9b700 1 -- 172.21.15.37:0/2438078456 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f136c06c210 msgr2=0x7f136c1588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f1371f9b700 1 --2- 172.21.15.37:0/2438078456 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f136c06c210 0x7f136c1588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f1371f9b700 1 -- 172.21.15.37:0/2438078456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f136c0b4590 msgr2=0x7f136c15b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f1371f9b700 1 --2- 172.21.15.37:0/2438078456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f136c0b4590 0x7f136c15b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f1371f9b700 1 -- 172.21.15.37:0/2438078456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1368009550 con 0x7f136c06bda0 2023-07-12T02:05:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.789+0000 7f137179a700 1 --2- 172.21.15.37:0/2438078456 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f136c06c210 0x7f136c1588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.790+0000 7f1371f9b700 1 --2- 172.21.15.37:0/2438078456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f136c06bda0 0x7f136c1513b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1368000c00 tx=0x7f1368004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.790+0000 7f13627fc700 1 -- 172.21.15.37:0/2438078456 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368004520 con 0x7f136c06bda0 2023-07-12T02:05:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.790+0000 7f13627fc700 1 -- 172.21.15.37:0/2438078456 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136801e070 con 0x7f136c06bda0 2023-07-12T02:05:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.790+0000 7f13741ff700 1 -- 172.21.15.37:0/2438078456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c0cb840 con 0x7f136c06bda0 2023-07-12T02:05:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.790+0000 7f13627fc700 1 -- 172.21.15.37:0/2438078456 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13680038c0 con 0x7f136c06bda0 2023-07-12T02:05:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.790+0000 7f13741ff700 1 -- 172.21.15.37:0/2438078456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c0cbe00 con 0x7f136c06bda0 2023-07-12T02:05:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.791+0000 7f13741ff700 1 -- 172.21.15.37:0/2438078456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136c04ea60 con 0x7f136c06bda0 2023-07-12T02:05:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.792+0000 7f13627fc700 1 -- 172.21.15.37:0/2438078456 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1368003a20 con 0x7f136c06bda0 2023-07-12T02:05:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.793+0000 7f13627fc700 1 --2- 172.21.15.37:0/2438078456 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f135006ace0 0x7f135006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.793+0000 7f13627fc700 1 -- 172.21.15.37:0/2438078456 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1368020070 con 0x7f136c06bda0 2023-07-12T02:05:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.794+0000 7f137179a700 1 --2- 172.21.15.37:0/2438078456 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f135006ace0 0x7f135006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.795+0000 7f137179a700 1 --2- 172.21.15.37:0/2438078456 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f135006ace0 0x7f135006d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f136c0d31a0 tx=0x7f135c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:15.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:15.798+0000 7f13627fc700 1 -- 172.21.15.37:0/2438078456 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1368055b20 con 0x7f136c06bda0 2023-07-12T02:05:16.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.006+0000 7f13741ff700 1 -- 172.21.15.37:0/2438078456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f136c0d00a0 con 0x7f136c06bda0 2023-07-12T02:05:16.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.006+0000 7f13627fc700 1 -- 172.21.15.37:0/2438078456 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13680150a0 con 0x7f136c06bda0 2023-07-12T02:05:16.010 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:05:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.009+0000 7f13741ff700 1 -- 172.21.15.37:0/2438078456 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f135006ace0 msgr2=0x7f135006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.009+0000 7f13741ff700 1 --2- 172.21.15.37:0/2438078456 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f135006ace0 0x7f135006d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f136c0d31a0 tx=0x7f135c008040 comp rx=0 tx=0).stop 2023-07-12T02:05:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.009+0000 7f13741ff700 1 -- 172.21.15.37:0/2438078456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f136c06bda0 msgr2=0x7f136c1513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.009+0000 7f13741ff700 1 --2- 172.21.15.37:0/2438078456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f136c06bda0 0x7f136c1513b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1368000c00 tx=0x7f1368004750 comp rx=0 tx=0).stop 2023-07-12T02:05:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.009+0000 7f13741ff700 1 -- 172.21.15.37:0/2438078456 shutdown_connections 2023-07-12T02:05:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.009+0000 7f13741ff700 1 --2- 172.21.15.37:0/2438078456 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f135006ace0 0x7f135006d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.009+0000 7f13741ff700 1 --2- 172.21.15.37:0/2438078456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f136c06bda0 0x7f136c1513b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.009+0000 7f13741ff700 1 --2- 172.21.15.37:0/2438078456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f136c0b4590 0x7f136c15b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.009+0000 7f13741ff700 1 --2- 172.21.15.37:0/2438078456 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f136c06c210 0x7f136c1588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.009+0000 7f13741ff700 1 -- 172.21.15.37:0/2438078456 >> 172.21.15.37:0/2438078456 conn(0x7f136c0cf590 msgr2=0x7f136c0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.009+0000 7f13741ff700 1 -- 172.21.15.37:0/2438078456 shutdown_connections 2023-07-12T02:05:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.009+0000 7f13741ff700 1 -- 172.21.15.37:0/2438078456 wait complete. 2023-07-12T02:05:16.030 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:05:16.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.231+0000 7fa0bc9ff700 1 Processor -- start 2023-07-12T02:05:16.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.231+0000 7fa0bc9ff700 1 -- start start 2023-07-12T02:05:16.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.232+0000 7fa0bc9ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa0b80b8430 0x7fa0b80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:16.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.232+0000 7fa0bc9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0b80d3730 0x7fa0b80cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:16.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.232+0000 7fa0bc9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0b80cfa90 0x7fa0b815feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:16.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.232+0000 7fa0bc9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b80b8800 con 0x7fa0b80d3730 2023-07-12T02:05:16.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.233+0000 7fa0bc9ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b80d0b20 con 0x7fa0b80b8430 2023-07-12T02:05:16.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.233+0000 7fa0bc9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80cfeb0 con 0x7fa0b80cfa90 2023-07-12T02:05:16.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.233+0000 7fa0affff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0b80d3730 0x7fa0b80cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:16.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.233+0000 7fa0affff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0b80d3730 0x7fa0b80cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49800/0 (socket says 172.21.15.37:49800) 2023-07-12T02:05:16.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.233+0000 7fa0affff700 1 -- 172.21.15.37:0/601920192 learned_addr learned my addr 172.21.15.37:0/601920192 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:16.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.233+0000 7fa0b659c700 1 --2- 172.21.15.37:0/601920192 >> v2:172.21.15.196:3300/0 conn(0x7fa0b80b8430 0x7fa0b80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.233+0000 7fa0b6d9d700 1 --2- 172.21.15.37:0/601920192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0b80cfa90 0x7fa0b815feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.233+0000 7fa0affff700 1 -- 172.21.15.37:0/601920192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0b80cfa90 msgr2=0x7fa0b815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.233+0000 7fa0affff700 1 --2- 172.21.15.37:0/601920192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0b80cfa90 0x7fa0b815feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.233+0000 7fa0affff700 1 -- 172.21.15.37:0/601920192 >> v2:172.21.15.196:3300/0 conn(0x7fa0b80b8430 msgr2=0x7fa0b80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.233+0000 7fa0affff700 1 --2- 172.21.15.37:0/601920192 >> v2:172.21.15.196:3300/0 conn(0x7fa0b80b8430 0x7fa0b80cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.233+0000 7fa0affff700 1 -- 172.21.15.37:0/601920192 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b80b4ee0 con 0x7fa0b80d3730 2023-07-12T02:05:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.233+0000 7fa0b659c700 1 --2- 172.21.15.37:0/601920192 >> v2:172.21.15.196:3300/0 conn(0x7fa0b80b8430 0x7fa0b80cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.233+0000 7fa0b6d9d700 1 --2- 172.21.15.37:0/601920192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0b80cfa90 0x7fa0b815feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.234+0000 7fa0affff700 1 --2- 172.21.15.37:0/601920192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b80d3730 0x7fa0b80cf550 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80cf520 tx=0x7fa0a0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7b6b5a61a01f72 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.234+0000 7fa0b5d9b700 1 -- 172.21.15.37:0/601920192 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a000b870 con 0x7fa0b80d3730 2023-07-12T02:05:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.234+0000 7fa0b5d9b700 1 -- 172.21.15.37:0/601920192 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a000b9d0 con 0x7fa0b80d3730 2023-07-12T02:05:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.234+0000 7fa0b5d9b700 1 -- 172.21.15.37:0/601920192 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a000bd60 con 0x7fa0b80d3730 2023-07-12T02:05:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.234+0000 7fa0bc9ff700 1 -- 172.21.15.37:0/601920192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b80d3730 msgr2=0x7fa0b80cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.234+0000 7fa0bc9ff700 1 --2- 172.21.15.37:0/601920192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b80d3730 0x7fa0b80cf550 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80cf520 tx=0x7fa0a0009bd0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.234+0000 7fa0bc9ff700 1 -- 172.21.15.37:0/601920192 shutdown_connections 2023-07-12T02:05:16.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.234+0000 7fa0bc9ff700 1 --2- 172.21.15.37:0/601920192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0b80cfa90 0x7fa0b815feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.234+0000 7fa0bc9ff700 1 --2- 172.21.15.37:0/601920192 >> v2:172.21.15.196:3300/0 conn(0x7fa0b80b8430 0x7fa0b80cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.234+0000 7fa0bc9ff700 1 --2- 172.21.15.37:0/601920192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b80d3730 0x7fa0b80cf550 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.234+0000 7fa0bc9ff700 1 -- 172.21.15.37:0/601920192 >> 172.21.15.37:0/601920192 conn(0x7fa0b806b3f0 msgr2=0x7fa0b806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:16.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.235+0000 7fa0bc9ff700 1 -- 172.21.15.37:0/601920192 shutdown_connections 2023-07-12T02:05:16.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.235+0000 7fa0bc9ff700 1 -- 172.21.15.37:0/601920192 wait complete. 2023-07-12T02:05:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.236+0000 7fa0bc9ff700 1 Processor -- start 2023-07-12T02:05:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.236+0000 7fa0bc9ff700 1 -- start start 2023-07-12T02:05:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.237+0000 7fa0bc9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b80b8430 0x7fa0b80ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.237+0000 7fa0bc9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0b80cfa90 0x7fa0b814d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.237+0000 7fa0bc9ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0b80d3730 0x7fa0b80c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.237+0000 7fa0bc9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b814d550 con 0x7fa0b80b8430 2023-07-12T02:05:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.237+0000 7fa0bc9ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80ca150 con 0x7fa0b80d3730 2023-07-12T02:05:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.237+0000 7fa0bc9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b815db20 con 0x7fa0b80cfa90 2023-07-12T02:05:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.238+0000 7fa0b659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b80b8430 0x7fa0b80ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.238+0000 7fa0b659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b80b8430 0x7fa0b80ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49806/0 (socket says 172.21.15.37:49806) 2023-07-12T02:05:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.238+0000 7fa0b659c700 1 -- 172.21.15.37:0/3986268553 learned_addr learned my addr 172.21.15.37:0/3986268553 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.238+0000 7fa0affff700 1 --2- 172.21.15.37:0/3986268553 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0b80cfa90 0x7fa0b814d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.238+0000 7fa0b6d9d700 1 --2- 172.21.15.37:0/3986268553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0b80d3730 0x7fa0b80c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:16.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.238+0000 7fa0b659c700 1 -- 172.21.15.37:0/3986268553 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0b80cfa90 msgr2=0x7fa0b814d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:16.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.238+0000 7fa0b659c700 1 --2- 172.21.15.37:0/3986268553 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0b80cfa90 0x7fa0b814d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.238+0000 7fa0b659c700 1 -- 172.21.15.37:0/3986268553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0b80d3730 msgr2=0x7fa0b80c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:16.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.238+0000 7fa0b659c700 1 --2- 172.21.15.37:0/3986268553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0b80d3730 0x7fa0b80c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.238+0000 7fa0b659c700 1 -- 172.21.15.37:0/3986268553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a0009550 con 0x7fa0b80b8430 2023-07-12T02:05:16.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.238+0000 7fa0b659c700 1 --2- 172.21.15.37:0/3986268553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b80b8430 0x7fa0b80ca840 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800c7f0 tx=0x7fa0a800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:16.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.238+0000 7fa0aeffd700 1 -- 172.21.15.37:0/3986268553 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8011800 con 0x7fa0b80b8430 2023-07-12T02:05:16.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.239+0000 7fa0aeffd700 1 -- 172.21.15.37:0/3986268553 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a8011960 con 0x7fa0b80b8430 2023-07-12T02:05:16.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.239+0000 7fa0bc9ff700 1 -- 172.21.15.37:0/3986268553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b815de00 con 0x7fa0b80b8430 2023-07-12T02:05:16.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.239+0000 7fa0aeffd700 1 -- 172.21.15.37:0/3986268553 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8011cf0 con 0x7fa0b80b8430 2023-07-12T02:05:16.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.239+0000 7fa0bc9ff700 1 -- 172.21.15.37:0/3986268553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b815e3c0 con 0x7fa0b80b8430 2023-07-12T02:05:16.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.240+0000 7fa0bc9ff700 1 -- 172.21.15.37:0/3986268553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b815e5e0 con 0x7fa0b80b8430 2023-07-12T02:05:16.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.241+0000 7fa0aeffd700 1 -- 172.21.15.37:0/3986268553 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa0a8018360 con 0x7fa0b80b8430 2023-07-12T02:05:16.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.241+0000 7fa0aeffd700 1 --2- 172.21.15.37:0/3986268553 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa09806ace0 0x7fa09806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:16.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.242+0000 7fa0aeffd700 1 -- 172.21.15.37:0/3986268553 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa0a80895e0 con 0x7fa0b80b8430 2023-07-12T02:05:16.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.242+0000 7fa0affff700 1 --2- 172.21.15.37:0/3986268553 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa09806ace0 0x7fa09806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:16.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.243+0000 7fa0affff700 1 --2- 172.21.15.37:0/3986268553 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa09806ace0 0x7fa09806d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0000c00 tx=0x7fa0a0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:16.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.246+0000 7fa0aeffd700 1 -- 172.21.15.37:0/3986268553 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa0a80543f0 con 0x7fa0b80b8430 2023-07-12T02:05:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.452+0000 7fa0bc9ff700 1 -- 172.21.15.37:0/3986268553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa0b804ea60 con 0x7fa0b80b8430 2023-07-12T02:05:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.452+0000 7fa0aeffd700 1 -- 172.21.15.37:0/3986268553 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa0a8057a10 con 0x7fa0b80b8430 2023-07-12T02:05:16.456 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:05:16.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.454+0000 7fa0bc9ff700 1 -- 172.21.15.37:0/3986268553 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa09806ace0 msgr2=0x7fa09806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:16.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.454+0000 7fa0bc9ff700 1 --2- 172.21.15.37:0/3986268553 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa09806ace0 0x7fa09806d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0000c00 tx=0x7fa0a0008030 comp rx=0 tx=0).stop 2023-07-12T02:05:16.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.454+0000 7fa0bc9ff700 1 -- 172.21.15.37:0/3986268553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b80b8430 msgr2=0x7fa0b80ca840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:16.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.454+0000 7fa0bc9ff700 1 --2- 172.21.15.37:0/3986268553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b80b8430 0x7fa0b80ca840 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800c7f0 tx=0x7fa0a800cb00 comp rx=0 tx=0).stop 2023-07-12T02:05:16.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.454+0000 7fa0bc9ff700 1 -- 172.21.15.37:0/3986268553 shutdown_connections 2023-07-12T02:05:16.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.454+0000 7fa0bc9ff700 1 --2- 172.21.15.37:0/3986268553 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa09806ace0 0x7fa09806d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.454+0000 7fa0bc9ff700 1 --2- 172.21.15.37:0/3986268553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b80b8430 0x7fa0b80ca840 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.454+0000 7fa0bc9ff700 1 --2- 172.21.15.37:0/3986268553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0b80d3730 0x7fa0b80c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.454+0000 7fa0bc9ff700 1 --2- 172.21.15.37:0/3986268553 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0b80cfa90 0x7fa0b814d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.454+0000 7fa0bc9ff700 1 -- 172.21.15.37:0/3986268553 >> 172.21.15.37:0/3986268553 conn(0x7fa0b806b3f0 msgr2=0x7fa0b80b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.454+0000 7fa0bc9ff700 1 -- 172.21.15.37:0/3986268553 shutdown_connections 2023-07-12T02:05:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.454+0000 7fa0bc9ff700 1 -- 172.21.15.37:0/3986268553 wait complete. 2023-07-12T02:05:16.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:05:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.676+0000 7f31fb7ff700 1 Processor -- start 2023-07-12T02:05:16.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.676+0000 7f31fb7ff700 1 -- start start 2023-07-12T02:05:16.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.677+0000 7f31fb7ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f31f40b8430 0x7f31f40cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:16.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.677+0000 7f31fb7ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31f40d3730 0x7f31f40cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.677+0000 7f31fb7ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f40d0b20 con 0x7f31f40cfa90 2023-07-12T02:05:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.677+0000 7f31fb7ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f40b8800 con 0x7f31f40d3730 2023-07-12T02:05:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.677+0000 7f31fb7ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f40cfe90 con 0x7f31f40b8430 2023-07-12T02:05:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.678+0000 7f31f8d9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31f40d3730 0x7f31f40cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.678+0000 7f31f8d9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31f40d3730 0x7f31f40cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49816/0 (socket says 172.21.15.37:49816) 2023-07-12T02:05:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.678+0000 7f31f8d9a700 1 -- 172.21.15.37:0/1644436498 learned_addr learned my addr 172.21.15.37:0/1644436498 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.678+0000 7f31f959b700 1 --2- 172.21.15.37:0/1644436498 >> v2:172.21.15.196:3300/0 conn(0x7f31f40b8430 0x7f31f40cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.678+0000 7f31f8d9a700 1 -- 172.21.15.37:0/1644436498 >> v2:172.21.15.196:3300/0 conn(0x7f31f40b8430 msgr2=0x7f31f40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.678+0000 7f31f8d9a700 1 --2- 172.21.15.37:0/1644436498 >> v2:172.21.15.196:3300/0 conn(0x7f31f40b8430 0x7f31f40cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.678+0000 7f31f8d9a700 1 -- 172.21.15.37:0/1644436498 >> v1:172.21.15.196:6789/0 conn(0x7f31f40cfa90 legacy=0x7f31f415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.678+0000 7f31f8d9a700 1 -- 172.21.15.37:0/1644436498 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f40b4ee0 con 0x7f31f40d3730 2023-07-12T02:05:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.678+0000 7f31f8d9a700 1 --2- 172.21.15.37:0/1644436498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f40d3730 0x7f31f40cf550 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f31f40cf520 tx=0x7f31e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d98a5270aa40877 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.679+0000 7f31ebfff700 1 -- 172.21.15.37:0/1644436498 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e4011830 con 0x7f31f40d3730 2023-07-12T02:05:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.679+0000 7f31ebfff700 1 -- 172.21.15.37:0/1644436498 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e4011990 con 0x7f31f40d3730 2023-07-12T02:05:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.679+0000 7f31ebfff700 1 -- 172.21.15.37:0/1644436498 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e4011d20 con 0x7f31f40d3730 2023-07-12T02:05:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.679+0000 7f31fb7ff700 1 -- 172.21.15.37:0/1644436498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f40d3730 msgr2=0x7f31f40cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.679+0000 7f31fb7ff700 1 --2- 172.21.15.37:0/1644436498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f40d3730 0x7f31f40cf550 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f31f40cf520 tx=0x7f31e4009bd0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.679+0000 7f31fb7ff700 1 -- 172.21.15.37:0/1644436498 shutdown_connections 2023-07-12T02:05:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.679+0000 7f31fb7ff700 1 --2- 172.21.15.37:0/1644436498 >> v2:172.21.15.196:3300/0 conn(0x7f31f40b8430 0x7f31f40cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.679+0000 7f31fb7ff700 1 --2- 172.21.15.37:0/1644436498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f40d3730 0x7f31f40cf550 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.679+0000 7f31fb7ff700 1 -- 172.21.15.37:0/1644436498 >> 172.21.15.37:0/1644436498 conn(0x7f31f406b3f0 msgr2=0x7f31f406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:16.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.679+0000 7f31fb7ff700 1 -- 172.21.15.37:0/1644436498 shutdown_connections 2023-07-12T02:05:16.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.679+0000 7f31fb7ff700 1 -- 172.21.15.37:0/1644436498 wait complete. 2023-07-12T02:05:16.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.681+0000 7f31fb7ff700 1 Processor -- start 2023-07-12T02:05:16.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.681+0000 7f31fb7ff700 1 -- start start 2023-07-12T02:05:16.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.682+0000 7f31fb7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f40b8430 0x7f31f415f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:16.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.682+0000 7f31fb7ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31f40cfa90 0x7f31f41f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:16.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.682+0000 7f31fb7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31f40d3730 0x7f31f40cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:16.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.682+0000 7f31fb7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f415d890 con 0x7f31f40b8430 2023-07-12T02:05:16.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.682+0000 7f31fb7ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f40b0fa0 con 0x7f31f40cfa90 2023-07-12T02:05:16.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.682+0000 7f31fb7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f415d2d0 con 0x7f31f40d3730 2023-07-12T02:05:16.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.682+0000 7f31f959b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f40b8430 0x7f31f415f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.682+0000 7f31f959b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f40b8430 0x7f31f415f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49820/0 (socket says 172.21.15.37:49820) 2023-07-12T02:05:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.682+0000 7f31f959b700 1 -- 172.21.15.37:0/4171698980 learned_addr learned my addr 172.21.15.37:0/4171698980 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.683+0000 7f31f959b700 1 -- 172.21.15.37:0/4171698980 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31f40d3730 msgr2=0x7f31f40cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.683+0000 7f31f959b700 1 --2- 172.21.15.37:0/4171698980 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31f40d3730 0x7f31f40cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.683+0000 7f31f959b700 1 -- 172.21.15.37:0/4171698980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31f40cfa90 msgr2=0x7f31f41f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.683+0000 7f31f959b700 1 --2- 172.21.15.37:0/4171698980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31f40cfa90 0x7f31f41f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.683+0000 7f31f959b700 1 -- 172.21.15.37:0/4171698980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e4009550 con 0x7f31f40b8430 2023-07-12T02:05:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.683+0000 7f31f959b700 1 --2- 172.21.15.37:0/4171698980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f40b8430 0x7f31f415f830 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f31f000e870 tx=0x7f31f000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.683+0000 7f31e9ffb700 1 -- 172.21.15.37:0/4171698980 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0009590 con 0x7f31f40b8430 2023-07-12T02:05:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.683+0000 7f31e9ffb700 1 -- 172.21.15.37:0/4171698980 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f000ee70 con 0x7f31f40b8430 2023-07-12T02:05:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.683+0000 7f31fb7ff700 1 -- 172.21.15.37:0/4171698980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f415d5b0 con 0x7f31f40b8430 2023-07-12T02:05:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.683+0000 7f31e9ffb700 1 -- 172.21.15.37:0/4171698980 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000ca50 con 0x7f31f40b8430 2023-07-12T02:05:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.684+0000 7f31fb7ff700 1 -- 172.21.15.37:0/4171698980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f40b1260 con 0x7f31f40b8430 2023-07-12T02:05:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.685+0000 7f31fb7ff700 1 -- 172.21.15.37:0/4171698980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f40c9bf0 con 0x7f31f40b8430 2023-07-12T02:05:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.685+0000 7f31e9ffb700 1 -- 172.21.15.37:0/4171698980 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f31f000cbb0 con 0x7f31f40b8430 2023-07-12T02:05:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.686+0000 7f31e9ffb700 1 --2- 172.21.15.37:0/4171698980 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f31d806ace0 0x7f31d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.686+0000 7f31e9ffb700 1 -- 172.21.15.37:0/4171698980 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f31f00897c0 con 0x7f31f40b8430 2023-07-12T02:05:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.687+0000 7f31f8d9a700 1 --2- 172.21.15.37:0/4171698980 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f31d806ace0 0x7f31d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.687+0000 7f31f8d9a700 1 --2- 172.21.15.37:0/4171698980 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f31d806ace0 0x7f31d806d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f31f40d34a0 tx=0x7f31e4010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:16.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.691+0000 7f31e9ffb700 1 -- 172.21.15.37:0/4171698980 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f31f0057fd0 con 0x7f31f40b8430 2023-07-12T02:05:16.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.896+0000 7f31fb7ff700 1 -- 172.21.15.37:0/4171698980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f31f404ea60 con 0x7f31f40b8430 2023-07-12T02:05:16.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.897+0000 7f31e9ffb700 1 -- 172.21.15.37:0/4171698980 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f31f000ce60 con 0x7f31f40b8430 2023-07-12T02:05:16.901 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:05:16.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.899+0000 7f31fb7ff700 1 -- 172.21.15.37:0/4171698980 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f31d806ace0 msgr2=0x7f31d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:16.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.899+0000 7f31fb7ff700 1 --2- 172.21.15.37:0/4171698980 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f31d806ace0 0x7f31d806d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f31f40d34a0 tx=0x7f31e4010000 comp rx=0 tx=0).stop 2023-07-12T02:05:16.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.899+0000 7f31fb7ff700 1 -- 172.21.15.37:0/4171698980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f40b8430 msgr2=0x7f31f415f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:16.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.899+0000 7f31fb7ff700 1 --2- 172.21.15.37:0/4171698980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f40b8430 0x7f31f415f830 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f31f000e870 tx=0x7f31f000ec30 comp rx=0 tx=0).stop 2023-07-12T02:05:16.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.899+0000 7f31fb7ff700 1 -- 172.21.15.37:0/4171698980 shutdown_connections 2023-07-12T02:05:16.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.899+0000 7f31fb7ff700 1 --2- 172.21.15.37:0/4171698980 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f31d806ace0 0x7f31d806d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.899+0000 7f31fb7ff700 1 --2- 172.21.15.37:0/4171698980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f40b8430 0x7f31f415f830 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.899+0000 7f31fb7ff700 1 --2- 172.21.15.37:0/4171698980 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31f40d3730 0x7f31f40cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.899+0000 7f31fb7ff700 1 --2- 172.21.15.37:0/4171698980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31f40cfa90 0x7f31f41f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:16.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.899+0000 7f31fb7ff700 1 -- 172.21.15.37:0/4171698980 >> 172.21.15.37:0/4171698980 conn(0x7f31f406b3f0 msgr2=0x7f31f40b5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:16.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.899+0000 7f31fb7ff700 1 -- 172.21.15.37:0/4171698980 shutdown_connections 2023-07-12T02:05:16.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:16.899+0000 7f31fb7ff700 1 -- 172.21.15.37:0/4171698980 wait complete. 2023-07-12T02:05:16.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:05:17.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.120+0000 7fbe0fbff700 1 Processor -- start 2023-07-12T02:05:17.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.121+0000 7fbe0fbff700 1 -- start start 2023-07-12T02:05:17.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.122+0000 7fbe0fbff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe080d3730 0x7fbe080cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:17.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.122+0000 7fbe0fbff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbe080cfa90 0x7fbe080d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:17.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.122+0000 7fbe0fbff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe080d0b20 con 0x7fbe080b8430 2023-07-12T02:05:17.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.122+0000 7fbe0fbff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe080cda30 con 0x7fbe080cfa90 2023-07-12T02:05:17.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.122+0000 7fbe0fbff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080b8800 con 0x7fbe080d3730 2023-07-12T02:05:17.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.122+0000 7fbe0e19c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbe080cfa90 0x7fbe080d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:17.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.122+0000 7fbe0d19a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe080d3730 0x7fbe080cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:17.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.122+0000 7fbe0e19c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbe080cfa90 0x7fbe080d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:54428/0 (socket says 172.21.15.37:54428) 2023-07-12T02:05:17.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.122+0000 7fbe0e19c700 1 -- 172.21.15.37:0/1619712384 learned_addr learned my addr 172.21.15.37:0/1619712384 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:17.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.122+0000 7fbe0d99b700 1 --1- 172.21.15.37:0/1619712384 >> v1:172.21.15.196:6789/0 conn(0x7fbe080b8430 0x7fbe080cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:35240/0 (socket says 172.21.15.37:35240) 2023-07-12T02:05:17.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.123+0000 7fbe0d19a700 1 -- 172.21.15.37:0/1619712384 >> v2:172.21.15.196:3300/0 conn(0x7fbe080cfa90 msgr2=0x7fbe080d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.123+0000 7fbe0d19a700 1 --2- 172.21.15.37:0/1619712384 >> v2:172.21.15.196:3300/0 conn(0x7fbe080cfa90 0x7fbe080d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.123+0000 7fbe0d19a700 1 -- 172.21.15.37:0/1619712384 >> v1:172.21.15.196:6789/0 conn(0x7fbe080b8430 legacy=0x7fbe080cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.123+0000 7fbe0d19a700 1 -- 172.21.15.37:0/1619712384 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe080cfeb0 con 0x7fbe080d3730 2023-07-12T02:05:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.123+0000 7fbe0c999700 1 -- 172.21.15.37:0/1619712384 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396984791 0 0) 0x7fbe080d0b20 con 0x7fbe080b8430 2023-07-12T02:05:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.123+0000 7fbe0d19a700 1 --2- 172.21.15.37:0/1619712384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe080d3730 0x7fbe080cf550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009840 tx=0x7fbdf8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feafec6f24db3e1d server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.123+0000 7fbe0c999700 1 -- 172.21.15.37:0/1619712384 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8011830 con 0x7fbe080d3730 2023-07-12T02:05:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.123+0000 7fbe0c999700 1 -- 172.21.15.37:0/1619712384 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf8011990 con 0x7fbe080d3730 2023-07-12T02:05:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.123+0000 7fbe0c999700 1 -- 172.21.15.37:0/1619712384 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8011d20 con 0x7fbe080d3730 2023-07-12T02:05:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.124+0000 7fbe0fbff700 1 -- 172.21.15.37:0/1619712384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe080d3730 msgr2=0x7fbe080cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.124+0000 7fbe0fbff700 1 --2- 172.21.15.37:0/1619712384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe080d3730 0x7fbe080cf550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009840 tx=0x7fbdf8009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.124+0000 7fbe0fbff700 1 -- 172.21.15.37:0/1619712384 shutdown_connections 2023-07-12T02:05:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.124+0000 7fbe0fbff700 1 --2- 172.21.15.37:0/1619712384 >> v2:172.21.15.196:3300/0 conn(0x7fbe080cfa90 0x7fbe080d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.124+0000 7fbe0fbff700 1 --2- 172.21.15.37:0/1619712384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe080d3730 0x7fbe080cf550 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.124+0000 7fbe0fbff700 1 -- 172.21.15.37:0/1619712384 >> 172.21.15.37:0/1619712384 conn(0x7fbe0806b3f0 msgr2=0x7fbe0806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.124+0000 7fbe0fbff700 1 -- 172.21.15.37:0/1619712384 shutdown_connections 2023-07-12T02:05:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.124+0000 7fbe0fbff700 1 -- 172.21.15.37:0/1619712384 wait complete. 2023-07-12T02:05:17.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.126+0000 7fbe0fbff700 1 Processor -- start 2023-07-12T02:05:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.126+0000 7fbe0fbff700 1 -- start start 2023-07-12T02:05:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.127+0000 7fbe0fbff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe080b8430 0x7fbe080c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.127+0000 7fbe0fbff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080cfa90 0x7fbe0815a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.127+0000 7fbe0fbff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe080d3730 0x7fbe0815e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.127+0000 7fbe0fbff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080c6cc0 con 0x7fbe080cfa90 2023-07-12T02:05:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.127+0000 7fbe0fbff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080c69e0 con 0x7fbe080b8430 2023-07-12T02:05:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.127+0000 7fbe0fbff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080cb020 con 0x7fbe080d3730 2023-07-12T02:05:17.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.127+0000 7fbe0d19a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080cfa90 0x7fbe0815a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:17.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.127+0000 7fbe0d19a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080cfa90 0x7fbe0815a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49832/0 (socket says 172.21.15.37:49832) 2023-07-12T02:05:17.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.127+0000 7fbe0d19a700 1 -- 172.21.15.37:0/1044467612 learned_addr learned my addr 172.21.15.37:0/1044467612 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:17.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.127+0000 7fbe0d99b700 1 --2- 172.21.15.37:0/1044467612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe080b8430 0x7fbe080c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:17.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.127+0000 7fbe0e19c700 1 --2- 172.21.15.37:0/1044467612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe080d3730 0x7fbe0815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:17.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.127+0000 7fbe0d19a700 1 -- 172.21.15.37:0/1044467612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe080d3730 msgr2=0x7fbe0815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:17.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.127+0000 7fbe0d19a700 1 --2- 172.21.15.37:0/1044467612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe080d3730 0x7fbe0815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.127+0000 7fbe0d19a700 1 -- 172.21.15.37:0/1044467612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe080b8430 msgr2=0x7fbe080c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.127+0000 7fbe0d19a700 1 --2- 172.21.15.37:0/1044467612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe080b8430 0x7fbe080c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.128+0000 7fbe0d19a700 1 -- 172.21.15.37:0/1044467612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf80094a0 con 0x7fbe080cfa90 2023-07-12T02:05:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.128+0000 7fbe0d99b700 1 --2- 172.21.15.37:0/1044467612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe080b8430 0x7fbe080c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.128+0000 7fbe0d19a700 1 --2- 172.21.15.37:0/1044467612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080cfa90 0x7fbe0815a5f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8014040 tx=0x7fbdf8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.128+0000 7fbdfe7fc700 1 -- 172.21.15.37:0/1044467612 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf80036a0 con 0x7fbe080cfa90 2023-07-12T02:05:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.128+0000 7fbe0fbff700 1 -- 172.21.15.37:0/1044467612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe080cb300 con 0x7fbe080cfa90 2023-07-12T02:05:17.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.128+0000 7fbdfe7fc700 1 -- 172.21.15.37:0/1044467612 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf801f070 con 0x7fbe080cfa90 2023-07-12T02:05:17.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.128+0000 7fbdfe7fc700 1 -- 172.21.15.37:0/1044467612 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8003a00 con 0x7fbe080cfa90 2023-07-12T02:05:17.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.128+0000 7fbe0fbff700 1 -- 172.21.15.37:0/1044467612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe080c6670 con 0x7fbe080cfa90 2023-07-12T02:05:17.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.129+0000 7fbe0fbff700 1 -- 172.21.15.37:0/1044467612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe080cb820 con 0x7fbe080cfa90 2023-07-12T02:05:17.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.130+0000 7fbdfe7fc700 1 -- 172.21.15.37:0/1044467612 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbdf8003b60 con 0x7fbe080cfa90 2023-07-12T02:05:17.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.131+0000 7fbdfe7fc700 1 --2- 172.21.15.37:0/1044467612 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbdec06ace0 0x7fbdec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:17.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.131+0000 7fbdfe7fc700 1 -- 172.21.15.37:0/1044467612 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbdf8021070 con 0x7fbe080cfa90 2023-07-12T02:05:17.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.132+0000 7fbe0d99b700 1 --2- 172.21.15.37:0/1044467612 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbdec06ace0 0x7fbdec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:17.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.132+0000 7fbe0d99b700 1 --2- 172.21.15.37:0/1044467612 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbdec06ace0 0x7fbdec06d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbe04000f60 tx=0x7fbe04007ca0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:17.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.136+0000 7fbdfe7fc700 1 -- 172.21.15.37:0/1044467612 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbe080cb820 con 0x7fbe080cfa90 2023-07-12T02:05:17.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.342+0000 7fbe0fbff700 1 -- 172.21.15.37:0/1044467612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe080cb820 con 0x7fbe080cfa90 2023-07-12T02:05:17.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.343+0000 7fbdfe7fc700 1 -- 172.21.15.37:0/1044467612 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe080cb820 con 0x7fbe080cfa90 2023-07-12T02:05:17.346 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-12T02:05:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.345+0000 7fbe0fbff700 1 -- 172.21.15.37:0/1044467612 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbdec06ace0 msgr2=0x7fbdec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.345+0000 7fbe0fbff700 1 --2- 172.21.15.37:0/1044467612 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbdec06ace0 0x7fbdec06d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbe04000f60 tx=0x7fbe04007ca0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.345+0000 7fbe0fbff700 1 -- 172.21.15.37:0/1044467612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080cfa90 msgr2=0x7fbe0815a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.345+0000 7fbe0fbff700 1 --2- 172.21.15.37:0/1044467612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080cfa90 0x7fbe0815a5f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8014040 tx=0x7fbdf8004750 comp rx=0 tx=0).stop 2023-07-12T02:05:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.345+0000 7fbe0fbff700 1 -- 172.21.15.37:0/1044467612 shutdown_connections 2023-07-12T02:05:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.345+0000 7fbe0fbff700 1 --2- 172.21.15.37:0/1044467612 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbdec06ace0 0x7fbdec06d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.345+0000 7fbe0fbff700 1 --2- 172.21.15.37:0/1044467612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe080d3730 0x7fbe0815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.345+0000 7fbe0fbff700 1 --2- 172.21.15.37:0/1044467612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe080b8430 0x7fbe080c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.345+0000 7fbe0fbff700 1 --2- 172.21.15.37:0/1044467612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080cfa90 0x7fbe0815a5f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.345+0000 7fbe0fbff700 1 -- 172.21.15.37:0/1044467612 >> 172.21.15.37:0/1044467612 conn(0x7fbe0806b3f0 msgr2=0x7fbe080b5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.345+0000 7fbe0fbff700 1 -- 172.21.15.37:0/1044467612 shutdown_connections 2023-07-12T02:05:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.345+0000 7fbe0fbff700 1 -- 172.21.15.37:0/1044467612 wait complete. 2023-07-12T02:05:17.366 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-12T02:05:17.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.566+0000 7f5cdafff700 1 Processor -- start 2023-07-12T02:05:17.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.567+0000 7f5cdafff700 1 -- start start 2023-07-12T02:05:17.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.568+0000 7f5cdafff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5cd40d3730 0x7f5cd40cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:17.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.568+0000 7f5cdafff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd40d0b20 con 0x7f5cd40cfa90 2023-07-12T02:05:17.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.568+0000 7f5cdafff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd40cfeb0 con 0x7f5cd40b8430 2023-07-12T02:05:17.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.568+0000 7f5cdafff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40cda30 con 0x7f5cd40d3730 2023-07-12T02:05:17.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.568+0000 7f5cd959c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5cd40cfa90 0x7f5cd40d0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38812/0 (socket says 172.21.15.37:38812) 2023-07-12T02:05:17.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.568+0000 7f5cd959c700 1 -- 172.21.15.37:0/2104568922 learned_addr learned my addr 172.21.15.37:0/2104568922 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:17.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.568+0000 7f5cd3fff700 1 --2- 172.21.15.37:0/2104568922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5cd40d3730 0x7f5cd40cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:17.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.569+0000 7f5cd37fe700 1 -- 172.21.15.37:0/2104568922 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447815923 0 0) 0x7f5cd40d0b20 con 0x7f5cd40cfa90 2023-07-12T02:05:17.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.569+0000 7f5cd37fe700 1 -- 172.21.15.37:0/2104568922 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cc40035b0 con 0x7f5cd40cfa90 2023-07-12T02:05:17.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.569+0000 7f5cd37fe700 1 -- 172.21.15.37:0/2104568922 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050517340 0 0) 0x7f5cd40cfeb0 con 0x7f5cd40b8430 2023-07-12T02:05:17.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.569+0000 7f5cd37fe700 1 -- 172.21.15.37:0/2104568922 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd40d0b20 con 0x7f5cd40b8430 2023-07-12T02:05:17.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.569+0000 7f5cd3fff700 1 -- 172.21.15.37:0/2104568922 >> v1:172.21.15.196:6789/0 conn(0x7f5cd40b8430 legacy=0x7f5cd40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:17.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.569+0000 7f5cd37fe700 1 -- 172.21.15.37:0/2104568922 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 707641084 0 0) 0x7f5cc40035b0 con 0x7f5cd40cfa90 2023-07-12T02:05:17.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.569+0000 7f5cd3fff700 1 -- 172.21.15.37:0/2104568922 >> v1:172.21.15.37:6789/0 conn(0x7f5cd40cfa90 legacy=0x7f5cd40d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:17.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.569+0000 7f5cd3fff700 1 -- 172.21.15.37:0/2104568922 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd40b4ee0 con 0x7f5cd40d3730 2023-07-12T02:05:17.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.569+0000 7f5cd3fff700 1 --2- 172.21.15.37:0/2104568922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5cd40d3730 0x7f5cd40cf550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009870 tx=0x7f5cc0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cacff10b089881c server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:17.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.570+0000 7f5cd37fe700 1 -- 172.21.15.37:0/2104568922 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0019f0 con 0x7f5cd40d3730 2023-07-12T02:05:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.570+0000 7f5cd37fe700 1 -- 172.21.15.37:0/2104568922 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc0004030 con 0x7f5cd40d3730 2023-07-12T02:05:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.570+0000 7f5cd37fe700 1 -- 172.21.15.37:0/2104568922 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc00043c0 con 0x7f5cd40d3730 2023-07-12T02:05:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.570+0000 7f5cdafff700 1 -- 172.21.15.37:0/2104568922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5cd40d3730 msgr2=0x7f5cd40cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.570+0000 7f5cdafff700 1 --2- 172.21.15.37:0/2104568922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5cd40d3730 0x7f5cd40cf550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009870 tx=0x7f5cc0009b80 comp rx=0 tx=0).stop 2023-07-12T02:05:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.570+0000 7f5cdafff700 1 -- 172.21.15.37:0/2104568922 shutdown_connections 2023-07-12T02:05:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.570+0000 7f5cdafff700 1 --2- 172.21.15.37:0/2104568922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5cd40d3730 0x7f5cd40cf550 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.570+0000 7f5cdafff700 1 -- 172.21.15.37:0/2104568922 >> 172.21.15.37:0/2104568922 conn(0x7f5cd406b3f0 msgr2=0x7f5cd406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.570+0000 7f5cdafff700 1 -- 172.21.15.37:0/2104568922 shutdown_connections 2023-07-12T02:05:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.570+0000 7f5cdafff700 1 -- 172.21.15.37:0/2104568922 wait complete. 2023-07-12T02:05:17.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.572+0000 7f5cdafff700 1 Processor -- start 2023-07-12T02:05:17.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.572+0000 7f5cdafff700 1 -- start start 2023-07-12T02:05:17.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.573+0000 7f5cdafff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5cd40b8430 0x7f5cd40cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:17.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.573+0000 7f5cdafff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40cfa90 0x7f5cd415d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:17.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.573+0000 7f5cdafff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5cd40d3730 0x7f5cd41f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.573+0000 7f5cdafff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd41f38f0 con 0x7f5cd40cfa90 2023-07-12T02:05:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.573+0000 7f5cdafff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd415df90 con 0x7f5cd40b8430 2023-07-12T02:05:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.573+0000 7f5cdafff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd41f32a0 con 0x7f5cd40d3730 2023-07-12T02:05:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.573+0000 7f5cd3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40cfa90 0x7f5cd415d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.573+0000 7f5cd3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40cfa90 0x7f5cd415d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49834/0 (socket says 172.21.15.37:49834) 2023-07-12T02:05:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.573+0000 7f5cd3fff700 1 -- 172.21.15.37:0/118936072 learned_addr learned my addr 172.21.15.37:0/118936072 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.573+0000 7f5cd8d9b700 1 --2- 172.21.15.37:0/118936072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5cd40b8430 0x7f5cd40cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.574+0000 7f5cd959c700 1 --2- 172.21.15.37:0/118936072 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5cd40d3730 0x7f5cd41f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.574+0000 7f5cd3fff700 1 -- 172.21.15.37:0/118936072 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5cd40d3730 msgr2=0x7f5cd41f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.574+0000 7f5cd3fff700 1 --2- 172.21.15.37:0/118936072 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5cd40d3730 0x7f5cd41f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.574+0000 7f5cd3fff700 1 -- 172.21.15.37:0/118936072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5cd40b8430 msgr2=0x7f5cd40cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.574+0000 7f5cd3fff700 1 --2- 172.21.15.37:0/118936072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5cd40b8430 0x7f5cd40cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.574+0000 7f5cd3fff700 1 -- 172.21.15.37:0/118936072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc00094a0 con 0x7f5cd40cfa90 2023-07-12T02:05:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.574+0000 7f5cd8d9b700 1 --2- 172.21.15.37:0/118936072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5cd40b8430 0x7f5cd40cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.574+0000 7f5cd3fff700 1 --2- 172.21.15.37:0/118936072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40cfa90 0x7f5cd415d740 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0000c00 tx=0x7f5cc0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.574+0000 7f5cd17fa700 1 -- 172.21.15.37:0/118936072 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0003db0 con 0x7f5cd40cfa90 2023-07-12T02:05:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.574+0000 7f5cd17fa700 1 -- 172.21.15.37:0/118936072 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc001f070 con 0x7f5cd40cfa90 2023-07-12T02:05:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.574+0000 7f5cd17fa700 1 -- 172.21.15.37:0/118936072 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0011870 con 0x7f5cd40cfa90 2023-07-12T02:05:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.574+0000 7f5cdafff700 1 -- 172.21.15.37:0/118936072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd41f3580 con 0x7f5cd40cfa90 2023-07-12T02:05:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.575+0000 7f5cdafff700 1 -- 172.21.15.37:0/118936072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd415dc80 con 0x7f5cd40cfa90 2023-07-12T02:05:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.575+0000 7f5cdafff700 1 -- 172.21.15.37:0/118936072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd41f3a60 con 0x7f5cd40cfa90 2023-07-12T02:05:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.576+0000 7f5cd17fa700 1 -- 172.21.15.37:0/118936072 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5cc0021030 con 0x7f5cd40cfa90 2023-07-12T02:05:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.577+0000 7f5cd17fa700 1 --2- 172.21.15.37:0/118936072 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5cb806ace0 0x7f5cb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.578+0000 7f5cd17fa700 1 -- 172.21.15.37:0/118936072 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5cc008ac00 con 0x7f5cd40cfa90 2023-07-12T02:05:17.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.578+0000 7f5cd8d9b700 1 --2- 172.21.15.37:0/118936072 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5cb806ace0 0x7f5cb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:17.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.579+0000 7f5cd8d9b700 1 --2- 172.21.15.37:0/118936072 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5cb806ace0 0x7f5cb806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80011e0 tx=0x7f5cc8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.581+0000 7f5cd17fa700 1 -- 172.21.15.37:0/118936072 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5cc0055970 con 0x7f5cd40cfa90 2023-07-12T02:05:17.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.788+0000 7f5cdafff700 1 -- 172.21.15.37:0/118936072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5cd404ea60 con 0x7f5cd40cfa90 2023-07-12T02:05:17.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.788+0000 7f5cd17fa700 1 -- 172.21.15.37:0/118936072 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5cc0058f90 con 0x7f5cd40cfa90 2023-07-12T02:05:17.792 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:05:17.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.790+0000 7f5cdafff700 1 -- 172.21.15.37:0/118936072 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5cb806ace0 msgr2=0x7f5cb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:17.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.790+0000 7f5cdafff700 1 --2- 172.21.15.37:0/118936072 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5cb806ace0 0x7f5cb806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80011e0 tx=0x7f5cc8009040 comp rx=0 tx=0).stop 2023-07-12T02:05:17.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.790+0000 7f5cdafff700 1 -- 172.21.15.37:0/118936072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40cfa90 msgr2=0x7f5cd415d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:17.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.790+0000 7f5cdafff700 1 --2- 172.21.15.37:0/118936072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40cfa90 0x7f5cd415d740 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0000c00 tx=0x7f5cc0004750 comp rx=0 tx=0).stop 2023-07-12T02:05:17.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.790+0000 7f5cdafff700 1 -- 172.21.15.37:0/118936072 shutdown_connections 2023-07-12T02:05:17.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.790+0000 7f5cdafff700 1 --2- 172.21.15.37:0/118936072 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5cb806ace0 0x7f5cb806d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.790+0000 7f5cdafff700 1 --2- 172.21.15.37:0/118936072 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5cd40d3730 0x7f5cd41f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.790+0000 7f5cdafff700 1 --2- 172.21.15.37:0/118936072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5cd40b8430 0x7f5cd40cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.790+0000 7f5cdafff700 1 --2- 172.21.15.37:0/118936072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40cfa90 0x7f5cd415d740 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:17.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.790+0000 7f5cdafff700 1 -- 172.21.15.37:0/118936072 >> 172.21.15.37:0/118936072 conn(0x7f5cd406b3f0 msgr2=0x7f5cd40d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:17.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.790+0000 7f5cdafff700 1 -- 172.21.15.37:0/118936072 shutdown_connections 2023-07-12T02:05:17.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:17.791+0000 7f5cdafff700 1 -- 172.21.15.37:0/118936072 wait complete. 2023-07-12T02:05:17.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-12T02:05:18.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.010+0000 7f77f4bff700 1 Processor -- start 2023-07-12T02:05:18.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.010+0000 7f77f4bff700 1 -- start start 2023-07-12T02:05:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.011+0000 7f77f4bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77f00d2640 0x7f77f00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.011+0000 7f77f4bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f00d1790 con 0x7f77f00cf8f0 2023-07-12T02:05:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.012+0000 7f77f4bff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f00cd950 con 0x7f77f015c460 2023-07-12T02:05:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.012+0000 7f77f4bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f00cedd0 con 0x7f77f00d2640 2023-07-12T02:05:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.012+0000 7f77eed9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f77f00cf8f0 0x7f77f015fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38822/0 (socket says 172.21.15.37:38822) 2023-07-12T02:05:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.012+0000 7f77edd9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77f00d2640 0x7f77f00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:18.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.012+0000 7f77eed9d700 1 -- 172.21.15.37:0/3022534447 learned_addr learned my addr 172.21.15.37:0/3022534447 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.012+0000 7f77edd9b700 1 -- 172.21.15.37:0/3022534447 >> v1:172.21.15.196:6789/0 conn(0x7f77f015c460 legacy=0x7f77f00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.012+0000 7f77edd9b700 1 -- 172.21.15.37:0/3022534447 >> v1:172.21.15.37:6789/0 conn(0x7f77f00cf8f0 legacy=0x7f77f015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:18.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.012+0000 7f77edd9b700 1 -- 172.21.15.37:0/3022534447 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f00d14b0 con 0x7f77f00d2640 2023-07-12T02:05:18.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.012+0000 7f77edd9b700 1 --2- 172.21.15.37:0/3022534447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77f00d2640 0x7f77f00b59d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009840 tx=0x7f77e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ff47d9958fc7f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:18.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.013+0000 7f77ed59a700 1 -- 172.21.15.37:0/3022534447 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4011830 con 0x7f77f00d2640 2023-07-12T02:05:18.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.013+0000 7f77ed59a700 1 -- 172.21.15.37:0/3022534447 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e4011990 con 0x7f77f00d2640 2023-07-12T02:05:18.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.013+0000 7f77ed59a700 1 -- 172.21.15.37:0/3022534447 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4011d20 con 0x7f77f00d2640 2023-07-12T02:05:18.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.013+0000 7f77f4bff700 1 -- 172.21.15.37:0/3022534447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77f00d2640 msgr2=0x7f77f00b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:18.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.013+0000 7f77f4bff700 1 --2- 172.21.15.37:0/3022534447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77f00d2640 0x7f77f00b59d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009840 tx=0x7f77e4009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:18.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.013+0000 7f77f4bff700 1 -- 172.21.15.37:0/3022534447 shutdown_connections 2023-07-12T02:05:18.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.013+0000 7f77f4bff700 1 --2- 172.21.15.37:0/3022534447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77f00d2640 0x7f77f00b59d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:18.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.013+0000 7f77f4bff700 1 -- 172.21.15.37:0/3022534447 >> 172.21.15.37:0/3022534447 conn(0x7f77f0071660 msgr2=0x7f77f0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:18.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.013+0000 7f77f4bff700 1 -- 172.21.15.37:0/3022534447 shutdown_connections 2023-07-12T02:05:18.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.013+0000 7f77f4bff700 1 -- 172.21.15.37:0/3022534447 wait complete. 2023-07-12T02:05:18.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.016+0000 7f77f4bff700 1 Processor -- start 2023-07-12T02:05:18.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.016+0000 7f77f4bff700 1 -- start start 2023-07-12T02:05:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.017+0000 7f77f4bff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77f00cf8f0 0x7f77f0145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.017+0000 7f77f4bff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77f00d2640 0x7f77f00c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.017+0000 7f77f4bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77f015c460 0x7f77f00c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.017+0000 7f77f4bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f0145840 con 0x7f77f015c460 2023-07-12T02:05:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.017+0000 7f77f4bff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f00c8de0 con 0x7f77f00cf8f0 2023-07-12T02:05:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.017+0000 7f77f4bff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f0157ef0 con 0x7f77f00d2640 2023-07-12T02:05:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.018+0000 7f77eed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77f015c460 0x7f77f00c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.018+0000 7f77eed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77f015c460 0x7f77f00c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49858/0 (socket says 172.21.15.37:49858) 2023-07-12T02:05:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.018+0000 7f77eed9d700 1 -- 172.21.15.37:0/3395894120 learned_addr learned my addr 172.21.15.37:0/3395894120 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.018+0000 7f77ee59c700 1 --2- 172.21.15.37:0/3395894120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77f00cf8f0 0x7f77f0145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:18.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.018+0000 7f77edd9b700 1 --2- 172.21.15.37:0/3395894120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77f00d2640 0x7f77f00c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.018+0000 7f77eed9d700 1 -- 172.21.15.37:0/3395894120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77f00d2640 msgr2=0x7f77f00c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.018+0000 7f77eed9d700 1 --2- 172.21.15.37:0/3395894120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77f00d2640 0x7f77f00c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.018+0000 7f77eed9d700 1 -- 172.21.15.37:0/3395894120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77f00cf8f0 msgr2=0x7f77f0145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.018+0000 7f77eed9d700 1 --2- 172.21.15.37:0/3395894120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77f00cf8f0 0x7f77f0145300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.018+0000 7f77eed9d700 1 -- 172.21.15.37:0/3395894120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e40094a0 con 0x7f77f015c460 2023-07-12T02:05:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.018+0000 7f77eed9d700 1 --2- 172.21.15.37:0/3395894120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77f015c460 0x7f77f00c66b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f77e800ca80 tx=0x7f77e800cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.019+0000 7f77deffd700 1 -- 172.21.15.37:0/3395894120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e800a9e0 con 0x7f77f015c460 2023-07-12T02:05:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.019+0000 7f77deffd700 1 -- 172.21.15.37:0/3395894120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e800ab40 con 0x7f77f015c460 2023-07-12T02:05:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.019+0000 7f77deffd700 1 -- 172.21.15.37:0/3395894120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8012400 con 0x7f77f015c460 2023-07-12T02:05:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.019+0000 7f77f4bff700 1 -- 172.21.15.37:0/3395894120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f01581d0 con 0x7f77f015c460 2023-07-12T02:05:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.019+0000 7f77f4bff700 1 -- 172.21.15.37:0/3395894120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f0158790 con 0x7f77f015c460 2023-07-12T02:05:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.020+0000 7f77f4bff700 1 -- 172.21.15.37:0/3395894120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f00723f0 con 0x7f77f015c460 2023-07-12T02:05:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.021+0000 7f77deffd700 1 -- 172.21.15.37:0/3395894120 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f77e801b3b0 con 0x7f77f015c460 2023-07-12T02:05:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.022+0000 7f77deffd700 1 --2- 172.21.15.37:0/3395894120 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f77d006ace0 0x7f77d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.022+0000 7f77deffd700 1 -- 172.21.15.37:0/3395894120 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f77e80892c0 con 0x7f77f015c460 2023-07-12T02:05:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.022+0000 7f77ee59c700 1 --2- 172.21.15.37:0/3395894120 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f77d006ace0 0x7f77d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:18.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.023+0000 7f77ee59c700 1 --2- 172.21.15.37:0/3395894120 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f77d006ace0 0x7f77d006d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f77e0007fd0 tx=0x7f77e0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:18.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.026+0000 7f77deffd700 1 -- 172.21.15.37:0/3395894120 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f77e8054050 con 0x7f77f015c460 2023-07-12T02:05:18.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.255+0000 7f77f4bff700 1 -- 172.21.15.37:0/3395894120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f77f004ea60 con 0x7f77f015c460 2023-07-12T02:05:18.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.255+0000 7f77deffd700 1 -- 172.21.15.37:0/3395894120 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f77e8057670 con 0x7f77f015c460 2023-07-12T02:05:18.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.257+0000 7f77f4bff700 1 -- 172.21.15.37:0/3395894120 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f77d006ace0 msgr2=0x7f77d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:18.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.257+0000 7f77f4bff700 1 --2- 172.21.15.37:0/3395894120 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f77d006ace0 0x7f77d006d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f77e0007fd0 tx=0x7f77e0009040 comp rx=0 tx=0).stop 2023-07-12T02:05:18.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.257+0000 7f77f4bff700 1 -- 172.21.15.37:0/3395894120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77f015c460 msgr2=0x7f77f00c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:18.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.257+0000 7f77f4bff700 1 --2- 172.21.15.37:0/3395894120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77f015c460 0x7f77f00c66b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f77e800ca80 tx=0x7f77e800cd90 comp rx=0 tx=0).stop 2023-07-12T02:05:18.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.258+0000 7f77f4bff700 1 -- 172.21.15.37:0/3395894120 shutdown_connections 2023-07-12T02:05:18.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.258+0000 7f77f4bff700 1 --2- 172.21.15.37:0/3395894120 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f77d006ace0 0x7f77d006d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:18.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.258+0000 7f77f4bff700 1 --2- 172.21.15.37:0/3395894120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77f015c460 0x7f77f00c66b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:18.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.258+0000 7f77f4bff700 1 --2- 172.21.15.37:0/3395894120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77f00cf8f0 0x7f77f0145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:18.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.258+0000 7f77f4bff700 1 --2- 172.21.15.37:0/3395894120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77f00d2640 0x7f77f00c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:18.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.258+0000 7f77f4bff700 1 -- 172.21.15.37:0/3395894120 >> 172.21.15.37:0/3395894120 conn(0x7f77f0071660 msgr2=0x7f77f00d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:18.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.258+0000 7f77f4bff700 1 -- 172.21.15.37:0/3395894120 shutdown_connections 2023-07-12T02:05:18.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.258+0000 7f77f4bff700 1 -- 172.21.15.37:0/3395894120 wait complete. 2023-07-12T02:05:18.263 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-12T02:05:18.278 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-07-12T02:05:18.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:18.279 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-07-12T02:05:18.365 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-12T02:05:18.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:18.365 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-12T02:05:18.411 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:05:18.412 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:05:18.462 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:05:18.463 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:05:18.510 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:05:18.510 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:05:18.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:05:18.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.792+0000 7fc6d53ff700 1 Processor -- start 2023-07-12T02:05:18.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.792+0000 7fc6d53ff700 1 -- start start 2023-07-12T02:05:18.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.794+0000 7fc6d53ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc6d00d2640 0x7fc6d00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:18.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.794+0000 7fc6d53ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d00d1790 con 0x7fc6d015c460 2023-07-12T02:05:18.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.794+0000 7fc6d53ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d00cd950 con 0x7fc6d00cf8f0 2023-07-12T02:05:18.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.794+0000 7fc6d53ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d00cedd0 con 0x7fc6d00d2640 2023-07-12T02:05:18.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.794+0000 7fc6ceffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc6d015c460 0x7fc6d00cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38832/0 (socket says 172.21.15.37:38832) 2023-07-12T02:05:18.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.794+0000 7fc6ceffd700 1 -- 172.21.15.37:0/3703779001 learned_addr learned my addr 172.21.15.37:0/3703779001 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:18.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.794+0000 7fc6ce7fc700 1 --2- 172.21.15.37:0/3703779001 >> v2:172.21.15.37:3300/0 conn(0x7fc6d00d2640 0x7fc6d00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:18.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.794+0000 7fc6ce7fc700 1 -- 172.21.15.37:0/3703779001 >> v1:172.21.15.196:6789/0 conn(0x7fc6d00cf8f0 legacy=0x7fc6d015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:18.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.794+0000 7fc6ce7fc700 1 -- 172.21.15.37:0/3703779001 >> v1:172.21.15.37:6789/0 conn(0x7fc6d015c460 legacy=0x7fc6d00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:18.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.794+0000 7fc6ce7fc700 1 -- 172.21.15.37:0/3703779001 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d00d14b0 con 0x7fc6d00d2640 2023-07-12T02:05:18.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.794+0000 7fc6cdffb700 1 -- 172.21.15.37:0/3703779001 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018238010 0 0) 0x7fc6d00d1790 con 0x7fc6d015c460 2023-07-12T02:05:18.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.795+0000 7fc6ce7fc700 1 --2- 172.21.15.37:0/3703779001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d00d2640 0x7fc6d00b59d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009840 tx=0x7fc6c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8afe86de6e62af server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:18.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.795+0000 7fc6cdffb700 1 -- 172.21.15.37:0/3703779001 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4011830 con 0x7fc6d00d2640 2023-07-12T02:05:18.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.795+0000 7fc6cdffb700 1 -- 172.21.15.37:0/3703779001 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c4011990 con 0x7fc6d00d2640 2023-07-12T02:05:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.795+0000 7fc6cdffb700 1 -- 172.21.15.37:0/3703779001 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4011d20 con 0x7fc6d00d2640 2023-07-12T02:05:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.795+0000 7fc6d53ff700 1 -- 172.21.15.37:0/3703779001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d00d2640 msgr2=0x7fc6d00b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.795+0000 7fc6d53ff700 1 --2- 172.21.15.37:0/3703779001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d00d2640 0x7fc6d00b59d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009840 tx=0x7fc6c4009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.796+0000 7fc6d53ff700 1 -- 172.21.15.37:0/3703779001 shutdown_connections 2023-07-12T02:05:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.796+0000 7fc6d53ff700 1 --2- 172.21.15.37:0/3703779001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d00d2640 0x7fc6d00b59d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.796+0000 7fc6d53ff700 1 -- 172.21.15.37:0/3703779001 >> 172.21.15.37:0/3703779001 conn(0x7fc6d0071660 msgr2=0x7fc6d0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.796+0000 7fc6d53ff700 1 -- 172.21.15.37:0/3703779001 shutdown_connections 2023-07-12T02:05:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.796+0000 7fc6d53ff700 1 -- 172.21.15.37:0/3703779001 wait complete. 2023-07-12T02:05:18.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.797+0000 7fc6d53ff700 1 Processor -- start 2023-07-12T02:05:18.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.798+0000 7fc6d53ff700 1 -- start start 2023-07-12T02:05:18.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6d53ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d00cf8f0 0x7fc6d015d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:18.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6d53ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d00d2640 0x7fc6d015eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:18.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6d53ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6d015c460 0x7fc6d00c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:18.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6d53ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d01e66f0 con 0x7fc6d00cf8f0 2023-07-12T02:05:18.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6d53ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d01e5dc0 con 0x7fc6d00d2640 2023-07-12T02:05:18.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6d53ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d01e60a0 con 0x7fc6d015c460 2023-07-12T02:05:18.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6ceffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d00cf8f0 0x7fc6d015d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:18.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6ceffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d00cf8f0 0x7fc6d015d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49882/0 (socket says 172.21.15.37:49882) 2023-07-12T02:05:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6ceffd700 1 -- 172.21.15.37:0/2936430496 learned_addr learned my addr 172.21.15.37:0/2936430496 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6cf7fe700 1 --2- 172.21.15.37:0/2936430496 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6d015c460 0x7fc6d00c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6ce7fc700 1 --2- 172.21.15.37:0/2936430496 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d00d2640 0x7fc6d015eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6ceffd700 1 -- 172.21.15.37:0/2936430496 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6d015c460 msgr2=0x7fc6d00c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6ceffd700 1 --2- 172.21.15.37:0/2936430496 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6d015c460 0x7fc6d00c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6ceffd700 1 -- 172.21.15.37:0/2936430496 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d00d2640 msgr2=0x7fc6d015eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6ceffd700 1 --2- 172.21.15.37:0/2936430496 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d00d2640 0x7fc6d015eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6ceffd700 1 -- 172.21.15.37:0/2936430496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c40094a0 con 0x7fc6d00cf8f0 2023-07-12T02:05:18.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6ce7fc700 1 --2- 172.21.15.37:0/2936430496 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d00d2640 0x7fc6d015eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:18.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6cf7fe700 1 --2- 172.21.15.37:0/2936430496 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6d015c460 0x7fc6d00c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:18.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.799+0000 7fc6ceffd700 1 --2- 172.21.15.37:0/2936430496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d00cf8f0 0x7fc6d015d340 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000c520 tx=0x7fc6c000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:18.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.800+0000 7fc6b77fe700 1 -- 172.21.15.37:0/2936430496 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0004c80 con 0x7fc6d00cf8f0 2023-07-12T02:05:18.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.800+0000 7fc6b77fe700 1 -- 172.21.15.37:0/2936430496 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c0004e00 con 0x7fc6d00cf8f0 2023-07-12T02:05:18.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.800+0000 7fc6b77fe700 1 -- 172.21.15.37:0/2936430496 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0007310 con 0x7fc6d00cf8f0 2023-07-12T02:05:18.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.800+0000 7fc6d53ff700 1 -- 172.21.15.37:0/2936430496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d01e6380 con 0x7fc6d00cf8f0 2023-07-12T02:05:18.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.800+0000 7fc6d53ff700 1 -- 172.21.15.37:0/2936430496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d00c9f30 con 0x7fc6d00cf8f0 2023-07-12T02:05:18.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.801+0000 7fc6d53ff700 1 -- 172.21.15.37:0/2936430496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d004ea60 con 0x7fc6d00cf8f0 2023-07-12T02:05:18.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.802+0000 7fc6b77fe700 1 -- 172.21.15.37:0/2936430496 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc6c0007470 con 0x7fc6d00cf8f0 2023-07-12T02:05:18.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.802+0000 7fc6b77fe700 1 --2- 172.21.15.37:0/2936430496 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc6bc06ace0 0x7fc6bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:18.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.803+0000 7fc6b77fe700 1 -- 172.21.15.37:0/2936430496 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc6c00894e0 con 0x7fc6d00cf8f0 2023-07-12T02:05:18.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.803+0000 7fc6ce7fc700 1 --2- 172.21.15.37:0/2936430496 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc6bc06ace0 0x7fc6bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:18.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.804+0000 7fc6ce7fc700 1 --2- 172.21.15.37:0/2936430496 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc6bc06ace0 0x7fc6bc06d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00c9d20 tx=0x7fc6c401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:18.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:18.807+0000 7fc6b77fe700 1 -- 172.21.15.37:0/2936430496 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc6c0054260 con 0x7fc6d00cf8f0 2023-07-12T02:05:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.012+0000 7fc6d53ff700 1 -- 172.21.15.37:0/2936430496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6d015bc80 con 0x7fc6d00cf8f0 2023-07-12T02:05:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.013+0000 7fc6b77fe700 1 -- 172.21.15.37:0/2936430496 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20168 (secure 0 0 0) 0x7fc6c0057880 con 0x7fc6d00cf8f0 2023-07-12T02:05:19.017 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:19.018 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:39.032667+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:05:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.016+0000 7fc6d53ff700 1 -- 172.21.15.37:0/2936430496 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc6bc06ace0 msgr2=0x7fc6bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.016+0000 7fc6d53ff700 1 --2- 172.21.15.37:0/2936430496 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc6bc06ace0 0x7fc6bc06d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00c9d20 tx=0x7fc6c401c040 comp rx=0 tx=0).stop 2023-07-12T02:05:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.016+0000 7fc6d53ff700 1 -- 172.21.15.37:0/2936430496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d00cf8f0 msgr2=0x7fc6d015d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.016+0000 7fc6d53ff700 1 --2- 172.21.15.37:0/2936430496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d00cf8f0 0x7fc6d015d340 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000c520 tx=0x7fc6c000c8e0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.016+0000 7fc6d53ff700 1 -- 172.21.15.37:0/2936430496 shutdown_connections 2023-07-12T02:05:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.016+0000 7fc6d53ff700 1 --2- 172.21.15.37:0/2936430496 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc6bc06ace0 0x7fc6bc06d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.016+0000 7fc6d53ff700 1 --2- 172.21.15.37:0/2936430496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d00cf8f0 0x7fc6d015d340 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.016+0000 7fc6d53ff700 1 --2- 172.21.15.37:0/2936430496 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6d015c460 0x7fc6d00c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.016+0000 7fc6d53ff700 1 --2- 172.21.15.37:0/2936430496 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d00d2640 0x7fc6d015eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.016+0000 7fc6d53ff700 1 -- 172.21.15.37:0/2936430496 >> 172.21.15.37:0/2936430496 conn(0x7fc6d0071660 msgr2=0x7fc6d00b7090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.016+0000 7fc6d53ff700 1 -- 172.21.15.37:0/2936430496 shutdown_connections 2023-07-12T02:05:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.016+0000 7fc6d53ff700 1 -- 172.21.15.37:0/2936430496 wait complete. 2023-07-12T02:05:19.038 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:03:56.039938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:03:56.612707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-12T02:04:00.200885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-12T02:05:19.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:05:19.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.239+0000 7f19a57ff700 1 Processor -- start 2023-07-12T02:05:19.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.239+0000 7f19a57ff700 1 -- start start 2023-07-12T02:05:19.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.241+0000 7f19a57ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19a00b8430 0x7f19a00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:19.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.241+0000 7f19a57ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19a00cfc60 0x7f19a00d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:19.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.241+0000 7f19a57ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a00d0b20 con 0x7f19a00d3730 2023-07-12T02:05:19.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.241+0000 7f19a57ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a00b8800 con 0x7f19a00b8430 2023-07-12T02:05:19.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.241+0000 7f19a57ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00b4ee0 con 0x7f19a00cfc60 2023-07-12T02:05:19.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.241+0000 7f199effd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19a00b8430 0x7f19a00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:19.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.241+0000 7f199e7fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f19a00d3730 0x7f19a00cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38836/0 (socket says 172.21.15.37:38836) 2023-07-12T02:05:19.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.241+0000 7f199e7fc700 1 -- 172.21.15.37:0/1123042736 learned_addr learned my addr 172.21.15.37:0/1123042736 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.241+0000 7f199f7fe700 1 --2- 172.21.15.37:0/1123042736 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19a00cfc60 0x7f19a00d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.241+0000 7f199dffb700 1 -- 172.21.15.37:0/1123042736 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507739709 0 0) 0x7f19a00d0b20 con 0x7f19a00d3730 2023-07-12T02:05:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.241+0000 7f199dffb700 1 -- 172.21.15.37:0/1123042736 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19880035b0 con 0x7f19a00d3730 2023-07-12T02:05:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.242+0000 7f199effd700 1 -- 172.21.15.37:0/1123042736 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19a00cfc60 msgr2=0x7f19a00d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.242+0000 7f199effd700 1 --2- 172.21.15.37:0/1123042736 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19a00cfc60 0x7f19a00d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.242+0000 7f199effd700 1 -- 172.21.15.37:0/1123042736 >> v1:172.21.15.37:6789/0 conn(0x7f19a00d3730 legacy=0x7f19a00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.242+0000 7f199effd700 1 -- 172.21.15.37:0/1123042736 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a00b51c0 con 0x7f19a00b8430 2023-07-12T02:05:19.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.242+0000 7f199effd700 1 --2- 172.21.15.37:0/1123042736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00b8430 0x7f19a00cd320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1990009840 tx=0x7f1990009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8681e06b5763f571 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:19.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.242+0000 7f199dffb700 1 -- 172.21.15.37:0/1123042736 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990011830 con 0x7f19a00b8430 2023-07-12T02:05:19.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.242+0000 7f199dffb700 1 -- 172.21.15.37:0/1123042736 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1990011990 con 0x7f19a00b8430 2023-07-12T02:05:19.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.242+0000 7f199dffb700 1 -- 172.21.15.37:0/1123042736 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990011d20 con 0x7f19a00b8430 2023-07-12T02:05:19.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.243+0000 7f19a57ff700 1 -- 172.21.15.37:0/1123042736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00b8430 msgr2=0x7f19a00cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:19.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.243+0000 7f19a57ff700 1 --2- 172.21.15.37:0/1123042736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00b8430 0x7f19a00cd320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1990009840 tx=0x7f1990009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:19.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.243+0000 7f19a57ff700 1 -- 172.21.15.37:0/1123042736 shutdown_connections 2023-07-12T02:05:19.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.243+0000 7f19a57ff700 1 --2- 172.21.15.37:0/1123042736 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19a00cfc60 0x7f19a00d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.243+0000 7f19a57ff700 1 --2- 172.21.15.37:0/1123042736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00b8430 0x7f19a00cd320 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.243+0000 7f19a57ff700 1 -- 172.21.15.37:0/1123042736 >> 172.21.15.37:0/1123042736 conn(0x7f19a006b3f0 msgr2=0x7f19a006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:19.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.243+0000 7f19a57ff700 1 -- 172.21.15.37:0/1123042736 shutdown_connections 2023-07-12T02:05:19.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.243+0000 7f19a57ff700 1 -- 172.21.15.37:0/1123042736 wait complete. 2023-07-12T02:05:19.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.245+0000 7f19a57ff700 1 Processor -- start 2023-07-12T02:05:19.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.245+0000 7f19a57ff700 1 -- start start 2023-07-12T02:05:19.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.246+0000 7f19a57ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19a00b8430 0x7f19a00cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:19.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.246+0000 7f19a57ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19a00cfc60 0x7f19a00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:19.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.246+0000 7f19a57ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00d3730 0x7f19a015db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:19.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.246+0000 7f19a57ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00ca510 con 0x7f19a00d3730 2023-07-12T02:05:19.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.246+0000 7f19a57ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00ca7f0 con 0x7f19a00cfc60 2023-07-12T02:05:19.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.246+0000 7f19a57ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00caad0 con 0x7f19a00b8430 2023-07-12T02:05:19.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.246+0000 7f199f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00d3730 0x7f19a015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:19.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.246+0000 7f199f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00d3730 0x7f19a015db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49900/0 (socket says 172.21.15.37:49900) 2023-07-12T02:05:19.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.246+0000 7f199f7fe700 1 -- 172.21.15.37:0/1279996961 learned_addr learned my addr 172.21.15.37:0/1279996961 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:19.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.246+0000 7f199effd700 1 --2- 172.21.15.37:0/1279996961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19a00b8430 0x7f19a00cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:19.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.246+0000 7f199e7fc700 1 --2- 172.21.15.37:0/1279996961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19a00cfc60 0x7f19a00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:19.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.246+0000 7f199f7fe700 1 -- 172.21.15.37:0/1279996961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19a00b8430 msgr2=0x7f19a00cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:19.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.246+0000 7f199f7fe700 1 --2- 172.21.15.37:0/1279996961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19a00b8430 0x7f19a00cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.246+0000 7f199f7fe700 1 -- 172.21.15.37:0/1279996961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19a00cfc60 msgr2=0x7f19a00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:19.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.246+0000 7f199f7fe700 1 --2- 172.21.15.37:0/1279996961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19a00cfc60 0x7f19a00c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.247+0000 7f199f7fe700 1 -- 172.21.15.37:0/1279996961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19900094a0 con 0x7f19a00d3730 2023-07-12T02:05:19.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.247+0000 7f199e7fc700 1 --2- 172.21.15.37:0/1279996961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19a00cfc60 0x7f19a00c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:19.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.247+0000 7f199f7fe700 1 --2- 172.21.15.37:0/1279996961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00d3730 0x7f19a015db30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f199800efc0 tx=0x7f199800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:19.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.247+0000 7f19877fe700 1 -- 172.21.15.37:0/1279996961 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199800cd40 con 0x7f19a00d3730 2023-07-12T02:05:19.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.247+0000 7f19877fe700 1 -- 172.21.15.37:0/1279996961 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199800f040 con 0x7f19a00d3730 2023-07-12T02:05:19.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.247+0000 7f19a57ff700 1 -- 172.21.15.37:0/1279996961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a00cadb0 con 0x7f19a00d3730 2023-07-12T02:05:19.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.247+0000 7f19877fe700 1 -- 172.21.15.37:0/1279996961 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19980146c0 con 0x7f19a00d3730 2023-07-12T02:05:19.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.247+0000 7f19a57ff700 1 -- 172.21.15.37:0/1279996961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a00ca150 con 0x7f19a00d3730 2023-07-12T02:05:19.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.248+0000 7f19a57ff700 1 -- 172.21.15.37:0/1279996961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a004ea60 con 0x7f19a00d3730 2023-07-12T02:05:19.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.249+0000 7f19877fe700 1 -- 172.21.15.37:0/1279996961 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1998014820 con 0x7f19a00d3730 2023-07-12T02:05:19.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.250+0000 7f19877fe700 1 --2- 172.21.15.37:0/1279996961 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f198c06ace0 0x7f198c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:19.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.250+0000 7f19877fe700 1 -- 172.21.15.37:0/1279996961 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f199808a4c0 con 0x7f19a00d3730 2023-07-12T02:05:19.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.251+0000 7f199effd700 1 --2- 172.21.15.37:0/1279996961 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f198c06ace0 0x7f198c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:19.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.251+0000 7f199effd700 1 --2- 172.21.15.37:0/1279996961 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f198c06ace0 0x7f198c06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1990000c00 tx=0x7f199001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:19.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.255+0000 7f19877fe700 1 -- 172.21.15.37:0/1279996961 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1998058c30 con 0x7f19a00d3730 2023-07-12T02:05:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.460+0000 7f19a57ff700 1 -- 172.21.15.37:0/1279996961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19a00ce700 con 0x7f19a00d3730 2023-07-12T02:05:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.461+0000 7f19877fe700 1 -- 172.21.15.37:0/1279996961 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f199800cea0 con 0x7f19a00d3730 2023-07-12T02:05:19.464 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:05:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.463+0000 7f19a57ff700 1 -- 172.21.15.37:0/1279996961 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f198c06ace0 msgr2=0x7f198c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.463+0000 7f19a57ff700 1 --2- 172.21.15.37:0/1279996961 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f198c06ace0 0x7f198c06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1990000c00 tx=0x7f199001c040 comp rx=0 tx=0).stop 2023-07-12T02:05:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.463+0000 7f19a57ff700 1 -- 172.21.15.37:0/1279996961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00d3730 msgr2=0x7f19a015db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.463+0000 7f19a57ff700 1 --2- 172.21.15.37:0/1279996961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00d3730 0x7f19a015db30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f199800efc0 tx=0x7f199800c3a0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.463+0000 7f19a57ff700 1 -- 172.21.15.37:0/1279996961 shutdown_connections 2023-07-12T02:05:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.463+0000 7f19a57ff700 1 --2- 172.21.15.37:0/1279996961 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f198c06ace0 0x7f198c06d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.463+0000 7f19a57ff700 1 --2- 172.21.15.37:0/1279996961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00d3730 0x7f19a015db30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.463+0000 7f19a57ff700 1 --2- 172.21.15.37:0/1279996961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19a00b8430 0x7f19a00cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.463+0000 7f19a57ff700 1 --2- 172.21.15.37:0/1279996961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19a00cfc60 0x7f19a00c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.463+0000 7f19a57ff700 1 -- 172.21.15.37:0/1279996961 >> 172.21.15.37:0/1279996961 conn(0x7f19a006b3f0 msgr2=0x7f19a00d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.463+0000 7f19a57ff700 1 -- 172.21.15.37:0/1279996961 shutdown_connections 2023-07-12T02:05:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.463+0000 7f19a57ff700 1 -- 172.21.15.37:0/1279996961 wait complete. 2023-07-12T02:05:19.484 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:05:19.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.685+0000 7f2c8b1ff700 1 Processor -- start 2023-07-12T02:05:19.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.685+0000 7f2c8b1ff700 1 -- start start 2023-07-12T02:05:19.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.687+0000 7f2c8b1ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c840d3730 0x7f2c840cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:19.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.687+0000 7f2c8b1ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c840cfa90 0x7f2c840d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:19.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.687+0000 7f2c8b1ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c840d0b20 con 0x7f2c840b8430 2023-07-12T02:05:19.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.687+0000 7f2c8b1ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c840cda30 con 0x7f2c840d3730 2023-07-12T02:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.687+0000 7f2c8b1ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840b8800 con 0x7f2c840cfa90 2023-07-12T02:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.687+0000 7f2c83fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c840d3730 0x7f2c840cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.687+0000 7f2c83fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c840d3730 0x7f2c840cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49914/0 (socket says 172.21.15.37:49914) 2023-07-12T02:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.687+0000 7f2c83fff700 1 -- 172.21.15.37:0/388362419 learned_addr learned my addr 172.21.15.37:0/388362419 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.687+0000 7f2c8979c700 1 --2- 172.21.15.37:0/388362419 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c840cfa90 0x7f2c840d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.687+0000 7f2c83fff700 1 -- 172.21.15.37:0/388362419 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c840cfa90 msgr2=0x7f2c840d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.687+0000 7f2c83fff700 1 --2- 172.21.15.37:0/388362419 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c840cfa90 0x7f2c840d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.687+0000 7f2c83fff700 1 -- 172.21.15.37:0/388362419 >> v1:172.21.15.196:6789/0 conn(0x7f2c840b8430 legacy=0x7f2c840cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.687+0000 7f2c83fff700 1 -- 172.21.15.37:0/388362419 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c840cfeb0 con 0x7f2c840d3730 2023-07-12T02:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.687+0000 7f2c8979c700 1 --2- 172.21.15.37:0/388362419 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c840cfa90 0x7f2c840d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.688+0000 7f2c83fff700 1 --2- 172.21.15.37:0/388362419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c840d3730 0x7f2c840cf550 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2c700098f0 tx=0x7f2c70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78edb24d16f4b58b server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.688+0000 7f2c837fe700 1 -- 172.21.15.37:0/388362419 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000b8a0 con 0x7f2c840d3730 2023-07-12T02:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.688+0000 7f2c837fe700 1 -- 172.21.15.37:0/388362419 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7000ba00 con 0x7f2c840d3730 2023-07-12T02:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.688+0000 7f2c837fe700 1 -- 172.21.15.37:0/388362419 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000bd90 con 0x7f2c840d3730 2023-07-12T02:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.688+0000 7f2c8b1ff700 1 -- 172.21.15.37:0/388362419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c840d3730 msgr2=0x7f2c840cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:19.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.688+0000 7f2c8b1ff700 1 --2- 172.21.15.37:0/388362419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c840d3730 0x7f2c840cf550 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2c700098f0 tx=0x7f2c70009c00 comp rx=0 tx=0).stop 2023-07-12T02:05:19.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.689+0000 7f2c8b1ff700 1 -- 172.21.15.37:0/388362419 shutdown_connections 2023-07-12T02:05:19.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.689+0000 7f2c8b1ff700 1 --2- 172.21.15.37:0/388362419 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c840cfa90 0x7f2c840d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.689+0000 7f2c8b1ff700 1 --2- 172.21.15.37:0/388362419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c840d3730 0x7f2c840cf550 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.689+0000 7f2c8b1ff700 1 -- 172.21.15.37:0/388362419 >> 172.21.15.37:0/388362419 conn(0x7f2c8406b3f0 msgr2=0x7f2c8406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:19.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.689+0000 7f2c8b1ff700 1 -- 172.21.15.37:0/388362419 shutdown_connections 2023-07-12T02:05:19.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.689+0000 7f2c8b1ff700 1 -- 172.21.15.37:0/388362419 wait complete. 2023-07-12T02:05:19.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.690+0000 7f2c8b1ff700 1 Processor -- start 2023-07-12T02:05:19.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.690+0000 7f2c8b1ff700 1 -- start start 2023-07-12T02:05:19.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.691+0000 7f2c8b1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c840b8430 0x7f2c840c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:19.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.691+0000 7f2c8b1ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c840cfa90 0x7f2c841f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:19.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.691+0000 7f2c8b1ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c840d3730 0x7f2c840b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:19.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.691+0000 7f2c8b1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840c6f70 con 0x7f2c840b8430 2023-07-12T02:05:19.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.691+0000 7f2c8b1ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840c7250 con 0x7f2c840cfa90 2023-07-12T02:05:19.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.691+0000 7f2c8b1ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840c7530 con 0x7f2c840d3730 2023-07-12T02:05:19.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.692+0000 7f2c88f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c840b8430 0x7f2c840c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:19.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.692+0000 7f2c88f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c840b8430 0x7f2c840c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49916/0 (socket says 172.21.15.37:49916) 2023-07-12T02:05:19.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.692+0000 7f2c88f9b700 1 -- 172.21.15.37:0/2632228376 learned_addr learned my addr 172.21.15.37:0/2632228376 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:19.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.692+0000 7f2c83fff700 1 --2- 172.21.15.37:0/2632228376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c840cfa90 0x7f2c841f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.692+0000 7f2c8979c700 1 --2- 172.21.15.37:0/2632228376 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c840d3730 0x7f2c840b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.692+0000 7f2c88f9b700 1 -- 172.21.15.37:0/2632228376 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c840d3730 msgr2=0x7f2c840b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.692+0000 7f2c88f9b700 1 --2- 172.21.15.37:0/2632228376 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c840d3730 0x7f2c840b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.692+0000 7f2c88f9b700 1 -- 172.21.15.37:0/2632228376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c840cfa90 msgr2=0x7f2c841f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.692+0000 7f2c88f9b700 1 --2- 172.21.15.37:0/2632228376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c840cfa90 0x7f2c841f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.692+0000 7f2c88f9b700 1 -- 172.21.15.37:0/2632228376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c70009550 con 0x7f2c840b8430 2023-07-12T02:05:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.692+0000 7f2c83fff700 1 --2- 172.21.15.37:0/2632228376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c840cfa90 0x7f2c841f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.692+0000 7f2c88f9b700 1 --2- 172.21.15.37:0/2632228376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c840b8430 0x7f2c840c6670 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800c4e0 tx=0x7f2c7800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:19.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.693+0000 7f2c817fa700 1 -- 172.21.15.37:0/2632228376 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c780052d0 con 0x7f2c840b8430 2023-07-12T02:05:19.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.693+0000 7f2c817fa700 1 -- 172.21.15.37:0/2632228376 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c78005430 con 0x7f2c840b8430 2023-07-12T02:05:19.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.693+0000 7f2c817fa700 1 -- 172.21.15.37:0/2632228376 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c780038c0 con 0x7f2c840b8430 2023-07-12T02:05:19.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.693+0000 7f2c8b1ff700 1 -- 172.21.15.37:0/2632228376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c840c7810 con 0x7f2c840b8430 2023-07-12T02:05:19.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.693+0000 7f2c8b1ff700 1 -- 172.21.15.37:0/2632228376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c840c6bb0 con 0x7f2c840b8430 2023-07-12T02:05:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.694+0000 7f2c8b1ff700 1 -- 172.21.15.37:0/2632228376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c8404ea60 con 0x7f2c840b8430 2023-07-12T02:05:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.695+0000 7f2c817fa700 1 -- 172.21.15.37:0/2632228376 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2c78003a20 con 0x7f2c840b8430 2023-07-12T02:05:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.697+0000 7f2c817fa700 1 --2- 172.21.15.37:0/2632228376 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2c6806ace0 0x7f2c6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.697+0000 7f2c817fa700 1 -- 172.21.15.37:0/2632228376 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2c78088da0 con 0x7f2c840b8430 2023-07-12T02:05:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.697+0000 7f2c83fff700 1 --2- 172.21.15.37:0/2632228376 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2c6806ace0 0x7f2c6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.698+0000 7f2c83fff700 1 --2- 172.21.15.37:0/2632228376 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2c6806ace0 0x7f2c6806d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2c70014040 tx=0x7f2c70008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.701+0000 7f2c817fa700 1 -- 172.21.15.37:0/2632228376 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2c78053a80 con 0x7f2c840b8430 2023-07-12T02:05:19.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.908+0000 7f2c8b1ff700 1 -- 172.21.15.37:0/2632228376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2c840cde60 con 0x7f2c840b8430 2023-07-12T02:05:19.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.908+0000 7f2c817fa700 1 -- 172.21.15.37:0/2632228376 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2c78017020 con 0x7f2c840b8430 2023-07-12T02:05:19.912 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:05:19.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.911+0000 7f2c8b1ff700 1 -- 172.21.15.37:0/2632228376 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2c6806ace0 msgr2=0x7f2c6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:19.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.911+0000 7f2c8b1ff700 1 --2- 172.21.15.37:0/2632228376 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2c6806ace0 0x7f2c6806d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2c70014040 tx=0x7f2c70008030 comp rx=0 tx=0).stop 2023-07-12T02:05:19.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.911+0000 7f2c8b1ff700 1 -- 172.21.15.37:0/2632228376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c840b8430 msgr2=0x7f2c840c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:19.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.911+0000 7f2c8b1ff700 1 --2- 172.21.15.37:0/2632228376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c840b8430 0x7f2c840c6670 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800c4e0 tx=0x7f2c7800c8a0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.911+0000 7f2c8b1ff700 1 -- 172.21.15.37:0/2632228376 shutdown_connections 2023-07-12T02:05:19.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.911+0000 7f2c8b1ff700 1 --2- 172.21.15.37:0/2632228376 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2c6806ace0 0x7f2c6806d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.911+0000 7f2c8b1ff700 1 --2- 172.21.15.37:0/2632228376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c840b8430 0x7f2c840c6670 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.911+0000 7f2c8b1ff700 1 --2- 172.21.15.37:0/2632228376 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c840d3730 0x7f2c840b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.911+0000 7f2c8b1ff700 1 --2- 172.21.15.37:0/2632228376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c840cfa90 0x7f2c841f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:19.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.911+0000 7f2c8b1ff700 1 -- 172.21.15.37:0/2632228376 >> 172.21.15.37:0/2632228376 conn(0x7f2c8406b3f0 msgr2=0x7f2c840d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:19.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.911+0000 7f2c8b1ff700 1 -- 172.21.15.37:0/2632228376 shutdown_connections 2023-07-12T02:05:19.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:19.911+0000 7f2c8b1ff700 1 -- 172.21.15.37:0/2632228376 wait complete. 2023-07-12T02:05:19.932 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:05:20.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.134+0000 7f538abff700 1 Processor -- start 2023-07-12T02:05:20.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.134+0000 7f538abff700 1 -- start start 2023-07-12T02:05:20.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.135+0000 7f538abff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53840cfc60 0x7f5384167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:20.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.135+0000 7f538abff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53840d0b20 con 0x7f53840d3730 2023-07-12T02:05:20.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.135+0000 7f538abff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53840b4ee0 con 0x7f53840b8430 2023-07-12T02:05:20.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.135+0000 7f538abff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53840cda30 con 0x7f53840cfc60 2023-07-12T02:05:20.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.135+0000 7f5383fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f53840d3730 0x7f53840cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38846/0 (socket says 172.21.15.37:38846) 2023-07-12T02:05:20.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.135+0000 7f5383fff700 1 -- 172.21.15.37:0/443805657 learned_addr learned my addr 172.21.15.37:0/443805657 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:20.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.136+0000 7f538919c700 1 --2- 172.21.15.37:0/443805657 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53840cfc60 0x7f5384167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:20.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.136+0000 7f53837fe700 1 -- 172.21.15.37:0/443805657 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360994026 0 0) 0x7f53840d0b20 con 0x7f53840d3730 2023-07-12T02:05:20.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.136+0000 7f53837fe700 1 -- 172.21.15.37:0/443805657 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53740035b0 con 0x7f53840d3730 2023-07-12T02:05:20.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.136+0000 7f53837fe700 1 -- 172.21.15.37:0/443805657 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611176737 0 0) 0x7f53840b4ee0 con 0x7f53840b8430 2023-07-12T02:05:20.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.136+0000 7f53837fe700 1 -- 172.21.15.37:0/443805657 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53840d0b20 con 0x7f53840b8430 2023-07-12T02:05:20.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.136+0000 7f538919c700 1 -- 172.21.15.37:0/443805657 >> v1:172.21.15.196:6789/0 conn(0x7f53840b8430 legacy=0x7f53840cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:20.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.136+0000 7f538919c700 1 -- 172.21.15.37:0/443805657 >> v1:172.21.15.37:6789/0 conn(0x7f53840d3730 legacy=0x7f53840cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:20.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.136+0000 7f53837fe700 1 -- 172.21.15.37:0/443805657 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4182271899 0 0) 0x7f53740035b0 con 0x7f53840d3730 2023-07-12T02:05:20.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.136+0000 7f538919c700 1 -- 172.21.15.37:0/443805657 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53840b51c0 con 0x7f53840cfc60 2023-07-12T02:05:20.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.136+0000 7f538919c700 1 --2- 172.21.15.37:0/443805657 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53840cfc60 0x7f5384167010 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f537c009dc0 tx=0x7f537c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4c5a254a33594aa server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:20.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.137+0000 7f53837fe700 1 -- 172.21.15.37:0/443805657 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c00e070 con 0x7f53840cfc60 2023-07-12T02:05:20.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.137+0000 7f53837fe700 1 -- 172.21.15.37:0/443805657 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c003a20 con 0x7f53840cfc60 2023-07-12T02:05:20.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.137+0000 7f53837fe700 1 -- 172.21.15.37:0/443805657 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5370001670 con 0x7f53840cfc60 2023-07-12T02:05:20.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.137+0000 7f538abff700 1 -- 172.21.15.37:0/443805657 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53840cfc60 msgr2=0x7f5384167010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:20.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.137+0000 7f538abff700 1 --2- 172.21.15.37:0/443805657 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53840cfc60 0x7f5384167010 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f537c009dc0 tx=0x7f537c00b330 comp rx=0 tx=0).stop 2023-07-12T02:05:20.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.137+0000 7f538abff700 1 -- 172.21.15.37:0/443805657 shutdown_connections 2023-07-12T02:05:20.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.137+0000 7f538abff700 1 --2- 172.21.15.37:0/443805657 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53840cfc60 0x7f5384167010 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:20.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.137+0000 7f538abff700 1 -- 172.21.15.37:0/443805657 >> 172.21.15.37:0/443805657 conn(0x7f538406b3f0 msgr2=0x7f538406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:20.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.138+0000 7f538abff700 1 -- 172.21.15.37:0/443805657 shutdown_connections 2023-07-12T02:05:20.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.138+0000 7f538abff700 1 -- 172.21.15.37:0/443805657 wait complete. 2023-07-12T02:05:20.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.139+0000 7f538abff700 1 Processor -- start 2023-07-12T02:05:20.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.139+0000 7f538abff700 1 -- start start 2023-07-12T02:05:20.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.140+0000 7f538abff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53840b8430 0x7f5384154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:20.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.140+0000 7f538abff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53840cfc60 0x7f53840b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:20.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.140+0000 7f538abff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53840d3730 0x7f53840b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:20.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.140+0000 7f538abff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538415c930 con 0x7f53840cfc60 2023-07-12T02:05:20.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.140+0000 7f538abff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53841f19d0 con 0x7f53840b8430 2023-07-12T02:05:20.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.140+0000 7f538abff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53841f5ef0 con 0x7f53840d3730 2023-07-12T02:05:20.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.141+0000 7f5383fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53840cfc60 0x7f53840b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:20.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.141+0000 7f538899b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53840b8430 0x7f5384154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:20.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.141+0000 7f538919c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53840d3730 0x7f53840b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:20.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.141+0000 7f538899b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53840b8430 0x7f5384154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:54488/0 (socket says 172.21.15.37:54488) 2023-07-12T02:05:20.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.141+0000 7f5383fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53840cfc60 0x7f53840b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49924/0 (socket says 172.21.15.37:49924) 2023-07-12T02:05:20.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.141+0000 7f538899b700 1 -- 172.21.15.37:0/4066067413 learned_addr learned my addr 172.21.15.37:0/4066067413 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:20.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.141+0000 7f538919c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53840d3730 0x7f53840b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:60002/0 (socket says 172.21.15.37:60002) 2023-07-12T02:05:20.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.141+0000 7f5383fff700 1 -- 172.21.15.37:0/4066067413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53840d3730 msgr2=0x7f53840b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:20.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.141+0000 7f5383fff700 1 --2- 172.21.15.37:0/4066067413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53840d3730 0x7f53840b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.141+0000 7f5383fff700 1 -- 172.21.15.37:0/4066067413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53840b8430 msgr2=0x7f5384154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.141+0000 7f5383fff700 1 --2- 172.21.15.37:0/4066067413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53840b8430 0x7f5384154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.141+0000 7f5383fff700 1 -- 172.21.15.37:0/4066067413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c009a70 con 0x7f53840cfc60 2023-07-12T02:05:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.141+0000 7f538919c700 1 --2- 172.21.15.37:0/4066067413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53840d3730 0x7f53840b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.142+0000 7f5383fff700 1 --2- 172.21.15.37:0/4066067413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53840cfc60 0x7f53840b3600 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f53700011e0 tx=0x7f537000c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.142+0000 7f53817fa700 1 -- 172.21.15.37:0/4066067413 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5370004c80 con 0x7f53840cfc60 2023-07-12T02:05:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.142+0000 7f53817fa700 1 -- 172.21.15.37:0/4066067413 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5370004e00 con 0x7f53840cfc60 2023-07-12T02:05:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.142+0000 7f538abff700 1 -- 172.21.15.37:0/4066067413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538415cb40 con 0x7f53840cfc60 2023-07-12T02:05:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.142+0000 7f53817fa700 1 -- 172.21.15.37:0/4066067413 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5370007310 con 0x7f53840cfc60 2023-07-12T02:05:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.142+0000 7f538abff700 1 -- 172.21.15.37:0/4066067413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538415d100 con 0x7f53840cfc60 2023-07-12T02:05:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.143+0000 7f538abff700 1 -- 172.21.15.37:0/4066067413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538415d320 con 0x7f53840cfc60 2023-07-12T02:05:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.144+0000 7f53817fa700 1 -- 172.21.15.37:0/4066067413 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5370007470 con 0x7f53840cfc60 2023-07-12T02:05:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.145+0000 7f53817fa700 1 --2- 172.21.15.37:0/4066067413 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f536806ace0 0x7f536806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.145+0000 7f53817fa700 1 -- 172.21.15.37:0/4066067413 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5370089410 con 0x7f53840cfc60 2023-07-12T02:05:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.146+0000 7f538899b700 1 --2- 172.21.15.37:0/4066067413 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f536806ace0 0x7f536806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.146+0000 7f538899b700 1 --2- 172.21.15.37:0/4066067413 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f536806ace0 0x7f536806d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5378007fd0 tx=0x7f5378009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.150+0000 7f53817fa700 1 -- 172.21.15.37:0/4066067413 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f53700540f0 con 0x7f53840cfc60 2023-07-12T02:05:20.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.356+0000 7f538abff700 1 -- 172.21.15.37:0/4066067413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f538404ea60 con 0x7f53840cfc60 2023-07-12T02:05:20.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.357+0000 7f53817fa700 1 -- 172.21.15.37:0/4066067413 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5370057710 con 0x7f53840cfc60 2023-07-12T02:05:20.360 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:05:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.359+0000 7f538abff700 1 -- 172.21.15.37:0/4066067413 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f536806ace0 msgr2=0x7f536806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.359+0000 7f538abff700 1 --2- 172.21.15.37:0/4066067413 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f536806ace0 0x7f536806d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5378007fd0 tx=0x7f5378009040 comp rx=0 tx=0).stop 2023-07-12T02:05:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.359+0000 7f538abff700 1 -- 172.21.15.37:0/4066067413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53840cfc60 msgr2=0x7f53840b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.359+0000 7f538abff700 1 --2- 172.21.15.37:0/4066067413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53840cfc60 0x7f53840b3600 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f53700011e0 tx=0x7f537000c780 comp rx=0 tx=0).stop 2023-07-12T02:05:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.359+0000 7f538abff700 1 -- 172.21.15.37:0/4066067413 shutdown_connections 2023-07-12T02:05:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.359+0000 7f538abff700 1 --2- 172.21.15.37:0/4066067413 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f536806ace0 0x7f536806d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.359+0000 7f538abff700 1 --2- 172.21.15.37:0/4066067413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53840d3730 0x7f53840b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.359+0000 7f538abff700 1 --2- 172.21.15.37:0/4066067413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53840b8430 0x7f5384154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.359+0000 7f538abff700 1 --2- 172.21.15.37:0/4066067413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53840cfc60 0x7f53840b3600 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.359+0000 7f538abff700 1 -- 172.21.15.37:0/4066067413 >> 172.21.15.37:0/4066067413 conn(0x7f538406b3f0 msgr2=0x7f53840729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.359+0000 7f538abff700 1 -- 172.21.15.37:0/4066067413 shutdown_connections 2023-07-12T02:05:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.359+0000 7f538abff700 1 -- 172.21.15.37:0/4066067413 wait complete. 2023-07-12T02:05:20.381 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:05:20.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.581+0000 7ff9197ff700 1 Processor -- start 2023-07-12T02:05:20.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.581+0000 7ff9197ff700 1 -- start start 2023-07-12T02:05:20.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.582+0000 7ff9197ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9140afca0 0x7ff914160a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:20.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.582+0000 7ff9197ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9140caee0 0x7ff9140cb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:20.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.582+0000 7ff9197ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9140b0070 con 0x7ff91406e0a0 2023-07-12T02:05:20.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.583+0000 7ff9197ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9140cb8a0 con 0x7ff9140caee0 2023-07-12T02:05:20.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.583+0000 7ff9197ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91406e880 con 0x7ff9140afca0 2023-07-12T02:05:20.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.583+0000 7ff9137fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9140caee0 0x7ff9140cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:20.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.583+0000 7ff9127fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff91406e0a0 0x7ff91406bdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38850/0 (socket says 172.21.15.37:38850) 2023-07-12T02:05:20.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.583+0000 7ff9127fc700 1 -- 172.21.15.37:0/3639406421 learned_addr learned my addr 172.21.15.37:0/3639406421 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:20.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.583+0000 7ff912ffd700 1 --2- 172.21.15.37:0/3639406421 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9140afca0 0x7ff914160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:20.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.583+0000 7ff911ffb700 1 -- 172.21.15.37:0/3639406421 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978455858 0 0) 0x7ff9140b0070 con 0x7ff91406e0a0 2023-07-12T02:05:20.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.583+0000 7ff911ffb700 1 -- 172.21.15.37:0/3639406421 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8fc0035b0 con 0x7ff91406e0a0 2023-07-12T02:05:20.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.583+0000 7ff9137fe700 1 -- 172.21.15.37:0/3639406421 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9140afca0 msgr2=0x7ff914160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:20.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.583+0000 7ff9137fe700 1 --2- 172.21.15.37:0/3639406421 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9140afca0 0x7ff914160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:20.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.583+0000 7ff9137fe700 1 -- 172.21.15.37:0/3639406421 >> v1:172.21.15.37:6789/0 conn(0x7ff91406e0a0 legacy=0x7ff91406bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:20.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.583+0000 7ff9137fe700 1 -- 172.21.15.37:0/3639406421 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91406eb60 con 0x7ff9140caee0 2023-07-12T02:05:20.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.584+0000 7ff9137fe700 1 --2- 172.21.15.37:0/3639406421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9140caee0 0x7ff9140cb360 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009d90 tx=0x7ff90c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2dc5291b210325 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:20.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.584+0000 7ff911ffb700 1 -- 172.21.15.37:0/3639406421 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c00e070 con 0x7ff9140caee0 2023-07-12T02:05:20.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.584+0000 7ff911ffb700 1 -- 172.21.15.37:0/3639406421 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c00bb20 con 0x7ff9140caee0 2023-07-12T02:05:20.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.584+0000 7ff911ffb700 1 -- 172.21.15.37:0/3639406421 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c012430 con 0x7ff9140caee0 2023-07-12T02:05:20.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.584+0000 7ff9197ff700 1 -- 172.21.15.37:0/3639406421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9140caee0 msgr2=0x7ff9140cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:20.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.584+0000 7ff9197ff700 1 --2- 172.21.15.37:0/3639406421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9140caee0 0x7ff9140cb360 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009d90 tx=0x7ff90c00b330 comp rx=0 tx=0).stop 2023-07-12T02:05:20.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.584+0000 7ff9197ff700 1 -- 172.21.15.37:0/3639406421 shutdown_connections 2023-07-12T02:05:20.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.584+0000 7ff9197ff700 1 --2- 172.21.15.37:0/3639406421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9140caee0 0x7ff9140cb360 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:20.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.584+0000 7ff9197ff700 1 --2- 172.21.15.37:0/3639406421 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9140afca0 0x7ff914160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:20.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.584+0000 7ff9197ff700 1 -- 172.21.15.37:0/3639406421 >> 172.21.15.37:0/3639406421 conn(0x7ff91408a3b0 msgr2=0x7ff91406a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:20.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.585+0000 7ff9197ff700 1 -- 172.21.15.37:0/3639406421 shutdown_connections 2023-07-12T02:05:20.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.585+0000 7ff9197ff700 1 -- 172.21.15.37:0/3639406421 wait complete. 2023-07-12T02:05:20.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.586+0000 7ff9197ff700 1 Processor -- start 2023-07-12T02:05:20.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.586+0000 7ff9197ff700 1 -- start start 2023-07-12T02:05:20.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.587+0000 7ff9197ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff91406e0a0 0x7ff9140d0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:20.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.587+0000 7ff9197ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9140afca0 0x7ff9140ced90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:20.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.587+0000 7ff9197ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9140caee0 0x7ff9140c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:20.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.588+0000 7ff9197ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9140d12d0 con 0x7ff9140afca0 2023-07-12T02:05:20.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.588+0000 7ff9197ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9140d0a70 con 0x7ff9140caee0 2023-07-12T02:05:20.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.588+0000 7ff9197ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9140d0d10 con 0x7ff91406e0a0 2023-07-12T02:05:20.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.588+0000 7ff9127fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9140afca0 0x7ff9140ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:20.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.588+0000 7ff9127fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9140afca0 0x7ff9140ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49944/0 (socket says 172.21.15.37:49944) 2023-07-12T02:05:20.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.588+0000 7ff9127fc700 1 -- 172.21.15.37:0/1776327817 learned_addr learned my addr 172.21.15.37:0/1776327817 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:20.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.588+0000 7ff9137fe700 1 --2- 172.21.15.37:0/1776327817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9140caee0 0x7ff9140c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:20.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.588+0000 7ff912ffd700 1 --2- 172.21.15.37:0/1776327817 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff91406e0a0 0x7ff9140d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:20.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.588+0000 7ff9127fc700 1 -- 172.21.15.37:0/1776327817 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff91406e0a0 msgr2=0x7ff9140d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:20.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.588+0000 7ff9127fc700 1 --2- 172.21.15.37:0/1776327817 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff91406e0a0 0x7ff9140d0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:20.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.588+0000 7ff9127fc700 1 -- 172.21.15.37:0/1776327817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9140caee0 msgr2=0x7ff9140c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:20.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.588+0000 7ff9127fc700 1 --2- 172.21.15.37:0/1776327817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9140caee0 0x7ff9140c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:20.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.588+0000 7ff9127fc700 1 -- 172.21.15.37:0/1776327817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c009a70 con 0x7ff9140afca0 2023-07-12T02:05:20.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.588+0000 7ff9127fc700 1 --2- 172.21.15.37:0/1776327817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9140afca0 0x7ff9140ced90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff908001260 tx=0x7ff90800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:20.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.589+0000 7ff8fb7fe700 1 -- 172.21.15.37:0/1776327817 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9080074e0 con 0x7ff9140afca0 2023-07-12T02:05:20.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.589+0000 7ff8fb7fe700 1 -- 172.21.15.37:0/1776327817 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff908007640 con 0x7ff9140afca0 2023-07-12T02:05:20.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.589+0000 7ff9197ff700 1 -- 172.21.15.37:0/1776327817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9140d0ff0 con 0x7ff9140afca0 2023-07-12T02:05:20.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.589+0000 7ff8fb7fe700 1 -- 172.21.15.37:0/1776327817 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908005a50 con 0x7ff9140afca0 2023-07-12T02:05:20.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.589+0000 7ff9197ff700 1 -- 172.21.15.37:0/1776327817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9140ce870 con 0x7ff9140afca0 2023-07-12T02:05:20.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.590+0000 7ff9197ff700 1 -- 172.21.15.37:0/1776327817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff91404ea60 con 0x7ff9140afca0 2023-07-12T02:05:20.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.591+0000 7ff8fb7fe700 1 -- 172.21.15.37:0/1776327817 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff908005bb0 con 0x7ff9140afca0 2023-07-12T02:05:20.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.592+0000 7ff8fb7fe700 1 --2- 172.21.15.37:0/1776327817 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff90006ace0 0x7ff90006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:20.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.592+0000 7ff8fb7fe700 1 -- 172.21.15.37:0/1776327817 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff908088cf0 con 0x7ff9140afca0 2023-07-12T02:05:20.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.593+0000 7ff912ffd700 1 --2- 172.21.15.37:0/1776327817 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff90006ace0 0x7ff90006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:20.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.594+0000 7ff912ffd700 1 --2- 172.21.15.37:0/1776327817 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff90006ace0 0x7ff90006d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff904006fd0 tx=0x7ff904008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:20.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.597+0000 7ff8fb7fe700 1 -- 172.21.15.37:0/1776327817 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff90808d070 con 0x7ff9140afca0 2023-07-12T02:05:20.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.803+0000 7ff9197ff700 1 -- 172.21.15.37:0/1776327817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9140af700 con 0x7ff9140afca0 2023-07-12T02:05:20.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.804+0000 7ff8fb7fe700 1 -- 172.21.15.37:0/1776327817 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9080170a0 con 0x7ff9140afca0 2023-07-12T02:05:20.807 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-12T02:05:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.806+0000 7ff9197ff700 1 -- 172.21.15.37:0/1776327817 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff90006ace0 msgr2=0x7ff90006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.806+0000 7ff9197ff700 1 --2- 172.21.15.37:0/1776327817 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff90006ace0 0x7ff90006d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff904006fd0 tx=0x7ff904008040 comp rx=0 tx=0).stop 2023-07-12T02:05:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.806+0000 7ff9197ff700 1 -- 172.21.15.37:0/1776327817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9140afca0 msgr2=0x7ff9140ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.806+0000 7ff9197ff700 1 --2- 172.21.15.37:0/1776327817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9140afca0 0x7ff9140ced90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff908001260 tx=0x7ff90800ca90 comp rx=0 tx=0).stop 2023-07-12T02:05:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.806+0000 7ff9197ff700 1 -- 172.21.15.37:0/1776327817 shutdown_connections 2023-07-12T02:05:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.806+0000 7ff9197ff700 1 --2- 172.21.15.37:0/1776327817 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7ff90006ace0 0x7ff90006d190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.806+0000 7ff9197ff700 1 --2- 172.21.15.37:0/1776327817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9140caee0 0x7ff9140c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.806+0000 7ff9197ff700 1 --2- 172.21.15.37:0/1776327817 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff91406e0a0 0x7ff9140d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.806+0000 7ff9197ff700 1 --2- 172.21.15.37:0/1776327817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9140afca0 0x7ff9140ced90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.806+0000 7ff9197ff700 1 -- 172.21.15.37:0/1776327817 >> 172.21.15.37:0/1776327817 conn(0x7ff91408a3b0 msgr2=0x7ff9140cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.806+0000 7ff9197ff700 1 -- 172.21.15.37:0/1776327817 shutdown_connections 2023-07-12T02:05:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:20.806+0000 7ff9197ff700 1 -- 172.21.15.37:0/1776327817 wait complete. 2023-07-12T02:05:20.827 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-12T02:05:21.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.027+0000 7f3a83fff700 1 Processor -- start 2023-07-12T02:05:21.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.028+0000 7f3a83fff700 1 -- start start 2023-07-12T02:05:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.029+0000 7f3a83fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3a7c0d3730 0x7f3a7c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.029+0000 7f3a83fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3a7c0cfa90 0x7f3a7c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.029+0000 7f3a83fff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7c0d0b20 con 0x7f3a7c0b8430 2023-07-12T02:05:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.029+0000 7f3a83fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7c0cda30 con 0x7f3a7c0cfa90 2023-07-12T02:05:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.029+0000 7f3a83fff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7c0b8800 con 0x7f3a7c0d3730 2023-07-12T02:05:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.029+0000 7f3a8259c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3a7c0cfa90 0x7f3a7c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:21.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.029+0000 7f3a8259c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3a7c0cfa90 0x7f3a7c0d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49946/0 (socket says 172.21.15.37:49946) 2023-07-12T02:05:21.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.029+0000 7f3a8259c700 1 -- 172.21.15.37:0/750093572 learned_addr learned my addr 172.21.15.37:0/750093572 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:21.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.029+0000 7f3a8159a700 1 --2- 172.21.15.37:0/750093572 >> v2:172.21.15.196:3300/0 conn(0x7f3a7c0d3730 0x7f3a7c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:21.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.030+0000 7f3a8259c700 1 -- 172.21.15.37:0/750093572 >> v2:172.21.15.196:3300/0 conn(0x7f3a7c0d3730 msgr2=0x7f3a7c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:21.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.030+0000 7f3a8259c700 1 --2- 172.21.15.37:0/750093572 >> v2:172.21.15.196:3300/0 conn(0x7f3a7c0d3730 0x7f3a7c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.030+0000 7f3a8259c700 1 -- 172.21.15.37:0/750093572 >> v1:172.21.15.196:6789/0 conn(0x7f3a7c0b8430 legacy=0x7f3a7c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:21.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.030+0000 7f3a8259c700 1 -- 172.21.15.37:0/750093572 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c0cfe90 con 0x7f3a7c0cfa90 2023-07-12T02:05:21.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.030+0000 7f3a8259c700 1 --2- 172.21.15.37:0/750093572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a7c0cfa90 0x7f3a7c0d0fb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c160f50 tx=0x7f3a7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8efcefdf43ded1ac server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:21.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.030+0000 7f3a80d99700 1 -- 172.21.15.37:0/750093572 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7400e070 con 0x7f3a7c0cfa90 2023-07-12T02:05:21.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.030+0000 7f3a80d99700 1 -- 172.21.15.37:0/750093572 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7400b910 con 0x7f3a7c0cfa90 2023-07-12T02:05:21.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.030+0000 7f3a80d99700 1 -- 172.21.15.37:0/750093572 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7400bcc0 con 0x7f3a7c0cfa90 2023-07-12T02:05:21.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.031+0000 7f3a83fff700 1 -- 172.21.15.37:0/750093572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a7c0cfa90 msgr2=0x7f3a7c0d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:21.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.031+0000 7f3a83fff700 1 --2- 172.21.15.37:0/750093572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a7c0cfa90 0x7f3a7c0d0fb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c160f50 tx=0x7f3a7400b330 comp rx=0 tx=0).stop 2023-07-12T02:05:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.031+0000 7f3a83fff700 1 -- 172.21.15.37:0/750093572 shutdown_connections 2023-07-12T02:05:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.031+0000 7f3a83fff700 1 --2- 172.21.15.37:0/750093572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a7c0cfa90 0x7f3a7c0d0fb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.031+0000 7f3a83fff700 1 --2- 172.21.15.37:0/750093572 >> v2:172.21.15.196:3300/0 conn(0x7f3a7c0d3730 0x7f3a7c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.031+0000 7f3a83fff700 1 -- 172.21.15.37:0/750093572 >> 172.21.15.37:0/750093572 conn(0x7f3a7c06b3f0 msgr2=0x7f3a7c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.031+0000 7f3a83fff700 1 -- 172.21.15.37:0/750093572 shutdown_connections 2023-07-12T02:05:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.031+0000 7f3a83fff700 1 -- 172.21.15.37:0/750093572 wait complete. 2023-07-12T02:05:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.033+0000 7f3a83fff700 1 Processor -- start 2023-07-12T02:05:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.033+0000 7f3a83fff700 1 -- start start 2023-07-12T02:05:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a83fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a7c0b8430 0x7f3a7c14df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a83fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a7c0cfa90 0x7f3a7c15dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a83fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a7c0d3730 0x7f3a7c15e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a83fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0c8380 con 0x7f3a7c0d3730 2023-07-12T02:05:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a83fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0c8660 con 0x7f3a7c0cfa90 2023-07-12T02:05:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a83fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0c8940 con 0x7f3a7c0b8430 2023-07-12T02:05:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a8259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a7c0d3730 0x7f3a7c15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a8259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a7c0d3730 0x7f3a7c15e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49948/0 (socket says 172.21.15.37:49948) 2023-07-12T02:05:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a8259c700 1 -- 172.21.15.37:0/168704538 learned_addr learned my addr 172.21.15.37:0/168704538 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a8159a700 1 --2- 172.21.15.37:0/168704538 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a7c0cfa90 0x7f3a7c15dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a81d9b700 1 --2- 172.21.15.37:0/168704538 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a7c0b8430 0x7f3a7c14df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:21.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a8259c700 1 -- 172.21.15.37:0/168704538 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a7c0b8430 msgr2=0x7f3a7c14df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:21.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a8259c700 1 --2- 172.21.15.37:0/168704538 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a7c0b8430 0x7f3a7c14df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a8259c700 1 -- 172.21.15.37:0/168704538 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a7c0cfa90 msgr2=0x7f3a7c15dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:21.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a8259c700 1 --2- 172.21.15.37:0/168704538 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a7c0cfa90 0x7f3a7c15dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a8259c700 1 -- 172.21.15.37:0/168704538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a74009b30 con 0x7f3a7c0d3730 2023-07-12T02:05:21.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.034+0000 7f3a8159a700 1 --2- 172.21.15.37:0/168704538 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a7c0cfa90 0x7f3a7c15dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:21.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.035+0000 7f3a8259c700 1 --2- 172.21.15.37:0/168704538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a7c0d3730 0x7f3a7c15e500 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c06c780 tx=0x7f3a74004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:21.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.035+0000 7f3a727fc700 1 -- 172.21.15.37:0/168704538 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a740099b0 con 0x7f3a7c0d3730 2023-07-12T02:05:21.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.035+0000 7f3a727fc700 1 -- 172.21.15.37:0/168704538 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a740092e0 con 0x7f3a7c0d3730 2023-07-12T02:05:21.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.035+0000 7f3a727fc700 1 -- 172.21.15.37:0/168704538 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7401c640 con 0x7f3a7c0d3730 2023-07-12T02:05:21.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.035+0000 7f3a83fff700 1 -- 172.21.15.37:0/168704538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7c0c8c20 con 0x7f3a7c0d3730 2023-07-12T02:05:21.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.035+0000 7f3a83fff700 1 -- 172.21.15.37:0/168704538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7c14e460 con 0x7f3a7c0d3730 2023-07-12T02:05:21.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.036+0000 7f3a83fff700 1 -- 172.21.15.37:0/168704538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a7c0c9140 con 0x7f3a7c0d3730 2023-07-12T02:05:21.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.037+0000 7f3a727fc700 1 -- 172.21.15.37:0/168704538 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a7401c7a0 con 0x7f3a7c0d3730 2023-07-12T02:05:21.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.038+0000 7f3a727fc700 1 --2- 172.21.15.37:0/168704538 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3a6006ace0 0x7f3a6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:21.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.038+0000 7f3a727fc700 1 -- 172.21.15.37:0/168704538 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3a7408b480 con 0x7f3a7c0d3730 2023-07-12T02:05:21.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.039+0000 7f3a81d9b700 1 --2- 172.21.15.37:0/168704538 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3a6006ace0 0x7f3a6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:21.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.040+0000 7f3a81d9b700 1 --2- 172.21.15.37:0/168704538 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3a6006ace0 0x7f3a6006d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0d2e10 tx=0x7f3a78009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:21.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.043+0000 7f3a727fc700 1 -- 172.21.15.37:0/168704538 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3a74056290 con 0x7f3a7c0d3730 2023-07-12T02:05:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.246+0000 7f3a83fff700 1 -- 172.21.15.37:0/168704538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3a7c04ea60 con 0x7f3a7c0d3730 2023-07-12T02:05:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.247+0000 7f3a727fc700 1 -- 172.21.15.37:0/168704538 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3a740598b0 con 0x7f3a7c0d3730 2023-07-12T02:05:21.251 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:05:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.249+0000 7f3a83fff700 1 -- 172.21.15.37:0/168704538 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3a6006ace0 msgr2=0x7f3a6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.249+0000 7f3a83fff700 1 --2- 172.21.15.37:0/168704538 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3a6006ace0 0x7f3a6006d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0d2e10 tx=0x7f3a78009040 comp rx=0 tx=0).stop 2023-07-12T02:05:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.249+0000 7f3a83fff700 1 -- 172.21.15.37:0/168704538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a7c0d3730 msgr2=0x7f3a7c15e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.249+0000 7f3a83fff700 1 --2- 172.21.15.37:0/168704538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a7c0d3730 0x7f3a7c15e500 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c06c780 tx=0x7f3a74004ad0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.249+0000 7f3a83fff700 1 -- 172.21.15.37:0/168704538 shutdown_connections 2023-07-12T02:05:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.249+0000 7f3a83fff700 1 --2- 172.21.15.37:0/168704538 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3a6006ace0 0x7f3a6006d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.249+0000 7f3a83fff700 1 --2- 172.21.15.37:0/168704538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a7c0d3730 0x7f3a7c15e500 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.249+0000 7f3a83fff700 1 --2- 172.21.15.37:0/168704538 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a7c0b8430 0x7f3a7c14df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.249+0000 7f3a83fff700 1 --2- 172.21.15.37:0/168704538 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a7c0cfa90 0x7f3a7c15dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.249+0000 7f3a83fff700 1 -- 172.21.15.37:0/168704538 >> 172.21.15.37:0/168704538 conn(0x7f3a7c06b3f0 msgr2=0x7f3a7c15bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.249+0000 7f3a83fff700 1 -- 172.21.15.37:0/168704538 shutdown_connections 2023-07-12T02:05:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.249+0000 7f3a83fff700 1 -- 172.21.15.37:0/168704538 wait complete. 2023-07-12T02:05:21.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-12T02:05:21.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.468+0000 7fccdabff700 1 Processor -- start 2023-07-12T02:05:21.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.468+0000 7fccdabff700 1 -- start start 2023-07-12T02:05:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.469+0000 7fccdabff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fccd415c460 0x7fccd40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.469+0000 7fccdabff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccd40d2640 0x7fccd40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.470+0000 7fccdabff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd40d1790 con 0x7fccd40cf720 2023-07-12T02:05:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.470+0000 7fccdabff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd40cedd0 con 0x7fccd415c460 2023-07-12T02:05:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.470+0000 7fccdabff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40cd950 con 0x7fccd40d2640 2023-07-12T02:05:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.470+0000 7fccd899b700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fccd415c460 0x7fccd40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.470+0000 7fccd3fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccd40d2640 0x7fccd40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.470+0000 7fccd919c700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fccd40cf720 0x7fccd40d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:35308/0 (socket says 172.21.15.37:35308) 2023-07-12T02:05:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.470+0000 7fccd919c700 1 -- 172.21.15.37:0/286066216 learned_addr learned my addr 172.21.15.37:0/286066216 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.470+0000 7fccd37fe700 1 -- 172.21.15.37:0/286066216 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990858710 0 0) 0x7fccd40d1790 con 0x7fccd40cf720 2023-07-12T02:05:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.470+0000 7fccd37fe700 1 -- 172.21.15.37:0/286066216 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc40035b0 con 0x7fccd40cf720 2023-07-12T02:05:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.471+0000 7fccd3fff700 1 -- 172.21.15.37:0/286066216 >> v2:172.21.15.196:3300/0 conn(0x7fccd415c460 msgr2=0x7fccd40b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.471+0000 7fccd3fff700 1 --2- 172.21.15.37:0/286066216 >> v2:172.21.15.196:3300/0 conn(0x7fccd415c460 0x7fccd40b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.471+0000 7fccd3fff700 1 -- 172.21.15.37:0/286066216 >> v1:172.21.15.196:6789/0 conn(0x7fccd40cf720 legacy=0x7fccd40d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.471+0000 7fccd3fff700 1 -- 172.21.15.37:0/286066216 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd40d14b0 con 0x7fccd40d2640 2023-07-12T02:05:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.471+0000 7fccd899b700 1 --2- 172.21.15.37:0/286066216 >> v2:172.21.15.196:3300/0 conn(0x7fccd415c460 0x7fccd40b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.471+0000 7fccd3fff700 1 --2- 172.21.15.37:0/286066216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccd40d2640 0x7fccd40cf1e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009840 tx=0x7fccc0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81061e49ed46ada2 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.471+0000 7fccd37fe700 1 -- 172.21.15.37:0/286066216 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc0011830 con 0x7fccd40d2640 2023-07-12T02:05:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.471+0000 7fccd37fe700 1 -- 172.21.15.37:0/286066216 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc0011990 con 0x7fccd40d2640 2023-07-12T02:05:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.471+0000 7fccd37fe700 1 -- 172.21.15.37:0/286066216 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc0011d20 con 0x7fccd40d2640 2023-07-12T02:05:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.472+0000 7fccdabff700 1 -- 172.21.15.37:0/286066216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccd40d2640 msgr2=0x7fccd40cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.472+0000 7fccdabff700 1 --2- 172.21.15.37:0/286066216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccd40d2640 0x7fccd40cf1e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009840 tx=0x7fccc0009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.472+0000 7fccdabff700 1 -- 172.21.15.37:0/286066216 shutdown_connections 2023-07-12T02:05:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.472+0000 7fccdabff700 1 --2- 172.21.15.37:0/286066216 >> v2:172.21.15.196:3300/0 conn(0x7fccd415c460 0x7fccd40b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.472+0000 7fccdabff700 1 --2- 172.21.15.37:0/286066216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccd40d2640 0x7fccd40cf1e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.472+0000 7fccdabff700 1 -- 172.21.15.37:0/286066216 >> 172.21.15.37:0/286066216 conn(0x7fccd4071660 msgr2=0x7fccd4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.472+0000 7fccdabff700 1 -- 172.21.15.37:0/286066216 shutdown_connections 2023-07-12T02:05:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.472+0000 7fccdabff700 1 -- 172.21.15.37:0/286066216 wait complete. 2023-07-12T02:05:21.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.474+0000 7fccdabff700 1 Processor -- start 2023-07-12T02:05:21.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.474+0000 7fccdabff700 1 -- start start 2023-07-12T02:05:21.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.475+0000 7fccdabff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd40cf720 0x7fccd40c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:21.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.475+0000 7fccdabff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccd40d2640 0x7fccd41e7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:21.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.475+0000 7fccdabff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccd415c460 0x7fccd40c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.475+0000 7fccdabff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd41e8640 con 0x7fccd40cf720 2023-07-12T02:05:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.475+0000 7fccdabff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd41e7b80 con 0x7fccd40d2640 2023-07-12T02:05:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.475+0000 7fccdabff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd41e7da0 con 0x7fccd415c460 2023-07-12T02:05:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.475+0000 7fccd899b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd40cf720 0x7fccd40c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.475+0000 7fccd899b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd40cf720 0x7fccd40c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49952/0 (socket says 172.21.15.37:49952) 2023-07-12T02:05:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.475+0000 7fccd899b700 1 -- 172.21.15.37:0/3193146665 learned_addr learned my addr 172.21.15.37:0/3193146665 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.476+0000 7fccd3fff700 1 --2- 172.21.15.37:0/3193146665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccd40d2640 0x7fccd41e7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.476+0000 7fccd919c700 1 --2- 172.21.15.37:0/3193146665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccd415c460 0x7fccd40c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.476+0000 7fccd899b700 1 -- 172.21.15.37:0/3193146665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccd415c460 msgr2=0x7fccd40c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.476+0000 7fccd899b700 1 --2- 172.21.15.37:0/3193146665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccd415c460 0x7fccd40c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.476+0000 7fccd899b700 1 -- 172.21.15.37:0/3193146665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccd40d2640 msgr2=0x7fccd41e7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.476+0000 7fccd899b700 1 --2- 172.21.15.37:0/3193146665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccd40d2640 0x7fccd41e7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.476+0000 7fccd899b700 1 -- 172.21.15.37:0/3193146665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc80094a0 con 0x7fccd40cf720 2023-07-12T02:05:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.476+0000 7fccd899b700 1 --2- 172.21.15.37:0/3193146665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd40cf720 0x7fccd40c5a10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fccc800ec10 tx=0x7fccc800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.476+0000 7fccd17fa700 1 -- 172.21.15.37:0/3193146665 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc800c910 con 0x7fccd40cf720 2023-07-12T02:05:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.476+0000 7fccd17fa700 1 -- 172.21.15.37:0/3193146665 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc800ca70 con 0x7fccd40cf720 2023-07-12T02:05:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.476+0000 7fccd17fa700 1 -- 172.21.15.37:0/3193146665 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc800cde0 con 0x7fccd40cf720 2023-07-12T02:05:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.476+0000 7fccdabff700 1 -- 172.21.15.37:0/3193146665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc00094a0 con 0x7fccd40cf720 2023-07-12T02:05:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.476+0000 7fccdabff700 1 -- 172.21.15.37:0/3193146665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd41e8360 con 0x7fccd40cf720 2023-07-12T02:05:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.478+0000 7fccdabff700 1 -- 172.21.15.37:0/3193146665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd415d3a0 con 0x7fccd40cf720 2023-07-12T02:05:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.478+0000 7fccd17fa700 1 -- 172.21.15.37:0/3193146665 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fccc8013470 con 0x7fccd40cf720 2023-07-12T02:05:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.480+0000 7fccd17fa700 1 --2- 172.21.15.37:0/3193146665 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fccb806ace0 0x7fccb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.480+0000 7fccd17fa700 1 -- 172.21.15.37:0/3193146665 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fccc80899e0 con 0x7fccd40cf720 2023-07-12T02:05:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.480+0000 7fccd3fff700 1 --2- 172.21.15.37:0/3193146665 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fccb806ace0 0x7fccb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.481+0000 7fccd3fff700 1 --2- 172.21.15.37:0/3193146665 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fccb806ace0 0x7fccb806d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009fd0 tx=0x7fccc001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:21.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.484+0000 7fccd17fa700 1 -- 172.21.15.37:0/3193146665 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fccc80546c0 con 0x7fccd40cf720 2023-07-12T02:05:21.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.705+0000 7fccdabff700 1 -- 172.21.15.37:0/3193146665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fccd415ce90 con 0x7fccd40cf720 2023-07-12T02:05:21.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.705+0000 7fccd17fa700 1 -- 172.21.15.37:0/3193146665 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fccd415ce90 con 0x7fccd40cf720 2023-07-12T02:05:21.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.707+0000 7fccdabff700 1 -- 172.21.15.37:0/3193146665 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fccb806ace0 msgr2=0x7fccb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:21.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.707+0000 7fccdabff700 1 --2- 172.21.15.37:0/3193146665 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fccb806ace0 0x7fccb806d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009fd0 tx=0x7fccc001c040 comp rx=0 tx=0).stop 2023-07-12T02:05:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.708+0000 7fccdabff700 1 -- 172.21.15.37:0/3193146665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd40cf720 msgr2=0x7fccd40c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.708+0000 7fccdabff700 1 --2- 172.21.15.37:0/3193146665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd40cf720 0x7fccd40c5a10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fccc800ec10 tx=0x7fccc800ef20 comp rx=0 tx=0).stop 2023-07-12T02:05:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.708+0000 7fccdabff700 1 -- 172.21.15.37:0/3193146665 shutdown_connections 2023-07-12T02:05:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.708+0000 7fccdabff700 1 --2- 172.21.15.37:0/3193146665 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fccb806ace0 0x7fccb806d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.708+0000 7fccdabff700 1 --2- 172.21.15.37:0/3193146665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd40cf720 0x7fccd40c5a10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.708+0000 7fccdabff700 1 --2- 172.21.15.37:0/3193146665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccd415c460 0x7fccd40c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.708+0000 7fccdabff700 1 --2- 172.21.15.37:0/3193146665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccd40d2640 0x7fccd41e7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:21.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.708+0000 7fccdabff700 1 -- 172.21.15.37:0/3193146665 >> 172.21.15.37:0/3193146665 conn(0x7fccd4071660 msgr2=0x7fccd40b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:21.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.708+0000 7fccdabff700 1 -- 172.21.15.37:0/3193146665 shutdown_connections 2023-07-12T02:05:21.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:21.708+0000 7fccdabff700 1 -- 172.21.15.37:0/3193146665 wait complete. 2023-07-12T02:05:21.713 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-12T02:05:21.729 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-07-12T02:05:21.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:21.730 DEBUG:teuthology.orchestra.run.smithi196:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-07-12T02:05:21.819 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi196.front.sepia.ceph.com 2023-07-12T02:05:21.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:21.820 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-12T02:05:21.867 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-12T02:05:21.867 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:05:22.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.065+0000 7f75be3ff700 1 Processor -- start 2023-07-12T02:05:22.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.065+0000 7f75be3ff700 1 -- start start 2023-07-12T02:05:22.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.066+0000 7f75be3ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f75b815c460 0x7f75b80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:22.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.066+0000 7f75be3ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75b80d2640 0x7f75b80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:22.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.066+0000 7f75be3ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f75b80cf720 0x7f75b80cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:22.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.066+0000 7f75be3ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b80cedd0 con 0x7f75b815c460 2023-07-12T02:05:22.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.066+0000 7f75be3ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b80d1790 con 0x7f75b80cf720 2023-07-12T02:05:22.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.066+0000 7f75be3ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80cd950 con 0x7f75b80d2640 2023-07-12T02:05:22.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.066+0000 7f75b7fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f75b815c460 0x7f75b80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.066+0000 7f75b7fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f75b815c460 0x7f75b80b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48858/0 (socket says 172.21.15.37:48858) 2023-07-12T02:05:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.066+0000 7f75b7fff700 1 -- 172.21.15.37:0/2774256795 learned_addr learned my addr 172.21.15.37:0/2774256795 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.066+0000 7f75b77fe700 1 --2- 172.21.15.37:0/2774256795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75b80d2640 0x7f75b80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.066+0000 7f75bc99c700 1 --2- 172.21.15.37:0/2774256795 >> v2:172.21.15.196:3300/0 conn(0x7f75b80cf720 0x7f75b80cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.067+0000 7f75b7fff700 1 -- 172.21.15.37:0/2774256795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75b80d2640 msgr2=0x7f75b80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:22.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.067+0000 7f75b7fff700 1 --2- 172.21.15.37:0/2774256795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75b80d2640 0x7f75b80cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.067+0000 7f75b7fff700 1 -- 172.21.15.37:0/2774256795 >> v2:172.21.15.196:3300/0 conn(0x7f75b80cf720 msgr2=0x7f75b80cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:22.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.067+0000 7f75b7fff700 1 --2- 172.21.15.37:0/2774256795 >> v2:172.21.15.196:3300/0 conn(0x7f75b80cf720 0x7f75b80cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.067+0000 7f75b7fff700 1 -- 172.21.15.37:0/2774256795 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b80d14b0 con 0x7f75b815c460 2023-07-12T02:05:22.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.067+0000 7f75b7fff700 1 --2- 172.21.15.37:0/2774256795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b815c460 0x7f75b80b59d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f75b808bf90 tx=0x7f75a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7cefe11edfd7bd server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:22.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.067+0000 7f75b6ffd700 1 -- 172.21.15.37:0/2774256795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8011830 con 0x7f75b815c460 2023-07-12T02:05:22.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.067+0000 7f75b6ffd700 1 -- 172.21.15.37:0/2774256795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a8011990 con 0x7f75b815c460 2023-07-12T02:05:22.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.067+0000 7f75b6ffd700 1 -- 172.21.15.37:0/2774256795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8011d20 con 0x7f75b815c460 2023-07-12T02:05:22.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.068+0000 7f75be3ff700 1 -- 172.21.15.37:0/2774256795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b815c460 msgr2=0x7f75b80b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:22.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.068+0000 7f75be3ff700 1 --2- 172.21.15.37:0/2774256795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b815c460 0x7f75b80b59d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f75b808bf90 tx=0x7f75a8009bd0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.068+0000 7f75be3ff700 1 -- 172.21.15.37:0/2774256795 shutdown_connections 2023-07-12T02:05:22.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.068+0000 7f75be3ff700 1 --2- 172.21.15.37:0/2774256795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b815c460 0x7f75b80b59d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.068+0000 7f75be3ff700 1 --2- 172.21.15.37:0/2774256795 >> v2:172.21.15.196:3300/0 conn(0x7f75b80cf720 0x7f75b80cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.068+0000 7f75be3ff700 1 --2- 172.21.15.37:0/2774256795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75b80d2640 0x7f75b80cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.068+0000 7f75be3ff700 1 -- 172.21.15.37:0/2774256795 >> 172.21.15.37:0/2774256795 conn(0x7f75b8071660 msgr2=0x7f75b8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.068+0000 7f75be3ff700 1 -- 172.21.15.37:0/2774256795 shutdown_connections 2023-07-12T02:05:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.068+0000 7f75be3ff700 1 -- 172.21.15.37:0/2774256795 wait complete. 2023-07-12T02:05:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.070+0000 7f75be3ff700 1 Processor -- start 2023-07-12T02:05:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.070+0000 7f75be3ff700 1 -- start start 2023-07-12T02:05:22.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.071+0000 7f75be3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b80cf720 0x7f75b8153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:22.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.071+0000 7f75be3ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75b80d2640 0x7f75b80b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:22.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.071+0000 7f75be3ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75b815c460 0x7f75b80b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:22.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.071+0000 7f75be3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b81e6130 con 0x7f75b80cf720 2023-07-12T02:05:22.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.071+0000 7f75be3ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b81e6670 con 0x7f75b815c460 2023-07-12T02:05:22.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.071+0000 7f75be3ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b81e6950 con 0x7f75b80d2640 2023-07-12T02:05:22.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.071+0000 7f75b7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b80cf720 0x7f75b8153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:22.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.071+0000 7f75b7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b80cf720 0x7f75b8153920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48870/0 (socket says 172.21.15.37:48870) 2023-07-12T02:05:22.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.071+0000 7f75b7fff700 1 -- 172.21.15.37:0/2514530006 learned_addr learned my addr 172.21.15.37:0/2514530006 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:22.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.071+0000 7f75b77fe700 1 --2- 172.21.15.37:0/2514530006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75b80d2640 0x7f75b80b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:22.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.071+0000 7f75bc99c700 1 --2- 172.21.15.37:0/2514530006 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75b815c460 0x7f75b80b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:22.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.072+0000 7f75b7fff700 1 -- 172.21.15.37:0/2514530006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75b80d2640 msgr2=0x7f75b80b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:22.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.072+0000 7f75b7fff700 1 --2- 172.21.15.37:0/2514530006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75b80d2640 0x7f75b80b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.072+0000 7f75b7fff700 1 -- 172.21.15.37:0/2514530006 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75b815c460 msgr2=0x7f75b80b7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:22.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.072+0000 7f75b7fff700 1 --2- 172.21.15.37:0/2514530006 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75b815c460 0x7f75b80b7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.072+0000 7f75b7fff700 1 -- 172.21.15.37:0/2514530006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a8009550 con 0x7f75b80cf720 2023-07-12T02:05:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.072+0000 7f75b7fff700 1 --2- 172.21.15.37:0/2514530006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b80cf720 0x7f75b8153920 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009c10 tx=0x7f75a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.072+0000 7f75b4ff9700 1 -- 172.21.15.37:0/2514530006 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8004450 con 0x7f75b80cf720 2023-07-12T02:05:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.072+0000 7f75b4ff9700 1 -- 172.21.15.37:0/2514530006 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a801e070 con 0x7f75b80cf720 2023-07-12T02:05:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.072+0000 7f75be3ff700 1 -- 172.21.15.37:0/2514530006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b81e5d50 con 0x7f75b80cf720 2023-07-12T02:05:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.072+0000 7f75b4ff9700 1 -- 172.21.15.37:0/2514530006 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a80038e0 con 0x7f75b80cf720 2023-07-12T02:05:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.072+0000 7f75be3ff700 1 -- 172.21.15.37:0/2514530006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b8158340 con 0x7f75b80cf720 2023-07-12T02:05:22.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.073+0000 7f75be3ff700 1 -- 172.21.15.37:0/2514530006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b804ea60 con 0x7f75b80cf720 2023-07-12T02:05:22.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.074+0000 7f75b4ff9700 1 -- 172.21.15.37:0/2514530006 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f75a8003a40 con 0x7f75b80cf720 2023-07-12T02:05:22.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.075+0000 7f75b4ff9700 1 --2- 172.21.15.37:0/2514530006 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f75a406ace0 0x7f75a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:22.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.075+0000 7f75b4ff9700 1 -- 172.21.15.37:0/2514530006 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f75a808a5a0 con 0x7f75b80cf720 2023-07-12T02:05:22.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.076+0000 7f75b77fe700 1 --2- 172.21.15.37:0/2514530006 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f75a406ace0 0x7f75a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:22.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.076+0000 7f75b77fe700 1 --2- 172.21.15.37:0/2514530006 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f75a406ace0 0x7f75a406d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f75b80b7d00 tx=0x7f75ac009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:22.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.079+0000 7f75b4ff9700 1 -- 172.21.15.37:0/2514530006 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f75a8055310 con 0x7f75b80cf720 2023-07-12T02:05:22.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.336+0000 7f75be3ff700 1 -- 172.21.15.37:0/2514530006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75b80caf10 con 0x7f75b80cf720 2023-07-12T02:05:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.337+0000 7f75b4ff9700 1 -- 172.21.15.37:0/2514530006 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f75a8058930 con 0x7f75b80cf720 2023-07-12T02:05:22.340 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:22.340 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/2496042538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":2496042538},{"type":"v1","addr":"172.21.15.196:6836","nonce":2496042538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2193116262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":2193116262},{"type":"v1","addr":"172.21.15.196:6837","nonce":2193116262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3195008737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3195008737},{"type":"v1","addr":"172.21.15.37:6834","nonce":3195008737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:03:57.647919+0000","modified":"2023-07-12T02:04:25.438552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/4264740807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4264740807},{"type":"v1","addr":"172.21.15.37:6835","nonce":4264740807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-12T02:05:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.339+0000 7f75be3ff700 1 -- 172.21.15.37:0/2514530006 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f75a406ace0 msgr2=0x7f75a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.339+0000 7f75be3ff700 1 --2- 172.21.15.37:0/2514530006 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f75a406ace0 0x7f75a406d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f75b80b7d00 tx=0x7f75ac009210 comp rx=0 tx=0).stop 2023-07-12T02:05:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.339+0000 7f75be3ff700 1 -- 172.21.15.37:0/2514530006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b80cf720 msgr2=0x7f75b8153920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.339+0000 7f75be3ff700 1 --2- 172.21.15.37:0/2514530006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b80cf720 0x7f75b8153920 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009c10 tx=0x7f75a8004750 comp rx=0 tx=0).stop 2023-07-12T02:05:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.339+0000 7f75be3ff700 1 -- 172.21.15.37:0/2514530006 shutdown_connections 2023-07-12T02:05:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.339+0000 7f75be3ff700 1 --2- 172.21.15.37:0/2514530006 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f75a406ace0 0x7f75a406d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.339+0000 7f75be3ff700 1 --2- 172.21.15.37:0/2514530006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b80cf720 0x7f75b8153920 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.339+0000 7f75be3ff700 1 --2- 172.21.15.37:0/2514530006 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75b815c460 0x7f75b80b7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.339+0000 7f75be3ff700 1 --2- 172.21.15.37:0/2514530006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75b80d2640 0x7f75b80b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.339+0000 7f75be3ff700 1 -- 172.21.15.37:0/2514530006 >> 172.21.15.37:0/2514530006 conn(0x7f75b8071660 msgr2=0x7f75b815fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.339+0000 7f75be3ff700 1 -- 172.21.15.37:0/2514530006 shutdown_connections 2023-07-12T02:05:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.339+0000 7f75be3ff700 1 -- 172.21.15.37:0/2514530006 wait complete. 2023-07-12T02:05:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2023-07-12T02:05:22.360 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:05:22.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.557+0000 7fd5735ff700 1 Processor -- start 2023-07-12T02:05:22.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.557+0000 7fd5735ff700 1 -- start start 2023-07-12T02:05:22.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.558+0000 7fd5735ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c15c460 0x7fd56c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:22.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.558+0000 7fd5735ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56c0d1790 con 0x7fd56c0d2640 2023-07-12T02:05:22.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.558+0000 7fd5735ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56c0cd950 con 0x7fd56c0cf8f0 2023-07-12T02:05:22.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.558+0000 7fd5735ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0cedd0 con 0x7fd56c15c460 2023-07-12T02:05:22.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.558+0000 7fd570b9a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd56c0d2640 0x7fd56c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38796/0 (socket says 172.21.15.37:38796) 2023-07-12T02:05:22.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.558+0000 7fd570b9a700 1 -- 172.21.15.37:0/2080618005 learned_addr learned my addr 172.21.15.37:0/2080618005 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:22.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.558+0000 7fd57139b700 1 --2- 172.21.15.37:0/2080618005 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c15c460 0x7fd56c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:22.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.559+0000 7fd563fff700 1 -- 172.21.15.37:0/2080618005 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157824697 0 0) 0x7fd56c0d1790 con 0x7fd56c0d2640 2023-07-12T02:05:22.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.559+0000 7fd563fff700 1 -- 172.21.15.37:0/2080618005 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5580035b0 con 0x7fd56c0d2640 2023-07-12T02:05:22.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.559+0000 7fd563fff700 1 -- 172.21.15.37:0/2080618005 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144198004 0 0) 0x7fd56c0cd950 con 0x7fd56c0cf8f0 2023-07-12T02:05:22.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.559+0000 7fd563fff700 1 -- 172.21.15.37:0/2080618005 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd56c0d1790 con 0x7fd56c0cf8f0 2023-07-12T02:05:22.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.559+0000 7fd57139b700 1 -- 172.21.15.37:0/2080618005 >> v1:172.21.15.196:6789/0 conn(0x7fd56c0cf8f0 legacy=0x7fd56c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:22.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.559+0000 7fd57139b700 1 -- 172.21.15.37:0/2080618005 >> v1:172.21.15.37:6789/0 conn(0x7fd56c0d2640 legacy=0x7fd56c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:22.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.559+0000 7fd563fff700 1 -- 172.21.15.37:0/2080618005 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2699645454 0 0) 0x7fd5580035b0 con 0x7fd56c0d2640 2023-07-12T02:05:22.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.559+0000 7fd57139b700 1 -- 172.21.15.37:0/2080618005 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c0d14b0 con 0x7fd56c15c460 2023-07-12T02:05:22.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.559+0000 7fd57139b700 1 --2- 172.21.15.37:0/2080618005 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c15c460 0x7fd56c0b59d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd568009870 tx=0x7fd568009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26c8d137791c8ba0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:22.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.560+0000 7fd563fff700 1 -- 172.21.15.37:0/2080618005 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c001670 con 0x7fd56c15c460 2023-07-12T02:05:22.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.560+0000 7fd563fff700 1 -- 172.21.15.37:0/2080618005 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd568004030 con 0x7fd56c15c460 2023-07-12T02:05:22.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.560+0000 7fd563fff700 1 -- 172.21.15.37:0/2080618005 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5680043c0 con 0x7fd56c15c460 2023-07-12T02:05:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.560+0000 7fd5735ff700 1 -- 172.21.15.37:0/2080618005 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c15c460 msgr2=0x7fd56c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.560+0000 7fd5735ff700 1 --2- 172.21.15.37:0/2080618005 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c15c460 0x7fd56c0b59d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd568009870 tx=0x7fd568009b80 comp rx=0 tx=0).stop 2023-07-12T02:05:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.560+0000 7fd5735ff700 1 -- 172.21.15.37:0/2080618005 shutdown_connections 2023-07-12T02:05:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.560+0000 7fd5735ff700 1 --2- 172.21.15.37:0/2080618005 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c15c460 0x7fd56c0b59d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.560+0000 7fd5735ff700 1 -- 172.21.15.37:0/2080618005 >> 172.21.15.37:0/2080618005 conn(0x7fd56c071660 msgr2=0x7fd56c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.560+0000 7fd5735ff700 1 -- 172.21.15.37:0/2080618005 shutdown_connections 2023-07-12T02:05:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.560+0000 7fd5735ff700 1 -- 172.21.15.37:0/2080618005 wait complete. 2023-07-12T02:05:22.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.562+0000 7fd5735ff700 1 Processor -- start 2023-07-12T02:05:22.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.562+0000 7fd5735ff700 1 -- start start 2023-07-12T02:05:22.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.563+0000 7fd5735ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd56c0cf8f0 0x7fd56c156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:22.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.563+0000 7fd5735ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0d2640 0x7fd56c0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:22.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.563+0000 7fd5735ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c15c460 0x7fd56c0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:22.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.563+0000 7fd5735ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0c7c40 con 0x7fd56c15c460 2023-07-12T02:05:22.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.563+0000 7fd5735ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0c8a60 con 0x7fd56c0cf8f0 2023-07-12T02:05:22.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.563+0000 7fd5735ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0c7e50 con 0x7fd56c0d2640 2023-07-12T02:05:22.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.563+0000 7fd571b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c15c460 0x7fd56c0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:22.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.563+0000 7fd571b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c15c460 0x7fd56c0b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48886/0 (socket says 172.21.15.37:48886) 2023-07-12T02:05:22.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.563+0000 7fd571b9c700 1 -- 172.21.15.37:0/3648000103 learned_addr learned my addr 172.21.15.37:0/3648000103 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:22.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.564+0000 7fd57139b700 1 --2- 172.21.15.37:0/3648000103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd56c0cf8f0 0x7fd56c156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:22.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.564+0000 7fd570b9a700 1 --2- 172.21.15.37:0/3648000103 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0d2640 0x7fd56c0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:22.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.564+0000 7fd571b9c700 1 -- 172.21.15.37:0/3648000103 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0d2640 msgr2=0x7fd56c0c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:22.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.564+0000 7fd571b9c700 1 --2- 172.21.15.37:0/3648000103 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0d2640 0x7fd56c0c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.564+0000 7fd571b9c700 1 -- 172.21.15.37:0/3648000103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd56c0cf8f0 msgr2=0x7fd56c156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:22.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.564+0000 7fd571b9c700 1 --2- 172.21.15.37:0/3648000103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd56c0cf8f0 0x7fd56c156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.564+0000 7fd571b9c700 1 -- 172.21.15.37:0/3648000103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5680094a0 con 0x7fd56c15c460 2023-07-12T02:05:22.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.564+0000 7fd57139b700 1 --2- 172.21.15.37:0/3648000103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd56c0cf8f0 0x7fd56c156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:22.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.564+0000 7fd571b9c700 1 --2- 172.21.15.37:0/3648000103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c15c460 0x7fd56c0b2470 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd56400cbc0 tx=0x7fd56400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:22.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.564+0000 7fd561ffb700 1 -- 172.21.15.37:0/3648000103 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564003c00 con 0x7fd56c15c460 2023-07-12T02:05:22.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.564+0000 7fd561ffb700 1 -- 172.21.15.37:0/3648000103 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd564003d60 con 0x7fd56c15c460 2023-07-12T02:05:22.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.564+0000 7fd561ffb700 1 -- 172.21.15.37:0/3648000103 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400abb0 con 0x7fd56c15c460 2023-07-12T02:05:22.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.564+0000 7fd5735ff700 1 -- 172.21.15.37:0/3648000103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56c0c8130 con 0x7fd56c15c460 2023-07-12T02:05:22.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.565+0000 7fd5735ff700 1 -- 172.21.15.37:0/3648000103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56c0c86f0 con 0x7fd56c15c460 2023-07-12T02:05:22.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.565+0000 7fd5735ff700 1 -- 172.21.15.37:0/3648000103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56c04ea60 con 0x7fd56c15c460 2023-07-12T02:05:22.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.567+0000 7fd561ffb700 1 -- 172.21.15.37:0/3648000103 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd56400ad10 con 0x7fd56c15c460 2023-07-12T02:05:22.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.568+0000 7fd561ffb700 1 --2- 172.21.15.37:0/3648000103 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd55006ace0 0x7fd55006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:22.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.568+0000 7fd561ffb700 1 -- 172.21.15.37:0/3648000103 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd5640898b0 con 0x7fd56c15c460 2023-07-12T02:05:22.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.568+0000 7fd57139b700 1 --2- 172.21.15.37:0/3648000103 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd55006ace0 0x7fd55006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:22.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.569+0000 7fd57139b700 1 --2- 172.21.15.37:0/3648000103 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd55006ace0 0x7fd55006d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd5680090b0 tx=0x7fd568008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:22.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.573+0000 7fd561ffb700 1 -- 172.21.15.37:0/3648000103 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd564054620 con 0x7fd56c15c460 2023-07-12T02:05:22.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.778+0000 7fd5735ff700 1 -- 172.21.15.37:0/3648000103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd56c0b4fa0 con 0x7fd56c15c460 2023-07-12T02:05:22.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.780+0000 7fd561ffb700 1 -- 172.21.15.37:0/3648000103 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20168 (secure 0 0 0) 0x7fd564057c40 con 0x7fd56c15c460 2023-07-12T02:05:22.784 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:22.784 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:39.032667+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:05:22.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.782+0000 7fd5735ff700 1 -- 172.21.15.37:0/3648000103 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd55006ace0 msgr2=0x7fd55006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:22.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.782+0000 7fd5735ff700 1 --2- 172.21.15.37:0/3648000103 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd55006ace0 0x7fd55006d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd5680090b0 tx=0x7fd568008030 comp rx=0 tx=0).stop 2023-07-12T02:05:22.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.782+0000 7fd5735ff700 1 -- 172.21.15.37:0/3648000103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c15c460 msgr2=0x7fd56c0b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.782+0000 7fd5735ff700 1 --2- 172.21.15.37:0/3648000103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c15c460 0x7fd56c0b2470 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd56400cbc0 tx=0x7fd56400cf80 comp rx=0 tx=0).stop 2023-07-12T02:05:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.783+0000 7fd5735ff700 1 -- 172.21.15.37:0/3648000103 shutdown_connections 2023-07-12T02:05:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.783+0000 7fd5735ff700 1 --2- 172.21.15.37:0/3648000103 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd55006ace0 0x7fd55006d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.783+0000 7fd5735ff700 1 --2- 172.21.15.37:0/3648000103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c15c460 0x7fd56c0b2470 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.783+0000 7fd5735ff700 1 --2- 172.21.15.37:0/3648000103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd56c0cf8f0 0x7fd56c156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.783+0000 7fd5735ff700 1 --2- 172.21.15.37:0/3648000103 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd56c0d2640 0x7fd56c0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.783+0000 7fd5735ff700 1 -- 172.21.15.37:0/3648000103 >> 172.21.15.37:0/3648000103 conn(0x7fd56c071660 msgr2=0x7fd56c0d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:22.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.783+0000 7fd5735ff700 1 -- 172.21.15.37:0/3648000103 shutdown_connections 2023-07-12T02:05:22.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:22.783+0000 7fd5735ff700 1 -- 172.21.15.37:0/3648000103 wait complete. 2023-07-12T02:05:22.804 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:03:56.039938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:03:56.612707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-12T02:04:00.200885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-12T02:05:22.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:05:23.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.005+0000 7f2351fff700 1 Processor -- start 2023-07-12T02:05:23.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.005+0000 7f2351fff700 1 -- start start 2023-07-12T02:05:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.006+0000 7f2351fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f234c0b8430 0x7f234c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.006+0000 7f2351fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f234c0d3730 0x7f234c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.006+0000 7f2351fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f234c0cfa90 0x7f234c15feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.006+0000 7f2351fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234c0b8800 con 0x7f234c0b8430 2023-07-12T02:05:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.006+0000 7f2351fff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234c0d0b20 con 0x7f234c0d3730 2023-07-12T02:05:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.006+0000 7f2351fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234c0cfeb0 con 0x7f234c0cfa90 2023-07-12T02:05:23.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.006+0000 7f234b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f234c0b8430 0x7f234c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.006+0000 7f234b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f234c0b8430 0x7f234c0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48888/0 (socket says 172.21.15.37:48888) 2023-07-12T02:05:23.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.006+0000 7f234b7fe700 1 -- 172.21.15.37:0/80240978 learned_addr learned my addr 172.21.15.37:0/80240978 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:23.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.007+0000 7f234b7fe700 1 -- 172.21.15.37:0/80240978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f234c0cfa90 msgr2=0x7f234c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:23.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.007+0000 7f234b7fe700 1 --2- 172.21.15.37:0/80240978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f234c0cfa90 0x7f234c15feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.007+0000 7f234b7fe700 1 -- 172.21.15.37:0/80240978 >> v2:172.21.15.196:3300/0 conn(0x7f234c0d3730 msgr2=0x7f234c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.007+0000 7f234affd700 1 --2- 172.21.15.37:0/80240978 >> v2:172.21.15.196:3300/0 conn(0x7f234c0d3730 0x7f234c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.007+0000 7f234b7fe700 1 --2- 172.21.15.37:0/80240978 >> v2:172.21.15.196:3300/0 conn(0x7f234c0d3730 0x7f234c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.007+0000 7f234b7fe700 1 -- 172.21.15.37:0/80240978 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c0b4ee0 con 0x7f234c0b8430 2023-07-12T02:05:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.007+0000 7f234affd700 1 --2- 172.21.15.37:0/80240978 >> v2:172.21.15.196:3300/0 conn(0x7f234c0d3730 0x7f234c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.007+0000 7f234b7fe700 1 --2- 172.21.15.37:0/80240978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f234c0b8430 0x7f234c0cd320 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f234c160f50 tx=0x7f233c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8471980e6db5c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.007+0000 7f234a7fc700 1 -- 172.21.15.37:0/80240978 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00b870 con 0x7f234c0b8430 2023-07-12T02:05:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.007+0000 7f234a7fc700 1 -- 172.21.15.37:0/80240978 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c00b9d0 con 0x7f234c0b8430 2023-07-12T02:05:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.007+0000 7f234a7fc700 1 -- 172.21.15.37:0/80240978 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00bd60 con 0x7f234c0b8430 2023-07-12T02:05:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.008+0000 7f2351fff700 1 -- 172.21.15.37:0/80240978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f234c0b8430 msgr2=0x7f234c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.008+0000 7f2351fff700 1 --2- 172.21.15.37:0/80240978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f234c0b8430 0x7f234c0cd320 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f234c160f50 tx=0x7f233c009bd0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.008+0000 7f2351fff700 1 -- 172.21.15.37:0/80240978 shutdown_connections 2023-07-12T02:05:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.008+0000 7f2351fff700 1 --2- 172.21.15.37:0/80240978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f234c0b8430 0x7f234c0cd320 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.008+0000 7f2351fff700 1 --2- 172.21.15.37:0/80240978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f234c0cfa90 0x7f234c15feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.008+0000 7f2351fff700 1 --2- 172.21.15.37:0/80240978 >> v2:172.21.15.196:3300/0 conn(0x7f234c0d3730 0x7f234c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.008+0000 7f2351fff700 1 -- 172.21.15.37:0/80240978 >> 172.21.15.37:0/80240978 conn(0x7f234c06b3f0 msgr2=0x7f234c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.008+0000 7f2351fff700 1 -- 172.21.15.37:0/80240978 shutdown_connections 2023-07-12T02:05:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.008+0000 7f2351fff700 1 -- 172.21.15.37:0/80240978 wait complete. 2023-07-12T02:05:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.010+0000 7f2351fff700 1 Processor -- start 2023-07-12T02:05:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.010+0000 7f2351fff700 1 -- start start 2023-07-12T02:05:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.011+0000 7f2351fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f234c0b8430 0x7f234c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.011+0000 7f2351fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f234c0cfa90 0x7f234c0c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.011+0000 7f2351fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f234c0d3730 0x7f234c15a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.011+0000 7f2351fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c0caeb0 con 0x7f234c0cfa90 2023-07-12T02:05:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.011+0000 7f2351fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c0c6670 con 0x7f234c0b8430 2023-07-12T02:05:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.011+0000 7f2351fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234c0ca2a0 con 0x7f234c0d3730 2023-07-12T02:05:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.011+0000 7f234affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f234c0cfa90 0x7f234c0c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.011+0000 7f234affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f234c0cfa90 0x7f234c0c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48896/0 (socket says 172.21.15.37:48896) 2023-07-12T02:05:23.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.011+0000 7f234affd700 1 -- 172.21.15.37:0/3272172223 learned_addr learned my addr 172.21.15.37:0/3272172223 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:23.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.011+0000 7f234b7fe700 1 --2- 172.21.15.37:0/3272172223 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f234c0b8430 0x7f234c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.011+0000 7f234bfff700 1 --2- 172.21.15.37:0/3272172223 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f234c0d3730 0x7f234c15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.012+0000 7f234affd700 1 -- 172.21.15.37:0/3272172223 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f234c0d3730 msgr2=0x7f234c15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:23.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.012+0000 7f234affd700 1 --2- 172.21.15.37:0/3272172223 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f234c0d3730 0x7f234c15a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.012+0000 7f234affd700 1 -- 172.21.15.37:0/3272172223 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f234c0b8430 msgr2=0x7f234c0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:23.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.012+0000 7f234affd700 1 --2- 172.21.15.37:0/3272172223 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f234c0b8430 0x7f234c0c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.012+0000 7f234affd700 1 -- 172.21.15.37:0/3272172223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c009550 con 0x7f234c0cfa90 2023-07-12T02:05:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.012+0000 7f234affd700 1 --2- 172.21.15.37:0/3272172223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f234c0cfa90 0x7f234c0c8fc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f234000c750 tx=0x7f234000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.012+0000 7f2333fff700 1 -- 172.21.15.37:0/3272172223 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340011800 con 0x7f234c0cfa90 2023-07-12T02:05:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.012+0000 7f2333fff700 1 -- 172.21.15.37:0/3272172223 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2340011960 con 0x7f234c0cfa90 2023-07-12T02:05:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.012+0000 7f2351fff700 1 -- 172.21.15.37:0/3272172223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234c0ca580 con 0x7f234c0cfa90 2023-07-12T02:05:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.012+0000 7f2333fff700 1 -- 172.21.15.37:0/3272172223 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340011cd0 con 0x7f234c0cfa90 2023-07-12T02:05:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.012+0000 7f2351fff700 1 -- 172.21.15.37:0/3272172223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234c0cab40 con 0x7f234c0cfa90 2023-07-12T02:05:23.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.013+0000 7f2351fff700 1 -- 172.21.15.37:0/3272172223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234c0cb060 con 0x7f234c0cfa90 2023-07-12T02:05:23.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.015+0000 7f2333fff700 1 -- 172.21.15.37:0/3272172223 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2340021350 con 0x7f234c0cfa90 2023-07-12T02:05:23.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.015+0000 7f2333fff700 1 --2- 172.21.15.37:0/3272172223 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f233806ace0 0x7f233806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.016+0000 7f2333fff700 1 -- 172.21.15.37:0/3272172223 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f23400896c0 con 0x7f234c0cfa90 2023-07-12T02:05:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.016+0000 7f234b7fe700 1 --2- 172.21.15.37:0/3272172223 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f233806ace0 0x7f233806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.017+0000 7f234b7fe700 1 --2- 172.21.15.37:0/3272172223 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f233806ace0 0x7f233806d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f233c014040 tx=0x7f233c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:23.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.020+0000 7f2333fff700 1 -- 172.21.15.37:0/3272172223 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f234c0cb060 con 0x7f234c0cfa90 2023-07-12T02:05:23.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.230+0000 7f2351fff700 1 -- 172.21.15.37:0/3272172223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f234c04ea60 con 0x7f234c0cfa90 2023-07-12T02:05:23.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.230+0000 7f2333fff700 1 -- 172.21.15.37:0/3272172223 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2340057e30 con 0x7f234c0cfa90 2023-07-12T02:05:23.234 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:05:23.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.232+0000 7f2351fff700 1 -- 172.21.15.37:0/3272172223 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f233806ace0 msgr2=0x7f233806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:23.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.233+0000 7f2351fff700 1 --2- 172.21.15.37:0/3272172223 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f233806ace0 0x7f233806d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f233c014040 tx=0x7f233c008030 comp rx=0 tx=0).stop 2023-07-12T02:05:23.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.233+0000 7f2351fff700 1 -- 172.21.15.37:0/3272172223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f234c0cfa90 msgr2=0x7f234c0c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:23.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.233+0000 7f2351fff700 1 --2- 172.21.15.37:0/3272172223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f234c0cfa90 0x7f234c0c8fc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f234000c750 tx=0x7f234000ca60 comp rx=0 tx=0).stop 2023-07-12T02:05:23.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.233+0000 7f2351fff700 1 -- 172.21.15.37:0/3272172223 shutdown_connections 2023-07-12T02:05:23.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.233+0000 7f2351fff700 1 --2- 172.21.15.37:0/3272172223 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f233806ace0 0x7f233806d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.233+0000 7f2351fff700 1 --2- 172.21.15.37:0/3272172223 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f234c0d3730 0x7f234c15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.233+0000 7f2351fff700 1 --2- 172.21.15.37:0/3272172223 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f234c0b8430 0x7f234c0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.233+0000 7f2351fff700 1 --2- 172.21.15.37:0/3272172223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f234c0cfa90 0x7f234c0c8fc0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.233+0000 7f2351fff700 1 -- 172.21.15.37:0/3272172223 >> 172.21.15.37:0/3272172223 conn(0x7f234c06b3f0 msgr2=0x7f234c0d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:23.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.233+0000 7f2351fff700 1 -- 172.21.15.37:0/3272172223 shutdown_connections 2023-07-12T02:05:23.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.233+0000 7f2351fff700 1 -- 172.21.15.37:0/3272172223 wait complete. 2023-07-12T02:05:23.254 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:05:23.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.453+0000 7f7466fff700 1 Processor -- start 2023-07-12T02:05:23.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.454+0000 7f7466fff700 1 -- start start 2023-07-12T02:05:23.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.455+0000 7f7466fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f74600b8430 0x7f74600cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.455+0000 7f7466fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74600d3730 0x7f74600cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.455+0000 7f7466fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74600d0b20 con 0x7f74600cfa90 2023-07-12T02:05:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.455+0000 7f7466fff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74600b8800 con 0x7f74600b8430 2023-07-12T02:05:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.455+0000 7f7466fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74600cfeb0 con 0x7f74600d3730 2023-07-12T02:05:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.455+0000 7f746559c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f74600cfa90 0x7f746015feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38810/0 (socket says 172.21.15.37:38810) 2023-07-12T02:05:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.455+0000 7f746559c700 1 -- 172.21.15.37:0/3614757960 learned_addr learned my addr 172.21.15.37:0/3614757960 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:23.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.455+0000 7f7464d9b700 1 --2- 172.21.15.37:0/3614757960 >> v2:172.21.15.196:3300/0 conn(0x7f74600b8430 0x7f74600cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.455+0000 7f745ffff700 1 --2- 172.21.15.37:0/3614757960 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74600d3730 0x7f74600cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.455+0000 7f745f7fe700 1 -- 172.21.15.37:0/3614757960 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527240062 0 0) 0x7f74600d0b20 con 0x7f74600cfa90 2023-07-12T02:05:23.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f745f7fe700 1 -- 172.21.15.37:0/3614757960 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74500035b0 con 0x7f74600cfa90 2023-07-12T02:05:23.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f745f7fe700 1 -- 172.21.15.37:0/3614757960 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 296565457 0 0) 0x7f74500035b0 con 0x7f74600cfa90 2023-07-12T02:05:23.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f745f7fe700 1 -- 172.21.15.37:0/3614757960 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74600d3730 msgr2=0x7f74600cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:23.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f745f7fe700 1 --2- 172.21.15.37:0/3614757960 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74600d3730 0x7f74600cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f745f7fe700 1 -- 172.21.15.37:0/3614757960 >> v2:172.21.15.196:3300/0 conn(0x7f74600b8430 msgr2=0x7f74600cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:23.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f745f7fe700 1 --2- 172.21.15.37:0/3614757960 >> v2:172.21.15.196:3300/0 conn(0x7f74600b8430 0x7f74600cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f745f7fe700 1 -- 172.21.15.37:0/3614757960 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74600b4ee0 con 0x7f74600cfa90 2023-07-12T02:05:23.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f745f7fe700 1 -- 172.21.15.37:0/3614757960 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7f74580019f0 con 0x7f74600cfa90 2023-07-12T02:05:23.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f745f7fe700 1 -- 172.21.15.37:0/3614757960 >> v1:172.21.15.37:6789/0 conn(0x7f74600cfa90 legacy=0x7f746015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:23.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f745f7fe700 1 --2- 172.21.15.37:0/3614757960 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74600d3730 0x7f7450003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f745f7fe700 1 --2- 172.21.15.37:0/3614757960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7450003f80 0x7f7450004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f745f7fe700 1 --2- 172.21.15.37:0/3614757960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7450004d90 0x7f7450005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f745f7fe700 1 -- 172.21.15.37:0/3614757960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74600b8800 con 0x7f7450003f80 2023-07-12T02:05:23.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f745f7fe700 1 -- 172.21.15.37:0/3614757960 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74600cfeb0 con 0x7f7450004d90 2023-07-12T02:05:23.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f745f7fe700 1 -- 172.21.15.37:0/3614757960 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745000ba10 con 0x7f74600d3730 2023-07-12T02:05:23.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f745ffff700 1 --2- 172.21.15.37:0/3614757960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7450003f80 0x7f7450004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.456+0000 7f7464d9b700 1 --2- 172.21.15.37:0/3614757960 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74600d3730 0x7f7450003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.457+0000 7f746559c700 1 --2- 172.21.15.37:0/3614757960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7450004d90 0x7f7450005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.457+0000 7f7464d9b700 1 -- 172.21.15.37:0/3614757960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7450004d90 msgr2=0x7f7450005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:23.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.457+0000 7f7464d9b700 1 --2- 172.21.15.37:0/3614757960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7450004d90 0x7f7450005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.457+0000 7f7464d9b700 1 -- 172.21.15.37:0/3614757960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7450003f80 msgr2=0x7f7450004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:23.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.457+0000 7f7464d9b700 1 --2- 172.21.15.37:0/3614757960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7450003f80 0x7f7450004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.457+0000 7f7464d9b700 1 -- 172.21.15.37:0/3614757960 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74500035b0 con 0x7f74600d3730 2023-07-12T02:05:23.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.457+0000 7f745ffff700 1 --2- 172.21.15.37:0/3614757960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7450003f80 0x7f7450004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:23.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.457+0000 7f7464d9b700 1 --2- 172.21.15.37:0/3614757960 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74600d3730 0x7f7450003a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7454009b60 tx=0x7f7450005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2491fcb346834d8d server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:23.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.457+0000 7f745f7fe700 1 -- 172.21.15.37:0/3614757960 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745400e6c0 con 0x7f74600d3730 2023-07-12T02:05:23.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.457+0000 7f745f7fe700 1 -- 172.21.15.37:0/3614757960 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745400e820 con 0x7f74600d3730 2023-07-12T02:05:23.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.457+0000 7f745f7fe700 1 -- 172.21.15.37:0/3614757960 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745400eb90 con 0x7f74600d3730 2023-07-12T02:05:23.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.458+0000 7f7466fff700 1 -- 172.21.15.37:0/3614757960 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74600d3730 msgr2=0x7f7450003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:23.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.458+0000 7f7466fff700 1 --2- 172.21.15.37:0/3614757960 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74600d3730 0x7f7450003a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7454009b60 tx=0x7f7450005880 comp rx=0 tx=0).stop 2023-07-12T02:05:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.458+0000 7f746559c700 1 -- 172.21.15.37:0/3614757960 reap_dead start 2023-07-12T02:05:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.458+0000 7f7466fff700 1 -- 172.21.15.37:0/3614757960 shutdown_connections 2023-07-12T02:05:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.458+0000 7f7466fff700 1 -- 172.21.15.37:0/3614757960 >> 172.21.15.37:0/3614757960 conn(0x7f746006b3f0 msgr2=0x7f746006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.458+0000 7f7466fff700 1 -- 172.21.15.37:0/3614757960 shutdown_connections 2023-07-12T02:05:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.458+0000 7f7466fff700 1 -- 172.21.15.37:0/3614757960 wait complete. 2023-07-12T02:05:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.461+0000 7f7466fff700 1 Processor -- start 2023-07-12T02:05:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.461+0000 7f7466fff700 1 -- start start 2023-07-12T02:05:23.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.462+0000 7f7466fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74600d3730 0x7f74600c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.462+0000 7f7466fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74600cc3f0 0x7f74601f19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.462+0000 7f7466fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f746015eb00 0x7f746015ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.462+0000 7f7466fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746015f4b0 con 0x7f746015eb00 2023-07-12T02:05:23.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.462+0000 7f7466fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74601f2f00 con 0x7f74600cc3f0 2023-07-12T02:05:23.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.462+0000 7f7466fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74601f2270 con 0x7f74600d3730 2023-07-12T02:05:23.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.462+0000 7f746559c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f746015eb00 0x7f746015ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.462+0000 7f746559c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f746015eb00 0x7f746015ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48914/0 (socket says 172.21.15.37:48914) 2023-07-12T02:05:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.462+0000 7f746559c700 1 -- 172.21.15.37:0/2003979946 learned_addr learned my addr 172.21.15.37:0/2003979946 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.463+0000 7f745ffff700 1 --2- 172.21.15.37:0/2003979946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74600cc3f0 0x7f74601f19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.463+0000 7f7464d9b700 1 --2- 172.21.15.37:0/2003979946 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74600d3730 0x7f74600c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.463+0000 7f746559c700 1 -- 172.21.15.37:0/2003979946 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74600d3730 msgr2=0x7f74600c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.463+0000 7f746559c700 1 --2- 172.21.15.37:0/2003979946 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74600d3730 0x7f74600c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.463+0000 7f746559c700 1 -- 172.21.15.37:0/2003979946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74600cc3f0 msgr2=0x7f74601f19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.463+0000 7f746559c700 1 --2- 172.21.15.37:0/2003979946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74600cc3f0 0x7f74601f19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.463+0000 7f746559c700 1 -- 172.21.15.37:0/2003979946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74601f2550 con 0x7f746015eb00 2023-07-12T02:05:23.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.463+0000 7f746559c700 1 --2- 172.21.15.37:0/2003979946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f746015eb00 0x7f746015ef70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f74600b8c90 tx=0x7f745800a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:23.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.463+0000 7f745d7fa700 1 -- 172.21.15.37:0/2003979946 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745800ad50 con 0x7f746015eb00 2023-07-12T02:05:23.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.463+0000 7f745d7fa700 1 -- 172.21.15.37:0/2003979946 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74580133f0 con 0x7f746015eb00 2023-07-12T02:05:23.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.463+0000 7f745d7fa700 1 -- 172.21.15.37:0/2003979946 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74580137a0 con 0x7f746015eb00 2023-07-12T02:05:23.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.463+0000 7f7466fff700 1 -- 172.21.15.37:0/2003979946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74601f2830 con 0x7f746015eb00 2023-07-12T02:05:23.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.464+0000 7f7466fff700 1 -- 172.21.15.37:0/2003979946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74601f2b10 con 0x7f746015eb00 2023-07-12T02:05:23.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.465+0000 7f7466fff700 1 -- 172.21.15.37:0/2003979946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74601f2d30 con 0x7f746015eb00 2023-07-12T02:05:23.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.466+0000 7f745d7fa700 1 -- 172.21.15.37:0/2003979946 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7458013900 con 0x7f746015eb00 2023-07-12T02:05:23.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.467+0000 7f745d7fa700 1 --2- 172.21.15.37:0/2003979946 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f744406ace0 0x7f744406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.467+0000 7f745d7fa700 1 -- 172.21.15.37:0/2003979946 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7458089ee0 con 0x7f746015eb00 2023-07-12T02:05:23.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.467+0000 7f7464d9b700 1 --2- 172.21.15.37:0/2003979946 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f744406ace0 0x7f744406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.468+0000 7f7464d9b700 1 --2- 172.21.15.37:0/2003979946 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f744406ace0 0x7f744406d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f74540090b0 tx=0x7f7454008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:23.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.471+0000 7f745d7fa700 1 -- 172.21.15.37:0/2003979946 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7458054c50 con 0x7f746015eb00 2023-07-12T02:05:23.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.675+0000 7f7466fff700 1 -- 172.21.15.37:0/2003979946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f746004ea60 con 0x7f746015eb00 2023-07-12T02:05:23.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.676+0000 7f745d7fa700 1 -- 172.21.15.37:0/2003979946 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7458058270 con 0x7f746015eb00 2023-07-12T02:05:23.680 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:05:23.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.678+0000 7f7466fff700 1 -- 172.21.15.37:0/2003979946 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f744406ace0 msgr2=0x7f744406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:23.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.678+0000 7f7466fff700 1 --2- 172.21.15.37:0/2003979946 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f744406ace0 0x7f744406d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f74540090b0 tx=0x7f7454008030 comp rx=0 tx=0).stop 2023-07-12T02:05:23.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.678+0000 7f7466fff700 1 -- 172.21.15.37:0/2003979946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f746015eb00 msgr2=0x7f746015ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:23.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.678+0000 7f7466fff700 1 --2- 172.21.15.37:0/2003979946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f746015eb00 0x7f746015ef70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f74600b8c90 tx=0x7f745800a640 comp rx=0 tx=0).stop 2023-07-12T02:05:23.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.678+0000 7f7466fff700 1 -- 172.21.15.37:0/2003979946 shutdown_connections 2023-07-12T02:05:23.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.678+0000 7f7466fff700 1 --2- 172.21.15.37:0/2003979946 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f744406ace0 0x7f744406d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.678+0000 7f7466fff700 1 --2- 172.21.15.37:0/2003979946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f746015eb00 0x7f746015ef70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.678+0000 7f7466fff700 1 --2- 172.21.15.37:0/2003979946 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f74600d3730 0x7f74600c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.678+0000 7f7466fff700 1 --2- 172.21.15.37:0/2003979946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74600cc3f0 0x7f74601f19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.678+0000 7f7466fff700 1 -- 172.21.15.37:0/2003979946 >> 172.21.15.37:0/2003979946 conn(0x7f746006b3f0 msgr2=0x7f746015bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:23.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.678+0000 7f7466fff700 1 -- 172.21.15.37:0/2003979946 shutdown_connections 2023-07-12T02:05:23.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.678+0000 7f7466fff700 1 -- 172.21.15.37:0/2003979946 wait complete. 2023-07-12T02:05:23.700 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:05:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.901+0000 7fb6cabff700 1 Processor -- start 2023-07-12T02:05:23.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.901+0000 7fb6cabff700 1 -- start start 2023-07-12T02:05:23.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.902+0000 7fb6cabff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6c40cfc60 0x7fb6c4167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.902+0000 7fb6cabff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c40d0b20 con 0x7fb6c40d3730 2023-07-12T02:05:23.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.902+0000 7fb6cabff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c40b4ee0 con 0x7fb6c40b8430 2023-07-12T02:05:23.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.902+0000 7fb6cabff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c40cda30 con 0x7fb6c40cfc60 2023-07-12T02:05:23.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.903+0000 7fb6bbfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb6c40d3730 0x7fb6c40cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38814/0 (socket says 172.21.15.37:38814) 2023-07-12T02:05:23.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.903+0000 7fb6bbfff700 1 -- 172.21.15.37:0/2399027054 learned_addr learned my addr 172.21.15.37:0/2399027054 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:23.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.903+0000 7fb6c919c700 1 --2- 172.21.15.37:0/2399027054 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6c40cfc60 0x7fb6c4167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.903+0000 7fb6bb7fe700 1 -- 172.21.15.37:0/2399027054 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051473187 0 0) 0x7fb6c40d0b20 con 0x7fb6c40d3730 2023-07-12T02:05:23.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.903+0000 7fb6bb7fe700 1 -- 172.21.15.37:0/2399027054 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6ac0035b0 con 0x7fb6c40d3730 2023-07-12T02:05:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.903+0000 7fb6bb7fe700 1 -- 172.21.15.37:0/2399027054 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622208658 0 0) 0x7fb6c40b4ee0 con 0x7fb6c40b8430 2023-07-12T02:05:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.903+0000 7fb6bb7fe700 1 -- 172.21.15.37:0/2399027054 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6c40d0b20 con 0x7fb6c40b8430 2023-07-12T02:05:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.903+0000 7fb6bb7fe700 1 -- 172.21.15.37:0/2399027054 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3286532494 0 0) 0x7fb6ac0035b0 con 0x7fb6c40d3730 2023-07-12T02:05:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.903+0000 7fb6bb7fe700 1 -- 172.21.15.37:0/2399027054 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6c40cfc60 msgr2=0x7fb6c4167010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.903+0000 7fb6bb7fe700 1 --2- 172.21.15.37:0/2399027054 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6c40cfc60 0x7fb6c4167010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.903+0000 7fb6bb7fe700 1 -- 172.21.15.37:0/2399027054 >> v1:172.21.15.196:6789/0 conn(0x7fb6c40b8430 legacy=0x7fb6c40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.903+0000 7fb6bb7fe700 1 -- 172.21.15.37:0/2399027054 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c40b51c0 con 0x7fb6c40d3730 2023-07-12T02:05:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.903+0000 7fb6bb7fe700 1 -- 172.21.15.37:0/2399027054 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7fb6b4001670 con 0x7fb6c40d3730 2023-07-12T02:05:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.903+0000 7fb6bb7fe700 1 -- 172.21.15.37:0/2399027054 >> v1:172.21.15.37:6789/0 conn(0x7fb6c40d3730 legacy=0x7fb6c40cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.903+0000 7fb6bb7fe700 1 --2- 172.21.15.37:0/2399027054 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6ac003bc0 0x7fb6ac003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.903+0000 7fb6bb7fe700 1 --2- 172.21.15.37:0/2399027054 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6c40cfc60 0x7fb6ac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.904+0000 7fb6bb7fe700 1 --2- 172.21.15.37:0/2399027054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6ac004d90 0x7fb6ac005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.904+0000 7fb6bb7fe700 1 -- 172.21.15.37:0/2399027054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac00bac0 con 0x7fb6ac004d90 2023-07-12T02:05:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.904+0000 7fb6bb7fe700 1 -- 172.21.15.37:0/2399027054 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac00bc00 con 0x7fb6ac003bc0 2023-07-12T02:05:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.904+0000 7fb6bb7fe700 1 -- 172.21.15.37:0/2399027054 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac00bdc0 con 0x7fb6c40cfc60 2023-07-12T02:05:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.904+0000 7fb6c919c700 1 --2- 172.21.15.37:0/2399027054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6ac004d90 0x7fb6ac005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.904+0000 7fb6bbfff700 1 --2- 172.21.15.37:0/2399027054 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6c40cfc60 0x7fb6ac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.904+0000 7fb6c899b700 1 --2- 172.21.15.37:0/2399027054 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6ac003bc0 0x7fb6ac003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.904+0000 7fb6c919c700 1 -- 172.21.15.37:0/2399027054 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6c40cfc60 msgr2=0x7fb6ac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.904+0000 7fb6c919c700 1 --2- 172.21.15.37:0/2399027054 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6c40cfc60 0x7fb6ac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.904+0000 7fb6c919c700 1 -- 172.21.15.37:0/2399027054 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6ac003bc0 msgr2=0x7fb6ac003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.904+0000 7fb6c919c700 1 --2- 172.21.15.37:0/2399027054 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6ac003bc0 0x7fb6ac003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.904+0000 7fb6c919c700 1 -- 172.21.15.37:0/2399027054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac0035b0 con 0x7fb6ac004d90 2023-07-12T02:05:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.905+0000 7fb6c919c700 1 --2- 172.21.15.37:0/2399027054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6ac004d90 0x7fb6ac005200 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009f90 tx=0x7fb6ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5448afa70ee69853 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.905+0000 7fb6bb7fe700 1 -- 172.21.15.37:0/2399027054 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc00ec30 con 0x7fb6ac004d90 2023-07-12T02:05:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.905+0000 7fb6bb7fe700 1 -- 172.21.15.37:0/2399027054 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc00f040 con 0x7fb6ac004d90 2023-07-12T02:05:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.905+0000 7fb6bb7fe700 1 -- 172.21.15.37:0/2399027054 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc014480 con 0x7fb6ac004d90 2023-07-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.905+0000 7fb6cabff700 1 -- 172.21.15.37:0/2399027054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6ac004d90 msgr2=0x7fb6ac005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.905+0000 7fb6cabff700 1 --2- 172.21.15.37:0/2399027054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6ac004d90 0x7fb6ac005200 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009f90 tx=0x7fb6ac005880 comp rx=0 tx=0).stop 2023-07-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.905+0000 7fb6c919c700 1 -- 172.21.15.37:0/2399027054 reap_dead start 2023-07-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.905+0000 7fb6cabff700 1 -- 172.21.15.37:0/2399027054 shutdown_connections 2023-07-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.905+0000 7fb6cabff700 1 -- 172.21.15.37:0/2399027054 >> 172.21.15.37:0/2399027054 conn(0x7fb6c406b3f0 msgr2=0x7fb6c406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.906+0000 7fb6cabff700 1 -- 172.21.15.37:0/2399027054 shutdown_connections 2023-07-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.906+0000 7fb6cabff700 1 -- 172.21.15.37:0/2399027054 wait complete. 2023-07-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.907+0000 7fb6cabff700 1 Processor -- start 2023-07-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.908+0000 7fb6cabff700 1 -- start start 2023-07-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.908+0000 7fb6cabff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6ac004d90 0x7fb6c41f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.908+0000 7fb6cabff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6c40cbde0 0x7fb6c40ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.908+0000 7fb6cabff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6c40caa60 0x7fb6c415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.909+0000 7fb6cabff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c41f6220 con 0x7fb6c40cbde0 2023-07-12T02:05:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.909+0000 7fb6cabff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c41f5c60 con 0x7fb6c40caa60 2023-07-12T02:05:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.909+0000 7fb6cabff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c41f5f40 con 0x7fb6ac004d90 2023-07-12T02:05:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.909+0000 7fb6bbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6c40cbde0 0x7fb6c40ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.909+0000 7fb6bbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6c40cbde0 0x7fb6c40ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48936/0 (socket says 172.21.15.37:48936) 2023-07-12T02:05:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.909+0000 7fb6bbfff700 1 -- 172.21.15.37:0/1724502645 learned_addr learned my addr 172.21.15.37:0/1724502645 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.909+0000 7fb6c899b700 1 --2- 172.21.15.37:0/1724502645 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6ac004d90 0x7fb6c41f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.909+0000 7fb6c919c700 1 --2- 172.21.15.37:0/1724502645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6c40caa60 0x7fb6c415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.909+0000 7fb6bbfff700 1 -- 172.21.15.37:0/1724502645 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6ac004d90 msgr2=0x7fb6c41f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.909+0000 7fb6bbfff700 1 --2- 172.21.15.37:0/1724502645 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6ac004d90 0x7fb6c41f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.909+0000 7fb6bbfff700 1 -- 172.21.15.37:0/1724502645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6c40caa60 msgr2=0x7fb6c415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.909+0000 7fb6bbfff700 1 --2- 172.21.15.37:0/1724502645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6c40caa60 0x7fb6c415be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.909+0000 7fb6bbfff700 1 -- 172.21.15.37:0/1724502645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c40c9d20 con 0x7fb6c40cbde0 2023-07-12T02:05:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.909+0000 7fb6bbfff700 1 --2- 172.21.15.37:0/1724502645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6c40cbde0 0x7fb6c40ca520 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4007290 tx=0x7fb6b40075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.910+0000 7fb6b97fa700 1 -- 172.21.15.37:0/1724502645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b400f6c0 con 0x7fb6c40cbde0 2023-07-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.910+0000 7fb6b97fa700 1 -- 172.21.15.37:0/1724502645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b400f840 con 0x7fb6c40cbde0 2023-07-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.910+0000 7fb6b97fa700 1 -- 172.21.15.37:0/1724502645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b400fbf0 con 0x7fb6c40cbde0 2023-07-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.910+0000 7fb6cabff700 1 -- 172.21.15.37:0/1724502645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c40ca000 con 0x7fb6c40cbde0 2023-07-12T02:05:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.910+0000 7fb6cabff700 1 -- 172.21.15.37:0/1724502645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c415c390 con 0x7fb6c40cbde0 2023-07-12T02:05:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.911+0000 7fb6cabff700 1 -- 172.21.15.37:0/1724502645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c40ca1f0 con 0x7fb6c40cbde0 2023-07-12T02:05:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.912+0000 7fb6b97fa700 1 -- 172.21.15.37:0/1724502645 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb6b400fd50 con 0x7fb6c40cbde0 2023-07-12T02:05:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.913+0000 7fb6b97fa700 1 --2- 172.21.15.37:0/1724502645 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb6b006ace0 0x7fb6b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.913+0000 7fb6b97fa700 1 -- 172.21.15.37:0/1724502645 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb6b40897e0 con 0x7fb6c40cbde0 2023-07-12T02:05:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.914+0000 7fb6c899b700 1 --2- 172.21.15.37:0/1724502645 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb6b006ace0 0x7fb6b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:23.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.914+0000 7fb6c899b700 1 --2- 172.21.15.37:0/1724502645 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb6b006ace0 0x7fb6b006d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0000c00 tx=0x7fb6c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:23.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:23.918+0000 7fb6b97fa700 1 -- 172.21.15.37:0/1724502645 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb6b4054550 con 0x7fb6c40cbde0 2023-07-12T02:05:24.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.124+0000 7fb6cabff700 1 -- 172.21.15.37:0/1724502645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6c404ea60 con 0x7fb6c40cbde0 2023-07-12T02:05:24.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.124+0000 7fb6b97fa700 1 -- 172.21.15.37:0/1724502645 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb6b4057b70 con 0x7fb6c40cbde0 2023-07-12T02:05:24.128 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:05:24.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.126+0000 7fb6cabff700 1 -- 172.21.15.37:0/1724502645 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb6b006ace0 msgr2=0x7fb6b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:24.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.126+0000 7fb6cabff700 1 --2- 172.21.15.37:0/1724502645 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb6b006ace0 0x7fb6b006d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0000c00 tx=0x7fb6c0009040 comp rx=0 tx=0).stop 2023-07-12T02:05:24.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.126+0000 7fb6cabff700 1 -- 172.21.15.37:0/1724502645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6c40cbde0 msgr2=0x7fb6c40ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:24.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.126+0000 7fb6cabff700 1 --2- 172.21.15.37:0/1724502645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6c40cbde0 0x7fb6c40ca520 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4007290 tx=0x7fb6b40075a0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.126+0000 7fb6cabff700 1 -- 172.21.15.37:0/1724502645 shutdown_connections 2023-07-12T02:05:24.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.126+0000 7fb6cabff700 1 --2- 172.21.15.37:0/1724502645 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb6b006ace0 0x7fb6b006d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.126+0000 7fb6cabff700 1 --2- 172.21.15.37:0/1724502645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6c40caa60 0x7fb6c415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.126+0000 7fb6cabff700 1 --2- 172.21.15.37:0/1724502645 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6ac004d90 0x7fb6c41f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.126+0000 7fb6cabff700 1 --2- 172.21.15.37:0/1724502645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6c40cbde0 0x7fb6c40ca520 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.126+0000 7fb6cabff700 1 -- 172.21.15.37:0/1724502645 >> 172.21.15.37:0/1724502645 conn(0x7fb6c406b3f0 msgr2=0x7fb6c406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:24.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.126+0000 7fb6cabff700 1 -- 172.21.15.37:0/1724502645 shutdown_connections 2023-07-12T02:05:24.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.126+0000 7fb6cabff700 1 -- 172.21.15.37:0/1724502645 wait complete. 2023-07-12T02:05:24.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:05:24.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.349+0000 7f126e5ff700 1 Processor -- start 2023-07-12T02:05:24.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.349+0000 7f126e5ff700 1 -- start start 2023-07-12T02:05:24.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.350+0000 7f126e5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12680d3730 0x7f12680cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:24.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.350+0000 7f126e5ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f12680cfa90 0x7f12680d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:24.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.350+0000 7f126e5ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12680d0b20 con 0x7f12680b8430 2023-07-12T02:05:24.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.350+0000 7f126e5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12680cda30 con 0x7f12680d3730 2023-07-12T02:05:24.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.350+0000 7f126e5ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12680b8800 con 0x7f12680cfa90 2023-07-12T02:05:24.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.350+0000 7f12677fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12680d3730 0x7f12680cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:24.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.350+0000 7f1267fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f12680b8430 0x7f12680cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38822/0 (socket says 172.21.15.37:38822) 2023-07-12T02:05:24.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.350+0000 7f1267fff700 1 -- 172.21.15.37:0/3348177447 learned_addr learned my addr 172.21.15.37:0/3348177447 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:24.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.351+0000 7f126cb9c700 1 --2- 172.21.15.37:0/3348177447 >> v2:172.21.15.196:3300/0 conn(0x7f12680cfa90 0x7f12680d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:24.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.351+0000 7f12677fe700 1 -- 172.21.15.37:0/3348177447 >> v2:172.21.15.196:3300/0 conn(0x7f12680cfa90 msgr2=0x7f12680d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:24.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.351+0000 7f12677fe700 1 --2- 172.21.15.37:0/3348177447 >> v2:172.21.15.196:3300/0 conn(0x7f12680cfa90 0x7f12680d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.351+0000 7f12677fe700 1 -- 172.21.15.37:0/3348177447 >> v1:172.21.15.37:6789/0 conn(0x7f12680b8430 legacy=0x7f12680cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:24.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.351+0000 7f12677fe700 1 -- 172.21.15.37:0/3348177447 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12680cfe90 con 0x7f12680d3730 2023-07-12T02:05:24.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.351+0000 7f1266ffd700 1 -- 172.21.15.37:0/3348177447 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037016861 0 0) 0x7f12680d0b20 con 0x7f12680b8430 2023-07-12T02:05:24.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.351+0000 7f12677fe700 1 --2- 172.21.15.37:0/3348177447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12680d3730 0x7f12680cf550 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f12680b2100 tx=0x7f125c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712077d350b599ec server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:24.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.351+0000 7f1266ffd700 1 -- 172.21.15.37:0/3348177447 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c011830 con 0x7f12680d3730 2023-07-12T02:05:24.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.351+0000 7f1266ffd700 1 -- 172.21.15.37:0/3348177447 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c011990 con 0x7f12680d3730 2023-07-12T02:05:24.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.351+0000 7f1266ffd700 1 -- 172.21.15.37:0/3348177447 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c011d20 con 0x7f12680d3730 2023-07-12T02:05:24.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.352+0000 7f126e5ff700 1 -- 172.21.15.37:0/3348177447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12680d3730 msgr2=0x7f12680cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.352+0000 7f126e5ff700 1 --2- 172.21.15.37:0/3348177447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12680d3730 0x7f12680cf550 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f12680b2100 tx=0x7f125c009b20 comp rx=0 tx=0).stop 2023-07-12T02:05:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.352+0000 7f126e5ff700 1 -- 172.21.15.37:0/3348177447 shutdown_connections 2023-07-12T02:05:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.352+0000 7f126e5ff700 1 --2- 172.21.15.37:0/3348177447 >> v2:172.21.15.196:3300/0 conn(0x7f12680cfa90 0x7f12680d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.352+0000 7f126e5ff700 1 --2- 172.21.15.37:0/3348177447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12680d3730 0x7f12680cf550 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.352+0000 7f126e5ff700 1 -- 172.21.15.37:0/3348177447 >> 172.21.15.37:0/3348177447 conn(0x7f126806b3f0 msgr2=0x7f126806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.352+0000 7f126e5ff700 1 -- 172.21.15.37:0/3348177447 shutdown_connections 2023-07-12T02:05:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.352+0000 7f126e5ff700 1 -- 172.21.15.37:0/3348177447 wait complete. 2023-07-12T02:05:24.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.354+0000 7f126e5ff700 1 Processor -- start 2023-07-12T02:05:24.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.355+0000 7f126e5ff700 1 -- start start 2023-07-12T02:05:24.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.356+0000 7f126e5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12680b8430 0x7f12680c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:24.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.356+0000 7f126e5ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12680cfa90 0x7f12681f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:24.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.356+0000 7f126e5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12680d3730 0x7f12680d1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:24.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.356+0000 7f126e5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12680c9560 con 0x7f12680d3730 2023-07-12T02:05:24.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.356+0000 7f126e5ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12680c8c30 con 0x7f12680cfa90 2023-07-12T02:05:24.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.356+0000 7f126e5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12680c77f0 con 0x7f12680b8430 2023-07-12T02:05:24.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.356+0000 7f126cb9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12680d3730 0x7f12680d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:24.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.356+0000 7f126cb9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12680d3730 0x7f12680d1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48950/0 (socket says 172.21.15.37:48950) 2023-07-12T02:05:24.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.356+0000 7f126cb9c700 1 -- 172.21.15.37:0/1163467404 learned_addr learned my addr 172.21.15.37:0/1163467404 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:24.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.357+0000 7f12677fe700 1 --2- 172.21.15.37:0/1163467404 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12680cfa90 0x7f12681f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:24.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.357+0000 7f1267fff700 1 --2- 172.21.15.37:0/1163467404 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12680b8430 0x7f12680c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:24.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.357+0000 7f126cb9c700 1 -- 172.21.15.37:0/1163467404 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12680b8430 msgr2=0x7f12680c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:24.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.357+0000 7f126cb9c700 1 --2- 172.21.15.37:0/1163467404 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12680b8430 0x7f12680c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.357+0000 7f126cb9c700 1 -- 172.21.15.37:0/1163467404 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12680cfa90 msgr2=0x7f12681f2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.357+0000 7f126cb9c700 1 --2- 172.21.15.37:0/1163467404 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12680cfa90 0x7f12681f2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.357+0000 7f126cb9c700 1 -- 172.21.15.37:0/1163467404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c0094a0 con 0x7f12680d3730 2023-07-12T02:05:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.357+0000 7f126cb9c700 1 --2- 172.21.15.37:0/1163467404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12680d3730 0x7f12680d1670 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1260007e40 tx=0x7f126000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.357+0000 7f1264ff9700 1 -- 172.21.15.37:0/1163467404 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126000ed30 con 0x7f12680d3730 2023-07-12T02:05:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.357+0000 7f1264ff9700 1 -- 172.21.15.37:0/1163467404 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1260014420 con 0x7f12680d3730 2023-07-12T02:05:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.357+0000 7f126e5ff700 1 -- 172.21.15.37:0/1163467404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12681f23d0 con 0x7f12680d3730 2023-07-12T02:05:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.358+0000 7f1264ff9700 1 -- 172.21.15.37:0/1163467404 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12600147d0 con 0x7f12680d3730 2023-07-12T02:05:24.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.358+0000 7f126e5ff700 1 -- 172.21.15.37:0/1163467404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12681f2990 con 0x7f12680d3730 2023-07-12T02:05:24.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.359+0000 7f126e5ff700 1 -- 172.21.15.37:0/1163467404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126804ea60 con 0x7f12680d3730 2023-07-12T02:05:24.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.360+0000 7f1264ff9700 1 -- 172.21.15.37:0/1163467404 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1260014930 con 0x7f12680d3730 2023-07-12T02:05:24.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.360+0000 7f1264ff9700 1 --2- 172.21.15.37:0/1163467404 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f125406ace0 0x7f125406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:24.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.361+0000 7f1264ff9700 1 -- 172.21.15.37:0/1163467404 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1260089ec0 con 0x7f12680d3730 2023-07-12T02:05:24.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.361+0000 7f1267fff700 1 --2- 172.21.15.37:0/1163467404 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f125406ace0 0x7f125406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:24.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.362+0000 7f1267fff700 1 --2- 172.21.15.37:0/1163467404 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f125406ace0 0x7f125406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1258007fd0 tx=0x7f1258007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:24.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.365+0000 7f1264ff9700 1 -- 172.21.15.37:0/1163467404 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1260054cd0 con 0x7f12680d3730 2023-07-12T02:05:24.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.571+0000 7f126e5ff700 1 -- 172.21.15.37:0/1163467404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12680c7930 con 0x7f12680d3730 2023-07-12T02:05:24.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.572+0000 7f1264ff9700 1 -- 172.21.15.37:0/1163467404 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12600582f0 con 0x7f12680d3730 2023-07-12T02:05:24.575 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-12T02:05:24.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.574+0000 7f126e5ff700 1 -- 172.21.15.37:0/1163467404 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f125406ace0 msgr2=0x7f125406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:24.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.574+0000 7f126e5ff700 1 --2- 172.21.15.37:0/1163467404 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f125406ace0 0x7f125406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1258007fd0 tx=0x7f1258007de0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.574+0000 7f126e5ff700 1 -- 172.21.15.37:0/1163467404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12680d3730 msgr2=0x7f12680d1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:24.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.574+0000 7f126e5ff700 1 --2- 172.21.15.37:0/1163467404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12680d3730 0x7f12680d1670 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1260007e40 tx=0x7f126000e3c0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.574+0000 7f126e5ff700 1 -- 172.21.15.37:0/1163467404 shutdown_connections 2023-07-12T02:05:24.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.574+0000 7f126e5ff700 1 --2- 172.21.15.37:0/1163467404 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f125406ace0 0x7f125406d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.574+0000 7f126e5ff700 1 --2- 172.21.15.37:0/1163467404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12680d3730 0x7f12680d1670 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.574+0000 7f126e5ff700 1 --2- 172.21.15.37:0/1163467404 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f12680b8430 0x7f12680c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.574+0000 7f126e5ff700 1 --2- 172.21.15.37:0/1163467404 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12680cfa90 0x7f12681f2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.574+0000 7f126e5ff700 1 -- 172.21.15.37:0/1163467404 >> 172.21.15.37:0/1163467404 conn(0x7f126806b3f0 msgr2=0x7f12680b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.574+0000 7f126e5ff700 1 -- 172.21.15.37:0/1163467404 shutdown_connections 2023-07-12T02:05:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.574+0000 7f126e5ff700 1 -- 172.21.15.37:0/1163467404 wait complete. 2023-07-12T02:05:24.595 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-12T02:05:24.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.797+0000 7fb9007ff700 1 Processor -- start 2023-07-12T02:05:24.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.797+0000 7fb9007ff700 1 -- start start 2023-07-12T02:05:24.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.799+0000 7fb9007ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb8f80b8430 0x7fb8f80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:24.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.799+0000 7fb9007ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f80d3730 0x7fb8f80cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:24.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.799+0000 7fb9007ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f80d0b20 con 0x7fb8f80cfa90 2023-07-12T02:05:24.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.799+0000 7fb9007ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f80b8800 con 0x7fb8f80b8430 2023-07-12T02:05:24.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.799+0000 7fb9007ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80cfeb0 con 0x7fb8f80d3730 2023-07-12T02:05:24.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.799+0000 7fb8fdd9a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f80d3730 0x7fb8f80cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:24.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.799+0000 7fb8fed9c700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fb8f80cfa90 0x7fb8f815feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:36534/0 (socket says 172.21.15.37:36534) 2023-07-12T02:05:24.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.799+0000 7fb8fe59b700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb8f80b8430 0x7fb8f80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:24.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.799+0000 7fb8fed9c700 1 -- 172.21.15.37:0/185251172 learned_addr learned my addr 172.21.15.37:0/185251172 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:24.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.800+0000 7fb8fd599700 1 -- 172.21.15.37:0/185251172 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332341772 0 0) 0x7fb8f80d0b20 con 0x7fb8f80cfa90 2023-07-12T02:05:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.800+0000 7fb8fd599700 1 -- 172.21.15.37:0/185251172 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8e40035b0 con 0x7fb8f80cfa90 2023-07-12T02:05:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.800+0000 7fb8fdd9a700 1 -- 172.21.15.37:0/185251172 >> v2:172.21.15.196:3300/0 conn(0x7fb8f80b8430 msgr2=0x7fb8f80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.800+0000 7fb8fdd9a700 1 --2- 172.21.15.37:0/185251172 >> v2:172.21.15.196:3300/0 conn(0x7fb8f80b8430 0x7fb8f80cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.800+0000 7fb8fdd9a700 1 -- 172.21.15.37:0/185251172 >> v1:172.21.15.196:6789/0 conn(0x7fb8f80cfa90 legacy=0x7fb8f815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.800+0000 7fb8fdd9a700 1 -- 172.21.15.37:0/185251172 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f80b4ee0 con 0x7fb8f80d3730 2023-07-12T02:05:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.800+0000 7fb8fe59b700 1 --2- 172.21.15.37:0/185251172 >> v2:172.21.15.196:3300/0 conn(0x7fb8f80b8430 0x7fb8f80cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.800+0000 7fb8fdd9a700 1 --2- 172.21.15.37:0/185251172 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f80d3730 0x7fb8f80cf550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009840 tx=0x7fb8e8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=152be593952d3bc server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.800+0000 7fb8fd599700 1 -- 172.21.15.37:0/185251172 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8011830 con 0x7fb8f80d3730 2023-07-12T02:05:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.800+0000 7fb8fd599700 1 -- 172.21.15.37:0/185251172 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e8011990 con 0x7fb8f80d3730 2023-07-12T02:05:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.800+0000 7fb8fd599700 1 -- 172.21.15.37:0/185251172 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8011d20 con 0x7fb8f80d3730 2023-07-12T02:05:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.801+0000 7fb9007ff700 1 -- 172.21.15.37:0/185251172 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f80d3730 msgr2=0x7fb8f80cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.801+0000 7fb9007ff700 1 --2- 172.21.15.37:0/185251172 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f80d3730 0x7fb8f80cf550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009840 tx=0x7fb8e8009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.801+0000 7fb9007ff700 1 -- 172.21.15.37:0/185251172 shutdown_connections 2023-07-12T02:05:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.801+0000 7fb9007ff700 1 --2- 172.21.15.37:0/185251172 >> v2:172.21.15.196:3300/0 conn(0x7fb8f80b8430 0x7fb8f80cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.801+0000 7fb9007ff700 1 --2- 172.21.15.37:0/185251172 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f80d3730 0x7fb8f80cf550 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.801+0000 7fb9007ff700 1 -- 172.21.15.37:0/185251172 >> 172.21.15.37:0/185251172 conn(0x7fb8f806b3f0 msgr2=0x7fb8f806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.801+0000 7fb9007ff700 1 -- 172.21.15.37:0/185251172 shutdown_connections 2023-07-12T02:05:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.801+0000 7fb9007ff700 1 -- 172.21.15.37:0/185251172 wait complete. 2023-07-12T02:05:24.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.803+0000 7fb9007ff700 1 Processor -- start 2023-07-12T02:05:24.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.803+0000 7fb9007ff700 1 -- start start 2023-07-12T02:05:24.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.804+0000 7fb9007ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8f80b8430 0x7fb8f815f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:24.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.804+0000 7fb9007ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8f80cfa90 0x7fb8f814ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:24.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.804+0000 7fb9007ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f80d3730 0x7fb8f80cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:24.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.804+0000 7fb9007ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80cc080 con 0x7fb8f80cfa90 2023-07-12T02:05:24.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.804+0000 7fb9007ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80cb470 con 0x7fb8f80b8430 2023-07-12T02:05:24.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.804+0000 7fb9007ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80cb750 con 0x7fb8f80d3730 2023-07-12T02:05:24.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.804+0000 7fb8fdd9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8f80cfa90 0x7fb8f814ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:24.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.804+0000 7fb8fdd9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8f80cfa90 0x7fb8f814ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48966/0 (socket says 172.21.15.37:48966) 2023-07-12T02:05:24.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.804+0000 7fb8fdd9a700 1 -- 172.21.15.37:0/4187623823 learned_addr learned my addr 172.21.15.37:0/4187623823 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:24.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.804+0000 7fb8fed9c700 1 --2- 172.21.15.37:0/4187623823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f80d3730 0x7fb8f80cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:24.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.804+0000 7fb8fe59b700 1 --2- 172.21.15.37:0/4187623823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8f80b8430 0x7fb8f815f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:24.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.805+0000 7fb8fdd9a700 1 -- 172.21.15.37:0/4187623823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f80d3730 msgr2=0x7fb8f80cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:24.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.805+0000 7fb8fdd9a700 1 --2- 172.21.15.37:0/4187623823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f80d3730 0x7fb8f80cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.805+0000 7fb8fdd9a700 1 -- 172.21.15.37:0/4187623823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8f80b8430 msgr2=0x7fb8f815f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:24.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.805+0000 7fb8fdd9a700 1 --2- 172.21.15.37:0/4187623823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8f80b8430 0x7fb8f815f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:24.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.805+0000 7fb8fdd9a700 1 -- 172.21.15.37:0/4187623823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f40094a0 con 0x7fb8f80cfa90 2023-07-12T02:05:24.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.805+0000 7fb8fdd9a700 1 --2- 172.21.15.37:0/4187623823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8f80cfa90 0x7fb8f814ff40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009b90 tx=0x7fb8e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:24.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.805+0000 7fb8eeffd700 1 -- 172.21.15.37:0/4187623823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8004510 con 0x7fb8f80cfa90 2023-07-12T02:05:24.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.805+0000 7fb8eeffd700 1 -- 172.21.15.37:0/4187623823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e80036a0 con 0x7fb8f80cfa90 2023-07-12T02:05:24.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.805+0000 7fb8eeffd700 1 -- 172.21.15.37:0/4187623823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8003a50 con 0x7fb8f80cfa90 2023-07-12T02:05:24.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.805+0000 7fb9007ff700 1 -- 172.21.15.37:0/4187623823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e80094a0 con 0x7fb8f80cfa90 2023-07-12T02:05:24.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.805+0000 7fb9007ff700 1 -- 172.21.15.37:0/4187623823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f80cbd10 con 0x7fb8f80cfa90 2023-07-12T02:05:24.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.806+0000 7fb9007ff700 1 -- 172.21.15.37:0/4187623823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f804ea60 con 0x7fb8f80cfa90 2023-07-12T02:05:24.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.807+0000 7fb8eeffd700 1 -- 172.21.15.37:0/4187623823 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb8e8003bb0 con 0x7fb8f80cfa90 2023-07-12T02:05:24.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.808+0000 7fb8eeffd700 1 --2- 172.21.15.37:0/4187623823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb8dc06ace0 0x7fb8dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:24.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.808+0000 7fb8eeffd700 1 -- 172.21.15.37:0/4187623823 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb8e808aa90 con 0x7fb8f80cfa90 2023-07-12T02:05:24.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.809+0000 7fb8fe59b700 1 --2- 172.21.15.37:0/4187623823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb8dc06ace0 0x7fb8dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:24.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.809+0000 7fb8fe59b700 1 --2- 172.21.15.37:0/4187623823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb8dc06ace0 0x7fb8dc06d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb8f815b000 tx=0x7fb8f4009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:24.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:24.813+0000 7fb8eeffd700 1 -- 172.21.15.37:0/4187623823 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb8e80558a0 con 0x7fb8f80cfa90 2023-07-12T02:05:25.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.020+0000 7fb9007ff700 1 -- 172.21.15.37:0/4187623823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb8f80cc1c0 con 0x7fb8f80cfa90 2023-07-12T02:05:25.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.020+0000 7fb8eeffd700 1 -- 172.21.15.37:0/4187623823 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb8e8003e60 con 0x7fb8f80cfa90 2023-07-12T02:05:25.024 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:05:25.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.023+0000 7fb9007ff700 1 -- 172.21.15.37:0/4187623823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb8dc06ace0 msgr2=0x7fb8dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:25.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.023+0000 7fb9007ff700 1 --2- 172.21.15.37:0/4187623823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb8dc06ace0 0x7fb8dc06d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb8f815b000 tx=0x7fb8f4009210 comp rx=0 tx=0).stop 2023-07-12T02:05:25.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.023+0000 7fb9007ff700 1 -- 172.21.15.37:0/4187623823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8f80cfa90 msgr2=0x7fb8f814ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:25.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.023+0000 7fb9007ff700 1 --2- 172.21.15.37:0/4187623823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8f80cfa90 0x7fb8f814ff40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009b90 tx=0x7fb8e8004750 comp rx=0 tx=0).stop 2023-07-12T02:05:25.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.023+0000 7fb9007ff700 1 -- 172.21.15.37:0/4187623823 shutdown_connections 2023-07-12T02:05:25.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.023+0000 7fb9007ff700 1 --2- 172.21.15.37:0/4187623823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb8dc06ace0 0x7fb8dc06d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.023+0000 7fb9007ff700 1 --2- 172.21.15.37:0/4187623823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8f80d3730 0x7fb8f80cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.023+0000 7fb9007ff700 1 --2- 172.21.15.37:0/4187623823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8f80b8430 0x7fb8f815f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.023+0000 7fb9007ff700 1 --2- 172.21.15.37:0/4187623823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8f80cfa90 0x7fb8f814ff40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.023+0000 7fb9007ff700 1 -- 172.21.15.37:0/4187623823 >> 172.21.15.37:0/4187623823 conn(0x7fb8f806b3f0 msgr2=0x7fb8f80b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:25.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.023+0000 7fb9007ff700 1 -- 172.21.15.37:0/4187623823 shutdown_connections 2023-07-12T02:05:25.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.023+0000 7fb9007ff700 1 -- 172.21.15.37:0/4187623823 wait complete. 2023-07-12T02:05:25.044 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:05:25.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.243+0000 7f46a47ff700 1 Processor -- start 2023-07-12T02:05:25.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.243+0000 7f46a47ff700 1 -- start start 2023-07-12T02:05:25.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.245+0000 7f46a47ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f469c15c460 0x7f469c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:25.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.245+0000 7f46a47ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f469c0d2640 0x7f469c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:25.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.245+0000 7f46a47ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f469c0cf720 0x7f469c0cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:25.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.245+0000 7f46a47ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c0cedd0 con 0x7f469c0d2640 2023-07-12T02:05:25.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.245+0000 7f46a47ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c0d1790 con 0x7f469c15c460 2023-07-12T02:05:25.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.245+0000 7f46a47ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0cd950 con 0x7f469c0cf720 2023-07-12T02:05:25.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.245+0000 7f46a1d9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f469c0d2640 0x7f469c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:25.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.245+0000 7f46a1d9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f469c0d2640 0x7f469c0cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48984/0 (socket says 172.21.15.37:48984) 2023-07-12T02:05:25.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.245+0000 7f46a1d9a700 1 -- 172.21.15.37:0/289000104 learned_addr learned my addr 172.21.15.37:0/289000104 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:25.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.245+0000 7f46a259b700 1 --2- 172.21.15.37:0/289000104 >> v2:172.21.15.196:3300/0 conn(0x7f469c15c460 0x7f469c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:25.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.245+0000 7f46a2d9c700 1 --2- 172.21.15.37:0/289000104 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f469c0cf720 0x7f469c0cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:25.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.245+0000 7f46a1d9a700 1 -- 172.21.15.37:0/289000104 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f469c0cf720 msgr2=0x7f469c0cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:25.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.245+0000 7f46a1d9a700 1 --2- 172.21.15.37:0/289000104 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f469c0cf720 0x7f469c0cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.245+0000 7f46a1d9a700 1 -- 172.21.15.37:0/289000104 >> v2:172.21.15.196:3300/0 conn(0x7f469c15c460 msgr2=0x7f469c0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:25.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.245+0000 7f46a1d9a700 1 --2- 172.21.15.37:0/289000104 >> v2:172.21.15.196:3300/0 conn(0x7f469c15c460 0x7f469c0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.245+0000 7f46a1d9a700 1 -- 172.21.15.37:0/289000104 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c0d14b0 con 0x7f469c0d2640 2023-07-12T02:05:25.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.246+0000 7f46a1d9a700 1 --2- 172.21.15.37:0/289000104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f469c0d2640 0x7f469c0cf1e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f469c0b4f00 tx=0x7f468c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f6ffc7884a65f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:25.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.246+0000 7f46a1599700 1 -- 172.21.15.37:0/289000104 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c011830 con 0x7f469c0d2640 2023-07-12T02:05:25.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.246+0000 7f46a1599700 1 -- 172.21.15.37:0/289000104 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c011990 con 0x7f469c0d2640 2023-07-12T02:05:25.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.246+0000 7f46a1599700 1 -- 172.21.15.37:0/289000104 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c011d20 con 0x7f469c0d2640 2023-07-12T02:05:25.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.246+0000 7f46a47ff700 1 -- 172.21.15.37:0/289000104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f469c0d2640 msgr2=0x7f469c0cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:25.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.246+0000 7f46a47ff700 1 --2- 172.21.15.37:0/289000104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f469c0d2640 0x7f469c0cf1e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f469c0b4f00 tx=0x7f468c009bd0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.247+0000 7f46a47ff700 1 -- 172.21.15.37:0/289000104 shutdown_connections 2023-07-12T02:05:25.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.247+0000 7f46a47ff700 1 --2- 172.21.15.37:0/289000104 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f469c0cf720 0x7f469c0cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.247+0000 7f46a47ff700 1 --2- 172.21.15.37:0/289000104 >> v2:172.21.15.196:3300/0 conn(0x7f469c15c460 0x7f469c0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.247+0000 7f46a47ff700 1 --2- 172.21.15.37:0/289000104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f469c0d2640 0x7f469c0cf1e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.247+0000 7f46a47ff700 1 -- 172.21.15.37:0/289000104 >> 172.21.15.37:0/289000104 conn(0x7f469c071660 msgr2=0x7f469c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:25.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.247+0000 7f46a47ff700 1 -- 172.21.15.37:0/289000104 shutdown_connections 2023-07-12T02:05:25.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.247+0000 7f46a47ff700 1 -- 172.21.15.37:0/289000104 wait complete. 2023-07-12T02:05:25.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.248+0000 7f46a47ff700 1 Processor -- start 2023-07-12T02:05:25.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.248+0000 7f46a47ff700 1 -- start start 2023-07-12T02:05:25.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.249+0000 7f46a47ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f469c0cf720 0x7f469c1e6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:25.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.249+0000 7f46a47ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f469c0d2640 0x7f469c0c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:25.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.249+0000 7f46a47ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f469c15c460 0x7f469c1479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:25.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.249+0000 7f46a47ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0ca180 con 0x7f469c0cf720 2023-07-12T02:05:25.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.249+0000 7f46a47ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0ca460 con 0x7f469c0d2640 2023-07-12T02:05:25.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.249+0000 7f46a47ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0ca740 con 0x7f469c15c460 2023-07-12T02:05:25.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.250+0000 7f46a259b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f469c0cf720 0x7f469c1e6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:25.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.250+0000 7f46a259b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f469c0cf720 0x7f469c1e6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48992/0 (socket says 172.21.15.37:48992) 2023-07-12T02:05:25.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.250+0000 7f46a259b700 1 -- 172.21.15.37:0/3743930501 learned_addr learned my addr 172.21.15.37:0/3743930501 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:25.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.250+0000 7f46a1d9a700 1 --2- 172.21.15.37:0/3743930501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f469c0d2640 0x7f469c0c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:25.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.250+0000 7f46a2d9c700 1 --2- 172.21.15.37:0/3743930501 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f469c15c460 0x7f469c1479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:25.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.250+0000 7f46a259b700 1 -- 172.21.15.37:0/3743930501 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f469c15c460 msgr2=0x7f469c1479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:25.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.250+0000 7f46a259b700 1 --2- 172.21.15.37:0/3743930501 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f469c15c460 0x7f469c1479b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.250+0000 7f46a259b700 1 -- 172.21.15.37:0/3743930501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f469c0d2640 msgr2=0x7f469c0c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:25.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.250+0000 7f46a259b700 1 --2- 172.21.15.37:0/3743930501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f469c0d2640 0x7f469c0c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.250+0000 7f46a259b700 1 -- 172.21.15.37:0/3743930501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c009550 con 0x7f469c0cf720 2023-07-12T02:05:25.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.250+0000 7f46a1d9a700 1 --2- 172.21.15.37:0/3743930501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f469c0d2640 0x7f469c0c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:25.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.250+0000 7f46a259b700 1 --2- 172.21.15.37:0/3743930501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f469c0cf720 0x7f469c1e6650 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f469800e870 tx=0x7f469800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:25.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.251+0000 7f4692ffd700 1 -- 172.21.15.37:0/3743930501 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698009590 con 0x7f469c0cf720 2023-07-12T02:05:25.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.251+0000 7f4692ffd700 1 -- 172.21.15.37:0/3743930501 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469800ee70 con 0x7f469c0cf720 2023-07-12T02:05:25.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.251+0000 7f4692ffd700 1 -- 172.21.15.37:0/3743930501 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800ca50 con 0x7f469c0cf720 2023-07-12T02:05:25.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.251+0000 7f46a47ff700 1 -- 172.21.15.37:0/3743930501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c0caa20 con 0x7f469c0cf720 2023-07-12T02:05:25.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.251+0000 7f46a47ff700 1 -- 172.21.15.37:0/3743930501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c1e6b90 con 0x7f469c0cf720 2023-07-12T02:05:25.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.252+0000 7f46a47ff700 1 -- 172.21.15.37:0/3743930501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c0caf40 con 0x7f469c0cf720 2023-07-12T02:05:25.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.253+0000 7f4692ffd700 1 -- 172.21.15.37:0/3743930501 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f469800cbb0 con 0x7f469c0cf720 2023-07-12T02:05:25.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.254+0000 7f4692ffd700 1 --2- 172.21.15.37:0/3743930501 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f468006ace0 0x7f468006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:25.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.254+0000 7f4692ffd700 1 -- 172.21.15.37:0/3743930501 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f46980897d0 con 0x7f469c0cf720 2023-07-12T02:05:25.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.254+0000 7f46a1d9a700 1 --2- 172.21.15.37:0/3743930501 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f468006ace0 0x7f468006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:25.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.255+0000 7f46a1d9a700 1 --2- 172.21.15.37:0/3743930501 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f468006ace0 0x7f468006d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f469c157500 tx=0x7f468c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:25.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.259+0000 7f4692ffd700 1 -- 172.21.15.37:0/3743930501 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f469c0caf40 con 0x7f469c0cf720 2023-07-12T02:05:25.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.511+0000 7f46a47ff700 1 -- 172.21.15.37:0/3743930501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f469c0b8780 con 0x7f469c0cf720 2023-07-12T02:05:25.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.511+0000 7f4692ffd700 1 -- 172.21.15.37:0/3743930501 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f4698057fd0 con 0x7f469c0cf720 2023-07-12T02:05:25.515 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:25.515 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/2496042538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":2496042538},{"type":"v1","addr":"172.21.15.196:6836","nonce":2496042538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2193116262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":2193116262},{"type":"v1","addr":"172.21.15.196:6837","nonce":2193116262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3195008737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3195008737},{"type":"v1","addr":"172.21.15.37:6834","nonce":3195008737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:03:57.647919+0000","modified":"2023-07-12T02:04:25.438552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/4264740807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4264740807},{"type":"v1","addr":"172.21.15.37:6835","nonce":4264740807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-12T02:05:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.514+0000 7f46a47ff700 1 -- 172.21.15.37:0/3743930501 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f468006ace0 msgr2=0x7f468006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:25.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.514+0000 7f46a47ff700 1 --2- 172.21.15.37:0/3743930501 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f468006ace0 0x7f468006d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f469c157500 tx=0x7f468c008030 comp rx=0 tx=0).stop 2023-07-12T02:05:25.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.514+0000 7f46a47ff700 1 -- 172.21.15.37:0/3743930501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f469c0cf720 msgr2=0x7f469c1e6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:25.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.514+0000 7f46a47ff700 1 --2- 172.21.15.37:0/3743930501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f469c0cf720 0x7f469c1e6650 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f469800e870 tx=0x7f469800ec30 comp rx=0 tx=0).stop 2023-07-12T02:05:25.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.514+0000 7f46a47ff700 1 -- 172.21.15.37:0/3743930501 shutdown_connections 2023-07-12T02:05:25.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.514+0000 7f46a47ff700 1 --2- 172.21.15.37:0/3743930501 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f468006ace0 0x7f468006d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.514+0000 7f46a47ff700 1 --2- 172.21.15.37:0/3743930501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f469c0cf720 0x7f469c1e6650 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.514+0000 7f46a47ff700 1 --2- 172.21.15.37:0/3743930501 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f469c15c460 0x7f469c1479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.514+0000 7f46a47ff700 1 --2- 172.21.15.37:0/3743930501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f469c0d2640 0x7f469c0c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.514+0000 7f46a47ff700 1 -- 172.21.15.37:0/3743930501 >> 172.21.15.37:0/3743930501 conn(0x7f469c071660 msgr2=0x7f469c0d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.514+0000 7f46a47ff700 1 -- 172.21.15.37:0/3743930501 shutdown_connections 2023-07-12T02:05:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.514+0000 7f46a47ff700 1 -- 172.21.15.37:0/3743930501 wait complete. 2023-07-12T02:05:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2023-07-12T02:05:25.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:05:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.734+0000 7f252dfff700 1 Processor -- start 2023-07-12T02:05:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.734+0000 7f252dfff700 1 -- start start 2023-07-12T02:05:25.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.735+0000 7f252dfff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f252815c460 0x7f25280b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.735+0000 7f252dfff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25280d1790 con 0x7f25280cf8f0 2023-07-12T02:05:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.735+0000 7f252dfff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25280cd950 con 0x7f25280d2640 2023-07-12T02:05:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.735+0000 7f252dfff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25280cedd0 con 0x7f252815c460 2023-07-12T02:05:25.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.735+0000 7f2527fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f25280cf8f0 0x7f252815fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38838/0 (socket says 172.21.15.37:38838) 2023-07-12T02:05:25.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.735+0000 7f2527fff700 1 -- 172.21.15.37:0/2537094853 learned_addr learned my addr 172.21.15.37:0/2537094853 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:25.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.736+0000 7f25277fe700 1 --2- 172.21.15.37:0/2537094853 >> v2:172.21.15.196:3300/0 conn(0x7f252815c460 0x7f25280b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:25.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.736+0000 7f25267fc700 1 -- 172.21.15.37:0/2537094853 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760309046 0 0) 0x7f25280d1790 con 0x7f25280cf8f0 2023-07-12T02:05:25.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.736+0000 7f25267fc700 1 -- 172.21.15.37:0/2537094853 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25100035b0 con 0x7f25280cf8f0 2023-07-12T02:05:25.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.736+0000 7f25267fc700 1 -- 172.21.15.37:0/2537094853 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560745807 0 0) 0x7f25280cd950 con 0x7f25280d2640 2023-07-12T02:05:25.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.736+0000 7f25267fc700 1 -- 172.21.15.37:0/2537094853 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25280d1790 con 0x7f25280d2640 2023-07-12T02:05:25.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.736+0000 7f25277fe700 1 -- 172.21.15.37:0/2537094853 >> v1:172.21.15.196:6789/0 conn(0x7f25280d2640 legacy=0x7f25280cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:25.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.736+0000 7f25277fe700 1 -- 172.21.15.37:0/2537094853 >> v1:172.21.15.37:6789/0 conn(0x7f25280cf8f0 legacy=0x7f252815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:25.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.736+0000 7f25277fe700 1 -- 172.21.15.37:0/2537094853 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25280d14b0 con 0x7f252815c460 2023-07-12T02:05:25.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.737+0000 7f25277fe700 1 --2- 172.21.15.37:0/2537094853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f252815c460 0x7f25280b59d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2518009840 tx=0x7f2518009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8613d40a673ebdf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.737+0000 7f25267fc700 1 -- 172.21.15.37:0/2537094853 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518011830 con 0x7f252815c460 2023-07-12T02:05:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.737+0000 7f25267fc700 1 -- 172.21.15.37:0/2537094853 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2518011990 con 0x7f252815c460 2023-07-12T02:05:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.737+0000 7f25267fc700 1 -- 172.21.15.37:0/2537094853 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518011d20 con 0x7f252815c460 2023-07-12T02:05:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.737+0000 7f252dfff700 1 -- 172.21.15.37:0/2537094853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f252815c460 msgr2=0x7f25280b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.737+0000 7f252dfff700 1 --2- 172.21.15.37:0/2537094853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f252815c460 0x7f25280b59d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2518009840 tx=0x7f2518009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.738+0000 7f252dfff700 1 -- 172.21.15.37:0/2537094853 shutdown_connections 2023-07-12T02:05:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.738+0000 7f252dfff700 1 --2- 172.21.15.37:0/2537094853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f252815c460 0x7f25280b59d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.738+0000 7f252dfff700 1 -- 172.21.15.37:0/2537094853 >> 172.21.15.37:0/2537094853 conn(0x7f2528071660 msgr2=0x7f2528071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.738+0000 7f252dfff700 1 -- 172.21.15.37:0/2537094853 shutdown_connections 2023-07-12T02:05:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.738+0000 7f252dfff700 1 -- 172.21.15.37:0/2537094853 wait complete. 2023-07-12T02:05:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.739+0000 7f252dfff700 1 Processor -- start 2023-07-12T02:05:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.739+0000 7f252dfff700 1 -- start start 2023-07-12T02:05:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.740+0000 7f252dfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25280cf8f0 0x7f252815b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.740+0000 7f252dfff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25280d2640 0x7f25280cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.740+0000 7f252dfff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f252815c460 0x7f25281f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.740+0000 7f252dfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252815bac0 con 0x7f25280cf8f0 2023-07-12T02:05:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.740+0000 7f252dfff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25280cbff0 con 0x7f25280d2640 2023-07-12T02:05:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.740+0000 7f252dfff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25281f2390 con 0x7f252815c460 2023-07-12T02:05:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.741+0000 7f25277fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25280cf8f0 0x7f252815b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.741+0000 7f25277fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25280cf8f0 0x7f252815b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49000/0 (socket says 172.21.15.37:49000) 2023-07-12T02:05:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.741+0000 7f25277fe700 1 -- 172.21.15.37:0/1087368967 learned_addr learned my addr 172.21.15.37:0/1087368967 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.741+0000 7f2526ffd700 1 --2- 172.21.15.37:0/1087368967 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25280d2640 0x7f25280cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.741+0000 7f2527fff700 1 --2- 172.21.15.37:0/1087368967 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f252815c460 0x7f25281f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.741+0000 7f25277fe700 1 -- 172.21.15.37:0/1087368967 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f252815c460 msgr2=0x7f25281f1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:25.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.741+0000 7f25277fe700 1 --2- 172.21.15.37:0/1087368967 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f252815c460 0x7f25281f1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.741+0000 7f25277fe700 1 -- 172.21.15.37:0/1087368967 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25280d2640 msgr2=0x7f25280cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:25.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.741+0000 7f25277fe700 1 --2- 172.21.15.37:0/1087368967 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25280d2640 0x7f25280cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.741+0000 7f25277fe700 1 -- 172.21.15.37:0/1087368967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180094a0 con 0x7f25280cf8f0 2023-07-12T02:05:25.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.741+0000 7f2526ffd700 1 --2- 172.21.15.37:0/1087368967 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25280d2640 0x7f25280cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:25.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.741+0000 7f2527fff700 1 --2- 172.21.15.37:0/1087368967 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f252815c460 0x7f25281f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:25.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.741+0000 7f25277fe700 1 --2- 172.21.15.37:0/1087368967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25280cf8f0 0x7f252815b580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f25180090b0 tx=0x7f2518004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:25.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.742+0000 7f250ffff700 1 -- 172.21.15.37:0/1087368967 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251801a860 con 0x7f25280cf8f0 2023-07-12T02:05:25.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.742+0000 7f250ffff700 1 -- 172.21.15.37:0/1087368967 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251801a9c0 con 0x7f25280cf8f0 2023-07-12T02:05:25.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.742+0000 7f250ffff700 1 -- 172.21.15.37:0/1087368967 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251801ad30 con 0x7f25280cf8f0 2023-07-12T02:05:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.742+0000 7f252dfff700 1 -- 172.21.15.37:0/1087368967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25281f2670 con 0x7f25280cf8f0 2023-07-12T02:05:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.742+0000 7f252dfff700 1 -- 172.21.15.37:0/1087368967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25280cbc60 con 0x7f25280cf8f0 2023-07-12T02:05:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.743+0000 7f252dfff700 1 -- 172.21.15.37:0/1087368967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252804ea60 con 0x7f25280cf8f0 2023-07-12T02:05:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.744+0000 7f250ffff700 1 -- 172.21.15.37:0/1087368967 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2518022070 con 0x7f25280cf8f0 2023-07-12T02:05:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.745+0000 7f250ffff700 1 --2- 172.21.15.37:0/1087368967 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f251406ace0 0x7f251406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.745+0000 7f250ffff700 1 -- 172.21.15.37:0/1087368967 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f251808a540 con 0x7f25280cf8f0 2023-07-12T02:05:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.745+0000 7f2526ffd700 1 --2- 172.21.15.37:0/1087368967 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f251406ace0 0x7f251406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.746+0000 7f2526ffd700 1 --2- 172.21.15.37:0/1087368967 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f251406ace0 0x7f251406d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f251c0011e0 tx=0x7f251c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.750+0000 7f250ffff700 1 -- 172.21.15.37:0/1087368967 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2518055360 con 0x7f25280cf8f0 2023-07-12T02:05:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.957+0000 7f252dfff700 1 -- 172.21.15.37:0/1087368967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25280b4fa0 con 0x7f25280cf8f0 2023-07-12T02:05:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.958+0000 7f250ffff700 1 -- 172.21.15.37:0/1087368967 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20168 (secure 0 0 0) 0x7f2518015090 con 0x7f25280cf8f0 2023-07-12T02:05:25.962 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:25.962 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:39.032667+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:05:25.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.961+0000 7f252dfff700 1 -- 172.21.15.37:0/1087368967 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f251406ace0 msgr2=0x7f251406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.961+0000 7f252dfff700 1 --2- 172.21.15.37:0/1087368967 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f251406ace0 0x7f251406d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f251c0011e0 tx=0x7f251c009040 comp rx=0 tx=0).stop 2023-07-12T02:05:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.961+0000 7f252dfff700 1 -- 172.21.15.37:0/1087368967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25280cf8f0 msgr2=0x7f252815b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.961+0000 7f252dfff700 1 --2- 172.21.15.37:0/1087368967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25280cf8f0 0x7f252815b580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f25180090b0 tx=0x7f2518004750 comp rx=0 tx=0).stop 2023-07-12T02:05:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.961+0000 7f252dfff700 1 -- 172.21.15.37:0/1087368967 shutdown_connections 2023-07-12T02:05:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.961+0000 7f252dfff700 1 --2- 172.21.15.37:0/1087368967 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f251406ace0 0x7f251406d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.961+0000 7f252dfff700 1 --2- 172.21.15.37:0/1087368967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25280cf8f0 0x7f252815b580 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.961+0000 7f252dfff700 1 --2- 172.21.15.37:0/1087368967 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f252815c460 0x7f25281f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.961+0000 7f252dfff700 1 --2- 172.21.15.37:0/1087368967 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25280d2640 0x7f25280cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.961+0000 7f252dfff700 1 -- 172.21.15.37:0/1087368967 >> 172.21.15.37:0/1087368967 conn(0x7f2528071660 msgr2=0x7f25280b72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.961+0000 7f252dfff700 1 -- 172.21.15.37:0/1087368967 shutdown_connections 2023-07-12T02:05:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:25.961+0000 7f252dfff700 1 -- 172.21.15.37:0/1087368967 wait complete. 2023-07-12T02:05:25.983 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-12T02:05:25.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:05:26.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.184+0000 7fdc327ff700 1 Processor -- start 2023-07-12T02:05:26.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.184+0000 7fdc327ff700 1 -- start start 2023-07-12T02:05:26.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.185+0000 7fdc327ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdc2c0b59d0 0x7fdc2c1671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:26.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.185+0000 7fdc327ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2c0d1790 con 0x7fdc2c0d2640 2023-07-12T02:05:26.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.185+0000 7fdc327ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2c0cd950 con 0x7fdc2c15c460 2023-07-12T02:05:26.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.185+0000 7fdc327ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2c0b5e10 con 0x7fdc2c0b59d0 2023-07-12T02:05:26.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.185+0000 7fdc2b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdc2c0d2640 0x7fdc2c0cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38852/0 (socket says 172.21.15.37:38852) 2023-07-12T02:05:26.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.185+0000 7fdc2b7fe700 1 -- 172.21.15.37:0/2487174846 learned_addr learned my addr 172.21.15.37:0/2487174846 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:26.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.185+0000 7fdc30d9c700 1 --2- 172.21.15.37:0/2487174846 >> v2:172.21.15.37:3300/0 conn(0x7fdc2c0b59d0 0x7fdc2c1671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:26.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.186+0000 7fdc2affd700 1 -- 172.21.15.37:0/2487174846 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038022130 0 0) 0x7fdc2c0d1790 con 0x7fdc2c0d2640 2023-07-12T02:05:26.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.186+0000 7fdc2affd700 1 -- 172.21.15.37:0/2487174846 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc140035b0 con 0x7fdc2c0d2640 2023-07-12T02:05:26.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.186+0000 7fdc30d9c700 1 -- 172.21.15.37:0/2487174846 >> v1:172.21.15.196:6789/0 conn(0x7fdc2c15c460 legacy=0x7fdc2c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:26.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.186+0000 7fdc30d9c700 1 -- 172.21.15.37:0/2487174846 >> v1:172.21.15.37:6789/0 conn(0x7fdc2c0d2640 legacy=0x7fdc2c0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:26.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.186+0000 7fdc30d9c700 1 -- 172.21.15.37:0/2487174846 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c0d14b0 con 0x7fdc2c0b59d0 2023-07-12T02:05:26.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.186+0000 7fdc30d9c700 1 --2- 172.21.15.37:0/2487174846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c0b59d0 0x7fdc2c1671b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009d90 tx=0x7fdc2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914bcba7c9223725 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:26.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.186+0000 7fdc2affd700 1 -- 172.21.15.37:0/2487174846 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2400e070 con 0x7fdc2c0b59d0 2023-07-12T02:05:26.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.186+0000 7fdc2affd700 1 -- 172.21.15.37:0/2487174846 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2400bb20 con 0x7fdc2c0b59d0 2023-07-12T02:05:26.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.186+0000 7fdc2affd700 1 -- 172.21.15.37:0/2487174846 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24012430 con 0x7fdc2c0b59d0 2023-07-12T02:05:26.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.187+0000 7fdc327ff700 1 -- 172.21.15.37:0/2487174846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c0b59d0 msgr2=0x7fdc2c1671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:26.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.187+0000 7fdc327ff700 1 --2- 172.21.15.37:0/2487174846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c0b59d0 0x7fdc2c1671b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009d90 tx=0x7fdc2400b330 comp rx=0 tx=0).stop 2023-07-12T02:05:26.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.187+0000 7fdc327ff700 1 -- 172.21.15.37:0/2487174846 shutdown_connections 2023-07-12T02:05:26.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.187+0000 7fdc327ff700 1 --2- 172.21.15.37:0/2487174846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c0b59d0 0x7fdc2c1671b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.187+0000 7fdc327ff700 1 -- 172.21.15.37:0/2487174846 >> 172.21.15.37:0/2487174846 conn(0x7fdc2c071660 msgr2=0x7fdc2c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:26.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.187+0000 7fdc327ff700 1 -- 172.21.15.37:0/2487174846 shutdown_connections 2023-07-12T02:05:26.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.187+0000 7fdc327ff700 1 -- 172.21.15.37:0/2487174846 wait complete. 2023-07-12T02:05:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.189+0000 7fdc327ff700 1 Processor -- start 2023-07-12T02:05:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.189+0000 7fdc327ff700 1 -- start start 2023-07-12T02:05:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc327ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc2c0b59d0 0x7fdc2c15edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc327ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c0d2640 0x7fdc2c0b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc327ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdc2c15c460 0x7fdc2c0b6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc327ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0cab70 con 0x7fdc2c0d2640 2023-07-12T02:05:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc327ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0ca820 con 0x7fdc2c0b59d0 2023-07-12T02:05:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc327ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c15f330 con 0x7fdc2c15c460 2023-07-12T02:05:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc2b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c0d2640 0x7fdc2c0b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc2b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c0d2640 0x7fdc2c0b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49024/0 (socket says 172.21.15.37:49024) 2023-07-12T02:05:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc2b7fe700 1 -- 172.21.15.37:0/1241191641 learned_addr learned my addr 172.21.15.37:0/1241191641 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc2bfff700 1 --2- 172.21.15.37:0/1241191641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc2c0b59d0 0x7fdc2c15edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc30d9c700 1 --2- 172.21.15.37:0/1241191641 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdc2c15c460 0x7fdc2c0b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc2b7fe700 1 -- 172.21.15.37:0/1241191641 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdc2c15c460 msgr2=0x7fdc2c0b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc2b7fe700 1 --2- 172.21.15.37:0/1241191641 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdc2c15c460 0x7fdc2c0b6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc2b7fe700 1 -- 172.21.15.37:0/1241191641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc2c0b59d0 msgr2=0x7fdc2c15edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc2b7fe700 1 --2- 172.21.15.37:0/1241191641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc2c0b59d0 0x7fdc2c15edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc2b7fe700 1 -- 172.21.15.37:0/1241191641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc24009a70 con 0x7fdc2c0d2640 2023-07-12T02:05:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.190+0000 7fdc2bfff700 1 --2- 172.21.15.37:0/1241191641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc2c0b59d0 0x7fdc2c15edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.191+0000 7fdc2b7fe700 1 --2- 172.21.15.37:0/1241191641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c0d2640 0x7fdc2c0b5f50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000c730 tx=0x7fdc2000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.191+0000 7fdc28ff9700 1 -- 172.21.15.37:0/1241191641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20005d70 con 0x7fdc2c0d2640 2023-07-12T02:05:26.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.191+0000 7fdc28ff9700 1 -- 172.21.15.37:0/1241191641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc200070d0 con 0x7fdc2c0d2640 2023-07-12T02:05:26.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.191+0000 7fdc327ff700 1 -- 172.21.15.37:0/1241191641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2c0b7100 con 0x7fdc2c0d2640 2023-07-12T02:05:26.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.191+0000 7fdc28ff9700 1 -- 172.21.15.37:0/1241191641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20007440 con 0x7fdc2c0d2640 2023-07-12T02:05:26.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.191+0000 7fdc327ff700 1 -- 172.21.15.37:0/1241191641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2c0b76c0 con 0x7fdc2c0d2640 2023-07-12T02:05:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.192+0000 7fdc327ff700 1 -- 172.21.15.37:0/1241191641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2c04ea60 con 0x7fdc2c0d2640 2023-07-12T02:05:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.193+0000 7fdc28ff9700 1 -- 172.21.15.37:0/1241191641 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc200075a0 con 0x7fdc2c0d2640 2023-07-12T02:05:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.194+0000 7fdc28ff9700 1 --2- 172.21.15.37:0/1241191641 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fdc1806ace0 0x7fdc1806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.194+0000 7fdc28ff9700 1 -- 172.21.15.37:0/1241191641 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdc20088c00 con 0x7fdc2c0d2640 2023-07-12T02:05:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.195+0000 7fdc2bfff700 1 --2- 172.21.15.37:0/1241191641 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fdc1806ace0 0x7fdc1806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.195+0000 7fdc2bfff700 1 --2- 172.21.15.37:0/1241191641 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fdc1806ace0 0x7fdc1806d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c000f60 tx=0x7fdc1c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:26.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.199+0000 7fdc28ff9700 1 -- 172.21.15.37:0/1241191641 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fdc2008f080 con 0x7fdc2c0d2640 2023-07-12T02:05:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.454+0000 7fdc327ff700 1 -- 172.21.15.37:0/1241191641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc2c0b4fa0 con 0x7fdc2c0d2640 2023-07-12T02:05:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.454+0000 7fdc28ff9700 1 -- 172.21.15.37:0/1241191641 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7fdc20053a30 con 0x7fdc2c0d2640 2023-07-12T02:05:26.458 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:26.458 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/2496042538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":2496042538},{"type":"v1","addr":"172.21.15.196:6836","nonce":2496042538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2193116262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":2193116262},{"type":"v1","addr":"172.21.15.196:6837","nonce":2193116262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3195008737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3195008737},{"type":"v1","addr":"172.21.15.37:6834","nonce":3195008737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:03:57.647919+0000","modified":"2023-07-12T02:04:25.438552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/4264740807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4264740807},{"type":"v1","addr":"172.21.15.37:6835","nonce":4264740807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-12T02:05:26.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.457+0000 7fdc327ff700 1 -- 172.21.15.37:0/1241191641 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fdc1806ace0 msgr2=0x7fdc1806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.457+0000 7fdc327ff700 1 --2- 172.21.15.37:0/1241191641 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fdc1806ace0 0x7fdc1806d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c000f60 tx=0x7fdc1c009040 comp rx=0 tx=0).stop 2023-07-12T02:05:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.457+0000 7fdc327ff700 1 -- 172.21.15.37:0/1241191641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c0d2640 msgr2=0x7fdc2c0b5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.457+0000 7fdc327ff700 1 --2- 172.21.15.37:0/1241191641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c0d2640 0x7fdc2c0b5f50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000c730 tx=0x7fdc2000caf0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.457+0000 7fdc327ff700 1 -- 172.21.15.37:0/1241191641 shutdown_connections 2023-07-12T02:05:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.457+0000 7fdc327ff700 1 --2- 172.21.15.37:0/1241191641 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fdc1806ace0 0x7fdc1806d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.457+0000 7fdc327ff700 1 --2- 172.21.15.37:0/1241191641 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdc2c15c460 0x7fdc2c0b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.457+0000 7fdc327ff700 1 --2- 172.21.15.37:0/1241191641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc2c0b59d0 0x7fdc2c15edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.457+0000 7fdc327ff700 1 --2- 172.21.15.37:0/1241191641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c0d2640 0x7fdc2c0b5f50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.457+0000 7fdc327ff700 1 -- 172.21.15.37:0/1241191641 >> 172.21.15.37:0/1241191641 conn(0x7fdc2c071660 msgr2=0x7fdc2c0b7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.457+0000 7fdc327ff700 1 -- 172.21.15.37:0/1241191641 shutdown_connections 2023-07-12T02:05:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.457+0000 7fdc327ff700 1 -- 172.21.15.37:0/1241191641 wait complete. 2023-07-12T02:05:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2023-07-12T02:05:26.478 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:05:26.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.675+0000 7f2d7c3ff700 1 Processor -- start 2023-07-12T02:05:26.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.675+0000 7f2d7c3ff700 1 -- start start 2023-07-12T02:05:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.676+0000 7f2d7c3ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d740d2640 0x7f2d740b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.676+0000 7f2d7c3ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d740cf8f0 0x7f2d7415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.676+0000 7f2d7c3ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d740d1790 con 0x7f2d7415c460 2023-07-12T02:05:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.676+0000 7f2d7c3ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d740cedd0 con 0x7f2d740cf8f0 2023-07-12T02:05:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.676+0000 7f2d7c3ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740cd950 con 0x7f2d740d2640 2023-07-12T02:05:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.676+0000 7f2d7a99c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d740cf8f0 0x7f2d7415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.677+0000 7f2d7a99c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d740cf8f0 0x7f2d7415fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49036/0 (socket says 172.21.15.37:49036) 2023-07-12T02:05:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.677+0000 7f2d7a99c700 1 -- 172.21.15.37:0/176159465 learned_addr learned my addr 172.21.15.37:0/176159465 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.677+0000 7f2d7999a700 1 --2- 172.21.15.37:0/176159465 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d740d2640 0x7f2d740b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.677+0000 7f2d7a99c700 1 -- 172.21.15.37:0/176159465 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d740d2640 msgr2=0x7f2d740b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.677+0000 7f2d7a99c700 1 --2- 172.21.15.37:0/176159465 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d740d2640 0x7f2d740b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.677+0000 7f2d7a99c700 1 -- 172.21.15.37:0/176159465 >> v1:172.21.15.196:6789/0 conn(0x7f2d7415c460 legacy=0x7f2d740cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.677+0000 7f2d7a99c700 1 -- 172.21.15.37:0/176159465 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d740d14b0 con 0x7f2d740cf8f0 2023-07-12T02:05:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.677+0000 7f2d7a99c700 1 --2- 172.21.15.37:0/176159465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740cf8f0 0x7f2d7415fe20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009e50 tx=0x7f2d6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a6acc7949b6780 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.677+0000 7f2d79199700 1 -- 172.21.15.37:0/176159465 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c00e070 con 0x7f2d740cf8f0 2023-07-12T02:05:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.677+0000 7f2d79199700 1 -- 172.21.15.37:0/176159465 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c00b9c0 con 0x7f2d740cf8f0 2023-07-12T02:05:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.677+0000 7f2d79199700 1 -- 172.21.15.37:0/176159465 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c00bd70 con 0x7f2d740cf8f0 2023-07-12T02:05:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.678+0000 7f2d7c3ff700 1 -- 172.21.15.37:0/176159465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740cf8f0 msgr2=0x7f2d7415fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.678+0000 7f2d7c3ff700 1 --2- 172.21.15.37:0/176159465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740cf8f0 0x7f2d7415fe20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009e50 tx=0x7f2d6c00b330 comp rx=0 tx=0).stop 2023-07-12T02:05:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.678+0000 7f2d7c3ff700 1 -- 172.21.15.37:0/176159465 shutdown_connections 2023-07-12T02:05:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.678+0000 7f2d7c3ff700 1 --2- 172.21.15.37:0/176159465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740cf8f0 0x7f2d7415fe20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.678+0000 7f2d7c3ff700 1 --2- 172.21.15.37:0/176159465 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d740d2640 0x7f2d740b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.678+0000 7f2d7c3ff700 1 -- 172.21.15.37:0/176159465 >> 172.21.15.37:0/176159465 conn(0x7f2d74071660 msgr2=0x7f2d74071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.678+0000 7f2d7c3ff700 1 -- 172.21.15.37:0/176159465 shutdown_connections 2023-07-12T02:05:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.678+0000 7f2d7c3ff700 1 -- 172.21.15.37:0/176159465 wait complete. 2023-07-12T02:05:26.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.680+0000 7f2d7c3ff700 1 Processor -- start 2023-07-12T02:05:26.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.681+0000 7f2d7c3ff700 1 -- start start 2023-07-12T02:05:26.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.682+0000 7f2d7c3ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d740cf8f0 0x7f2d74158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:26.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.682+0000 7f2d7c3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740d2640 0x7f2d740b6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:26.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.682+0000 7f2d7c3ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d7415c460 0x7f2d74155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.682+0000 7f2d7c3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740caff0 con 0x7f2d740d2640 2023-07-12T02:05:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.682+0000 7f2d7c3ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740caa30 con 0x7f2d7415c460 2023-07-12T02:05:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.682+0000 7f2d7c3ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740cad10 con 0x7f2d740cf8f0 2023-07-12T02:05:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.682+0000 7f2d7999a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740d2640 0x7f2d740b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.682+0000 7f2d7999a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740d2640 0x7f2d740b6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49044/0 (socket says 172.21.15.37:49044) 2023-07-12T02:05:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.682+0000 7f2d7a19b700 1 --2- 172.21.15.37:0/3335953411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d740cf8f0 0x7f2d74158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.682+0000 7f2d7999a700 1 -- 172.21.15.37:0/3335953411 learned_addr learned my addr 172.21.15.37:0/3335953411 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.682+0000 7f2d7a99c700 1 --2- 172.21.15.37:0/3335953411 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d7415c460 0x7f2d74155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.683+0000 7f2d7999a700 1 -- 172.21.15.37:0/3335953411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d740cf8f0 msgr2=0x7f2d74158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.683+0000 7f2d7999a700 1 --2- 172.21.15.37:0/3335953411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d740cf8f0 0x7f2d74158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.683+0000 7f2d7999a700 1 -- 172.21.15.37:0/3335953411 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d7415c460 msgr2=0x7f2d74155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.683+0000 7f2d7999a700 1 --2- 172.21.15.37:0/3335953411 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d7415c460 0x7f2d74155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.683+0000 7f2d7999a700 1 -- 172.21.15.37:0/3335953411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c009b30 con 0x7f2d740d2640 2023-07-12T02:05:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.683+0000 7f2d7999a700 1 --2- 172.21.15.37:0/3335953411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740d2640 0x7f2d740b6970 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400d800 tx=0x7f2d6400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.683+0000 7f2d6affd700 1 -- 172.21.15.37:0/3335953411 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d640125f0 con 0x7f2d740d2640 2023-07-12T02:05:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.683+0000 7f2d6affd700 1 -- 172.21.15.37:0/3335953411 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d64012750 con 0x7f2d740d2640 2023-07-12T02:05:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.683+0000 7f2d7c3ff700 1 -- 172.21.15.37:0/3335953411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d741e4b30 con 0x7f2d740d2640 2023-07-12T02:05:26.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.683+0000 7f2d6affd700 1 -- 172.21.15.37:0/3335953411 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64012b00 con 0x7f2d740d2640 2023-07-12T02:05:26.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.683+0000 7f2d7c3ff700 1 -- 172.21.15.37:0/3335953411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d740b6eb0 con 0x7f2d740d2640 2023-07-12T02:05:26.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.684+0000 7f2d7c3ff700 1 -- 172.21.15.37:0/3335953411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7404ea60 con 0x7f2d740d2640 2023-07-12T02:05:26.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.685+0000 7f2d6affd700 1 -- 172.21.15.37:0/3335953411 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d64012c60 con 0x7f2d740d2640 2023-07-12T02:05:26.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.686+0000 7f2d6affd700 1 --2- 172.21.15.37:0/3335953411 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2d5806ace0 0x7f2d5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:26.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.687+0000 7f2d6affd700 1 -- 172.21.15.37:0/3335953411 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2d640897b0 con 0x7f2d740d2640 2023-07-12T02:05:26.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.687+0000 7f2d7a19b700 1 --2- 172.21.15.37:0/3335953411 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2d5806ace0 0x7f2d5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:26.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.688+0000 7f2d7a19b700 1 --2- 172.21.15.37:0/3335953411 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2d5806ace0 0x7f2d5806d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2d70007fd0 tx=0x7f2d70009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:26.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.691+0000 7f2d6affd700 1 -- 172.21.15.37:0/3335953411 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2d64054520 con 0x7f2d740d2640 2023-07-12T02:05:26.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.942+0000 7f2d7c3ff700 1 -- 172.21.15.37:0/3335953411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d741e6a10 con 0x7f2d740d2640 2023-07-12T02:05:26.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.942+0000 7f2d6affd700 1 -- 172.21.15.37:0/3335953411 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f2d64057b40 con 0x7f2d740d2640 2023-07-12T02:05:26.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:26.946 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/2496042538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":2496042538},{"type":"v1","addr":"172.21.15.196:6836","nonce":2496042538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/2193116262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":2193116262},{"type":"v1","addr":"172.21.15.196:6837","nonce":2193116262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3195008737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3195008737},{"type":"v1","addr":"172.21.15.37:6834","nonce":3195008737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:03:57.647919+0000","modified":"2023-07-12T02:04:25.438552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/4264740807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4264740807},{"type":"v1","addr":"172.21.15.37:6835","nonce":4264740807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-12T02:05:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.945+0000 7f2d7c3ff700 1 -- 172.21.15.37:0/3335953411 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2d5806ace0 msgr2=0x7f2d5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.945+0000 7f2d7c3ff700 1 --2- 172.21.15.37:0/3335953411 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2d5806ace0 0x7f2d5806d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2d70007fd0 tx=0x7f2d70009040 comp rx=0 tx=0).stop 2023-07-12T02:05:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.945+0000 7f2d7c3ff700 1 -- 172.21.15.37:0/3335953411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740d2640 msgr2=0x7f2d740b6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.945+0000 7f2d7c3ff700 1 --2- 172.21.15.37:0/3335953411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740d2640 0x7f2d740b6970 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400d800 tx=0x7f2d6400db10 comp rx=0 tx=0).stop 2023-07-12T02:05:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.945+0000 7f2d7c3ff700 1 -- 172.21.15.37:0/3335953411 shutdown_connections 2023-07-12T02:05:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.945+0000 7f2d7c3ff700 1 --2- 172.21.15.37:0/3335953411 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f2d5806ace0 0x7f2d5806d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.945+0000 7f2d7c3ff700 1 --2- 172.21.15.37:0/3335953411 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d7415c460 0x7f2d74155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.945+0000 7f2d7c3ff700 1 --2- 172.21.15.37:0/3335953411 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d740cf8f0 0x7f2d74158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.945+0000 7f2d7c3ff700 1 --2- 172.21.15.37:0/3335953411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740d2640 0x7f2d740b6970 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.945+0000 7f2d7c3ff700 1 -- 172.21.15.37:0/3335953411 >> 172.21.15.37:0/3335953411 conn(0x7f2d74071660 msgr2=0x7f2d740b7470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.945+0000 7f2d7c3ff700 1 -- 172.21.15.37:0/3335953411 shutdown_connections 2023-07-12T02:05:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:26.945+0000 7f2d7c3ff700 1 -- 172.21.15.37:0/3335953411 wait complete. 2023-07-12T02:05:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2023-07-12T02:05:26.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:05:27.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.162+0000 7f650d7ff700 1 Processor -- start 2023-07-12T02:05:27.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.162+0000 7f650d7ff700 1 -- start start 2023-07-12T02:05:27.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.163+0000 7f650d7ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f650815c460 0x7f65080b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:27.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.163+0000 7f650d7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65080d2640 0x7f65080cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:27.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.163+0000 7f650d7ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65080d1790 con 0x7f65080cf720 2023-07-12T02:05:27.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.163+0000 7f650d7ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65080cedd0 con 0x7f650815c460 2023-07-12T02:05:27.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.163+0000 7f650d7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65080cd950 con 0x7f65080d2640 2023-07-12T02:05:27.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.164+0000 7f6506ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f650815c460 0x7f65080b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:27.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.164+0000 7f6506ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f650815c460 0x7f65080b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49050/0 (socket says 172.21.15.37:49050) 2023-07-12T02:05:27.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.164+0000 7f6506ffd700 1 -- 172.21.15.37:0/1681101989 learned_addr learned my addr 172.21.15.37:0/1681101989 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:27.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.164+0000 7f65067fc700 1 --2- 172.21.15.37:0/1681101989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65080d2640 0x7f65080cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:27.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.164+0000 7f6506ffd700 1 -- 172.21.15.37:0/1681101989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65080d2640 msgr2=0x7f65080cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:27.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.164+0000 7f6506ffd700 1 --2- 172.21.15.37:0/1681101989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65080d2640 0x7f65080cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.164+0000 7f6506ffd700 1 -- 172.21.15.37:0/1681101989 >> v1:172.21.15.196:6789/0 conn(0x7f65080cf720 legacy=0x7f65080d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:27.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.164+0000 7f6506ffd700 1 -- 172.21.15.37:0/1681101989 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65080d14b0 con 0x7f650815c460 2023-07-12T02:05:27.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.164+0000 7f6506ffd700 1 --2- 172.21.15.37:0/1681101989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f650815c460 0x7f65080b59d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f64f80098f0 tx=0x7f64f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cf11e49a06d663 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:27.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.165+0000 7f6505ffb700 1 -- 172.21.15.37:0/1681101989 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f8011830 con 0x7f650815c460 2023-07-12T02:05:27.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.165+0000 7f6505ffb700 1 -- 172.21.15.37:0/1681101989 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f8011990 con 0x7f650815c460 2023-07-12T02:05:27.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.165+0000 7f6505ffb700 1 -- 172.21.15.37:0/1681101989 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f8011d20 con 0x7f650815c460 2023-07-12T02:05:27.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.165+0000 7f650d7ff700 1 -- 172.21.15.37:0/1681101989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f650815c460 msgr2=0x7f65080b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:27.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.165+0000 7f650d7ff700 1 --2- 172.21.15.37:0/1681101989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f650815c460 0x7f65080b59d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f64f80098f0 tx=0x7f64f8009c00 comp rx=0 tx=0).stop 2023-07-12T02:05:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.165+0000 7f650d7ff700 1 -- 172.21.15.37:0/1681101989 shutdown_connections 2023-07-12T02:05:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.165+0000 7f650d7ff700 1 --2- 172.21.15.37:0/1681101989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f650815c460 0x7f65080b59d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.165+0000 7f650d7ff700 1 --2- 172.21.15.37:0/1681101989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65080d2640 0x7f65080cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.165+0000 7f650d7ff700 1 -- 172.21.15.37:0/1681101989 >> 172.21.15.37:0/1681101989 conn(0x7f6508071660 msgr2=0x7f6508071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.165+0000 7f650d7ff700 1 -- 172.21.15.37:0/1681101989 shutdown_connections 2023-07-12T02:05:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.165+0000 7f650d7ff700 1 -- 172.21.15.37:0/1681101989 wait complete. 2023-07-12T02:05:27.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.167+0000 7f650d7ff700 1 Processor -- start 2023-07-12T02:05:27.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.167+0000 7f650d7ff700 1 -- start start 2023-07-12T02:05:27.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.168+0000 7f650d7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65080cf720 0x7f65080cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:27.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.168+0000 7f650d7ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65080d2640 0x7f6508148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:27.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.168+0000 7f650d7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f650815c460 0x7f650815af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:27.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.168+0000 7f650d7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65081f6a80 con 0x7f650815c460 2023-07-12T02:05:27.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.168+0000 7f650d7ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6508149430 con 0x7f65080d2640 2023-07-12T02:05:27.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.168+0000 7f650d7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65081f5b20 con 0x7f65080cf720 2023-07-12T02:05:27.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.169+0000 7f65077fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f650815c460 0x7f650815af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:27.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.169+0000 7f65077fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f650815c460 0x7f650815af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49054/0 (socket says 172.21.15.37:49054) 2023-07-12T02:05:27.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.169+0000 7f65077fe700 1 -- 172.21.15.37:0/1041535987 learned_addr learned my addr 172.21.15.37:0/1041535987 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:27.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.169+0000 7f6506ffd700 1 --2- 172.21.15.37:0/1041535987 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65080cf720 0x7f65080cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:27.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.169+0000 7f65067fc700 1 --2- 172.21.15.37:0/1041535987 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65080d2640 0x7f6508148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:27.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.169+0000 7f65077fe700 1 -- 172.21.15.37:0/1041535987 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65080cf720 msgr2=0x7f65080cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:27.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.169+0000 7f65077fe700 1 --2- 172.21.15.37:0/1041535987 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65080cf720 0x7f65080cafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.169+0000 7f65077fe700 1 -- 172.21.15.37:0/1041535987 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65080d2640 msgr2=0x7f6508148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:27.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.169+0000 7f65077fe700 1 --2- 172.21.15.37:0/1041535987 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65080d2640 0x7f6508148ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.169+0000 7f65077fe700 1 -- 172.21.15.37:0/1041535987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f8009550 con 0x7f650815c460 2023-07-12T02:05:27.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.169+0000 7f65067fc700 1 --2- 172.21.15.37:0/1041535987 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65080d2640 0x7f6508148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:27.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.169+0000 7f65077fe700 1 --2- 172.21.15.37:0/1041535987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f650815c460 0x7f650815af60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f650000cb50 tx=0x7f650000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:27.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.170+0000 7f64ef7fe700 1 -- 172.21.15.37:0/1041535987 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500003c00 con 0x7f650815c460 2023-07-12T02:05:27.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.170+0000 7f64ef7fe700 1 -- 172.21.15.37:0/1041535987 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6500003d60 con 0x7f650815c460 2023-07-12T02:05:27.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.170+0000 7f650d7ff700 1 -- 172.21.15.37:0/1041535987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65081f5e00 con 0x7f650815c460 2023-07-12T02:05:27.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.170+0000 7f64ef7fe700 1 -- 172.21.15.37:0/1041535987 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650000aac0 con 0x7f650815c460 2023-07-12T02:05:27.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.170+0000 7f650d7ff700 1 -- 172.21.15.37:0/1041535987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65081f63c0 con 0x7f650815c460 2023-07-12T02:05:27.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.171+0000 7f650d7ff700 1 -- 172.21.15.37:0/1041535987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f650804ea60 con 0x7f650815c460 2023-07-12T02:05:27.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.172+0000 7f64ef7fe700 1 -- 172.21.15.37:0/1041535987 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f650000ac20 con 0x7f650815c460 2023-07-12T02:05:27.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.173+0000 7f64ef7fe700 1 --2- 172.21.15.37:0/1041535987 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f64f406ace0 0x7f64f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:27.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.173+0000 7f64ef7fe700 1 -- 172.21.15.37:0/1041535987 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f65000897e0 con 0x7f650815c460 2023-07-12T02:05:27.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.173+0000 7f6506ffd700 1 --2- 172.21.15.37:0/1041535987 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f64f406ace0 0x7f64f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:27.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.174+0000 7f6506ffd700 1 --2- 172.21.15.37:0/1041535987 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f64f406ace0 0x7f64f406d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f64f8000c00 tx=0x7f64f8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:27.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.178+0000 7f64ef7fe700 1 -- 172.21.15.37:0/1041535987 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6500054550 con 0x7f650815c460 2023-07-12T02:05:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.384+0000 7f650d7ff700 1 -- 172.21.15.37:0/1041535987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65080b4fa0 con 0x7f650815c460 2023-07-12T02:05:27.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.386+0000 7f64ef7fe700 1 -- 172.21.15.37:0/1041535987 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20168 (secure 0 0 0) 0x7f6500057b70 con 0x7f650815c460 2023-07-12T02:05:27.390 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:27.390 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:04:39.032667+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:03:56.039938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:03:56.612707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-12T02:04:00.200885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:05:27.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.388+0000 7f650d7ff700 1 -- 172.21.15.37:0/1041535987 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f64f406ace0 msgr2=0x7f64f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:27.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.388+0000 7f650d7ff700 1 --2- 172.21.15.37:0/1041535987 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f64f406ace0 0x7f64f406d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f64f8000c00 tx=0x7f64f8008030 comp rx=0 tx=0).stop 2023-07-12T02:05:27.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.388+0000 7f650d7ff700 1 -- 172.21.15.37:0/1041535987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f650815c460 msgr2=0x7f650815af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:27.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.388+0000 7f650d7ff700 1 --2- 172.21.15.37:0/1041535987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f650815c460 0x7f650815af60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f650000cb50 tx=0x7f650000ce60 comp rx=0 tx=0).stop 2023-07-12T02:05:27.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.388+0000 7f650d7ff700 1 -- 172.21.15.37:0/1041535987 shutdown_connections 2023-07-12T02:05:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.388+0000 7f650d7ff700 1 --2- 172.21.15.37:0/1041535987 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f64f406ace0 0x7f64f406d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.388+0000 7f650d7ff700 1 --2- 172.21.15.37:0/1041535987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f650815c460 0x7f650815af60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.388+0000 7f650d7ff700 1 --2- 172.21.15.37:0/1041535987 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65080cf720 0x7f65080cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.388+0000 7f650d7ff700 1 --2- 172.21.15.37:0/1041535987 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65080d2640 0x7f6508148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.388+0000 7f650d7ff700 1 -- 172.21.15.37:0/1041535987 >> 172.21.15.37:0/1041535987 conn(0x7f6508071660 msgr2=0x7f650815c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.388+0000 7f650d7ff700 1 -- 172.21.15.37:0/1041535987 shutdown_connections 2023-07-12T02:05:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.388+0000 7f650d7ff700 1 -- 172.21.15.37:0/1041535987 wait complete. 2023-07-12T02:05:27.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-12T02:05:27.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.608+0000 7fdde09ff700 1 Processor -- start 2023-07-12T02:05:27.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.609+0000 7fdde09ff700 1 -- start start 2023-07-12T02:05:27.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.610+0000 7fdde09ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdddc15c290 0x7fdddc0ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:27.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.610+0000 7fdde09ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdddc0cef10 0x7fdddc069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:27.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.610+0000 7fdde09ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdddc0cdad0 con 0x7fdddc0cf360 2023-07-12T02:05:27.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.610+0000 7fdde09ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdddc0725c0 con 0x7fdddc0cef10 2023-07-12T02:05:27.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.610+0000 7fdde09ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0abdf0 con 0x7fdddc15c290 2023-07-12T02:05:27.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.610+0000 7fddd3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdddc0cef10 0x7fdddc069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:27.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.610+0000 7fdddad9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdddc0cf360 0x7fdddc06f260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38854/0 (socket says 172.21.15.37:38854) 2023-07-12T02:05:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.610+0000 7fdddad9d700 1 -- 172.21.15.37:0/2295528738 learned_addr learned my addr 172.21.15.37:0/2295528738 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.610+0000 7fddda59c700 1 --2- 172.21.15.37:0/2295528738 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdddc15c290 0x7fdddc0ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.611+0000 7fddd9d9b700 1 -- 172.21.15.37:0/2295528738 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598311002 0 0) 0x7fdddc0cdad0 con 0x7fdddc0cf360 2023-07-12T02:05:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.611+0000 7fddd9d9b700 1 -- 172.21.15.37:0/2295528738 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddc80035b0 con 0x7fdddc0cf360 2023-07-12T02:05:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.611+0000 7fddd3fff700 1 -- 172.21.15.37:0/2295528738 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdddc15c290 msgr2=0x7fdddc0ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.611+0000 7fddd3fff700 1 --2- 172.21.15.37:0/2295528738 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdddc15c290 0x7fdddc0ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.611+0000 7fddd3fff700 1 -- 172.21.15.37:0/2295528738 >> v1:172.21.15.37:6789/0 conn(0x7fdddc0cf360 legacy=0x7fdddc06f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:27.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.611+0000 7fddd3fff700 1 -- 172.21.15.37:0/2295528738 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc0cd550 con 0x7fdddc0cef10 2023-07-12T02:05:27.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.611+0000 7fddd3fff700 1 --2- 172.21.15.37:0/2295528738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cef10 0x7fdddc069f30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009840 tx=0x7fddc4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95edb01e77d6e9a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:27.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.611+0000 7fddd9d9b700 1 -- 172.21.15.37:0/2295528738 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4011830 con 0x7fdddc0cef10 2023-07-12T02:05:27.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.611+0000 7fddd9d9b700 1 -- 172.21.15.37:0/2295528738 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc4011990 con 0x7fdddc0cef10 2023-07-12T02:05:27.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.611+0000 7fddd9d9b700 1 -- 172.21.15.37:0/2295528738 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4011d00 con 0x7fdddc0cef10 2023-07-12T02:05:27.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.612+0000 7fdde09ff700 1 -- 172.21.15.37:0/2295528738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cef10 msgr2=0x7fdddc069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:27.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.612+0000 7fdde09ff700 1 --2- 172.21.15.37:0/2295528738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cef10 0x7fdddc069f30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009840 tx=0x7fddc4009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:27.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.612+0000 7fdde09ff700 1 -- 172.21.15.37:0/2295528738 shutdown_connections 2023-07-12T02:05:27.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.612+0000 7fdde09ff700 1 --2- 172.21.15.37:0/2295528738 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdddc15c290 0x7fdddc0ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.612+0000 7fdde09ff700 1 --2- 172.21.15.37:0/2295528738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cef10 0x7fdddc069f30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.612+0000 7fdde09ff700 1 -- 172.21.15.37:0/2295528738 >> 172.21.15.37:0/2295528738 conn(0x7fdddc06d450 msgr2=0x7fdddc06d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:27.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.612+0000 7fdde09ff700 1 -- 172.21.15.37:0/2295528738 shutdown_connections 2023-07-12T02:05:27.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.612+0000 7fdde09ff700 1 -- 172.21.15.37:0/2295528738 wait complete. 2023-07-12T02:05:27.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.614+0000 7fdde09ff700 1 Processor -- start 2023-07-12T02:05:27.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.614+0000 7fdde09ff700 1 -- start start 2023-07-12T02:05:27.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.615+0000 7fdde09ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cef10 0x7fdddc1e62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:27.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.615+0000 7fdde09ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdddc0cf360 0x7fdddc155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:27.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.615+0000 7fdde09ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdddc15c290 0x7fdddc155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:27.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.615+0000 7fdde09ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc1e6810 con 0x7fdddc0cef10 2023-07-12T02:05:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.615+0000 7fdde09ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0b12b0 con 0x7fdddc0cf360 2023-07-12T02:05:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.615+0000 7fdde09ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0b0210 con 0x7fdddc15c290 2023-07-12T02:05:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.615+0000 7fddda59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cef10 0x7fdddc1e62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.615+0000 7fddda59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cef10 0x7fdddc1e62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49072/0 (socket says 172.21.15.37:49072) 2023-07-12T02:05:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.615+0000 7fddda59c700 1 -- 172.21.15.37:0/2899893588 learned_addr learned my addr 172.21.15.37:0/2899893588 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.615+0000 7fddd3fff700 1 --2- 172.21.15.37:0/2899893588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdddc0cf360 0x7fdddc155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.615+0000 7fdddad9d700 1 --2- 172.21.15.37:0/2899893588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdddc15c290 0x7fdddc155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.615+0000 7fddda59c700 1 -- 172.21.15.37:0/2899893588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdddc15c290 msgr2=0x7fdddc155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:27.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.615+0000 7fddda59c700 1 --2- 172.21.15.37:0/2899893588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdddc15c290 0x7fdddc155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.615+0000 7fddda59c700 1 -- 172.21.15.37:0/2899893588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdddc0cf360 msgr2=0x7fdddc155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:27.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.615+0000 7fddda59c700 1 --2- 172.21.15.37:0/2899893588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdddc0cf360 0x7fdddc155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.615+0000 7fddda59c700 1 -- 172.21.15.37:0/2899893588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc40094a0 con 0x7fdddc0cef10 2023-07-12T02:05:27.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.616+0000 7fddda59c700 1 --2- 172.21.15.37:0/2899893588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cef10 0x7fdddc1e62d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00e870 tx=0x7fddcc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:27.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.616+0000 7fddd2ffd700 1 -- 172.21.15.37:0/2899893588 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc009590 con 0x7fdddc0cef10 2023-07-12T02:05:27.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.616+0000 7fddd2ffd700 1 -- 172.21.15.37:0/2899893588 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc00ee70 con 0x7fdddc0cef10 2023-07-12T02:05:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.616+0000 7fdde09ff700 1 -- 172.21.15.37:0/2899893588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdddc0b04f0 con 0x7fdddc0cef10 2023-07-12T02:05:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.616+0000 7fddd2ffd700 1 -- 172.21.15.37:0/2899893588 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc00ca50 con 0x7fdddc0cef10 2023-07-12T02:05:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.616+0000 7fdde09ff700 1 -- 172.21.15.37:0/2899893588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc0b0ab0 con 0x7fdddc0cef10 2023-07-12T02:05:27.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.617+0000 7fdde09ff700 1 -- 172.21.15.37:0/2899893588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc04ea60 con 0x7fdddc0cef10 2023-07-12T02:05:27.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.618+0000 7fddd2ffd700 1 -- 172.21.15.37:0/2899893588 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fddcc00cbb0 con 0x7fdddc0cef10 2023-07-12T02:05:27.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.619+0000 7fddd2ffd700 1 --2- 172.21.15.37:0/2899893588 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fddbc06ace0 0x7fddbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:27.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.619+0000 7fddd2ffd700 1 -- 172.21.15.37:0/2899893588 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fddcc089790 con 0x7fdddc0cef10 2023-07-12T02:05:27.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.619+0000 7fddd3fff700 1 --2- 172.21.15.37:0/2899893588 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fddbc06ace0 0x7fddbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:27.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.620+0000 7fddd3fff700 1 --2- 172.21.15.37:0/2899893588 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fddbc06ace0 0x7fddbc06d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009fd0 tx=0x7fddc4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.623+0000 7fddd2ffd700 1 -- 172.21.15.37:0/2899893588 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fddcc057f90 con 0x7fdddc0cef10 2023-07-12T02:05:27.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.875+0000 7fdde09ff700 1 -- 172.21.15.37:0/2899893588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdddc06dfc0 con 0x7fdddc0cef10 2023-07-12T02:05:27.879 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-12T02:05:27.875+0000 7f9855df4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-12T02:05:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.879+0000 7fddd2ffd700 1 -- 172.21.15.37:0/2899893588 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fddcc00ce60 con 0x7fdddc0cef10 2023-07-12T02:05:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.883+0000 7fdde09ff700 1 -- 172.21.15.37:0/2899893588 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fddbc06ace0 msgr2=0x7fddbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.883+0000 7fdde09ff700 1 --2- 172.21.15.37:0/2899893588 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fddbc06ace0 0x7fddbc06d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009fd0 tx=0x7fddc4008030 comp rx=0 tx=0).stop 2023-07-12T02:05:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.883+0000 7fdde09ff700 1 -- 172.21.15.37:0/2899893588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cef10 msgr2=0x7fdddc1e62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.883+0000 7fdde09ff700 1 --2- 172.21.15.37:0/2899893588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cef10 0x7fdddc1e62d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00e870 tx=0x7fddcc00ec30 comp rx=0 tx=0).stop 2023-07-12T02:05:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.884+0000 7fdde09ff700 1 -- 172.21.15.37:0/2899893588 shutdown_connections 2023-07-12T02:05:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.884+0000 7fdde09ff700 1 --2- 172.21.15.37:0/2899893588 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fddbc06ace0 0x7fddbc06d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.884+0000 7fdde09ff700 1 --2- 172.21.15.37:0/2899893588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cef10 0x7fdddc1e62d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.884+0000 7fdde09ff700 1 --2- 172.21.15.37:0/2899893588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdddc15c290 0x7fdddc155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.884+0000 7fdde09ff700 1 --2- 172.21.15.37:0/2899893588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdddc0cf360 0x7fdddc155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:27.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.884+0000 7fdde09ff700 1 -- 172.21.15.37:0/2899893588 >> 172.21.15.37:0/2899893588 conn(0x7fdddc06d450 msgr2=0x7fdddc159880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:27.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.884+0000 7fdde09ff700 1 -- 172.21.15.37:0/2899893588 shutdown_connections 2023-07-12T02:05:27.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:27.884+0000 7fdde09ff700 1 -- 172.21.15.37:0/2899893588 wait complete. 2023-07-12T02:05:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-12T02:05:27.896 INFO:tasks.ceph.mds.c.smithi037.stderr: -6728> 2023-07-12T02:04:03.104+0000 7f72b4bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-12T02:05:27.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-12T02:05:27.950 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-12T02:05:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.110+0000 7fbb46dff700 1 Processor -- start 2023-07-12T02:05:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.110+0000 7fbb46dff700 1 -- start start 2023-07-12T02:05:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.111+0000 7fbb46dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb4015c540 0x7fbb4015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.111+0000 7fbb46dff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbb400d0430 0x7fbb401604c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.111+0000 7fbb46dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb400cdc60 con 0x7fbb4015c170 2023-07-12T02:05:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.111+0000 7fbb46dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb4015d8e0 con 0x7fbb4015c540 2023-07-12T02:05:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.111+0000 7fbb46dff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb400cf620 con 0x7fbb400d0430 2023-07-12T02:05:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.111+0000 7fbb3ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb4015c540 0x7fbb4015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.111+0000 7fbb44b9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbb4015c170 0x7fbb400715a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38874/0 (socket says 172.21.15.37:38874) 2023-07-12T02:05:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.111+0000 7fbb44b9b700 1 -- 172.21.15.37:0/3451865363 learned_addr learned my addr 172.21.15.37:0/3451865363 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.112+0000 7fbb4539c700 1 --2- 172.21.15.37:0/3451865363 >> v2:172.21.15.196:3300/0 conn(0x7fbb400d0430 0x7fbb401604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.112+0000 7fbb3f7fe700 1 -- 172.21.15.37:0/3451865363 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13787274 0 0) 0x7fbb400cdc60 con 0x7fbb4015c170 2023-07-12T02:05:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.112+0000 7fbb3ffff700 1 -- 172.21.15.37:0/3451865363 >> v2:172.21.15.196:3300/0 conn(0x7fbb400d0430 msgr2=0x7fbb401604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.112+0000 7fbb3ffff700 1 --2- 172.21.15.37:0/3451865363 >> v2:172.21.15.196:3300/0 conn(0x7fbb400d0430 0x7fbb401604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.112+0000 7fbb3ffff700 1 -- 172.21.15.37:0/3451865363 >> v1:172.21.15.37:6789/0 conn(0x7fbb4015c170 legacy=0x7fbb400715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.112+0000 7fbb3ffff700 1 -- 172.21.15.37:0/3451865363 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb400d08d0 con 0x7fbb4015c540 2023-07-12T02:05:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.112+0000 7fbb3ffff700 1 --2- 172.21.15.37:0/3451865363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4015c540 0x7fbb4015d2e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009870 tx=0x7fbb2c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b216d34028b5945d server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.112+0000 7fbb3f7fe700 1 -- 172.21.15.37:0/3451865363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c011830 con 0x7fbb4015c540 2023-07-12T02:05:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.112+0000 7fbb3f7fe700 1 -- 172.21.15.37:0/3451865363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c011990 con 0x7fbb4015c540 2023-07-12T02:05:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.112+0000 7fbb3f7fe700 1 -- 172.21.15.37:0/3451865363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c011d20 con 0x7fbb4015c540 2023-07-12T02:05:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.113+0000 7fbb46dff700 1 -- 172.21.15.37:0/3451865363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4015c540 msgr2=0x7fbb4015d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.113+0000 7fbb46dff700 1 --2- 172.21.15.37:0/3451865363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4015c540 0x7fbb4015d2e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009870 tx=0x7fbb2c009b80 comp rx=0 tx=0).stop 2023-07-12T02:05:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.113+0000 7fbb46dff700 1 -- 172.21.15.37:0/3451865363 shutdown_connections 2023-07-12T02:05:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.113+0000 7fbb46dff700 1 --2- 172.21.15.37:0/3451865363 >> v2:172.21.15.196:3300/0 conn(0x7fbb400d0430 0x7fbb401604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.113+0000 7fbb46dff700 1 --2- 172.21.15.37:0/3451865363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4015c540 0x7fbb4015d2e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.113+0000 7fbb46dff700 1 -- 172.21.15.37:0/3451865363 >> 172.21.15.37:0/3451865363 conn(0x7fbb4006b040 msgr2=0x7fbb4006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.113+0000 7fbb46dff700 1 -- 172.21.15.37:0/3451865363 shutdown_connections 2023-07-12T02:05:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.113+0000 7fbb46dff700 1 -- 172.21.15.37:0/3451865363 wait complete. 2023-07-12T02:05:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.115+0000 7fbb46dff700 1 Processor -- start 2023-07-12T02:05:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.115+0000 7fbb46dff700 1 -- start start 2023-07-12T02:05:28.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.116+0000 7fbb46dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb400d0430 0x7fbb40155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.116+0000 7fbb46dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb4015c170 0x7fbb400af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.116+0000 7fbb46dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb4015c540 0x7fbb400af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.116+0000 7fbb46dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40156320 con 0x7fbb400d0430 2023-07-12T02:05:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.116+0000 7fbb46dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb400c3460 con 0x7fbb4015c170 2023-07-12T02:05:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.116+0000 7fbb46dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb400c5880 con 0x7fbb4015c540 2023-07-12T02:05:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.116+0000 7fbb44b9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb400d0430 0x7fbb40155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.116+0000 7fbb44b9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb400d0430 0x7fbb40155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49126/0 (socket says 172.21.15.37:49126) 2023-07-12T02:05:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.116+0000 7fbb44b9b700 1 -- 172.21.15.37:0/360049834 learned_addr learned my addr 172.21.15.37:0/360049834 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.117+0000 7fbb4539c700 1 --2- 172.21.15.37:0/360049834 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb4015c540 0x7fbb400af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.117+0000 7fbb3ffff700 1 --2- 172.21.15.37:0/360049834 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb4015c170 0x7fbb400af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.117+0000 7fbb44b9b700 1 -- 172.21.15.37:0/360049834 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb4015c540 msgr2=0x7fbb400af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.117+0000 7fbb44b9b700 1 --2- 172.21.15.37:0/360049834 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb4015c540 0x7fbb400af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.117+0000 7fbb44b9b700 1 -- 172.21.15.37:0/360049834 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb4015c170 msgr2=0x7fbb400af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.117+0000 7fbb44b9b700 1 --2- 172.21.15.37:0/360049834 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb4015c170 0x7fbb400af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.117+0000 7fbb44b9b700 1 -- 172.21.15.37:0/360049834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c0094a0 con 0x7fbb400d0430 2023-07-12T02:05:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.117+0000 7fbb44b9b700 1 --2- 172.21.15.37:0/360049834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb400d0430 0x7fbb40155de0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbb340011e0 tx=0x7fbb3400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.117+0000 7fbb3d7fa700 1 -- 172.21.15.37:0/360049834 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34004c80 con 0x7fbb400d0430 2023-07-12T02:05:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.117+0000 7fbb3d7fa700 1 -- 172.21.15.37:0/360049834 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb34004e00 con 0x7fbb400d0430 2023-07-12T02:05:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.117+0000 7fbb46dff700 1 -- 172.21.15.37:0/360049834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb400aff60 con 0x7fbb400d0430 2023-07-12T02:05:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.117+0000 7fbb3d7fa700 1 -- 172.21.15.37:0/360049834 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34007310 con 0x7fbb400d0430 2023-07-12T02:05:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.118+0000 7fbb46dff700 1 -- 172.21.15.37:0/360049834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb400b0520 con 0x7fbb400d0430 2023-07-12T02:05:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.119+0000 7fbb46dff700 1 -- 172.21.15.37:0/360049834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4004ea60 con 0x7fbb400d0430 2023-07-12T02:05:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.120+0000 7fbb3d7fa700 1 -- 172.21.15.37:0/360049834 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb34007470 con 0x7fbb400d0430 2023-07-12T02:05:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.121+0000 7fbb3d7fa700 1 --2- 172.21.15.37:0/360049834 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbb2406ace0 0x7fbb2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.121+0000 7fbb3d7fa700 1 -- 172.21.15.37:0/360049834 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fbb34089630 con 0x7fbb400d0430 2023-07-12T02:05:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.122+0000 7fbb3ffff700 1 --2- 172.21.15.37:0/360049834 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbb2406ace0 0x7fbb2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.122+0000 7fbb3ffff700 1 --2- 172.21.15.37:0/360049834 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbb2406ace0 0x7fbb2406d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbb400c33f0 tx=0x7fbb2c01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.125+0000 7fbb3d7fa700 1 -- 172.21.15.37:0/360049834 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbb34054360 con 0x7fbb400d0430 2023-07-12T02:05:28.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.381+0000 7fbb46dff700 1 -- 172.21.15.37:0/360049834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbb400d0210 con 0x7fbb400d0430 2023-07-12T02:05:28.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.881+0000 7fbb3d7fa700 1 -- 172.21.15.37:0/360049834 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbb34057980 con 0x7fbb400d0430 2023-07-12T02:05:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.883+0000 7fbb46dff700 1 -- 172.21.15.37:0/360049834 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbb2406ace0 msgr2=0x7fbb2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.883+0000 7fbb46dff700 1 --2- 172.21.15.37:0/360049834 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbb2406ace0 0x7fbb2406d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbb400c33f0 tx=0x7fbb2c01c040 comp rx=0 tx=0).stop 2023-07-12T02:05:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.883+0000 7fbb46dff700 1 -- 172.21.15.37:0/360049834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb400d0430 msgr2=0x7fbb40155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.883+0000 7fbb46dff700 1 --2- 172.21.15.37:0/360049834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb400d0430 0x7fbb40155de0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbb340011e0 tx=0x7fbb3400cae0 comp rx=0 tx=0).stop 2023-07-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.883+0000 7fbb46dff700 1 -- 172.21.15.37:0/360049834 shutdown_connections 2023-07-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.883+0000 7fbb46dff700 1 --2- 172.21.15.37:0/360049834 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbb2406ace0 0x7fbb2406d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.883+0000 7fbb46dff700 1 --2- 172.21.15.37:0/360049834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb400d0430 0x7fbb40155de0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.883+0000 7fbb46dff700 1 --2- 172.21.15.37:0/360049834 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb4015c540 0x7fbb400af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:28.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.883+0000 7fbb46dff700 1 --2- 172.21.15.37:0/360049834 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb4015c170 0x7fbb400af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:28.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.883+0000 7fbb46dff700 1 -- 172.21.15.37:0/360049834 >> 172.21.15.37:0/360049834 conn(0x7fbb4006b040 msgr2=0x7fbb400b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:28.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.884+0000 7fbb46dff700 1 -- 172.21.15.37:0/360049834 shutdown_connections 2023-07-12T02:05:28.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:28.884+0000 7fbb46dff700 1 -- 172.21.15.37:0/360049834 wait complete. 2023-07-12T02:05:28.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-12T02:05:29.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.149+0000 7f24a69ff700 1 Processor -- start 2023-07-12T02:05:29.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.150+0000 7f24a69ff700 1 -- start start 2023-07-12T02:05:29.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.151+0000 7f24a69ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f24a00b1f00 0x7f24a0160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:29.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.151+0000 7f24a69ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a0160db0 con 0x7f24a00b82c0 2023-07-12T02:05:29.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.151+0000 7f24a69ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a015fe20 con 0x7f24a00cf4d0 2023-07-12T02:05:29.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.151+0000 7f24a69ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a00b8690 con 0x7f24a00b1f00 2023-07-12T02:05:29.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.151+0000 7f249ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f24a00b82c0 0x7f24a00ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38886/0 (socket says 172.21.15.37:38886) 2023-07-12T02:05:29.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.151+0000 7f249ffff700 1 -- 172.21.15.37:0/2232360580 learned_addr learned my addr 172.21.15.37:0/2232360580 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:29.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.151+0000 7f249f7fe700 1 --2- 172.21.15.37:0/2232360580 >> v2:172.21.15.196:3300/0 conn(0x7f24a00b1f00 0x7f24a0160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:29.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 -- 172.21.15.37:0/2232360580 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144626135 0 0) 0x7f2490001110 con 0x7f24a00b82c0 2023-07-12T02:05:29.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 -- 172.21.15.37:0/2232360580 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24880035b0 con 0x7f24a00b82c0 2023-07-12T02:05:29.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 -- 172.21.15.37:0/2232360580 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523104658 0 0) 0x7f24a015fe20 con 0x7f24a00cf4d0 2023-07-12T02:05:29.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 -- 172.21.15.37:0/2232360580 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2490001110 con 0x7f24a00cf4d0 2023-07-12T02:05:29.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 -- 172.21.15.37:0/2232360580 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4032721557 0 0) 0x7f24880035b0 con 0x7f24a00b82c0 2023-07-12T02:05:29.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 -- 172.21.15.37:0/2232360580 >> v2:172.21.15.196:3300/0 conn(0x7f24a00b1f00 msgr2=0x7f24a0160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:29.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 --2- 172.21.15.37:0/2232360580 >> v2:172.21.15.196:3300/0 conn(0x7f24a00b1f00 0x7f24a0160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:29.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 -- 172.21.15.37:0/2232360580 >> v1:172.21.15.196:6789/0 conn(0x7f24a00cf4d0 legacy=0x7f24a00cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:29.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 -- 172.21.15.37:0/2232360580 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a01603e0 con 0x7f24a00b82c0 2023-07-12T02:05:29.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 -- 172.21.15.37:0/2232360580 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7f2490001800 con 0x7f24a00b82c0 2023-07-12T02:05:29.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 -- 172.21.15.37:0/2232360580 >> v1:172.21.15.37:6789/0 conn(0x7f24a00b82c0 legacy=0x7f24a00ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:29.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 --2- 172.21.15.37:0/2232360580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2488003be0 0x7f2488003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:29.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 --2- 172.21.15.37:0/2232360580 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2488004850 0x7f2488004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:29.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 --2- 172.21.15.37:0/2232360580 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2488005250 0x7f248800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:29.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 -- 172.21.15.37:0/2232360580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00b8690 con 0x7f2488003be0 2023-07-12T02:05:29.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 -- 172.21.15.37:0/2232360580 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248800c160 con 0x7f2488005250 2023-07-12T02:05:29.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249effd700 1 -- 172.21.15.37:0/2232360580 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248800c320 con 0x7f2488004850 2023-07-12T02:05:29.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249f7fe700 1 --2- 172.21.15.37:0/2232360580 >> v2:172.21.15.196:3300/0 conn(0x7f24a00b1f00 0x7f24a0160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:29.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.152+0000 7f249ffff700 1 --2- 172.21.15.37:0/2232360580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2488003be0 0x7f2488003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:29.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.153+0000 7f24a4f9c700 1 --2- 172.21.15.37:0/2232360580 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2488005250 0x7f248800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:29.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.153+0000 7f249f7fe700 1 --2- 172.21.15.37:0/2232360580 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2488004850 0x7f2488004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:29.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.153+0000 7f249ffff700 1 -- 172.21.15.37:0/2232360580 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2488004850 msgr2=0x7f2488004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:29.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.153+0000 7f249ffff700 1 --2- 172.21.15.37:0/2232360580 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2488004850 0x7f2488004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:29.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.153+0000 7f249ffff700 1 -- 172.21.15.37:0/2232360580 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2488005250 msgr2=0x7f248800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:29.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.153+0000 7f249ffff700 1 --2- 172.21.15.37:0/2232360580 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2488005250 0x7f248800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:29.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.153+0000 7f249ffff700 1 -- 172.21.15.37:0/2232360580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24880035b0 con 0x7f2488003be0 2023-07-12T02:05:29.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.153+0000 7f24a4f9c700 1 --2- 172.21.15.37:0/2232360580 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2488005250 0x7f248800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:29.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.153+0000 7f24a4f9c700 1 -- 172.21.15.37:0/2232360580 reap_dead start 2023-07-12T02:05:29.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.153+0000 7f249ffff700 1 --2- 172.21.15.37:0/2232360580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2488003be0 0x7f2488003fd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f249000c0e0 tx=0x7f2488005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749e4c8336eb2861 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:29.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.153+0000 7f249effd700 1 -- 172.21.15.37:0/2232360580 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249000cc80 con 0x7f2488003be0 2023-07-12T02:05:29.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.153+0000 7f249effd700 1 -- 172.21.15.37:0/2232360580 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249000cde0 con 0x7f2488003be0 2023-07-12T02:05:29.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.153+0000 7f249effd700 1 -- 172.21.15.37:0/2232360580 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490005ba0 con 0x7f2488003be0 2023-07-12T02:05:29.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.154+0000 7f24a69ff700 1 -- 172.21.15.37:0/2232360580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2488003be0 msgr2=0x7f2488003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:29.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.154+0000 7f24a69ff700 1 --2- 172.21.15.37:0/2232360580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2488003be0 0x7f2488003fd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f249000c0e0 tx=0x7f2488005880 comp rx=0 tx=0).stop 2023-07-12T02:05:29.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.154+0000 7f24a69ff700 1 -- 172.21.15.37:0/2232360580 shutdown_connections 2023-07-12T02:05:29.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.154+0000 7f24a69ff700 1 --2- 172.21.15.37:0/2232360580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2488003be0 0x7f2488003fd0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:29.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.154+0000 7f24a69ff700 1 -- 172.21.15.37:0/2232360580 >> 172.21.15.37:0/2232360580 conn(0x7f24a0071660 msgr2=0x7f24a0071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:29.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.154+0000 7f24a69ff700 1 -- 172.21.15.37:0/2232360580 shutdown_connections 2023-07-12T02:05:29.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.154+0000 7f24a69ff700 1 -- 172.21.15.37:0/2232360580 wait complete. 2023-07-12T02:05:29.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.156+0000 7f24a69ff700 1 Processor -- start 2023-07-12T02:05:29.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.156+0000 7f24a69ff700 1 -- start start 2023-07-12T02:05:29.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.157+0000 7f24a69ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2488003be0 0x7f24a01f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:29.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.157+0000 7f24a69ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24a00b5920 0x7f24a00b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:29.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.157+0000 7f24a69ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f24a00a9860 0x7f24a00a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:29.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.157+0000 7f24a69ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00b62d0 con 0x7f2488003be0 2023-07-12T02:05:29.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.157+0000 7f24a69ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a01f6260 con 0x7f24a00a9860 2023-07-12T02:05:29.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.157+0000 7f24a69ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a01f5ca0 con 0x7f24a00b5920 2023-07-12T02:05:29.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.157+0000 7f249ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2488003be0 0x7f24a01f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:29.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.157+0000 7f249ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2488003be0 0x7f24a01f5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49150/0 (socket says 172.21.15.37:49150) 2023-07-12T02:05:29.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.157+0000 7f249ffff700 1 -- 172.21.15.37:0/3837028031 learned_addr learned my addr 172.21.15.37:0/3837028031 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:29.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.157+0000 7f249f7fe700 1 --2- 172.21.15.37:0/3837028031 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24a00b5920 0x7f24a00b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:29.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.157+0000 7f24a4f9c700 1 --2- 172.21.15.37:0/3837028031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f24a00a9860 0x7f24a00a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:29.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.157+0000 7f249ffff700 1 -- 172.21.15.37:0/3837028031 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24a00b5920 msgr2=0x7f24a00b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:29.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.157+0000 7f249ffff700 1 --2- 172.21.15.37:0/3837028031 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24a00b5920 0x7f24a00b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:29.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.157+0000 7f249ffff700 1 -- 172.21.15.37:0/3837028031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f24a00a9860 msgr2=0x7f24a00a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:29.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.157+0000 7f249ffff700 1 --2- 172.21.15.37:0/3837028031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f24a00a9860 0x7f24a00a9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:29.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.158+0000 7f249ffff700 1 -- 172.21.15.37:0/3837028031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a01f5f80 con 0x7f2488003be0 2023-07-12T02:05:29.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.158+0000 7f249ffff700 1 --2- 172.21.15.37:0/3837028031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2488003be0 0x7f24a01f5350 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f248800c130 tx=0x7f2490001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:29.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.158+0000 7f249cff9700 1 -- 172.21.15.37:0/3837028031 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24900070d0 con 0x7f2488003be0 2023-07-12T02:05:29.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.158+0000 7f249cff9700 1 -- 172.21.15.37:0/3837028031 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2490007230 con 0x7f2488003be0 2023-07-12T02:05:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.158+0000 7f249cff9700 1 -- 172.21.15.37:0/3837028031 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24900075c0 con 0x7f2488003be0 2023-07-12T02:05:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.158+0000 7f24a69ff700 1 -- 172.21.15.37:0/3837028031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a014ce60 con 0x7f2488003be0 2023-07-12T02:05:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.158+0000 7f24a69ff700 1 -- 172.21.15.37:0/3837028031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a00aa240 con 0x7f2488003be0 2023-07-12T02:05:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.159+0000 7f24a69ff700 1 -- 172.21.15.37:0/3837028031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a00b62d0 con 0x7f2488003be0 2023-07-12T02:05:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.160+0000 7f249cff9700 1 -- 172.21.15.37:0/3837028031 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2490007720 con 0x7f2488003be0 2023-07-12T02:05:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.161+0000 7f249cff9700 1 --2- 172.21.15.37:0/3837028031 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f248c06ace0 0x7f248c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.161+0000 7f249cff9700 1 -- 172.21.15.37:0/3837028031 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f249008a760 con 0x7f2488003be0 2023-07-12T02:05:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.162+0000 7f249f7fe700 1 --2- 172.21.15.37:0/3837028031 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f248c06ace0 0x7f248c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.162+0000 7f249f7fe700 1 --2- 172.21.15.37:0/3837028031 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f248c06ace0 0x7f248c06d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f24a00b3d30 tx=0x7f2494008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.166+0000 7f249cff9700 1 -- 172.21.15.37:0/3837028031 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f24900555a0 con 0x7f2488003be0 2023-07-12T02:05:29.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:29.374+0000 7f24a69ff700 1 -- 172.21.15.37:0/3837028031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f24a0160db0 con 0x7f2488003be0 2023-07-12T02:05:30.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.246+0000 7f249cff9700 1 -- 172.21.15.37:0/3837028031 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7f24a0160db0 con 0x7f2488003be0 2023-07-12T02:05:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.251+0000 7f24a69ff700 1 -- 172.21.15.37:0/3837028031 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f248c06ace0 msgr2=0x7f248c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.251+0000 7f24a69ff700 1 --2- 172.21.15.37:0/3837028031 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f248c06ace0 0x7f248c06d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f24a00b3d30 tx=0x7f2494008040 comp rx=0 tx=0).stop 2023-07-12T02:05:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.251+0000 7f24a69ff700 1 -- 172.21.15.37:0/3837028031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2488003be0 msgr2=0x7f24a01f5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.251+0000 7f24a69ff700 1 --2- 172.21.15.37:0/3837028031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2488003be0 0x7f24a01f5350 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f248800c130 tx=0x7f2490001ac0 comp rx=0 tx=0).stop 2023-07-12T02:05:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.251+0000 7f24a69ff700 1 -- 172.21.15.37:0/3837028031 shutdown_connections 2023-07-12T02:05:30.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.251+0000 7f24a69ff700 1 --2- 172.21.15.37:0/3837028031 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f248c06ace0 0x7f248c06d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:30.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.251+0000 7f24a69ff700 1 --2- 172.21.15.37:0/3837028031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2488003be0 0x7f24a01f5350 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:30.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.251+0000 7f24a69ff700 1 --2- 172.21.15.37:0/3837028031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f24a00a9860 0x7f24a00a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:30.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.251+0000 7f24a69ff700 1 --2- 172.21.15.37:0/3837028031 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24a00b5920 0x7f24a00b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:30.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.251+0000 7f24a69ff700 1 -- 172.21.15.37:0/3837028031 >> 172.21.15.37:0/3837028031 conn(0x7f24a0071660 msgr2=0x7f24a00b72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:30.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.251+0000 7f24a69ff700 1 -- 172.21.15.37:0/3837028031 shutdown_connections 2023-07-12T02:05:30.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.251+0000 7f24a69ff700 1 -- 172.21.15.37:0/3837028031 wait complete. 2023-07-12T02:05:30.257 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-07-12T02:05:30.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-12T02:05:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.482+0000 7f12915ff700 1 Processor -- start 2023-07-12T02:05:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.483+0000 7f12915ff700 1 -- start start 2023-07-12T02:05:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.484+0000 7f12915ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f128c0b82c0 0x7f128c160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:30.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.484+0000 7f12915ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f128c0b1f00 0x7f128c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:30.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.484+0000 7f12915ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f128c0cf4d0 0x7f128c0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:30.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.484+0000 7f12915ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128c0b8690 con 0x7f128c0cf4d0 2023-07-12T02:05:30.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.484+0000 7f12915ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128c160db0 con 0x7f128c0b1f00 2023-07-12T02:05:30.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.484+0000 7f12915ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0cfe90 con 0x7f128c0b82c0 2023-07-12T02:05:30.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.484+0000 7f128b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f128c0cf4d0 0x7f128c0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:30.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.484+0000 7f128b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f128c0cf4d0 0x7f128c0cf950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49166/0 (socket says 172.21.15.37:49166) 2023-07-12T02:05:30.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.484+0000 7f128b7fe700 1 -- 172.21.15.37:0/3158122214 learned_addr learned my addr 172.21.15.37:0/3158122214 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:30.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.484+0000 7f128affd700 1 --2- 172.21.15.37:0/3158122214 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f128c0b82c0 0x7f128c160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:30.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.484+0000 7f1283fff700 1 --2- 172.21.15.37:0/3158122214 >> v2:172.21.15.196:3300/0 conn(0x7f128c0b1f00 0x7f128c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:30.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.485+0000 7f128b7fe700 1 -- 172.21.15.37:0/3158122214 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f128c0b82c0 msgr2=0x7f128c160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:30.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.485+0000 7f128b7fe700 1 --2- 172.21.15.37:0/3158122214 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f128c0b82c0 0x7f128c160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:30.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.485+0000 7f128b7fe700 1 -- 172.21.15.37:0/3158122214 >> v2:172.21.15.196:3300/0 conn(0x7f128c0b1f00 msgr2=0x7f128c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:30.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.485+0000 7f128b7fe700 1 --2- 172.21.15.37:0/3158122214 >> v2:172.21.15.196:3300/0 conn(0x7f128c0b1f00 0x7f128c0ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.485+0000 7f128b7fe700 1 -- 172.21.15.37:0/3158122214 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c15fe20 con 0x7f128c0cf4d0 2023-07-12T02:05:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.485+0000 7f128affd700 1 --2- 172.21.15.37:0/3158122214 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f128c0b82c0 0x7f128c160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.485+0000 7f1283fff700 1 --2- 172.21.15.37:0/3158122214 >> v2:172.21.15.196:3300/0 conn(0x7f128c0b1f00 0x7f128c0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.485+0000 7f128b7fe700 1 --2- 172.21.15.37:0/3158122214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f128c0cf4d0 0x7f128c0cf950 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f128c06aa00 tx=0x7f128400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a45af7000ebc572 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.485+0000 7f128a7fc700 1 -- 172.21.15.37:0/3158122214 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128400e070 con 0x7f128c0cf4d0 2023-07-12T02:05:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.485+0000 7f128a7fc700 1 -- 172.21.15.37:0/3158122214 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128400b9c0 con 0x7f128c0cf4d0 2023-07-12T02:05:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.485+0000 7f128a7fc700 1 -- 172.21.15.37:0/3158122214 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128400bd70 con 0x7f128c0cf4d0 2023-07-12T02:05:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.485+0000 7f12915ff700 1 -- 172.21.15.37:0/3158122214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f128c0cf4d0 msgr2=0x7f128c0cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.486+0000 7f12915ff700 1 --2- 172.21.15.37:0/3158122214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f128c0cf4d0 0x7f128c0cf950 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f128c06aa00 tx=0x7f128400b330 comp rx=0 tx=0).stop 2023-07-12T02:05:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.486+0000 7f12915ff700 1 -- 172.21.15.37:0/3158122214 shutdown_connections 2023-07-12T02:05:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.486+0000 7f12915ff700 1 --2- 172.21.15.37:0/3158122214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f128c0cf4d0 0x7f128c0cf950 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.486+0000 7f12915ff700 1 --2- 172.21.15.37:0/3158122214 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f128c0b82c0 0x7f128c160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.486+0000 7f12915ff700 1 --2- 172.21.15.37:0/3158122214 >> v2:172.21.15.196:3300/0 conn(0x7f128c0b1f00 0x7f128c0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.486+0000 7f12915ff700 1 -- 172.21.15.37:0/3158122214 >> 172.21.15.37:0/3158122214 conn(0x7f128c071660 msgr2=0x7f128c071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.486+0000 7f12915ff700 1 -- 172.21.15.37:0/3158122214 shutdown_connections 2023-07-12T02:05:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.486+0000 7f12915ff700 1 -- 172.21.15.37:0/3158122214 wait complete. 2023-07-12T02:05:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.487+0000 7f12915ff700 1 Processor -- start 2023-07-12T02:05:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.488+0000 7f12915ff700 1 -- start start 2023-07-12T02:05:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.488+0000 7f12915ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f128c0b1f00 0x7f128c0c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.488+0000 7f12915ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f128c0b82c0 0x7f128c153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.489+0000 7f12915ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f128c0cf4d0 0x7f128c0d0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.489+0000 7f12915ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0c8e10 con 0x7f128c0b82c0 2023-07-12T02:05:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.489+0000 7f12915ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0c8200 con 0x7f128c0b1f00 2023-07-12T02:05:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.489+0000 7f12915ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0c84e0 con 0x7f128c0cf4d0 2023-07-12T02:05:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.489+0000 7f1283fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f128c0b82c0 0x7f128c153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.489+0000 7f1283fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f128c0b82c0 0x7f128c153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49176/0 (socket says 172.21.15.37:49176) 2023-07-12T02:05:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.489+0000 7f1283fff700 1 -- 172.21.15.37:0/4189904928 learned_addr learned my addr 172.21.15.37:0/4189904928 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.489+0000 7f128affd700 1 --2- 172.21.15.37:0/4189904928 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f128c0b1f00 0x7f128c0c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.489+0000 7f128b7fe700 1 --2- 172.21.15.37:0/4189904928 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f128c0cf4d0 0x7f128c0d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.489+0000 7f1283fff700 1 -- 172.21.15.37:0/4189904928 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f128c0cf4d0 msgr2=0x7f128c0d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.489+0000 7f1283fff700 1 --2- 172.21.15.37:0/4189904928 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f128c0cf4d0 0x7f128c0d0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.489+0000 7f1283fff700 1 -- 172.21.15.37:0/4189904928 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f128c0b1f00 msgr2=0x7f128c0c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.489+0000 7f1283fff700 1 --2- 172.21.15.37:0/4189904928 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f128c0b1f00 0x7f128c0c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.489+0000 7f1283fff700 1 -- 172.21.15.37:0/4189904928 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1284009b30 con 0x7f128c0b82c0 2023-07-12T02:05:30.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.489+0000 7f128b7fe700 1 --2- 172.21.15.37:0/4189904928 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f128c0cf4d0 0x7f128c0d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:30.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.489+0000 7f1283fff700 1 --2- 172.21.15.37:0/4189904928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f128c0b82c0 0x7f128c153f10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f127400c7f0 tx=0x7f127400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:30.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.490+0000 7f12837fe700 1 -- 172.21.15.37:0/4189904928 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274011800 con 0x7f128c0b82c0 2023-07-12T02:05:30.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.490+0000 7f12837fe700 1 -- 172.21.15.37:0/4189904928 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1274011960 con 0x7f128c0b82c0 2023-07-12T02:05:30.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.490+0000 7f12837fe700 1 -- 172.21.15.37:0/4189904928 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274011d10 con 0x7f128c0b82c0 2023-07-12T02:05:30.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.490+0000 7f12915ff700 1 -- 172.21.15.37:0/4189904928 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128c0c87c0 con 0x7f128c0b82c0 2023-07-12T02:05:30.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.490+0000 7f12915ff700 1 -- 172.21.15.37:0/4189904928 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c0c92a0 con 0x7f128c0b82c0 2023-07-12T02:05:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.491+0000 7f12915ff700 1 -- 172.21.15.37:0/4189904928 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c0c8fc0 con 0x7f128c0b82c0 2023-07-12T02:05:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.492+0000 7f12837fe700 1 -- 172.21.15.37:0/4189904928 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1274018360 con 0x7f128c0b82c0 2023-07-12T02:05:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.493+0000 7f12837fe700 1 --2- 172.21.15.37:0/4189904928 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f126c06ad10 0x7f126c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.493+0000 7f12837fe700 1 -- 172.21.15.37:0/4189904928 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f1274089600 con 0x7f128c0b82c0 2023-07-12T02:05:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.493+0000 7f128affd700 1 --2- 172.21.15.37:0/4189904928 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f126c06ad10 0x7f126c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.494+0000 7f128affd700 1 --2- 172.21.15.37:0/4189904928 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f126c06ad10 0x7f126c06d1c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f127c006fd0 tx=0x7f127c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:30.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.498+0000 7f12837fe700 1 -- 172.21.15.37:0/4189904928 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f12740544e0 con 0x7f128c0b82c0 2023-07-12T02:05:30.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:30.703+0000 7f12915ff700 1 -- 172.21.15.37:0/4189904928 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f128c074180 con 0x7f128c0b82c0 2023-07-12T02:05:31.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.250+0000 7f12837fe700 1 -- 172.21.15.37:0/4189904928 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1274057b00 con 0x7f128c0b82c0 2023-07-12T02:05:31.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.255+0000 7f12915ff700 1 -- 172.21.15.37:0/4189904928 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f126c06ad10 msgr2=0x7f126c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:31.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.255+0000 7f12915ff700 1 --2- 172.21.15.37:0/4189904928 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f126c06ad10 0x7f126c06d1c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f127c006fd0 tx=0x7f127c008040 comp rx=0 tx=0).stop 2023-07-12T02:05:31.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.255+0000 7f12915ff700 1 -- 172.21.15.37:0/4189904928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f128c0b82c0 msgr2=0x7f128c153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:31.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.255+0000 7f12915ff700 1 --2- 172.21.15.37:0/4189904928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f128c0b82c0 0x7f128c153f10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f127400c7f0 tx=0x7f127400cbb0 comp rx=0 tx=0).stop 2023-07-12T02:05:31.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.255+0000 7f12915ff700 1 -- 172.21.15.37:0/4189904928 shutdown_connections 2023-07-12T02:05:31.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.255+0000 7f12915ff700 1 --2- 172.21.15.37:0/4189904928 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f126c06ad10 0x7f126c06d1c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:31.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.255+0000 7f12915ff700 1 --2- 172.21.15.37:0/4189904928 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f128c0cf4d0 0x7f128c0d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:31.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.255+0000 7f12915ff700 1 --2- 172.21.15.37:0/4189904928 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f128c0b1f00 0x7f128c0c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:31.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.255+0000 7f12915ff700 1 --2- 172.21.15.37:0/4189904928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f128c0b82c0 0x7f128c153f10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:31.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.255+0000 7f12915ff700 1 -- 172.21.15.37:0/4189904928 >> 172.21.15.37:0/4189904928 conn(0x7f128c071660 msgr2=0x7f128c15c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:31.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.256+0000 7f12915ff700 1 -- 172.21.15.37:0/4189904928 shutdown_connections 2023-07-12T02:05:31.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.256+0000 7f12915ff700 1 -- 172.21.15.37:0/4189904928 wait complete. 2023-07-12T02:05:31.263 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-07-12T02:05:31.282 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-07-12T02:05:31.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.486+0000 7f1bd59ff700 1 Processor -- start 2023-07-12T02:05:31.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.486+0000 7f1bd59ff700 1 -- start start 2023-07-12T02:05:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.488+0000 7f1bd59ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1bd00b82c0 0x7f1bd0160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:31.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.488+0000 7f1bd59ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1bd00cf4d0 0x7f1bd00cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:31.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.488+0000 7f1bd59ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd0160db0 con 0x7f1bd00b1f00 2023-07-12T02:05:31.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.488+0000 7f1bd59ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd00b8690 con 0x7f1bd00b82c0 2023-07-12T02:05:31.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.488+0000 7f1bd59ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd015fe20 con 0x7f1bd00cf4d0 2023-07-12T02:05:31.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.488+0000 7f1bceffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1bd00b82c0 0x7f1bd0160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:31.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.488+0000 7f1bceffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1bd00b82c0 0x7f1bd0160870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49180/0 (socket says 172.21.15.37:49180) 2023-07-12T02:05:31.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.488+0000 7f1bceffd700 1 -- 172.21.15.37:0/3178534900 learned_addr learned my addr 172.21.15.37:0/3178534900 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:31.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.488+0000 7f1bcf7fe700 1 --2- 172.21.15.37:0/3178534900 >> v2:172.21.15.196:3300/0 conn(0x7f1bd00cf4d0 0x7f1bd00cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.488+0000 7f1bceffd700 1 -- 172.21.15.37:0/3178534900 >> v2:172.21.15.196:3300/0 conn(0x7f1bd00cf4d0 msgr2=0x7f1bd00cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.488+0000 7f1bceffd700 1 --2- 172.21.15.37:0/3178534900 >> v2:172.21.15.196:3300/0 conn(0x7f1bd00cf4d0 0x7f1bd00cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.488+0000 7f1bceffd700 1 -- 172.21.15.37:0/3178534900 >> v1:172.21.15.196:6789/0 conn(0x7f1bd00b1f00 legacy=0x7f1bd00ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.488+0000 7f1bceffd700 1 -- 172.21.15.37:0/3178534900 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd01603e0 con 0x7f1bd00b82c0 2023-07-12T02:05:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.489+0000 7f1bceffd700 1 --2- 172.21.15.37:0/3178534900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd00b82c0 0x7f1bd0160870 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00b2500 tx=0x7f1bc0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd370e7efe5890b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.489+0000 7f1bce7fc700 1 -- 172.21.15.37:0/3178534900 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0004230 con 0x7f1bd00b82c0 2023-07-12T02:05:31.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.489+0000 7f1bce7fc700 1 -- 172.21.15.37:0/3178534900 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc0004390 con 0x7f1bd00b82c0 2023-07-12T02:05:31.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.489+0000 7f1bce7fc700 1 -- 172.21.15.37:0/3178534900 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc00036a0 con 0x7f1bd00b82c0 2023-07-12T02:05:31.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.489+0000 7f1bd59ff700 1 -- 172.21.15.37:0/3178534900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd00b82c0 msgr2=0x7f1bd0160870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:31.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.489+0000 7f1bd59ff700 1 --2- 172.21.15.37:0/3178534900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd00b82c0 0x7f1bd0160870 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00b2500 tx=0x7f1bc0009bd0 comp rx=0 tx=0).stop 2023-07-12T02:05:31.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.490+0000 7f1bd59ff700 1 -- 172.21.15.37:0/3178534900 shutdown_connections 2023-07-12T02:05:31.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.490+0000 7f1bd59ff700 1 --2- 172.21.15.37:0/3178534900 >> v2:172.21.15.196:3300/0 conn(0x7f1bd00cf4d0 0x7f1bd00cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:31.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.490+0000 7f1bd59ff700 1 --2- 172.21.15.37:0/3178534900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd00b82c0 0x7f1bd0160870 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:31.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.490+0000 7f1bd59ff700 1 -- 172.21.15.37:0/3178534900 >> 172.21.15.37:0/3178534900 conn(0x7f1bd0071660 msgr2=0x7f1bd0071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:31.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.490+0000 7f1bd59ff700 1 -- 172.21.15.37:0/3178534900 shutdown_connections 2023-07-12T02:05:31.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.490+0000 7f1bd59ff700 1 -- 172.21.15.37:0/3178534900 wait complete. 2023-07-12T02:05:31.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.491+0000 7f1bd59ff700 1 Processor -- start 2023-07-12T02:05:31.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.492+0000 7f1bd59ff700 1 -- start start 2023-07-12T02:05:31.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.492+0000 7f1bd59ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bd00b1f00 0x7f1bd0159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:31.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.493+0000 7f1bd59ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bd00b82c0 0x7f1bd00b2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:31.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.493+0000 7f1bd59ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd00cf4d0 0x7f1bd00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:31.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.493+0000 7f1bd59ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd01f2ce0 con 0x7f1bd00cf4d0 2023-07-12T02:05:31.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.493+0000 7f1bd59ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00cc0c0 con 0x7f1bd00b1f00 2023-07-12T02:05:31.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.493+0000 7f1bd59ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00cc3a0 con 0x7f1bd00b82c0 2023-07-12T02:05:31.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.493+0000 7f1bcf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd00cf4d0 0x7f1bd00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:31.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.493+0000 7f1bcf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd00cf4d0 0x7f1bd00b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49190/0 (socket says 172.21.15.37:49190) 2023-07-12T02:05:31.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.493+0000 7f1bcf7fe700 1 -- 172.21.15.37:0/3530856560 learned_addr learned my addr 172.21.15.37:0/3530856560 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:31.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.493+0000 7f1bc7fff700 1 --2- 172.21.15.37:0/3530856560 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bd00b82c0 0x7f1bd00b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:31.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.493+0000 7f1bceffd700 1 --2- 172.21.15.37:0/3530856560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bd00b1f00 0x7f1bd0159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:31.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.493+0000 7f1bcf7fe700 1 -- 172.21.15.37:0/3530856560 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bd00b82c0 msgr2=0x7f1bd00b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:31.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.493+0000 7f1bcf7fe700 1 --2- 172.21.15.37:0/3530856560 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bd00b82c0 0x7f1bd00b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:31.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.493+0000 7f1bcf7fe700 1 -- 172.21.15.37:0/3530856560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bd00b1f00 msgr2=0x7f1bd0159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:31.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.493+0000 7f1bcf7fe700 1 --2- 172.21.15.37:0/3530856560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bd00b1f00 0x7f1bd0159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:31.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.493+0000 7f1bcf7fe700 1 -- 172.21.15.37:0/3530856560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc0009550 con 0x7f1bd00cf4d0 2023-07-12T02:05:31.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.494+0000 7f1bcf7fe700 1 --2- 172.21.15.37:0/3530856560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd00cf4d0 0x7f1bd00b2a90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8007e40 tx=0x7f1bc800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:31.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.494+0000 7f1bccff9700 1 -- 172.21.15.37:0/3530856560 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc800ed30 con 0x7f1bd00cf4d0 2023-07-12T02:05:31.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.494+0000 7f1bccff9700 1 -- 172.21.15.37:0/3530856560 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc8014420 con 0x7f1bd00cf4d0 2023-07-12T02:05:31.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.494+0000 7f1bd59ff700 1 -- 172.21.15.37:0/3530856560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd00cc680 con 0x7f1bd00cf4d0 2023-07-12T02:05:31.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.494+0000 7f1bccff9700 1 -- 172.21.15.37:0/3530856560 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80147d0 con 0x7f1bd00cf4d0 2023-07-12T02:05:31.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.494+0000 7f1bd59ff700 1 -- 172.21.15.37:0/3530856560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd015a410 con 0x7f1bd00cf4d0 2023-07-12T02:05:31.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.495+0000 7f1bd59ff700 1 -- 172.21.15.37:0/3530856560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd0074180 con 0x7f1bd00cf4d0 2023-07-12T02:05:31.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.496+0000 7f1bccff9700 1 -- 172.21.15.37:0/3530856560 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1bc8014930 con 0x7f1bd00cf4d0 2023-07-12T02:05:31.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.498+0000 7f1bccff9700 1 --2- 172.21.15.37:0/3530856560 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1bb006ace0 0x7f1bb006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:31.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.498+0000 7f1bccff9700 1 -- 172.21.15.37:0/3530856560 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f1bc8089c00 con 0x7f1bd00cf4d0 2023-07-12T02:05:31.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.498+0000 7f1bceffd700 1 --2- 172.21.15.37:0/3530856560 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1bb006ace0 0x7f1bb006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:31.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.499+0000 7f1bceffd700 1 --2- 172.21.15.37:0/3530856560 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1bb006ace0 0x7f1bb006d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009130 tx=0x7f1bc0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:31.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.502+0000 7f1bccff9700 1 -- 172.21.15.37:0/3530856560 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1bc8054cd0 con 0x7f1bd00cf4d0 2023-07-12T02:05:31.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:31.708+0000 7f1bd59ff700 1 -- 172.21.15.37:0/3530856560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1bd00d16e0 con 0x7f1bd00cf4d0 2023-07-12T02:05:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.264+0000 7f1bccff9700 1 -- 172.21.15.37:0/3530856560 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f1bc80582f0 con 0x7f1bd00cf4d0 2023-07-12T02:05:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.269+0000 7f1bd59ff700 1 -- 172.21.15.37:0/3530856560 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1bb006ace0 msgr2=0x7f1bb006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.269+0000 7f1bd59ff700 1 --2- 172.21.15.37:0/3530856560 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1bb006ace0 0x7f1bb006d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009130 tx=0x7f1bc0008030 comp rx=0 tx=0).stop 2023-07-12T02:05:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.269+0000 7f1bd59ff700 1 -- 172.21.15.37:0/3530856560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd00cf4d0 msgr2=0x7f1bd00b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.269+0000 7f1bd59ff700 1 --2- 172.21.15.37:0/3530856560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd00cf4d0 0x7f1bd00b2a90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8007e40 tx=0x7f1bc800e3c0 comp rx=0 tx=0).stop 2023-07-12T02:05:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.270+0000 7f1bd59ff700 1 -- 172.21.15.37:0/3530856560 shutdown_connections 2023-07-12T02:05:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.270+0000 7f1bd59ff700 1 --2- 172.21.15.37:0/3530856560 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1bb006ace0 0x7f1bb006d190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.270+0000 7f1bd59ff700 1 --2- 172.21.15.37:0/3530856560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd00cf4d0 0x7f1bd00b2a90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.270+0000 7f1bd59ff700 1 --2- 172.21.15.37:0/3530856560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bd00b1f00 0x7f1bd0159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:32.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.270+0000 7f1bd59ff700 1 --2- 172.21.15.37:0/3530856560 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bd00b82c0 0x7f1bd00b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:32.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.270+0000 7f1bd59ff700 1 -- 172.21.15.37:0/3530856560 >> 172.21.15.37:0/3530856560 conn(0x7f1bd0071660 msgr2=0x7f1bd00b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:32.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.271+0000 7f1bd59ff700 1 -- 172.21.15.37:0/3530856560 shutdown_connections 2023-07-12T02:05:32.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.271+0000 7f1bd59ff700 1 -- 172.21.15.37:0/3530856560 wait complete. 2023-07-12T02:05:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data_ec' removed 2023-07-12T02:05:32.298 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-12T02:05:32.299 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-12T02:05:32.299 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-12T02:05:32.299 INFO:teuthology.orchestra.run:waiting for 300 2023-07-12T02:05:32.299 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-12T02:05:32.300 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-12T02:05:32.300 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-12T02:05:32.300 INFO:teuthology.orchestra.run:waiting for 300 2023-07-12T02:05:32.300 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-12T02:05:32.301 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-12T02:05:32.301 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-12T02:05:32.301 INFO:teuthology.orchestra.run:waiting for 300 2023-07-12T02:05:32.301 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-12T02:05:32.301 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-12T02:05:32.302 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-12T02:05:32.302 INFO:teuthology.orchestra.run:waiting for 300 2023-07-12T02:05:32.316 INFO:tasks.ceph.mds.c:Stopped 2023-07-12T02:05:32.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-12T02:05:32.318 INFO:tasks.ceph.mds.a:Stopped 2023-07-12T02:05:32.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-12T02:05:32.320 INFO:tasks.ceph.mds.b:Stopped 2023-07-12T02:05:32.320 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-12T02:05:32.321 INFO:tasks.ceph.mds.d:Stopped 2023-07-12T02:05:32.321 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-12T02:05:32.362 INFO:tasks.ceph.mds.c:Started 2023-07-12T02:05:32.362 DEBUG:teuthology.parallel:result is None 2023-07-12T02:05:32.364 INFO:tasks.ceph.mds.b:Started 2023-07-12T02:05:32.365 DEBUG:teuthology.parallel:result is None 2023-07-12T02:05:32.365 INFO:tasks.ceph.mds.a:Started 2023-07-12T02:05:32.366 DEBUG:teuthology.parallel:result is None 2023-07-12T02:05:32.368 INFO:tasks.ceph.mds.d:Started 2023-07-12T02:05:32.368 DEBUG:teuthology.parallel:result is None 2023-07-12T02:05:32.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-12T02:05:32.516 INFO:tasks.ceph.mds.d.smithi196.stdout:starting mds.d at 2023-07-12T02:05:32.516 INFO:tasks.ceph.mds.b.smithi196.stdout:starting mds.b at 2023-07-12T02:05:32.519 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-12T02:05:32.520 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-12T02:05:32.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.578+0000 7f60e0bff700 1 Processor -- start 2023-07-12T02:05:32.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.579+0000 7f60e0bff700 1 -- start start 2023-07-12T02:05:32.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.580+0000 7f60e0bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60dc070340 0x7f60dc06a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.580+0000 7f60e0bff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60dc070a50 0x7f60dc070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.580+0000 7f60e0bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60dc0713f0 con 0x7f60dc157f10 2023-07-12T02:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.580+0000 7f60e0bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60dc06d900 con 0x7f60dc070340 2023-07-12T02:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.580+0000 7f60e0bff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc15e210 con 0x7f60dc070a50 2023-07-12T02:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.580+0000 7f60d3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60dc070340 0x7f60dc06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.580+0000 7f60d3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60dc070340 0x7f60dc06a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54416/0 (socket says 172.21.15.37:54416) 2023-07-12T02:05:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.580+0000 7f60da59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f60dc157f10 0x7f60dc15e6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38130/0 (socket says 172.21.15.37:38130) 2023-07-12T02:05:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.580+0000 7f60d3fff700 1 -- 172.21.15.37:0/1592483777 learned_addr learned my addr 172.21.15.37:0/1592483777 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.580+0000 7f60dad9d700 1 --2- 172.21.15.37:0/1592483777 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60dc070a50 0x7f60dc070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:32.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.581+0000 7f60d3fff700 1 -- 172.21.15.37:0/1592483777 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60dc070a50 msgr2=0x7f60dc070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:32.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.581+0000 7f60d3fff700 1 --2- 172.21.15.37:0/1592483777 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60dc070a50 0x7f60dc070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:32.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.581+0000 7f60d3fff700 1 -- 172.21.15.37:0/1592483777 >> v1:172.21.15.37:6789/0 conn(0x7f60dc157f10 legacy=0x7f60dc15e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.581+0000 7f60d3fff700 1 -- 172.21.15.37:0/1592483777 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc15dee0 con 0x7f60dc070340 2023-07-12T02:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.581+0000 7f60dad9d700 1 --2- 172.21.15.37:0/1592483777 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60dc070a50 0x7f60dc070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.581+0000 7f60d9d9b700 1 -- 172.21.15.37:0/1592483777 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114947931 0 0) 0x7f60dc0713f0 con 0x7f60dc157f10 2023-07-12T02:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.581+0000 7f60d3fff700 1 --2- 172.21.15.37:0/1592483777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60dc070340 0x7f60dc06a940 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f60c40098f0 tx=0x7f60c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94716dd3f3ff9f17 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.581+0000 7f60d9d9b700 1 -- 172.21.15.37:0/1592483777 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c4011830 con 0x7f60dc070340 2023-07-12T02:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.581+0000 7f60d9d9b700 1 -- 172.21.15.37:0/1592483777 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c4011990 con 0x7f60dc070340 2023-07-12T02:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.581+0000 7f60d9d9b700 1 -- 172.21.15.37:0/1592483777 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c4011d20 con 0x7f60dc070340 2023-07-12T02:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.582+0000 7f60e0bff700 1 -- 172.21.15.37:0/1592483777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60dc070340 msgr2=0x7f60dc06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:32.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.582+0000 7f60e0bff700 1 --2- 172.21.15.37:0/1592483777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60dc070340 0x7f60dc06a940 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f60c40098f0 tx=0x7f60c4009c00 comp rx=0 tx=0).stop 2023-07-12T02:05:32.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.582+0000 7f60e0bff700 1 -- 172.21.15.37:0/1592483777 shutdown_connections 2023-07-12T02:05:32.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.582+0000 7f60e0bff700 1 --2- 172.21.15.37:0/1592483777 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60dc070a50 0x7f60dc070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:32.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.582+0000 7f60e0bff700 1 --2- 172.21.15.37:0/1592483777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60dc070340 0x7f60dc06a940 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:32.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.582+0000 7f60e0bff700 1 -- 172.21.15.37:0/1592483777 >> 172.21.15.37:0/1592483777 conn(0x7f60dc0b0390 msgr2=0x7f60dc0b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:32.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.582+0000 7f60e0bff700 1 -- 172.21.15.37:0/1592483777 shutdown_connections 2023-07-12T02:05:32.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.582+0000 7f60e0bff700 1 -- 172.21.15.37:0/1592483777 wait complete. 2023-07-12T02:05:32.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.584+0000 7f60e0bff700 1 Processor -- start 2023-07-12T02:05:32.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.584+0000 7f60e0bff700 1 -- start start 2023-07-12T02:05:32.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.586+0000 7f60e0bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60dc070340 0x7f60dc150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:32.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.586+0000 7f60e0bff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60dc070a50 0x7f60dc0c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:32.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.586+0000 7f60e0bff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60dc157f10 0x7f60dc0c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:32.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.586+0000 7f60e0bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc151d80 con 0x7f60dc070340 2023-07-12T02:05:32.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.586+0000 7f60e0bff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc151170 con 0x7f60dc157f10 2023-07-12T02:05:32.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.586+0000 7f60e0bff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc151450 con 0x7f60dc070a50 2023-07-12T02:05:32.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.586+0000 7f60da59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60dc070340 0x7f60dc150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:32.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.586+0000 7f60da59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60dc070340 0x7f60dc150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54422/0 (socket says 172.21.15.37:54422) 2023-07-12T02:05:32.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.586+0000 7f60da59c700 1 -- 172.21.15.37:0/4030432781 learned_addr learned my addr 172.21.15.37:0/4030432781 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:32.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.586+0000 7f60d3fff700 1 --2- 172.21.15.37:0/4030432781 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60dc070a50 0x7f60dc0c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:32.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.586+0000 7f60dad9d700 1 --2- 172.21.15.37:0/4030432781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60dc157f10 0x7f60dc0c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:32.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.586+0000 7f60da59c700 1 -- 172.21.15.37:0/4030432781 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60dc070a50 msgr2=0x7f60dc0c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:32.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.586+0000 7f60da59c700 1 --2- 172.21.15.37:0/4030432781 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60dc070a50 0x7f60dc0c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.586+0000 7f60da59c700 1 -- 172.21.15.37:0/4030432781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60dc157f10 msgr2=0x7f60dc0c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.587+0000 7f60da59c700 1 --2- 172.21.15.37:0/4030432781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60dc157f10 0x7f60dc0c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.587+0000 7f60da59c700 1 -- 172.21.15.37:0/4030432781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d4009a70 con 0x7f60dc070340 2023-07-12T02:05:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.587+0000 7f60da59c700 1 --2- 172.21.15.37:0/4030432781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60dc070340 0x7f60dc150a40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0011e0 tx=0x7f60cc00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.587+0000 7f60d2ffd700 1 -- 172.21.15.37:0/4030432781 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc004c80 con 0x7f60dc070340 2023-07-12T02:05:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.587+0000 7f60d2ffd700 1 -- 172.21.15.37:0/4030432781 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc004de0 con 0x7f60dc070340 2023-07-12T02:05:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.587+0000 7f60e0bff700 1 -- 172.21.15.37:0/4030432781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c4009550 con 0x7f60dc070340 2023-07-12T02:05:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.587+0000 7f60d2ffd700 1 -- 172.21.15.37:0/4030432781 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc007310 con 0x7f60dc070340 2023-07-12T02:05:32.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.587+0000 7f60e0bff700 1 -- 172.21.15.37:0/4030432781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60dc151a10 con 0x7f60dc070340 2023-07-12T02:05:32.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.588+0000 7f60e0bff700 1 -- 172.21.15.37:0/4030432781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60dc04ea60 con 0x7f60dc070340 2023-07-12T02:05:32.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.589+0000 7f60d2ffd700 1 -- 172.21.15.37:0/4030432781 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f60cc007470 con 0x7f60dc070340 2023-07-12T02:05:32.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.590+0000 7f60d2ffd700 1 --2- 172.21.15.37:0/4030432781 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f60bc06ace0 0x7f60bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:32.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.590+0000 7f60d2ffd700 1 -- 172.21.15.37:0/4030432781 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f60cc088ff0 con 0x7f60dc070340 2023-07-12T02:05:32.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.590+0000 7f60d3fff700 1 --2- 172.21.15.37:0/4030432781 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f60bc06ace0 0x7f60bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:32.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.591+0000 7f60d3fff700 1 --2- 172.21.15.37:0/4030432781 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f60bc06ace0 0x7f60bc06d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f60c4014040 tx=0x7f60c4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:32.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.595+0000 7f60d2ffd700 1 -- 172.21.15.37:0/4030432781 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f60cc0541e0 con 0x7f60dc070340 2023-07-12T02:05:32.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:32.821+0000 7f60e0bff700 1 -- 172.21.15.37:0/4030432781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f60dc0c20d0 con 0x7f60dc070340 2023-07-12T02:05:33.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.274+0000 7f60d2ffd700 1 -- 172.21.15.37:0/4030432781 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f60cc057800 con 0x7f60dc070340 2023-07-12T02:05:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.276+0000 7f60e0bff700 1 -- 172.21.15.37:0/4030432781 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f60bc06ace0 msgr2=0x7f60bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.276+0000 7f60e0bff700 1 --2- 172.21.15.37:0/4030432781 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f60bc06ace0 0x7f60bc06d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f60c4014040 tx=0x7f60c4008030 comp rx=0 tx=0).stop 2023-07-12T02:05:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.277+0000 7f60e0bff700 1 -- 172.21.15.37:0/4030432781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60dc070340 msgr2=0x7f60dc150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.277+0000 7f60e0bff700 1 --2- 172.21.15.37:0/4030432781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60dc070340 0x7f60dc150a40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0011e0 tx=0x7f60cc00ca30 comp rx=0 tx=0).stop 2023-07-12T02:05:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.277+0000 7f60e0bff700 1 -- 172.21.15.37:0/4030432781 shutdown_connections 2023-07-12T02:05:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.277+0000 7f60e0bff700 1 --2- 172.21.15.37:0/4030432781 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f60bc06ace0 0x7f60bc06d190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.277+0000 7f60e0bff700 1 --2- 172.21.15.37:0/4030432781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60dc070340 0x7f60dc150a40 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.277+0000 7f60e0bff700 1 --2- 172.21.15.37:0/4030432781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60dc157f10 0x7f60dc0c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.277+0000 7f60e0bff700 1 --2- 172.21.15.37:0/4030432781 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60dc070a50 0x7f60dc0c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.277+0000 7f60e0bff700 1 -- 172.21.15.37:0/4030432781 >> 172.21.15.37:0/4030432781 conn(0x7f60dc0b0390 msgr2=0x7f60dc0ab8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.277+0000 7f60e0bff700 1 -- 172.21.15.37:0/4030432781 shutdown_connections 2023-07-12T02:05:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.277+0000 7f60e0bff700 1 -- 172.21.15.37:0/4030432781 wait complete. 2023-07-12T02:05:33.282 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-07-12T02:05:33.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-12T02:05:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.499+0000 7f84de9ff700 1 Processor -- start 2023-07-12T02:05:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.499+0000 7f84de9ff700 1 -- start start 2023-07-12T02:05:33.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.500+0000 7f84de9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84d8157f10 0x7f84d806a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:33.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.500+0000 7f84de9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d8070a50 0x7f84d8070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:33.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.500+0000 7f84de9ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d80713f0 con 0x7f84d8070340 2023-07-12T02:05:33.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.500+0000 7f84de9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d806d900 con 0x7f84d8157f10 2023-07-12T02:05:33.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.500+0000 7f84de9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d815e210 con 0x7f84d8070a50 2023-07-12T02:05:33.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.500+0000 7f84d7fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84d8157f10 0x7f84d806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:33.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.500+0000 7f84d7fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84d8157f10 0x7f84d806a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54426/0 (socket says 172.21.15.37:54426) 2023-07-12T02:05:33.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.500+0000 7f84d7fff700 1 -- 172.21.15.37:0/63881847 learned_addr learned my addr 172.21.15.37:0/63881847 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:33.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.501+0000 7f84dcf9c700 1 --2- 172.21.15.37:0/63881847 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d8070a50 0x7f84d8070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:33.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.501+0000 7f84d7fff700 1 -- 172.21.15.37:0/63881847 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d8070a50 msgr2=0x7f84d8070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:33.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.501+0000 7f84d7fff700 1 --2- 172.21.15.37:0/63881847 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d8070a50 0x7f84d8070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:33.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.501+0000 7f84d7fff700 1 -- 172.21.15.37:0/63881847 >> v1:172.21.15.196:6789/0 conn(0x7f84d8070340 legacy=0x7f84d815e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:33.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.501+0000 7f84d7fff700 1 -- 172.21.15.37:0/63881847 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d815dee0 con 0x7f84d8157f10 2023-07-12T02:05:33.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.501+0000 7f84d7fff700 1 --2- 172.21.15.37:0/63881847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d8157f10 0x7f84d806a940 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f84c80098f0 tx=0x7f84c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294eeb91535bf895 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:33.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.501+0000 7f84d6ffd700 1 -- 172.21.15.37:0/63881847 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c800b8a0 con 0x7f84d8157f10 2023-07-12T02:05:33.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.501+0000 7f84d6ffd700 1 -- 172.21.15.37:0/63881847 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c800ba00 con 0x7f84d8157f10 2023-07-12T02:05:33.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.501+0000 7f84d6ffd700 1 -- 172.21.15.37:0/63881847 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c800bd90 con 0x7f84d8157f10 2023-07-12T02:05:33.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.502+0000 7f84de9ff700 1 -- 172.21.15.37:0/63881847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d8157f10 msgr2=0x7f84d806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:33.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.502+0000 7f84de9ff700 1 --2- 172.21.15.37:0/63881847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d8157f10 0x7f84d806a940 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f84c80098f0 tx=0x7f84c8009c00 comp rx=0 tx=0).stop 2023-07-12T02:05:33.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.502+0000 7f84de9ff700 1 -- 172.21.15.37:0/63881847 shutdown_connections 2023-07-12T02:05:33.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.502+0000 7f84de9ff700 1 --2- 172.21.15.37:0/63881847 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d8070a50 0x7f84d8070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:33.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.502+0000 7f84de9ff700 1 --2- 172.21.15.37:0/63881847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d8157f10 0x7f84d806a940 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:33.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.502+0000 7f84de9ff700 1 -- 172.21.15.37:0/63881847 >> 172.21.15.37:0/63881847 conn(0x7f84d80b0390 msgr2=0x7f84d80b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:33.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.502+0000 7f84de9ff700 1 -- 172.21.15.37:0/63881847 shutdown_connections 2023-07-12T02:05:33.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.502+0000 7f84de9ff700 1 -- 172.21.15.37:0/63881847 wait complete. 2023-07-12T02:05:33.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.504+0000 7f84de9ff700 1 Processor -- start 2023-07-12T02:05:33.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.504+0000 7f84de9ff700 1 -- start start 2023-07-12T02:05:33.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.505+0000 7f84de9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d8070340 0x7f84d80b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:33.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.505+0000 7f84de9ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84d8070a50 0x7f84d815c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:33.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.505+0000 7f84de9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d8157f10 0x7f84d81582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:33.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.505+0000 7f84de9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d80c77b0 con 0x7f84d8157f10 2023-07-12T02:05:33.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.505+0000 7f84de9ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d80c6ba0 con 0x7f84d8070a50 2023-07-12T02:05:33.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.505+0000 7f84de9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d80c6e80 con 0x7f84d8070340 2023-07-12T02:05:33.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.505+0000 7f84dcf9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d8157f10 0x7f84d81582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:33.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.505+0000 7f84dcf9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d8157f10 0x7f84d81582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54432/0 (socket says 172.21.15.37:54432) 2023-07-12T02:05:33.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.505+0000 7f84dcf9c700 1 -- 172.21.15.37:0/3231407473 learned_addr learned my addr 172.21.15.37:0/3231407473 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:33.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.505+0000 7f84d7fff700 1 --2- 172.21.15.37:0/3231407473 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d8070340 0x7f84d80b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:33.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.505+0000 7f84d77fe700 1 --2- 172.21.15.37:0/3231407473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84d8070a50 0x7f84d815c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:33.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.506+0000 7f84dcf9c700 1 -- 172.21.15.37:0/3231407473 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d8070340 msgr2=0x7f84d80b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:33.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.506+0000 7f84dcf9c700 1 --2- 172.21.15.37:0/3231407473 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d8070340 0x7f84d80b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:33.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.506+0000 7f84dcf9c700 1 -- 172.21.15.37:0/3231407473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84d8070a50 msgr2=0x7f84d815c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:33.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.506+0000 7f84dcf9c700 1 --2- 172.21.15.37:0/3231407473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84d8070a50 0x7f84d815c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:33.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.506+0000 7f84dcf9c700 1 -- 172.21.15.37:0/3231407473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c8009550 con 0x7f84d8157f10 2023-07-12T02:05:33.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.506+0000 7f84dcf9c700 1 --2- 172.21.15.37:0/3231407473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d8157f10 0x7f84d81582e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f84d0007e40 tx=0x7f84d000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:33.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.506+0000 7f84d4ff9700 1 -- 172.21.15.37:0/3231407473 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d000ede0 con 0x7f84d8157f10 2023-07-12T02:05:33.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.506+0000 7f84d4ff9700 1 -- 172.21.15.37:0/3231407473 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d0014420 con 0x7f84d8157f10 2023-07-12T02:05:33.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.506+0000 7f84de9ff700 1 -- 172.21.15.37:0/3231407473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d80c7160 con 0x7f84d8157f10 2023-07-12T02:05:33.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.506+0000 7f84d4ff9700 1 -- 172.21.15.37:0/3231407473 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d00147d0 con 0x7f84d8157f10 2023-07-12T02:05:33.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.506+0000 7f84de9ff700 1 -- 172.21.15.37:0/3231407473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d8153140 con 0x7f84d8157f10 2023-07-12T02:05:33.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.507+0000 7f84de9ff700 1 -- 172.21.15.37:0/3231407473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d80c7960 con 0x7f84d8157f10 2023-07-12T02:05:33.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.508+0000 7f84d4ff9700 1 -- 172.21.15.37:0/3231407473 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f84d0014930 con 0x7f84d8157f10 2023-07-12T02:05:33.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.509+0000 7f84d4ff9700 1 --2- 172.21.15.37:0/3231407473 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f84c406ace0 0x7f84c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:33.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.509+0000 7f84d4ff9700 1 -- 172.21.15.37:0/3231407473 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f84d0089a00 con 0x7f84d8157f10 2023-07-12T02:05:33.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.510+0000 7f84d7fff700 1 --2- 172.21.15.37:0/3231407473 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f84c406ace0 0x7f84c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:33.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.510+0000 7f84d7fff700 1 --2- 172.21.15.37:0/3231407473 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f84c406ace0 0x7f84c406d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009c40 tx=0x7f84c8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:33.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.513+0000 7f84d4ff9700 1 -- 172.21.15.37:0/3231407473 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f84d80c7960 con 0x7f84d8157f10 2023-07-12T02:05:33.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.807+0000 7f84de9ff700 1 -- 172.21.15.37:0/3231407473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f84d804ea60 con 0x7f84d8157f10 2023-07-12T02:05:33.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.808+0000 7f84d4ff9700 1 -- 172.21.15.37:0/3231407473 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f84d0058740 con 0x7f84d8157f10 2023-07-12T02:05:33.812 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:33.812 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-12T02:05:33.812 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-07-12T02:05:33.812 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.812 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-07-12T02:05:33.812 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDCCa5kmzT6LxAAW0qkUzF6YI4EagSSaez+gQ==", 2023-07-12T02:05:33.813 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.813 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-12T02:05:33.813 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-12T02:05:33.813 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-12T02:05:33.813 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-12T02:05:33.813 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.813 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.813 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.814 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-07-12T02:05:33.814 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDDCa5k/vw7DBAAPp0phNSm5ZFCEj6sYUcjsg==", 2023-07-12T02:05:33.814 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.814 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-12T02:05:33.814 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-12T02:05:33.814 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-12T02:05:33.814 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-12T02:05:33.814 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.815 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.815 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.815 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-07-12T02:05:33.815 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDDCa5kn2kXABAAAnbLv1fuIMRmEBkg+pU8vQ==", 2023-07-12T02:05:33.815 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.815 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-12T02:05:33.815 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-12T02:05:33.815 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-12T02:05:33.816 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-12T02:05:33.816 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.816 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.816 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.816 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-07-12T02:05:33.816 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDDCa5k4ApMGBAAsQx7ltqZefMR3buK6/9iTQ==", 2023-07-12T02:05:33.816 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.817 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-12T02:05:33.817 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-12T02:05:33.817 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-12T02:05:33.817 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-12T02:05:33.817 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.817 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.817 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-07-12T02:05:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDHCa5ku+BQGBAAonxOANdZCZshPwxzllTRVA==", 2023-07-12T02:05:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-12T02:05:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-12T02:05:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-12T02:05:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-07-12T02:05:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDKCa5kDfhYHBAAfNKAb5TBMEd34E8nyy0tbQ==", 2023-07-12T02:05:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-12T02:05:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-12T02:05:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-12T02:05:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-07-12T02:05:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDNCa5kyXpiHxAA8Pl/jbeUv23j3+Zej0EAyA==", 2023-07-12T02:05:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-12T02:05:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-12T02:05:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-12T02:05:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-07-12T02:05:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDQCa5kd6YBIxAA32OIB3eq2oELuR5YVwOoww==", 2023-07-12T02:05:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-12T02:05:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-12T02:05:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-12T02:05:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-07-12T02:05:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDWCa5k0j3qORAA2AmosMC6V0SF0zFBPXnwsA==", 2023-07-12T02:05:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-12T02:05:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-12T02:05:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-12T02:05:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-07-12T02:05:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaCa5kIAtJAhAAR/AlDdZhFXIJPLHVvQ71NA==", 2023-07-12T02:05:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-12T02:05:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-12T02:05:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-12T02:05:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-07-12T02:05:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDdCa5kfS3nBRAA419im9djzLhwZy4VVsiq2Q==", 2023-07-12T02:05:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-12T02:05:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-12T02:05:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-12T02:05:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-07-12T02:05:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDgCa5kNfoWCRAAMjXouPb1lGaTHLFcb4iAPg==", 2023-07-12T02:05:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-12T02:05:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-12T02:05:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-12T02:05:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-07-12T02:05:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDDCa5kRgbdIhAAz7y/7oTRqD+BzAGhG1mhjg==", 2023-07-12T02:05:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-12T02:05:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-12T02:05:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-12T02:05:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-12T02:05:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-07-12T02:05:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDDCa5ksuf4MRAAXxrPxvbo/NPmReHt90AVpg==", 2023-07-12T02:05:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-12T02:05:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-12T02:05:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-12T02:05:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-12T02:05:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-07-12T02:05:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDDCa5kxPp6KhAA0VRGDq8kCvSgiaMkDO/Cpw==", 2023-07-12T02:05:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-12T02:05:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-12T02:05:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-12T02:05:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-12T02:05:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-07-12T02:05:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDDCa5ktwhhORAA7/eBsiiiQXaTfDYM8SYV3g==", 2023-07-12T02:05:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-12T02:05:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-12T02:05:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-12T02:05:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-12T02:05:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-07-12T02:05:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q==", 2023-07-12T02:05:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-12T02:05:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-12T02:05:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-12T02:05:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-12T02:05:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mds", 2023-07-12T02:05:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDyCa5kdo2HBRAAM/Wd6sfrcneNP9ul47c6Qg==", 2023-07-12T02:05:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mds" 2023-07-12T02:05:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mgr", 2023-07-12T02:05:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDyCa5kQZuHBRAAxmRdGCZ3Oj46qKA/deb06g==", 2023-07-12T02:05:33.835 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.835 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-12T02:05:33.835 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.835 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.835 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.835 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-osd", 2023-07-12T02:05:33.835 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDyCa5kBaWHBRAA49AJCaHNlO5JO3HRNvYGTw==", 2023-07-12T02:05:33.835 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.836 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-osd" 2023-07-12T02:05:33.836 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.836 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.836 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.836 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd", 2023-07-12T02:05:33.836 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDyCa5kn7CHBRAA0BJ8Yl2V0YX+zorChsTSGg==", 2023-07-12T02:05:33.836 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.837 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-12T02:05:33.837 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.837 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.837 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.837 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-12T02:05:33.837 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDyCa5k4rmHBRAAL9ncyKbXU/qJLsYoaUU5Mg==", 2023-07-12T02:05:33.837 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.837 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-12T02:05:33.838 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.838 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.838 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.838 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rgw", 2023-07-12T02:05:33.838 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDyCa5k68KHBRAA1RwtYkOcTZWIF8bwJ6/oLg==", 2023-07-12T02:05:33.838 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.838 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-12T02:05:33.838 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.839 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.839 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.839 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-07-12T02:05:33.839 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDCCa5kEQMtKBAABU2eONDRjE/1tUOyJTDCfw==", 2023-07-12T02:05:33.839 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.839 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-12T02:05:33.839 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-12T02:05:33.839 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-12T02:05:33.840 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:33.840 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:33.840 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-07-12T02:05:33.840 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDCCa5kFTjNHhAAZ80nufKhsfvlLW/0r8yXbg==", 2023-07-12T02:05:33.840 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-12T02:05:33.840 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-12T02:05:33.840 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-12T02:05:33.841 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-12T02:05:33.841 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.841 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:33.841 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-07-12T02:05:33.841 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-12T02:05:33.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.810+0000 7f84de9ff700 1 -- 172.21.15.37:0/3231407473 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f84c406ace0 msgr2=0x7f84c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:33.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.810+0000 7f84de9ff700 1 --2- 172.21.15.37:0/3231407473 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f84c406ace0 0x7f84c406d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009c40 tx=0x7f84c8008030 comp rx=0 tx=0).stop 2023-07-12T02:05:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.810+0000 7f84de9ff700 1 -- 172.21.15.37:0/3231407473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d8157f10 msgr2=0x7f84d81582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.810+0000 7f84de9ff700 1 --2- 172.21.15.37:0/3231407473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d8157f10 0x7f84d81582e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f84d0007e40 tx=0x7f84d000e3c0 comp rx=0 tx=0).stop 2023-07-12T02:05:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.810+0000 7f84de9ff700 1 -- 172.21.15.37:0/3231407473 shutdown_connections 2023-07-12T02:05:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.810+0000 7f84de9ff700 1 --2- 172.21.15.37:0/3231407473 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f84c406ace0 0x7f84c406d190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.810+0000 7f84de9ff700 1 --2- 172.21.15.37:0/3231407473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d8157f10 0x7f84d81582e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.810+0000 7f84de9ff700 1 --2- 172.21.15.37:0/3231407473 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d8070340 0x7f84d80b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.810+0000 7f84de9ff700 1 --2- 172.21.15.37:0/3231407473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84d8070a50 0x7f84d815c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.810+0000 7f84de9ff700 1 -- 172.21.15.37:0/3231407473 >> 172.21.15.37:0/3231407473 conn(0x7f84d80b0390 msgr2=0x7f84d806c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.810+0000 7f84de9ff700 1 -- 172.21.15.37:0/3231407473 shutdown_connections 2023-07-12T02:05:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:33.810+0000 7f84de9ff700 1 -- 172.21.15.37:0/3231407473 wait complete. 2023-07-12T02:05:33.844 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-12T02:05:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.042+0000 7f8b181ff700 1 Processor -- start 2023-07-12T02:05:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.042+0000 7f8b181ff700 1 -- start start 2023-07-12T02:05:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.043+0000 7f8b181ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b100b59d0 0x7f8b101671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.044+0000 7f8b181ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b100d1790 con 0x7f8b1015c460 2023-07-12T02:05:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.044+0000 7f8b181ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b100cd950 con 0x7f8b100d2640 2023-07-12T02:05:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.044+0000 7f8b181ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b100b5e10 con 0x7f8b100b59d0 2023-07-12T02:05:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.044+0000 7f8b15f9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8b1015c460 0x7f8b100cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38138/0 (socket says 172.21.15.37:38138) 2023-07-12T02:05:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.044+0000 7f8b15f9b700 1 -- 172.21.15.37:0/3298379086 learned_addr learned my addr 172.21.15.37:0/3298379086 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.044+0000 7f8b1679c700 1 --2- 172.21.15.37:0/3298379086 >> v2:172.21.15.37:3300/0 conn(0x7f8b100b59d0 0x7f8b101671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.044+0000 7f8b14f99700 1 -- 172.21.15.37:0/3298379086 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241958097 0 0) 0x7f8b100d1790 con 0x7f8b1015c460 2023-07-12T02:05:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.044+0000 7f8b1679c700 1 -- 172.21.15.37:0/3298379086 >> v1:172.21.15.196:6789/0 conn(0x7f8b100d2640 legacy=0x7f8b100cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.044+0000 7f8b1679c700 1 -- 172.21.15.37:0/3298379086 >> v1:172.21.15.37:6789/0 conn(0x7f8b1015c460 legacy=0x7f8b100cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.044+0000 7f8b1679c700 1 -- 172.21.15.37:0/3298379086 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100d14b0 con 0x7f8b100b59d0 2023-07-12T02:05:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.045+0000 7f8b1679c700 1 --2- 172.21.15.37:0/3298379086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b100b59d0 0x7f8b101671b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009d90 tx=0x7f8b0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e021693be5bab5 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.045+0000 7f8b14f99700 1 -- 172.21.15.37:0/3298379086 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0800e070 con 0x7f8b100b59d0 2023-07-12T02:05:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.045+0000 7f8b14f99700 1 -- 172.21.15.37:0/3298379086 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0800bbd0 con 0x7f8b100b59d0 2023-07-12T02:05:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.045+0000 7f8b14f99700 1 -- 172.21.15.37:0/3298379086 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08012430 con 0x7f8b100b59d0 2023-07-12T02:05:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.045+0000 7f8b181ff700 1 -- 172.21.15.37:0/3298379086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b100b59d0 msgr2=0x7f8b101671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.045+0000 7f8b181ff700 1 --2- 172.21.15.37:0/3298379086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b100b59d0 0x7f8b101671b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009d90 tx=0x7f8b0800b330 comp rx=0 tx=0).stop 2023-07-12T02:05:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.045+0000 7f8b181ff700 1 -- 172.21.15.37:0/3298379086 shutdown_connections 2023-07-12T02:05:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.045+0000 7f8b181ff700 1 --2- 172.21.15.37:0/3298379086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b100b59d0 0x7f8b101671b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.045+0000 7f8b181ff700 1 -- 172.21.15.37:0/3298379086 >> 172.21.15.37:0/3298379086 conn(0x7f8b10071660 msgr2=0x7f8b10071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.045+0000 7f8b181ff700 1 -- 172.21.15.37:0/3298379086 shutdown_connections 2023-07-12T02:05:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.046+0000 7f8b181ff700 1 -- 172.21.15.37:0/3298379086 wait complete. 2023-07-12T02:05:34.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.047+0000 7f8b181ff700 1 Processor -- start 2023-07-12T02:05:34.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.047+0000 7f8b181ff700 1 -- start start 2023-07-12T02:05:34.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.048+0000 7f8b181ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b100b59d0 0x7f8b10158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:34.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.048+0000 7f8b181ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b100d2640 0x7f8b1015ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:34.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.048+0000 7f8b181ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b1015c460 0x7f8b1015ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:34.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.048+0000 7f8b181ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b10158b70 con 0x7f8b100b59d0 2023-07-12T02:05:34.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.048+0000 7f8b181ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b10158e50 con 0x7f8b1015c460 2023-07-12T02:05:34.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.048+0000 7f8b181ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100c66b0 con 0x7f8b100d2640 2023-07-12T02:05:34.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.049+0000 7f8b15f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b100b59d0 0x7f8b10158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:34.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.049+0000 7f8b15f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b100b59d0 0x7f8b10158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54444/0 (socket says 172.21.15.37:54444) 2023-07-12T02:05:34.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.049+0000 7f8b15f9b700 1 -- 172.21.15.37:0/3097392962 learned_addr learned my addr 172.21.15.37:0/3097392962 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:34.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.049+0000 7f8b15f9b700 1 -- 172.21.15.37:0/3097392962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b100d2640 msgr2=0x7f8b1015ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.049+0000 7f8b1679c700 1 --2- 172.21.15.37:0/3097392962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b1015c460 0x7f8b1015ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.049+0000 7f8b1579a700 1 --2- 172.21.15.37:0/3097392962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b100d2640 0x7f8b1015ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.049+0000 7f8b15f9b700 1 --2- 172.21.15.37:0/3097392962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b100d2640 0x7f8b1015ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.049+0000 7f8b15f9b700 1 -- 172.21.15.37:0/3097392962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b1015c460 msgr2=0x7f8b1015ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.049+0000 7f8b15f9b700 1 --2- 172.21.15.37:0/3097392962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b1015c460 0x7f8b1015ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.049+0000 7f8b15f9b700 1 -- 172.21.15.37:0/3097392962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b08009a70 con 0x7f8b100b59d0 2023-07-12T02:05:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.049+0000 7f8b1679c700 1 --2- 172.21.15.37:0/3097392962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b1015c460 0x7f8b1015ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.049+0000 7f8b1579a700 1 --2- 172.21.15.37:0/3097392962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b100d2640 0x7f8b1015ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.049+0000 7f8b15f9b700 1 --2- 172.21.15.37:0/3097392962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b100b59d0 0x7f8b10158290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00c520 tx=0x7f8b0c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.050+0000 7f8b067fc700 1 -- 172.21.15.37:0/3097392962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c004c80 con 0x7f8b100b59d0 2023-07-12T02:05:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.050+0000 7f8b067fc700 1 -- 172.21.15.37:0/3097392962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c004e00 con 0x7f8b100b59d0 2023-07-12T02:05:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.050+0000 7f8b067fc700 1 -- 172.21.15.37:0/3097392962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c007310 con 0x7f8b100b59d0 2023-07-12T02:05:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.050+0000 7f8b181ff700 1 -- 172.21.15.37:0/3097392962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b100c6990 con 0x7f8b100b59d0 2023-07-12T02:05:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.050+0000 7f8b181ff700 1 -- 172.21.15.37:0/3097392962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b101587d0 con 0x7f8b100b59d0 2023-07-12T02:05:34.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.051+0000 7f8b181ff700 1 -- 172.21.15.37:0/3097392962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b100c6eb0 con 0x7f8b100b59d0 2023-07-12T02:05:34.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.052+0000 7f8b067fc700 1 -- 172.21.15.37:0/3097392962 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b0c007470 con 0x7f8b100b59d0 2023-07-12T02:05:34.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.053+0000 7f8b067fc700 1 --2- 172.21.15.37:0/3097392962 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8af406ace0 0x7f8af406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:34.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.053+0000 7f8b067fc700 1 -- 172.21.15.37:0/3097392962 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8b0c089040 con 0x7f8b100b59d0 2023-07-12T02:05:34.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.053+0000 7f8b1579a700 1 --2- 172.21.15.37:0/3097392962 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8af406ace0 0x7f8af406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:34.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.054+0000 7f8b1579a700 1 --2- 172.21.15.37:0/3097392962 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8af406ace0 0x7f8af406d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8b00000f60 tx=0x7f8b00009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:34.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.057+0000 7f8b067fc700 1 -- 172.21.15.37:0/3097392962 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8b0c0bb380 con 0x7f8b100b59d0 2023-07-12T02:05:34.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.355+0000 7f8b181ff700 1 -- 172.21.15.37:0/3097392962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f8b1004ea60 con 0x7f8b100b59d0 2023-07-12T02:05:34.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.359+0000 7f8b067fc700 1 -- 172.21.15.37:0/3097392962 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8b100c6eb0 con 0x7f8b100b59d0 2023-07-12T02:05:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.361+0000 7f8b181ff700 1 -- 172.21.15.37:0/3097392962 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8af406ace0 msgr2=0x7f8af406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.361+0000 7f8b181ff700 1 --2- 172.21.15.37:0/3097392962 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8af406ace0 0x7f8af406d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8b00000f60 tx=0x7f8b00009040 comp rx=0 tx=0).stop 2023-07-12T02:05:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.361+0000 7f8b181ff700 1 -- 172.21.15.37:0/3097392962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b100b59d0 msgr2=0x7f8b10158290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.361+0000 7f8b181ff700 1 --2- 172.21.15.37:0/3097392962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b100b59d0 0x7f8b10158290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00c520 tx=0x7f8b0c00c8e0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.361+0000 7f8b181ff700 1 -- 172.21.15.37:0/3097392962 shutdown_connections 2023-07-12T02:05:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.361+0000 7f8b181ff700 1 --2- 172.21.15.37:0/3097392962 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f8af406ace0 0x7f8af406d190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.361+0000 7f8b181ff700 1 --2- 172.21.15.37:0/3097392962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b100b59d0 0x7f8b10158290 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.361+0000 7f8b181ff700 1 --2- 172.21.15.37:0/3097392962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b1015c460 0x7f8b1015ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.361+0000 7f8b181ff700 1 --2- 172.21.15.37:0/3097392962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b100d2640 0x7f8b1015ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.361+0000 7f8b181ff700 1 -- 172.21.15.37:0/3097392962 >> 172.21.15.37:0/3097392962 conn(0x7f8b10071660 msgr2=0x7f8b100d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.361+0000 7f8b181ff700 1 -- 172.21.15.37:0/3097392962 shutdown_connections 2023-07-12T02:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.361+0000 7f8b181ff700 1 -- 172.21.15.37:0/3097392962 wait complete. 2023-07-12T02:05:34.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-12T02:05:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.581+0000 7fc5a43ff700 1 Processor -- start 2023-07-12T02:05:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.581+0000 7fc5a43ff700 1 -- start start 2023-07-12T02:05:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.582+0000 7fc5a43ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc59c15c460 0x7fc59c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.582+0000 7fc5a43ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc59c0cf8f0 0x7fc59c15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.582+0000 7fc5a43ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c0d1790 con 0x7fc59c0d2640 2023-07-12T02:05:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.582+0000 7fc5a43ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c0cedd0 con 0x7fc59c0cf8f0 2023-07-12T02:05:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.582+0000 7fc5a43ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0cd950 con 0x7fc59c15c460 2023-07-12T02:05:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.582+0000 7fc5a199a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc59c0d2640 0x7fc59c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38150/0 (socket says 172.21.15.37:38150) 2023-07-12T02:05:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.582+0000 7fc5a199a700 1 -- 172.21.15.37:0/706419793 learned_addr learned my addr 172.21.15.37:0/706419793 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.582+0000 7fc5a219b700 1 --2- 172.21.15.37:0/706419793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc59c15c460 0x7fc59c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.582+0000 7fc5a299c700 1 --2- 172.21.15.37:0/706419793 >> v2:172.21.15.196:3300/0 conn(0x7fc59c0cf8f0 0x7fc59c15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.583+0000 7fc5a1199700 1 -- 172.21.15.37:0/706419793 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035285979 0 0) 0x7fc59c0d1790 con 0x7fc59c0d2640 2023-07-12T02:05:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.583+0000 7fc5a1199700 1 -- 172.21.15.37:0/706419793 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5880035b0 con 0x7fc59c0d2640 2023-07-12T02:05:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.583+0000 7fc5a219b700 1 -- 172.21.15.37:0/706419793 >> v2:172.21.15.196:3300/0 conn(0x7fc59c0cf8f0 msgr2=0x7fc59c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.583+0000 7fc5a219b700 1 --2- 172.21.15.37:0/706419793 >> v2:172.21.15.196:3300/0 conn(0x7fc59c0cf8f0 0x7fc59c15fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.583+0000 7fc5a219b700 1 -- 172.21.15.37:0/706419793 >> v1:172.21.15.37:6789/0 conn(0x7fc59c0d2640 legacy=0x7fc59c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.583+0000 7fc5a1199700 1 -- 172.21.15.37:0/706419793 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3829945802 0 0) 0x7fc5880035b0 con 0x7fc59c0d2640 2023-07-12T02:05:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.583+0000 7fc5a219b700 1 -- 172.21.15.37:0/706419793 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c0d14b0 con 0x7fc59c15c460 2023-07-12T02:05:34.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.583+0000 7fc5a299c700 1 --2- 172.21.15.37:0/706419793 >> v2:172.21.15.196:3300/0 conn(0x7fc59c0cf8f0 0x7fc59c15fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:34.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.583+0000 7fc5a219b700 1 --2- 172.21.15.37:0/706419793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc59c15c460 0x7fc59c0b59d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc598009840 tx=0x7fc598009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a1a111dc24c5da2 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:34.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.584+0000 7fc5a1199700 1 -- 172.21.15.37:0/706419793 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c001670 con 0x7fc59c15c460 2023-07-12T02:05:34.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.584+0000 7fc5a1199700 1 -- 172.21.15.37:0/706419793 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc598004030 con 0x7fc59c15c460 2023-07-12T02:05:34.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.584+0000 7fc5a1199700 1 -- 172.21.15.37:0/706419793 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5980043c0 con 0x7fc59c15c460 2023-07-12T02:05:34.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.584+0000 7fc5a43ff700 1 -- 172.21.15.37:0/706419793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc59c15c460 msgr2=0x7fc59c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:34.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.584+0000 7fc5a43ff700 1 --2- 172.21.15.37:0/706419793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc59c15c460 0x7fc59c0b59d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc598009840 tx=0x7fc598009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:34.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.584+0000 7fc5a43ff700 1 -- 172.21.15.37:0/706419793 shutdown_connections 2023-07-12T02:05:34.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.584+0000 7fc5a43ff700 1 --2- 172.21.15.37:0/706419793 >> v2:172.21.15.196:3300/0 conn(0x7fc59c0cf8f0 0x7fc59c15fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.584+0000 7fc5a43ff700 1 --2- 172.21.15.37:0/706419793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc59c15c460 0x7fc59c0b59d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.584+0000 7fc5a43ff700 1 -- 172.21.15.37:0/706419793 >> 172.21.15.37:0/706419793 conn(0x7fc59c071660 msgr2=0x7fc59c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.584+0000 7fc5a43ff700 1 -- 172.21.15.37:0/706419793 shutdown_connections 2023-07-12T02:05:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.584+0000 7fc5a43ff700 1 -- 172.21.15.37:0/706419793 wait complete. 2023-07-12T02:05:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.586+0000 7fc5a43ff700 1 Processor -- start 2023-07-12T02:05:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.586+0000 7fc5a43ff700 1 -- start start 2023-07-12T02:05:34.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.587+0000 7fc5a43ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc59c0cf8f0 0x7fc59c1e5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:34.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.587+0000 7fc5a43ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc59c0d2640 0x7fc59c0c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:34.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.587+0000 7fc5a43ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc59c15c460 0x7fc59c1f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:34.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.587+0000 7fc5a43ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c1e6350 con 0x7fc59c0d2640 2023-07-12T02:05:34.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.587+0000 7fc5a43ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0c73e0 con 0x7fc59c0cf8f0 2023-07-12T02:05:34.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.587+0000 7fc5a43ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0c95a0 con 0x7fc59c15c460 2023-07-12T02:05:34.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.587+0000 7fc5a199a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc59c0d2640 0x7fc59c0c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:34.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.588+0000 7fc5a199a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc59c0d2640 0x7fc59c0c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54456/0 (socket says 172.21.15.37:54456) 2023-07-12T02:05:34.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.588+0000 7fc5a199a700 1 -- 172.21.15.37:0/1945728108 learned_addr learned my addr 172.21.15.37:0/1945728108 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:34.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.588+0000 7fc5a299c700 1 --2- 172.21.15.37:0/1945728108 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc59c15c460 0x7fc59c1f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:34.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.588+0000 7fc5a219b700 1 --2- 172.21.15.37:0/1945728108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc59c0cf8f0 0x7fc59c1e5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:34.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.588+0000 7fc5a199a700 1 -- 172.21.15.37:0/1945728108 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc59c15c460 msgr2=0x7fc59c1f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:34.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.588+0000 7fc5a199a700 1 --2- 172.21.15.37:0/1945728108 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc59c15c460 0x7fc59c1f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.588+0000 7fc5a199a700 1 -- 172.21.15.37:0/1945728108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc59c0cf8f0 msgr2=0x7fc59c1e5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:34.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.588+0000 7fc5a199a700 1 --2- 172.21.15.37:0/1945728108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc59c0cf8f0 0x7fc59c1e5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.588+0000 7fc5a199a700 1 -- 172.21.15.37:0/1945728108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594009a70 con 0x7fc59c0d2640 2023-07-12T02:05:34.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.588+0000 7fc5a299c700 1 --2- 172.21.15.37:0/1945728108 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc59c15c460 0x7fc59c1f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:34.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.588+0000 7fc5a199a700 1 --2- 172.21.15.37:0/1945728108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc59c0d2640 0x7fc59c0c9060 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00c780 tx=0x7fc58c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:34.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.588+0000 7fc592ffd700 1 -- 172.21.15.37:0/1945728108 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c004c80 con 0x7fc59c0d2640 2023-07-12T02:05:34.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.588+0000 7fc592ffd700 1 -- 172.21.15.37:0/1945728108 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c004de0 con 0x7fc59c0d2640 2023-07-12T02:05:34.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.588+0000 7fc592ffd700 1 -- 172.21.15.37:0/1945728108 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c0072f0 con 0x7fc59c0d2640 2023-07-12T02:05:34.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.588+0000 7fc5a43ff700 1 -- 172.21.15.37:0/1945728108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5980094a0 con 0x7fc59c0d2640 2023-07-12T02:05:34.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.589+0000 7fc5a43ff700 1 -- 172.21.15.37:0/1945728108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c0c7bf0 con 0x7fc59c0d2640 2023-07-12T02:05:34.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.590+0000 7fc5a43ff700 1 -- 172.21.15.37:0/1945728108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c1f3370 con 0x7fc59c0d2640 2023-07-12T02:05:34.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.591+0000 7fc592ffd700 1 -- 172.21.15.37:0/1945728108 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc58c007450 con 0x7fc59c0d2640 2023-07-12T02:05:34.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.592+0000 7fc592ffd700 1 --2- 172.21.15.37:0/1945728108 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc58006ace0 0x7fc58006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:34.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.592+0000 7fc592ffd700 1 -- 172.21.15.37:0/1945728108 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fc58c089080 con 0x7fc59c0d2640 2023-07-12T02:05:34.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.593+0000 7fc5a219b700 1 --2- 172.21.15.37:0/1945728108 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc58006ace0 0x7fc58006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:34.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.593+0000 7fc5a219b700 1 --2- 172.21.15.37:0/1945728108 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc58006ace0 0x7fc58006d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc5980090b0 tx=0x7fc598008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:34.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.596+0000 7fc592ffd700 1 -- 172.21.15.37:0/1945728108 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc58c0bb380 con 0x7fc59c0d2640 2023-07-12T02:05:34.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.883+0000 7fc5a43ff700 1 -- 172.21.15.37:0/1945728108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fc59c04ea60 con 0x7fc59c0d2640 2023-07-12T02:05:34.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.888+0000 7fc592ffd700 1 -- 172.21.15.37:0/1945728108 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc58c0542a0 con 0x7fc59c0d2640 2023-07-12T02:05:34.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.890+0000 7fc5a43ff700 1 -- 172.21.15.37:0/1945728108 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc58006ace0 msgr2=0x7fc58006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:34.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.890+0000 7fc5a43ff700 1 --2- 172.21.15.37:0/1945728108 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc58006ace0 0x7fc58006d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc5980090b0 tx=0x7fc598008030 comp rx=0 tx=0).stop 2023-07-12T02:05:34.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.890+0000 7fc5a43ff700 1 -- 172.21.15.37:0/1945728108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc59c0d2640 msgr2=0x7fc59c0c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:34.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.890+0000 7fc5a43ff700 1 --2- 172.21.15.37:0/1945728108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc59c0d2640 0x7fc59c0c9060 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00c780 tx=0x7fc58c00ca90 comp rx=0 tx=0).stop 2023-07-12T02:05:34.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.890+0000 7fc5a43ff700 1 -- 172.21.15.37:0/1945728108 shutdown_connections 2023-07-12T02:05:34.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.890+0000 7fc5a43ff700 1 --2- 172.21.15.37:0/1945728108 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fc58006ace0 0x7fc58006d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.890+0000 7fc5a43ff700 1 --2- 172.21.15.37:0/1945728108 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc59c15c460 0x7fc59c1f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.890+0000 7fc5a43ff700 1 --2- 172.21.15.37:0/1945728108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc59c0cf8f0 0x7fc59c1e5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.890+0000 7fc5a43ff700 1 --2- 172.21.15.37:0/1945728108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc59c0d2640 0x7fc59c0c9060 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:34.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.890+0000 7fc5a43ff700 1 -- 172.21.15.37:0/1945728108 >> 172.21.15.37:0/1945728108 conn(0x7fc59c071660 msgr2=0x7fc59c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:34.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.890+0000 7fc5a43ff700 1 -- 172.21.15.37:0/1945728108 shutdown_connections 2023-07-12T02:05:34.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:34.890+0000 7fc5a43ff700 1 -- 172.21.15.37:0/1945728108 wait complete. 2023-07-12T02:05:34.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-12T02:05:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.109+0000 7fa0719ff700 1 Processor -- start 2023-07-12T02:05:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.109+0000 7fa0719ff700 1 -- start start 2023-07-12T02:05:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.111+0000 7fa0719ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa06c0b59d0 0x7fa06c1671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.111+0000 7fa0719ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06c0d1790 con 0x7fa06c15c460 2023-07-12T02:05:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.111+0000 7fa0719ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06c0cd950 con 0x7fa06c0d2640 2023-07-12T02:05:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.111+0000 7fa0719ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa06c0b5e10 con 0x7fa06c0b59d0 2023-07-12T02:05:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.111+0000 7fa06b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa06c0b59d0 0x7fa06c1671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.111+0000 7fa06affd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa06c15c460 0x7fa06c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38156/0 (socket says 172.21.15.37:38156) 2023-07-12T02:05:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.111+0000 7fa06b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa06c0b59d0 0x7fa06c1671b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54460/0 (socket says 172.21.15.37:54460) 2023-07-12T02:05:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.111+0000 7fa06affd700 1 -- 172.21.15.37:0/1300146640 learned_addr learned my addr 172.21.15.37:0/1300146640 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:35.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.111+0000 7fa06b7fe700 1 -- 172.21.15.37:0/1300146640 >> v1:172.21.15.196:6789/0 conn(0x7fa06c0d2640 legacy=0x7fa06c0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:35.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.111+0000 7fa06b7fe700 1 -- 172.21.15.37:0/1300146640 >> v1:172.21.15.37:6789/0 conn(0x7fa06c15c460 legacy=0x7fa06c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:35.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.112+0000 7fa06b7fe700 1 -- 172.21.15.37:0/1300146640 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c0d14b0 con 0x7fa06c0b59d0 2023-07-12T02:05:35.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.111+0000 7fa069ffb700 1 -- 172.21.15.37:0/1300146640 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657285114 0 0) 0x7fa06c0d1790 con 0x7fa06c15c460 2023-07-12T02:05:35.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.112+0000 7fa06b7fe700 1 --2- 172.21.15.37:0/1300146640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa06c0b59d0 0x7fa06c1671b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa064009d90 tx=0x7fa06400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d25854d20119da4 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:35.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.112+0000 7fa069ffb700 1 -- 172.21.15.37:0/1300146640 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06400e070 con 0x7fa06c0b59d0 2023-07-12T02:05:35.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.112+0000 7fa069ffb700 1 -- 172.21.15.37:0/1300146640 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06400bbd0 con 0x7fa06c0b59d0 2023-07-12T02:05:35.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.112+0000 7fa069ffb700 1 -- 172.21.15.37:0/1300146640 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa064012430 con 0x7fa06c0b59d0 2023-07-12T02:05:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.113+0000 7fa0719ff700 1 -- 172.21.15.37:0/1300146640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa06c0b59d0 msgr2=0x7fa06c1671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.113+0000 7fa0719ff700 1 --2- 172.21.15.37:0/1300146640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa06c0b59d0 0x7fa06c1671b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa064009d90 tx=0x7fa06400b330 comp rx=0 tx=0).stop 2023-07-12T02:05:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.113+0000 7fa0719ff700 1 -- 172.21.15.37:0/1300146640 shutdown_connections 2023-07-12T02:05:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.113+0000 7fa0719ff700 1 --2- 172.21.15.37:0/1300146640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa06c0b59d0 0x7fa06c1671b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.113+0000 7fa0719ff700 1 -- 172.21.15.37:0/1300146640 >> 172.21.15.37:0/1300146640 conn(0x7fa06c071660 msgr2=0x7fa06c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.113+0000 7fa0719ff700 1 -- 172.21.15.37:0/1300146640 shutdown_connections 2023-07-12T02:05:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.113+0000 7fa0719ff700 1 -- 172.21.15.37:0/1300146640 wait complete. 2023-07-12T02:05:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.114+0000 7fa0719ff700 1 Processor -- start 2023-07-12T02:05:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.115+0000 7fa0719ff700 1 -- start start 2023-07-12T02:05:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.116+0000 7fa0719ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa06c0b59d0 0x7fa06c14a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.116+0000 7fa0719ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa06c0d2640 0x7fa06c0c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.116+0000 7fa0719ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa06c15c460 0x7fa06c0cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.116+0000 7fa0719ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c14b2f0 con 0x7fa06c0d2640 2023-07-12T02:05:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.116+0000 7fa0719ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c14aa20 con 0x7fa06c0b59d0 2023-07-12T02:05:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.116+0000 7fa0719ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c0c79c0 con 0x7fa06c15c460 2023-07-12T02:05:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.116+0000 7fa06a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa06c0d2640 0x7fa06c0c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.116+0000 7fa06a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa06c0d2640 0x7fa06c0c70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54466/0 (socket says 172.21.15.37:54466) 2023-07-12T02:05:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.116+0000 7fa06a7fc700 1 -- 172.21.15.37:0/1357221586 learned_addr learned my addr 172.21.15.37:0/1357221586 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.116+0000 7fa06b7fe700 1 --2- 172.21.15.37:0/1357221586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa06c15c460 0x7fa06c0cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.116+0000 7fa06affd700 1 --2- 172.21.15.37:0/1357221586 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa06c0b59d0 0x7fa06c14a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.116+0000 7fa06a7fc700 1 -- 172.21.15.37:0/1357221586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa06c15c460 msgr2=0x7fa06c0cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.116+0000 7fa06a7fc700 1 --2- 172.21.15.37:0/1357221586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa06c15c460 0x7fa06c0cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.116+0000 7fa06a7fc700 1 -- 172.21.15.37:0/1357221586 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa06c0b59d0 msgr2=0x7fa06c14a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.116+0000 7fa06a7fc700 1 --2- 172.21.15.37:0/1357221586 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa06c0b59d0 0x7fa06c14a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.116+0000 7fa06a7fc700 1 -- 172.21.15.37:0/1357221586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa064009a70 con 0x7fa06c0d2640 2023-07-12T02:05:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.117+0000 7fa06a7fc700 1 --2- 172.21.15.37:0/1357221586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa06c0d2640 0x7fa06c0c70c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa06000c4e0 tx=0x7fa06000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.117+0000 7fa053fff700 1 -- 172.21.15.37:0/1357221586 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600052d0 con 0x7fa06c0d2640 2023-07-12T02:05:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.117+0000 7fa053fff700 1 -- 172.21.15.37:0/1357221586 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa060005430 con 0x7fa06c0d2640 2023-07-12T02:05:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.117+0000 7fa0719ff700 1 -- 172.21.15.37:0/1357221586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa06c14aca0 con 0x7fa06c0d2640 2023-07-12T02:05:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.117+0000 7fa053fff700 1 -- 172.21.15.37:0/1357221586 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600038c0 con 0x7fa06c0d2640 2023-07-12T02:05:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.117+0000 7fa0719ff700 1 -- 172.21.15.37:0/1357221586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06c0c7ca0 con 0x7fa06c0d2640 2023-07-12T02:05:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.118+0000 7fa0719ff700 1 -- 172.21.15.37:0/1357221586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa06c04ea60 con 0x7fa06c0d2640 2023-07-12T02:05:35.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.119+0000 7fa053fff700 1 -- 172.21.15.37:0/1357221586 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa060003a20 con 0x7fa06c0d2640 2023-07-12T02:05:35.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.120+0000 7fa053fff700 1 --2- 172.21.15.37:0/1357221586 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa05806ace0 0x7fa05806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:35.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.120+0000 7fa053fff700 1 -- 172.21.15.37:0/1357221586 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa0600887f0 con 0x7fa06c0d2640 2023-07-12T02:05:35.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.120+0000 7fa06affd700 1 --2- 172.21.15.37:0/1357221586 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa05806ace0 0x7fa05806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:35.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.121+0000 7fa06affd700 1 --2- 172.21.15.37:0/1357221586 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa05806ace0 0x7fa05806d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa05c007fd0 tx=0x7fa05c007c20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:35.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.125+0000 7fa053fff700 1 -- 172.21.15.37:0/1357221586 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa060053a10 con 0x7fa06c0d2640 2023-07-12T02:05:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.419+0000 7fa0719ff700 1 -- 172.21.15.37:0/1357221586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fa06c0c6450 con 0x7fa06c0d2640 2023-07-12T02:05:35.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.424+0000 7fa053fff700 1 -- 172.21.15.37:0/1357221586 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa060057030 con 0x7fa06c0d2640 2023-07-12T02:05:35.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.426+0000 7fa0719ff700 1 -- 172.21.15.37:0/1357221586 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa05806ace0 msgr2=0x7fa05806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:35.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.426+0000 7fa0719ff700 1 --2- 172.21.15.37:0/1357221586 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa05806ace0 0x7fa05806d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa05c007fd0 tx=0x7fa05c007c20 comp rx=0 tx=0).stop 2023-07-12T02:05:35.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.426+0000 7fa0719ff700 1 -- 172.21.15.37:0/1357221586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa06c0d2640 msgr2=0x7fa06c0c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:35.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.426+0000 7fa0719ff700 1 --2- 172.21.15.37:0/1357221586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa06c0d2640 0x7fa06c0c70c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa06000c4e0 tx=0x7fa06000c8a0 comp rx=0 tx=0).stop 2023-07-12T02:05:35.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.426+0000 7fa0719ff700 1 -- 172.21.15.37:0/1357221586 shutdown_connections 2023-07-12T02:05:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.426+0000 7fa0719ff700 1 --2- 172.21.15.37:0/1357221586 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa05806ace0 0x7fa05806d190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.426+0000 7fa0719ff700 1 --2- 172.21.15.37:0/1357221586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa06c15c460 0x7fa06c0cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.426+0000 7fa0719ff700 1 --2- 172.21.15.37:0/1357221586 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa06c0b59d0 0x7fa06c14a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.426+0000 7fa0719ff700 1 --2- 172.21.15.37:0/1357221586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa06c0d2640 0x7fa06c0c70c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.426+0000 7fa0719ff700 1 -- 172.21.15.37:0/1357221586 >> 172.21.15.37:0/1357221586 conn(0x7fa06c071660 msgr2=0x7fa06c0b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.426+0000 7fa0719ff700 1 -- 172.21.15.37:0/1357221586 shutdown_connections 2023-07-12T02:05:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.426+0000 7fa0719ff700 1 -- 172.21.15.37:0/1357221586 wait complete. 2023-07-12T02:05:35.447 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-12T02:05:35.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.646+0000 7f5bf45ff700 1 Processor -- start 2023-07-12T02:05:35.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.647+0000 7f5bf45ff700 1 -- start start 2023-07-12T02:05:35.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.648+0000 7f5bf45ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5bec157f10 0x7f5bec06a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:35.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.648+0000 7f5bf45ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec15e210 con 0x7f5bec070340 2023-07-12T02:05:35.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.648+0000 7f5bf45ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec15dee0 con 0x7f5bec070a50 2023-07-12T02:05:35.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.648+0000 7f5bf45ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec06d900 con 0x7f5bec157f10 2023-07-12T02:05:35.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.648+0000 7f5bf1b9a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5bec070340 0x7f5bec15e6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38160/0 (socket says 172.21.15.37:38160) 2023-07-12T02:05:35.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.648+0000 7f5bf1b9a700 1 -- 172.21.15.37:0/3466530339 learned_addr learned my addr 172.21.15.37:0/3466530339 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:35.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.648+0000 7f5bf239b700 1 --2- 172.21.15.37:0/3466530339 >> v2:172.21.15.196:3300/0 conn(0x7f5bec157f10 0x7f5bec06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:35.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.648+0000 7f5bf1399700 1 -- 172.21.15.37:0/3466530339 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88024196 0 0) 0x7f5bec15e210 con 0x7f5bec070340 2023-07-12T02:05:35.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.649+0000 7f5bf1399700 1 -- 172.21.15.37:0/3466530339 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd80035b0 con 0x7f5bec070340 2023-07-12T02:05:35.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.649+0000 7f5bf1399700 1 -- 172.21.15.37:0/3466530339 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388640731 0 0) 0x7f5bec15dee0 con 0x7f5bec070a50 2023-07-12T02:05:35.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.649+0000 7f5bf1399700 1 -- 172.21.15.37:0/3466530339 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bec15e210 con 0x7f5bec070a50 2023-07-12T02:05:35.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.649+0000 7f5bf239b700 1 -- 172.21.15.37:0/3466530339 >> v1:172.21.15.196:6789/0 conn(0x7f5bec070a50 legacy=0x7f5bec070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:35.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.649+0000 7f5bf239b700 1 -- 172.21.15.37:0/3466530339 >> v1:172.21.15.37:6789/0 conn(0x7f5bec070340 legacy=0x7f5bec15e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:35.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.649+0000 7f5bf1399700 1 -- 172.21.15.37:0/3466530339 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 118725370 0 0) 0x7f5bd80035b0 con 0x7f5bec070340 2023-07-12T02:05:35.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.649+0000 7f5bf239b700 1 -- 172.21.15.37:0/3466530339 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0c8f40 con 0x7f5bec157f10 2023-07-12T02:05:35.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.649+0000 7f5bf239b700 1 --2- 172.21.15.37:0/3466530339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bec157f10 0x7f5bec06a940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009840 tx=0x7f5be8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e6cd685bd3d5811 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:35.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.650+0000 7f5bf1399700 1 -- 172.21.15.37:0/3466530339 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc001670 con 0x7f5bec157f10 2023-07-12T02:05:35.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.650+0000 7f5bf1399700 1 -- 172.21.15.37:0/3466530339 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be8004030 con 0x7f5bec157f10 2023-07-12T02:05:35.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.650+0000 7f5bf1399700 1 -- 172.21.15.37:0/3466530339 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be80043c0 con 0x7f5bec157f10 2023-07-12T02:05:35.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.650+0000 7f5bf45ff700 1 -- 172.21.15.37:0/3466530339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bec157f10 msgr2=0x7f5bec06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:35.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.650+0000 7f5bf45ff700 1 --2- 172.21.15.37:0/3466530339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bec157f10 0x7f5bec06a940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009840 tx=0x7f5be8009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:35.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.650+0000 7f5bf45ff700 1 -- 172.21.15.37:0/3466530339 shutdown_connections 2023-07-12T02:05:35.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.650+0000 7f5bf45ff700 1 --2- 172.21.15.37:0/3466530339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bec157f10 0x7f5bec06a940 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:35.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.650+0000 7f5bf45ff700 1 -- 172.21.15.37:0/3466530339 >> 172.21.15.37:0/3466530339 conn(0x7f5bec0b0390 msgr2=0x7f5bec0b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:35.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.650+0000 7f5bf45ff700 1 -- 172.21.15.37:0/3466530339 shutdown_connections 2023-07-12T02:05:35.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.650+0000 7f5bf45ff700 1 -- 172.21.15.37:0/3466530339 wait complete. 2023-07-12T02:05:35.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.652+0000 7f5bf45ff700 1 Processor -- start 2023-07-12T02:05:35.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.652+0000 7f5bf45ff700 1 -- start start 2023-07-12T02:05:35.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.653+0000 7f5bf45ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bec070340 0x7f5bec1f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:35.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.653+0000 7f5bf45ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bec070a50 0x7f5bec0cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:35.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.653+0000 7f5bf45ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bec157f10 0x7f5bec15d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:35.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.653+0000 7f5bf45ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0cc450 con 0x7f5bec070a50 2023-07-12T02:05:35.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.653+0000 7f5bf45ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec1f23b0 con 0x7f5bec157f10 2023-07-12T02:05:35.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.653+0000 7f5bf45ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec1f2690 con 0x7f5bec070340 2023-07-12T02:05:35.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.653+0000 7f5bf1b9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bec070a50 0x7f5bec0cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:35.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.654+0000 7f5bf1b9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bec070a50 0x7f5bec0cdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54482/0 (socket says 172.21.15.37:54482) 2023-07-12T02:05:35.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.654+0000 7f5bf1b9a700 1 -- 172.21.15.37:0/928006705 learned_addr learned my addr 172.21.15.37:0/928006705 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:35.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.654+0000 7f5bf239b700 1 --2- 172.21.15.37:0/928006705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bec070340 0x7f5bec1f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:35.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.654+0000 7f5bf2b9c700 1 --2- 172.21.15.37:0/928006705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bec157f10 0x7f5bec15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:35.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.654+0000 7f5bf1b9a700 1 -- 172.21.15.37:0/928006705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bec070340 msgr2=0x7f5bec1f1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:35.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.654+0000 7f5bf1b9a700 1 --2- 172.21.15.37:0/928006705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bec070340 0x7f5bec1f1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:35.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.654+0000 7f5bf1b9a700 1 -- 172.21.15.37:0/928006705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bec157f10 msgr2=0x7f5bec15d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:35.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.654+0000 7f5bf1b9a700 1 --2- 172.21.15.37:0/928006705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bec157f10 0x7f5bec15d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:35.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.654+0000 7f5bf1b9a700 1 -- 172.21.15.37:0/928006705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be80094a0 con 0x7f5bec070a50 2023-07-12T02:05:35.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.654+0000 7f5bf1b9a700 1 --2- 172.21.15.37:0/928006705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bec070a50 0x7f5bec0cdca0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c750 tx=0x7f5bdc00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:35.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.654+0000 7f5be2ffd700 1 -- 172.21.15.37:0/928006705 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc004c80 con 0x7f5bec070a50 2023-07-12T02:05:35.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.655+0000 7f5be2ffd700 1 -- 172.21.15.37:0/928006705 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc004de0 con 0x7f5bec070a50 2023-07-12T02:05:35.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.655+0000 7f5be2ffd700 1 -- 172.21.15.37:0/928006705 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0072d0 con 0x7f5bec070a50 2023-07-12T02:05:35.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.655+0000 7f5bf45ff700 1 -- 172.21.15.37:0/928006705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec1f2970 con 0x7f5bec070a50 2023-07-12T02:05:35.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.655+0000 7f5bf45ff700 1 -- 172.21.15.37:0/928006705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec15d940 con 0x7f5bec070a50 2023-07-12T02:05:35.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.656+0000 7f5bf45ff700 1 -- 172.21.15.37:0/928006705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec04ea60 con 0x7f5bec070a50 2023-07-12T02:05:35.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.657+0000 7f5be2ffd700 1 -- 172.21.15.37:0/928006705 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5bdc007430 con 0x7f5bec070a50 2023-07-12T02:05:35.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.658+0000 7f5be2ffd700 1 --2- 172.21.15.37:0/928006705 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5bd006ace0 0x7f5bd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:35.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.658+0000 7f5be2ffd700 1 -- 172.21.15.37:0/928006705 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5bdc0890b0 con 0x7f5bec070a50 2023-07-12T02:05:35.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.658+0000 7f5bf239b700 1 --2- 172.21.15.37:0/928006705 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5bd006ace0 0x7f5bd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:35.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.659+0000 7f5bf239b700 1 --2- 172.21.15.37:0/928006705 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5bd006ace0 0x7f5bd006d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5be80090b0 tx=0x7f5be8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:35.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.662+0000 7f5be2ffd700 1 -- 172.21.15.37:0/928006705 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5bdc054370 con 0x7f5bec070a50 2023-07-12T02:05:35.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.954+0000 7f5bf45ff700 1 -- 172.21.15.37:0/928006705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f5bec0c20d0 con 0x7f5bec070a50 2023-07-12T02:05:35.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.959+0000 7f5be2ffd700 1 -- 172.21.15.37:0/928006705 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5bdc057990 con 0x7f5bec070a50 2023-07-12T02:05:35.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.961+0000 7f5bf45ff700 1 -- 172.21.15.37:0/928006705 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5bd006ace0 msgr2=0x7f5bd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:35.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.961+0000 7f5bf45ff700 1 --2- 172.21.15.37:0/928006705 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5bd006ace0 0x7f5bd006d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5be80090b0 tx=0x7f5be8008030 comp rx=0 tx=0).stop 2023-07-12T02:05:35.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.961+0000 7f5bf45ff700 1 -- 172.21.15.37:0/928006705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bec070a50 msgr2=0x7f5bec0cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:35.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.961+0000 7f5bf45ff700 1 --2- 172.21.15.37:0/928006705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bec070a50 0x7f5bec0cdca0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c750 tx=0x7f5bdc00ca60 comp rx=0 tx=0).stop 2023-07-12T02:05:35.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.961+0000 7f5bf45ff700 1 -- 172.21.15.37:0/928006705 shutdown_connections 2023-07-12T02:05:35.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.961+0000 7f5bf45ff700 1 --2- 172.21.15.37:0/928006705 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f5bd006ace0 0x7f5bd006d190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:35.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.961+0000 7f5bf45ff700 1 --2- 172.21.15.37:0/928006705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bec157f10 0x7f5bec15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:35.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.961+0000 7f5bf45ff700 1 --2- 172.21.15.37:0/928006705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bec070340 0x7f5bec1f1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:35.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.961+0000 7f5bf45ff700 1 --2- 172.21.15.37:0/928006705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bec070a50 0x7f5bec0cdca0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:35.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.961+0000 7f5bf45ff700 1 -- 172.21.15.37:0/928006705 >> 172.21.15.37:0/928006705 conn(0x7f5bec0b0390 msgr2=0x7f5bec15af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:35.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.961+0000 7f5bf45ff700 1 -- 172.21.15.37:0/928006705 shutdown_connections 2023-07-12T02:05:35.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:35.961+0000 7f5bf45ff700 1 -- 172.21.15.37:0/928006705 wait complete. 2023-07-12T02:05:35.982 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-12T02:05:36.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.180+0000 7f3c19dff700 1 Processor -- start 2023-07-12T02:05:36.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.180+0000 7f3c19dff700 1 -- start start 2023-07-12T02:05:36.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.182+0000 7f3c19dff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3c1415c460 0x7f3c140b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:36.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.182+0000 7f3c19dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c140cf8f0 0x7f3c1415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:36.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.182+0000 7f3c19dff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c140d1790 con 0x7f3c140d2640 2023-07-12T02:05:36.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.182+0000 7f3c19dff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c140cedd0 con 0x7f3c1415c460 2023-07-12T02:05:36.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.182+0000 7f3c19dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c140cd950 con 0x7f3c140cf8f0 2023-07-12T02:05:36.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.182+0000 7f3c137fe700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3c1415c460 0x7f3c140b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:36.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.182+0000 7f3c13fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c140cf8f0 0x7f3c1415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:36.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.182+0000 7f3c137fe700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3c1415c460 0x7f3c140b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:41990/0 (socket says 172.21.15.37:41990) 2023-07-12T02:05:36.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.182+0000 7f3c137fe700 1 -- 172.21.15.37:0/4186376499 learned_addr learned my addr 172.21.15.37:0/4186376499 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:36.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.182+0000 7f3c0bfff700 1 --1- 172.21.15.37:0/4186376499 >> v1:172.21.15.196:6789/0 conn(0x7f3c140d2640 0x7f3c140cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:56304/0 (socket says 172.21.15.37:56304) 2023-07-12T02:05:36.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.183+0000 7f3c137fe700 1 -- 172.21.15.37:0/4186376499 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c140cf8f0 msgr2=0x7f3c1415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:36.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.183+0000 7f3c137fe700 1 --2- 172.21.15.37:0/4186376499 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c140cf8f0 0x7f3c1415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.183+0000 7f3c137fe700 1 -- 172.21.15.37:0/4186376499 >> v1:172.21.15.196:6789/0 conn(0x7f3c140d2640 legacy=0x7f3c140cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:36.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.183+0000 7f3c137fe700 1 -- 172.21.15.37:0/4186376499 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c140d14b0 con 0x7f3c1415c460 2023-07-12T02:05:36.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.183+0000 7f3c12ffd700 1 -- 172.21.15.37:0/4186376499 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236914335 0 0) 0x7f3c140d1790 con 0x7f3c140d2640 2023-07-12T02:05:36.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.183+0000 7f3c137fe700 1 --2- 172.21.15.37:0/4186376499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c1415c460 0x7f3c140b59d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3c040098f0 tx=0x7f3c04009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd2bc22092ffcfc6 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:36.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.183+0000 7f3c12ffd700 1 -- 172.21.15.37:0/4186376499 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04011830 con 0x7f3c1415c460 2023-07-12T02:05:36.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.183+0000 7f3c12ffd700 1 -- 172.21.15.37:0/4186376499 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c04011990 con 0x7f3c1415c460 2023-07-12T02:05:36.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.183+0000 7f3c12ffd700 1 -- 172.21.15.37:0/4186376499 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04011d20 con 0x7f3c1415c460 2023-07-12T02:05:36.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.184+0000 7f3c19dff700 1 -- 172.21.15.37:0/4186376499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c1415c460 msgr2=0x7f3c140b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:36.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.184+0000 7f3c19dff700 1 --2- 172.21.15.37:0/4186376499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c1415c460 0x7f3c140b59d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3c040098f0 tx=0x7f3c04009c00 comp rx=0 tx=0).stop 2023-07-12T02:05:36.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.184+0000 7f3c19dff700 1 -- 172.21.15.37:0/4186376499 shutdown_connections 2023-07-12T02:05:36.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.184+0000 7f3c19dff700 1 --2- 172.21.15.37:0/4186376499 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c140cf8f0 0x7f3c1415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.184+0000 7f3c19dff700 1 --2- 172.21.15.37:0/4186376499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c1415c460 0x7f3c140b59d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.184+0000 7f3c19dff700 1 -- 172.21.15.37:0/4186376499 >> 172.21.15.37:0/4186376499 conn(0x7f3c14071660 msgr2=0x7f3c14071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:36.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.184+0000 7f3c19dff700 1 -- 172.21.15.37:0/4186376499 shutdown_connections 2023-07-12T02:05:36.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.184+0000 7f3c19dff700 1 -- 172.21.15.37:0/4186376499 wait complete. 2023-07-12T02:05:36.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.186+0000 7f3c19dff700 1 Processor -- start 2023-07-12T02:05:36.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.186+0000 7f3c19dff700 1 -- start start 2023-07-12T02:05:36.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.187+0000 7f3c19dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c140cf8f0 0x7f3c140cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:36.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.187+0000 7f3c19dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c140d2640 0x7f3c141579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:36.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.187+0000 7f3c19dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c1415c460 0x7f3c14157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:36.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.187+0000 7f3c19dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c14158450 con 0x7f3c1415c460 2023-07-12T02:05:36.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.187+0000 7f3c19dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c140c7fb0 con 0x7f3c140cf8f0 2023-07-12T02:05:36.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.187+0000 7f3c19dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c140c9cf0 con 0x7f3c140d2640 2023-07-12T02:05:36.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.187+0000 7f3c13fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c1415c460 0x7f3c14157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:36.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.187+0000 7f3c13fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c1415c460 0x7f3c14157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54494/0 (socket says 172.21.15.37:54494) 2023-07-12T02:05:36.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.187+0000 7f3c13fff700 1 -- 172.21.15.37:0/2816999525 learned_addr learned my addr 172.21.15.37:0/2816999525 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:36.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.187+0000 7f3c137fe700 1 --2- 172.21.15.37:0/2816999525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c140cf8f0 0x7f3c140cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:36.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.187+0000 7f3c0bfff700 1 --2- 172.21.15.37:0/2816999525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c140d2640 0x7f3c141579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:36.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.188+0000 7f3c13fff700 1 -- 172.21.15.37:0/2816999525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c140d2640 msgr2=0x7f3c141579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:36.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.188+0000 7f3c13fff700 1 --2- 172.21.15.37:0/2816999525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c140d2640 0x7f3c141579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.188+0000 7f3c13fff700 1 -- 172.21.15.37:0/2816999525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c140cf8f0 msgr2=0x7f3c140cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:36.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.188+0000 7f3c13fff700 1 --2- 172.21.15.37:0/2816999525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c140cf8f0 0x7f3c140cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.188+0000 7f3c13fff700 1 -- 172.21.15.37:0/2816999525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c04009550 con 0x7f3c1415c460 2023-07-12T02:05:36.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.188+0000 7f3c13fff700 1 --2- 172.21.15.37:0/2816999525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c1415c460 0x7f3c14157f10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00efc0 tx=0x7f3c0c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:36.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.188+0000 7f3c10ff9700 1 -- 172.21.15.37:0/2816999525 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c00cad0 con 0x7f3c1415c460 2023-07-12T02:05:36.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.188+0000 7f3c10ff9700 1 -- 172.21.15.37:0/2816999525 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0c00f040 con 0x7f3c1415c460 2023-07-12T02:05:36.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.188+0000 7f3c10ff9700 1 -- 172.21.15.37:0/2816999525 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c00ce70 con 0x7f3c1415c460 2023-07-12T02:05:36.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.188+0000 7f3c19dff700 1 -- 172.21.15.37:0/2816999525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c140c9fd0 con 0x7f3c1415c460 2023-07-12T02:05:36.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.188+0000 7f3c19dff700 1 -- 172.21.15.37:0/2816999525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c140ca590 con 0x7f3c1415c460 2023-07-12T02:05:36.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.190+0000 7f3c19dff700 1 -- 172.21.15.37:0/2816999525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c1404ea60 con 0x7f3c1415c460 2023-07-12T02:05:36.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.190+0000 7f3c10ff9700 1 -- 172.21.15.37:0/2816999525 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c0c014480 con 0x7f3c1415c460 2023-07-12T02:05:36.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.192+0000 7f3c10ff9700 1 --2- 172.21.15.37:0/2816999525 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3bf406ace0 0x7f3bf406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:36.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.192+0000 7f3c10ff9700 1 -- 172.21.15.37:0/2816999525 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f3c0c089a90 con 0x7f3c1415c460 2023-07-12T02:05:36.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.192+0000 7f3c137fe700 1 --2- 172.21.15.37:0/2816999525 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3bf406ace0 0x7f3bf406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:36.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.193+0000 7f3c137fe700 1 --2- 172.21.15.37:0/2816999525 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3bf406ace0 0x7f3bf406d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c04014040 tx=0x7f3c04008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:36.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.197+0000 7f3c10ff9700 1 -- 172.21.15.37:0/2816999525 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3c0c054cb0 con 0x7f3c1415c460 2023-07-12T02:05:36.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.484+0000 7f3c19dff700 1 -- 172.21.15.37:0/2816999525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f3c140b4fa0 con 0x7f3c1415c460 2023-07-12T02:05:36.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.488+0000 7f3c10ff9700 1 -- 172.21.15.37:0/2816999525 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3c0c0180a0 con 0x7f3c1415c460 2023-07-12T02:05:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.491+0000 7f3c19dff700 1 -- 172.21.15.37:0/2816999525 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3bf406ace0 msgr2=0x7f3bf406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.491+0000 7f3c19dff700 1 --2- 172.21.15.37:0/2816999525 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3bf406ace0 0x7f3bf406d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c04014040 tx=0x7f3c04008030 comp rx=0 tx=0).stop 2023-07-12T02:05:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.491+0000 7f3c19dff700 1 -- 172.21.15.37:0/2816999525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c1415c460 msgr2=0x7f3c14157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.491+0000 7f3c19dff700 1 --2- 172.21.15.37:0/2816999525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c1415c460 0x7f3c14157f10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00efc0 tx=0x7f3c0c00c0c0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.491+0000 7f3c19dff700 1 -- 172.21.15.37:0/2816999525 shutdown_connections 2023-07-12T02:05:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.491+0000 7f3c19dff700 1 --2- 172.21.15.37:0/2816999525 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f3bf406ace0 0x7f3bf406d190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.491+0000 7f3c19dff700 1 --2- 172.21.15.37:0/2816999525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c1415c460 0x7f3c14157f10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.491+0000 7f3c19dff700 1 --2- 172.21.15.37:0/2816999525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c140cf8f0 0x7f3c140cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.491+0000 7f3c19dff700 1 --2- 172.21.15.37:0/2816999525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c140d2640 0x7f3c141579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.491+0000 7f3c19dff700 1 -- 172.21.15.37:0/2816999525 >> 172.21.15.37:0/2816999525 conn(0x7f3c14071660 msgr2=0x7f3c1415c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.491+0000 7f3c19dff700 1 -- 172.21.15.37:0/2816999525 shutdown_connections 2023-07-12T02:05:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.491+0000 7f3c19dff700 1 -- 172.21.15.37:0/2816999525 wait complete. 2023-07-12T02:05:36.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-12T02:05:36.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.711+0000 7f60ccbff700 1 Processor -- start 2023-07-12T02:05:36.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.711+0000 7f60ccbff700 1 -- start start 2023-07-12T02:05:36.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.712+0000 7f60ccbff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60c815c460 0x7f60c80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:36.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.712+0000 7f60ccbff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f60c80d2640 0x7f60c80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:36.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.712+0000 7f60ccbff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60c80cf720 0x7f60c80cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:36.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.712+0000 7f60ccbff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c80cedd0 con 0x7f60c815c460 2023-07-12T02:05:36.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.712+0000 7f60ccbff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c80d1790 con 0x7f60c80d2640 2023-07-12T02:05:36.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.712+0000 7f60ccbff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c80cd950 con 0x7f60c80cf720 2023-07-12T02:05:36.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.712+0000 7f60c659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60c815c460 0x7f60c80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:36.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.712+0000 7f60c659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60c815c460 0x7f60c80b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54510/0 (socket says 172.21.15.37:54510) 2023-07-12T02:05:36.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.712+0000 7f60c659c700 1 -- 172.21.15.37:0/4109226977 learned_addr learned my addr 172.21.15.37:0/4109226977 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:36.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.712+0000 7f60c6d9d700 1 --2- 172.21.15.37:0/4109226977 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60c80cf720 0x7f60c80cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:36.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.713+0000 7f60bffff700 1 --2- 172.21.15.37:0/4109226977 >> v2:172.21.15.196:3300/0 conn(0x7f60c80d2640 0x7f60c80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:36.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.713+0000 7f60c659c700 1 -- 172.21.15.37:0/4109226977 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60c80cf720 msgr2=0x7f60c80cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:36.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.713+0000 7f60c659c700 1 --2- 172.21.15.37:0/4109226977 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60c80cf720 0x7f60c80cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.713+0000 7f60c659c700 1 -- 172.21.15.37:0/4109226977 >> v2:172.21.15.196:3300/0 conn(0x7f60c80d2640 msgr2=0x7f60c80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.713+0000 7f60c659c700 1 --2- 172.21.15.37:0/4109226977 >> v2:172.21.15.196:3300/0 conn(0x7f60c80d2640 0x7f60c80cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.713+0000 7f60c659c700 1 -- 172.21.15.37:0/4109226977 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c80d14b0 con 0x7f60c815c460 2023-07-12T02:05:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.713+0000 7f60c659c700 1 --2- 172.21.15.37:0/4109226977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60c815c460 0x7f60c80b59d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f60c815fd80 tx=0x7f60b8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a0abeb506e9c17 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.713+0000 7f60c5d9b700 1 -- 172.21.15.37:0/4109226977 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b8011830 con 0x7f60c815c460 2023-07-12T02:05:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.713+0000 7f60c5d9b700 1 -- 172.21.15.37:0/4109226977 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b8011990 con 0x7f60c815c460 2023-07-12T02:05:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.713+0000 7f60c5d9b700 1 -- 172.21.15.37:0/4109226977 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b8011d20 con 0x7f60c815c460 2023-07-12T02:05:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.714+0000 7f60ccbff700 1 -- 172.21.15.37:0/4109226977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60c815c460 msgr2=0x7f60c80b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.714+0000 7f60ccbff700 1 --2- 172.21.15.37:0/4109226977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60c815c460 0x7f60c80b59d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f60c815fd80 tx=0x7f60b8009bd0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.714+0000 7f60ccbff700 1 -- 172.21.15.37:0/4109226977 shutdown_connections 2023-07-12T02:05:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.714+0000 7f60ccbff700 1 --2- 172.21.15.37:0/4109226977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60c815c460 0x7f60c80b59d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.714+0000 7f60ccbff700 1 --2- 172.21.15.37:0/4109226977 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60c80cf720 0x7f60c80cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.714+0000 7f60ccbff700 1 --2- 172.21.15.37:0/4109226977 >> v2:172.21.15.196:3300/0 conn(0x7f60c80d2640 0x7f60c80cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.714+0000 7f60ccbff700 1 -- 172.21.15.37:0/4109226977 >> 172.21.15.37:0/4109226977 conn(0x7f60c8071660 msgr2=0x7f60c8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.714+0000 7f60ccbff700 1 -- 172.21.15.37:0/4109226977 shutdown_connections 2023-07-12T02:05:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.714+0000 7f60ccbff700 1 -- 172.21.15.37:0/4109226977 wait complete. 2023-07-12T02:05:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.716+0000 7f60ccbff700 1 Processor -- start 2023-07-12T02:05:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.716+0000 7f60ccbff700 1 -- start start 2023-07-12T02:05:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.717+0000 7f60ccbff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60c80cf720 0x7f60c81e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.717+0000 7f60ccbff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60c80d2640 0x7f60c80cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.717+0000 7f60ccbff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60c815c460 0x7f60c8152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.717+0000 7f60ccbff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c81e6ee0 con 0x7f60c80d2640 2023-07-12T02:05:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.717+0000 7f60ccbff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c80cc6f0 con 0x7f60c80cf720 2023-07-12T02:05:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.717+0000 7f60ccbff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c81e62d0 con 0x7f60c815c460 2023-07-12T02:05:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.717+0000 7f60bffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60c80d2640 0x7f60c80cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.717+0000 7f60bffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60c80d2640 0x7f60c80cc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54512/0 (socket says 172.21.15.37:54512) 2023-07-12T02:05:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.717+0000 7f60bffff700 1 -- 172.21.15.37:0/1897870494 learned_addr learned my addr 172.21.15.37:0/1897870494 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.717+0000 7f60c659c700 1 --2- 172.21.15.37:0/1897870494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60c80cf720 0x7f60c81e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.717+0000 7f60c6d9d700 1 --2- 172.21.15.37:0/1897870494 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60c815c460 0x7f60c8152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.718+0000 7f60bffff700 1 -- 172.21.15.37:0/1897870494 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60c815c460 msgr2=0x7f60c8152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.718+0000 7f60bffff700 1 --2- 172.21.15.37:0/1897870494 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60c815c460 0x7f60c8152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.718+0000 7f60bffff700 1 -- 172.21.15.37:0/1897870494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60c80cf720 msgr2=0x7f60c81e5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.718+0000 7f60bffff700 1 --2- 172.21.15.37:0/1897870494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60c80cf720 0x7f60c81e5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.718+0000 7f60bffff700 1 -- 172.21.15.37:0/1897870494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b8009550 con 0x7f60c80d2640 2023-07-12T02:05:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.718+0000 7f60bffff700 1 --2- 172.21.15.37:0/1897870494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60c80d2640 0x7f60c80cc1b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f60b000d800 tx=0x7f60b000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.718+0000 7f60beffd700 1 -- 172.21.15.37:0/1897870494 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b00125f0 con 0x7f60c80d2640 2023-07-12T02:05:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.718+0000 7f60beffd700 1 -- 172.21.15.37:0/1897870494 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b0012750 con 0x7f60c80d2640 2023-07-12T02:05:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.718+0000 7f60ccbff700 1 -- 172.21.15.37:0/1897870494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c81e65b0 con 0x7f60c80d2640 2023-07-12T02:05:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.718+0000 7f60beffd700 1 -- 172.21.15.37:0/1897870494 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b0012b00 con 0x7f60c80d2640 2023-07-12T02:05:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.718+0000 7f60ccbff700 1 -- 172.21.15.37:0/1897870494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c81e6b70 con 0x7f60c80d2640 2023-07-12T02:05:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.719+0000 7f60ccbff700 1 -- 172.21.15.37:0/1897870494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c81e7050 con 0x7f60c80d2640 2023-07-12T02:05:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.720+0000 7f60beffd700 1 -- 172.21.15.37:0/1897870494 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f60b0012c60 con 0x7f60c80d2640 2023-07-12T02:05:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.722+0000 7f60beffd700 1 --2- 172.21.15.37:0/1897870494 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f60a806ace0 0x7f60a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.722+0000 7f60beffd700 1 -- 172.21.15.37:0/1897870494 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f60b0089350 con 0x7f60c80d2640 2023-07-12T02:05:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.722+0000 7f60c659c700 1 --2- 172.21.15.37:0/1897870494 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f60a806ace0 0x7f60a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:36.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.723+0000 7f60c659c700 1 --2- 172.21.15.37:0/1897870494 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f60a806ace0 0x7f60a806d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f60b8014040 tx=0x7f60b8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:36.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:36.726+0000 7f60beffd700 1 -- 172.21.15.37:0/1897870494 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f60b0054570 con 0x7f60c80d2640 2023-07-12T02:05:37.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.015+0000 7f60ccbff700 1 -- 172.21.15.37:0/1897870494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f60c804ea60 con 0x7f60c80d2640 2023-07-12T02:05:37.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.018+0000 7f60beffd700 1 -- 172.21.15.37:0/1897870494 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f60b0057b90 con 0x7f60c80d2640 2023-07-12T02:05:37.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.021+0000 7f60ccbff700 1 -- 172.21.15.37:0/1897870494 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f60a806ace0 msgr2=0x7f60a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:37.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.021+0000 7f60ccbff700 1 --2- 172.21.15.37:0/1897870494 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f60a806ace0 0x7f60a806d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f60b8014040 tx=0x7f60b8008030 comp rx=0 tx=0).stop 2023-07-12T02:05:37.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.021+0000 7f60ccbff700 1 -- 172.21.15.37:0/1897870494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60c80d2640 msgr2=0x7f60c80cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:37.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.021+0000 7f60ccbff700 1 --2- 172.21.15.37:0/1897870494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60c80d2640 0x7f60c80cc1b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f60b000d800 tx=0x7f60b000db10 comp rx=0 tx=0).stop 2023-07-12T02:05:37.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.021+0000 7f60ccbff700 1 -- 172.21.15.37:0/1897870494 shutdown_connections 2023-07-12T02:05:37.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.021+0000 7f60ccbff700 1 --2- 172.21.15.37:0/1897870494 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f60a806ace0 0x7f60a806d190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.021+0000 7f60ccbff700 1 --2- 172.21.15.37:0/1897870494 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60c815c460 0x7f60c8152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.021+0000 7f60ccbff700 1 --2- 172.21.15.37:0/1897870494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60c80cf720 0x7f60c81e5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.021+0000 7f60ccbff700 1 --2- 172.21.15.37:0/1897870494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60c80d2640 0x7f60c80cc1b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.021+0000 7f60ccbff700 1 -- 172.21.15.37:0/1897870494 >> 172.21.15.37:0/1897870494 conn(0x7f60c8071660 msgr2=0x7f60c80b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.021+0000 7f60ccbff700 1 -- 172.21.15.37:0/1897870494 shutdown_connections 2023-07-12T02:05:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.021+0000 7f60ccbff700 1 -- 172.21.15.37:0/1897870494 wait complete. 2023-07-12T02:05:37.043 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:05:37.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.240+0000 7fd4549ff700 1 Processor -- start 2023-07-12T02:05:37.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.240+0000 7fd4549ff700 1 -- start start 2023-07-12T02:05:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.241+0000 7fd4549ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd45015fe00 0x7fd4500cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.241+0000 7fd4549ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4500d0dd0 0x7fd4500d1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.241+0000 7fd4549ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4500cd120 con 0x7fd4501601d0 2023-07-12T02:05:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.241+0000 7fd4549ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4500cd930 con 0x7fd4500d0dd0 2023-07-12T02:05:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.241+0000 7fd4549ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4500d06a0 con 0x7fd45015fe00 2023-07-12T02:05:37.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.242+0000 7fd44ed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4500d0dd0 0x7fd4500d1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:37.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.242+0000 7fd44ed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4500d0dd0 0x7fd4500d1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54516/0 (socket says 172.21.15.37:54516) 2023-07-12T02:05:37.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.242+0000 7fd44ed9d700 1 -- 172.21.15.37:0/1684584319 learned_addr learned my addr 172.21.15.37:0/1684584319 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:37.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.242+0000 7fd44e59c700 1 --2- 172.21.15.37:0/1684584319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd45015fe00 0x7fd4500cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:37.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.242+0000 7fd44ed9d700 1 -- 172.21.15.37:0/1684584319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd45015fe00 msgr2=0x7fd4500cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:37.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.242+0000 7fd44ed9d700 1 --2- 172.21.15.37:0/1684584319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd45015fe00 0x7fd4500cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.242+0000 7fd44ed9d700 1 -- 172.21.15.37:0/1684584319 >> v1:172.21.15.196:6789/0 conn(0x7fd4501601d0 legacy=0x7fd450160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:37.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.242+0000 7fd44ed9d700 1 -- 172.21.15.37:0/1684584319 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4500d0940 con 0x7fd4500d0dd0 2023-07-12T02:05:37.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.242+0000 7fd44ed9d700 1 --2- 172.21.15.37:0/1684584319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500d0dd0 0x7fd4500d1250 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd448009e50 tx=0x7fd44800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78d5845630ae4a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:37.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.243+0000 7fd44dd9b700 1 -- 172.21.15.37:0/1684584319 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44800e070 con 0x7fd4500d0dd0 2023-07-12T02:05:37.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.243+0000 7fd44dd9b700 1 -- 172.21.15.37:0/1684584319 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd448003a70 con 0x7fd4500d0dd0 2023-07-12T02:05:37.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.243+0000 7fd44dd9b700 1 -- 172.21.15.37:0/1684584319 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448003e20 con 0x7fd4500d0dd0 2023-07-12T02:05:37.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.243+0000 7fd4549ff700 1 -- 172.21.15.37:0/1684584319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500d0dd0 msgr2=0x7fd4500d1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:37.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.243+0000 7fd4549ff700 1 --2- 172.21.15.37:0/1684584319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500d0dd0 0x7fd4500d1250 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd448009e50 tx=0x7fd44800b330 comp rx=0 tx=0).stop 2023-07-12T02:05:37.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.243+0000 7fd4549ff700 1 -- 172.21.15.37:0/1684584319 shutdown_connections 2023-07-12T02:05:37.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.243+0000 7fd4549ff700 1 --2- 172.21.15.37:0/1684584319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd45015fe00 0x7fd4500cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.243+0000 7fd4549ff700 1 --2- 172.21.15.37:0/1684584319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500d0dd0 0x7fd4500d1250 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.243+0000 7fd4549ff700 1 -- 172.21.15.37:0/1684584319 >> 172.21.15.37:0/1684584319 conn(0x7fd450071660 msgr2=0x7fd450071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:37.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.243+0000 7fd4549ff700 1 -- 172.21.15.37:0/1684584319 shutdown_connections 2023-07-12T02:05:37.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.243+0000 7fd4549ff700 1 -- 172.21.15.37:0/1684584319 wait complete. 2023-07-12T02:05:37.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.245+0000 7fd4549ff700 1 Processor -- start 2023-07-12T02:05:37.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.245+0000 7fd4549ff700 1 -- start start 2023-07-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.246+0000 7fd4549ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500d0dd0 0x7fd45015c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.246+0000 7fd4549ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd45015fe00 0x7fd4501512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.246+0000 7fd4549ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd4501601d0 0x7fd4500c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.246+0000 7fd4549ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4500c7930 con 0x7fd4500d0dd0 2023-07-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.246+0000 7fd4549ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45015da60 con 0x7fd45015fe00 2023-07-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.246+0000 7fd4549ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45015cee0 con 0x7fd4501601d0 2023-07-12T02:05:37.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.246+0000 7fd44e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500d0dd0 0x7fd45015c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.246+0000 7fd44e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500d0dd0 0x7fd45015c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54526/0 (socket says 172.21.15.37:54526) 2023-07-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.246+0000 7fd44e59c700 1 -- 172.21.15.37:0/3489418233 learned_addr learned my addr 172.21.15.37:0/3489418233 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.247+0000 7fd44ed9d700 1 --2- 172.21.15.37:0/3489418233 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd4501601d0 0x7fd4500c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.247+0000 7fd447fff700 1 --2- 172.21.15.37:0/3489418233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd45015fe00 0x7fd4501512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.247+0000 7fd44e59c700 1 -- 172.21.15.37:0/3489418233 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd4501601d0 msgr2=0x7fd4500c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.247+0000 7fd44e59c700 1 --2- 172.21.15.37:0/3489418233 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd4501601d0 0x7fd4500c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.247+0000 7fd44e59c700 1 -- 172.21.15.37:0/3489418233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd45015fe00 msgr2=0x7fd4501512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:37.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.247+0000 7fd44e59c700 1 --2- 172.21.15.37:0/3489418233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd45015fe00 0x7fd4501512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.247+0000 7fd44e59c700 1 -- 172.21.15.37:0/3489418233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd448009b30 con 0x7fd4500d0dd0 2023-07-12T02:05:37.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.247+0000 7fd44e59c700 1 --2- 172.21.15.37:0/3489418233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500d0dd0 0x7fd45015c900 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd44000d830 tx=0x7fd44000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.247+0000 7fd446ffd700 1 -- 172.21.15.37:0/3489418233 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4400125f0 con 0x7fd4500d0dd0 2023-07-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.248+0000 7fd446ffd700 1 -- 172.21.15.37:0/3489418233 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd440012750 con 0x7fd4500d0dd0 2023-07-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.248+0000 7fd446ffd700 1 -- 172.21.15.37:0/3489418233 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440012b00 con 0x7fd4500d0dd0 2023-07-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.248+0000 7fd4549ff700 1 -- 172.21.15.37:0/3489418233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45015d1c0 con 0x7fd4500d0dd0 2023-07-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.248+0000 7fd4549ff700 1 -- 172.21.15.37:0/3489418233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45015d780 con 0x7fd4500d0dd0 2023-07-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.249+0000 7fd4549ff700 1 -- 172.21.15.37:0/3489418233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45015e290 con 0x7fd4500d0dd0 2023-07-12T02:05:37.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.250+0000 7fd446ffd700 1 -- 172.21.15.37:0/3489418233 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd440012c60 con 0x7fd4500d0dd0 2023-07-12T02:05:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.251+0000 7fd446ffd700 1 --2- 172.21.15.37:0/3489418233 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd43006ace0 0x7fd43006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.251+0000 7fd446ffd700 1 -- 172.21.15.37:0/3489418233 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd440089310 con 0x7fd4500d0dd0 2023-07-12T02:05:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.251+0000 7fd447fff700 1 --2- 172.21.15.37:0/3489418233 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd43006ace0 0x7fd43006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.252+0000 7fd447fff700 1 --2- 172.21.15.37:0/3489418233 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd43006ace0 0x7fd43006d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd4500d3130 tx=0x7fd4380090e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:37.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.255+0000 7fd446ffd700 1 -- 172.21.15.37:0/3489418233 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd4400545c0 con 0x7fd4500d0dd0 2023-07-12T02:05:37.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.464+0000 7fd4549ff700 1 -- 172.21.15.37:0/3489418233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd45004ea60 con 0x7fd4500d0dd0 2023-07-12T02:05:37.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.465+0000 7fd446ffd700 1 -- 172.21.15.37:0/3489418233 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+14796 (secure 0 0 0) 0x7fd440057be0 con 0x7fd4500d0dd0 2023-07-12T02:05:37.469 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:37.469 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":37,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:05:33.281823+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:05:37.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.468+0000 7fd4549ff700 1 -- 172.21.15.37:0/3489418233 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd43006ace0 msgr2=0x7fd43006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:37.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.468+0000 7fd4549ff700 1 --2- 172.21.15.37:0/3489418233 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd43006ace0 0x7fd43006d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd4500d3130 tx=0x7fd4380090e0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.468+0000 7fd4549ff700 1 -- 172.21.15.37:0/3489418233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500d0dd0 msgr2=0x7fd45015c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:37.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.468+0000 7fd4549ff700 1 --2- 172.21.15.37:0/3489418233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500d0dd0 0x7fd45015c900 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd44000d830 tx=0x7fd44000db40 comp rx=0 tx=0).stop 2023-07-12T02:05:37.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.468+0000 7fd4549ff700 1 -- 172.21.15.37:0/3489418233 shutdown_connections 2023-07-12T02:05:37.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.468+0000 7fd4549ff700 1 --2- 172.21.15.37:0/3489418233 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fd43006ace0 0x7fd43006d190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.468+0000 7fd4549ff700 1 --2- 172.21.15.37:0/3489418233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500d0dd0 0x7fd45015c900 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.468+0000 7fd4549ff700 1 --2- 172.21.15.37:0/3489418233 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd4501601d0 0x7fd4500c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.468+0000 7fd4549ff700 1 --2- 172.21.15.37:0/3489418233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd45015fe00 0x7fd4501512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.468+0000 7fd4549ff700 1 -- 172.21.15.37:0/3489418233 >> 172.21.15.37:0/3489418233 conn(0x7fd450071660 msgr2=0x7fd450160640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:37.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.468+0000 7fd4549ff700 1 -- 172.21.15.37:0/3489418233 shutdown_connections 2023-07-12T02:05:37.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.468+0000 7fd4549ff700 1 -- 172.21.15.37:0/3489418233 wait complete. 2023-07-12T02:05:37.489 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-12T02:05:37.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:05:37.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.689+0000 7fac62dff700 1 Processor -- start 2023-07-12T02:05:37.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.689+0000 7fac62dff700 1 -- start start 2023-07-12T02:05:37.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.690+0000 7fac62dff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fac5c0d3730 0x7fac5c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.690+0000 7fac62dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0cfa90 0x7fac5c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.690+0000 7fac62dff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5c0d0b20 con 0x7fac5c0b8430 2023-07-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.690+0000 7fac62dff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c0cda30 con 0x7fac5c0d3730 2023-07-12T02:05:37.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.690+0000 7fac62dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0b8800 con 0x7fac5c0cfa90 2023-07-12T02:05:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.691+0000 7fac6139c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0cfa90 0x7fac5c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.691+0000 7fac5bfff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fac5c0d3730 0x7fac5c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.691+0000 7fac6139c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0cfa90 0x7fac5c0d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:44714/0 (socket says 172.21.15.37:44714) 2023-07-12T02:05:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.691+0000 7fac6139c700 1 -- 172.21.15.37:0/1487223561 learned_addr learned my addr 172.21.15.37:0/1487223561 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.691+0000 7fac6139c700 1 -- 172.21.15.37:0/1487223561 >> v2:172.21.15.196:3300/0 conn(0x7fac5c0d3730 msgr2=0x7fac5c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.691+0000 7fac6139c700 1 --2- 172.21.15.37:0/1487223561 >> v2:172.21.15.196:3300/0 conn(0x7fac5c0d3730 0x7fac5c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.691+0000 7fac6139c700 1 -- 172.21.15.37:0/1487223561 >> v1:172.21.15.196:6789/0 conn(0x7fac5c0b8430 legacy=0x7fac5c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.691+0000 7fac6139c700 1 -- 172.21.15.37:0/1487223561 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c0cfeb0 con 0x7fac5c0cfa90 2023-07-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.691+0000 7fac5bfff700 1 --2- 172.21.15.37:0/1487223561 >> v2:172.21.15.196:3300/0 conn(0x7fac5c0d3730 0x7fac5c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.691+0000 7fac5b7fe700 1 -- 172.21.15.37:0/1487223561 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844172429 0 0) 0x7fac5c0d0b20 con 0x7fac5c0b8430 2023-07-12T02:05:37.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.692+0000 7fac6139c700 1 --2- 172.21.15.37:0/1487223561 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0cfa90 0x7fac5c0d0fb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fac540098f0 tx=0x7fac54009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da90bae53d7ce786 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:37.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.692+0000 7fac5b7fe700 1 -- 172.21.15.37:0/1487223561 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54011830 con 0x7fac5c0cfa90 2023-07-12T02:05:37.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.692+0000 7fac5b7fe700 1 -- 172.21.15.37:0/1487223561 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac54011990 con 0x7fac5c0cfa90 2023-07-12T02:05:37.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.692+0000 7fac5b7fe700 1 -- 172.21.15.37:0/1487223561 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54011d20 con 0x7fac5c0cfa90 2023-07-12T02:05:37.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.693+0000 7fac62dff700 1 -- 172.21.15.37:0/1487223561 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0cfa90 msgr2=0x7fac5c0d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:37.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.693+0000 7fac62dff700 1 --2- 172.21.15.37:0/1487223561 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0cfa90 0x7fac5c0d0fb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fac540098f0 tx=0x7fac54009c00 comp rx=0 tx=0).stop 2023-07-12T02:05:37.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.693+0000 7fac62dff700 1 -- 172.21.15.37:0/1487223561 shutdown_connections 2023-07-12T02:05:37.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.693+0000 7fac62dff700 1 --2- 172.21.15.37:0/1487223561 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0cfa90 0x7fac5c0d0fb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.693+0000 7fac62dff700 1 --2- 172.21.15.37:0/1487223561 >> v2:172.21.15.196:3300/0 conn(0x7fac5c0d3730 0x7fac5c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.693+0000 7fac62dff700 1 -- 172.21.15.37:0/1487223561 >> 172.21.15.37:0/1487223561 conn(0x7fac5c06b3f0 msgr2=0x7fac5c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:37.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.693+0000 7fac62dff700 1 -- 172.21.15.37:0/1487223561 shutdown_connections 2023-07-12T02:05:37.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.693+0000 7fac62dff700 1 -- 172.21.15.37:0/1487223561 wait complete. 2023-07-12T02:05:37.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.695+0000 7fac62dff700 1 Processor -- start 2023-07-12T02:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.695+0000 7fac62dff700 1 -- start start 2023-07-12T02:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.696+0000 7fac62dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0b8430 0x7fac5c1516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.696+0000 7fac62dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac5c0cfa90 0x7fac5c15d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.696+0000 7fac62dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5c0d3730 0x7fac5c0b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.696+0000 7fac62dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c15ebf0 con 0x7fac5c0d3730 2023-07-12T02:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.696+0000 7fac62dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c15e630 con 0x7fac5c0cfa90 2023-07-12T02:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.696+0000 7fac62dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c15e910 con 0x7fac5c0b8430 2023-07-12T02:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.696+0000 7fac6139c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5c0d3730 0x7fac5c0b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.696+0000 7fac6139c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5c0d3730 0x7fac5c0b6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54542/0 (socket says 172.21.15.37:54542) 2023-07-12T02:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.696+0000 7fac6139c700 1 -- 172.21.15.37:0/317439160 learned_addr learned my addr 172.21.15.37:0/317439160 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.696+0000 7fac60b9b700 1 --2- 172.21.15.37:0/317439160 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0b8430 0x7fac5c1516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.696+0000 7fac5bfff700 1 --2- 172.21.15.37:0/317439160 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac5c0cfa90 0x7fac5c15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.696+0000 7fac6139c700 1 -- 172.21.15.37:0/317439160 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0b8430 msgr2=0x7fac5c1516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.696+0000 7fac6139c700 1 --2- 172.21.15.37:0/317439160 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0b8430 0x7fac5c1516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.696+0000 7fac6139c700 1 -- 172.21.15.37:0/317439160 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac5c0cfa90 msgr2=0x7fac5c15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.696+0000 7fac6139c700 1 --2- 172.21.15.37:0/317439160 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac5c0cfa90 0x7fac5c15d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.696+0000 7fac6139c700 1 -- 172.21.15.37:0/317439160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac480094a0 con 0x7fac5c0d3730 2023-07-12T02:05:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.697+0000 7fac6139c700 1 --2- 172.21.15.37:0/317439160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5c0d3730 0x7fac5c0b6ab0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0cd120 tx=0x7fac54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.697+0000 7fac597fa700 1 -- 172.21.15.37:0/317439160 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54004380 con 0x7fac5c0d3730 2023-07-12T02:05:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.697+0000 7fac597fa700 1 -- 172.21.15.37:0/317439160 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5401f070 con 0x7fac5c0d3730 2023-07-12T02:05:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.697+0000 7fac62dff700 1 -- 172.21.15.37:0/317439160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac54009550 con 0x7fac5c0d3730 2023-07-12T02:05:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.697+0000 7fac597fa700 1 -- 172.21.15.37:0/317439160 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac540036a0 con 0x7fac5c0d3730 2023-07-12T02:05:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.697+0000 7fac62dff700 1 -- 172.21.15.37:0/317439160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5c0c7a40 con 0x7fac5c0d3730 2023-07-12T02:05:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.698+0000 7fac62dff700 1 -- 172.21.15.37:0/317439160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5c0c7c30 con 0x7fac5c0d3730 2023-07-12T02:05:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.699+0000 7fac597fa700 1 -- 172.21.15.37:0/317439160 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac54021030 con 0x7fac5c0d3730 2023-07-12T02:05:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.701+0000 7fac597fa700 1 --2- 172.21.15.37:0/317439160 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fac4006ace0 0x7fac4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.701+0000 7fac597fa700 1 -- 172.21.15.37:0/317439160 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fac5408a5c0 con 0x7fac5c0d3730 2023-07-12T02:05:37.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.701+0000 7fac60b9b700 1 --2- 172.21.15.37:0/317439160 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fac4006ace0 0x7fac4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:37.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.702+0000 7fac60b9b700 1 --2- 172.21.15.37:0/317439160 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fac4006ace0 0x7fac4006d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fac500012e0 tx=0x7fac50009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:37.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.705+0000 7fac597fa700 1 -- 172.21.15.37:0/317439160 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fac54055990 con 0x7fac5c0d3730 2023-07-12T02:05:37.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.910+0000 7fac62dff700 1 -- 172.21.15.37:0/317439160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac5c04ea60 con 0x7fac5c0d3730 2023-07-12T02:05:37.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.910+0000 7fac597fa700 1 -- 172.21.15.37:0/317439160 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac54058fb0 con 0x7fac5c0d3730 2023-07-12T02:05:37.914 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:05:37.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.913+0000 7fac62dff700 1 -- 172.21.15.37:0/317439160 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fac4006ace0 msgr2=0x7fac4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:37.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.913+0000 7fac62dff700 1 --2- 172.21.15.37:0/317439160 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fac4006ace0 0x7fac4006d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fac500012e0 tx=0x7fac50009040 comp rx=0 tx=0).stop 2023-07-12T02:05:37.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.913+0000 7fac62dff700 1 -- 172.21.15.37:0/317439160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5c0d3730 msgr2=0x7fac5c0b6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:37.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.913+0000 7fac62dff700 1 --2- 172.21.15.37:0/317439160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5c0d3730 0x7fac5c0b6ab0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0cd120 tx=0x7fac54004750 comp rx=0 tx=0).stop 2023-07-12T02:05:37.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.913+0000 7fac62dff700 1 -- 172.21.15.37:0/317439160 shutdown_connections 2023-07-12T02:05:37.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.913+0000 7fac62dff700 1 --2- 172.21.15.37:0/317439160 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fac4006ace0 0x7fac4006d190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.913+0000 7fac62dff700 1 --2- 172.21.15.37:0/317439160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5c0d3730 0x7fac5c0b6ab0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.913+0000 7fac62dff700 1 --2- 172.21.15.37:0/317439160 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0b8430 0x7fac5c1516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.913+0000 7fac62dff700 1 --2- 172.21.15.37:0/317439160 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac5c0cfa90 0x7fac5c15d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:37.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.913+0000 7fac62dff700 1 -- 172.21.15.37:0/317439160 >> 172.21.15.37:0/317439160 conn(0x7fac5c06b3f0 msgr2=0x7fac5c15bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:37.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.913+0000 7fac62dff700 1 -- 172.21.15.37:0/317439160 shutdown_connections 2023-07-12T02:05:37.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:37.913+0000 7fac62dff700 1 -- 172.21.15.37:0/317439160 wait complete. 2023-07-12T02:05:37.934 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:05:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.136+0000 7f475f7ff700 1 Processor -- start 2023-07-12T02:05:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.136+0000 7f475f7ff700 1 -- start start 2023-07-12T02:05:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.137+0000 7f475f7ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f47580b8430 0x7f47580cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.137+0000 7f475f7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47580d0b20 con 0x7f47580d3730 2023-07-12T02:05:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.137+0000 7f475f7ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47580b4ee0 con 0x7f47580cfc60 2023-07-12T02:05:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.137+0000 7f475f7ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47580b8800 con 0x7f47580b8430 2023-07-12T02:05:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.137+0000 7f475cd9a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f47580d3730 0x7f47580cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38168/0 (socket says 172.21.15.37:38168) 2023-07-12T02:05:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.137+0000 7f475cd9a700 1 -- 172.21.15.37:0/1502365641 learned_addr learned my addr 172.21.15.37:0/1502365641 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.137+0000 7f475d59b700 1 --2- 172.21.15.37:0/1502365641 >> v2:172.21.15.196:3300/0 conn(0x7f47580b8430 0x7f47580cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.138+0000 7f474ffff700 1 -- 172.21.15.37:0/1502365641 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701629046 0 0) 0x7f47580d0b20 con 0x7f47580d3730 2023-07-12T02:05:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.138+0000 7f474ffff700 1 -- 172.21.15.37:0/1502365641 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47440035b0 con 0x7f47580d3730 2023-07-12T02:05:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.138+0000 7f474ffff700 1 -- 172.21.15.37:0/1502365641 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225640369 0 0) 0x7f47580b4ee0 con 0x7f47580cfc60 2023-07-12T02:05:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.138+0000 7f474ffff700 1 -- 172.21.15.37:0/1502365641 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47580d0b20 con 0x7f47580cfc60 2023-07-12T02:05:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.138+0000 7f475d59b700 1 -- 172.21.15.37:0/1502365641 >> v1:172.21.15.196:6789/0 conn(0x7f47580cfc60 legacy=0x7f47580d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.138+0000 7f475d59b700 1 -- 172.21.15.37:0/1502365641 >> v1:172.21.15.37:6789/0 conn(0x7f47580d3730 legacy=0x7f47580cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.138+0000 7f475d59b700 1 -- 172.21.15.37:0/1502365641 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47580b51c0 con 0x7f47580b8430 2023-07-12T02:05:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.138+0000 7f475d59b700 1 --2- 172.21.15.37:0/1502365641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47580b8430 0x7f47580cd320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4754009840 tx=0x7f4754009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e359cdaf2c39bced server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.139+0000 7f474ffff700 1 -- 172.21.15.37:0/1502365641 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754011830 con 0x7f47580b8430 2023-07-12T02:05:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.139+0000 7f474ffff700 1 -- 172.21.15.37:0/1502365641 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4754011990 con 0x7f47580b8430 2023-07-12T02:05:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.139+0000 7f474ffff700 1 -- 172.21.15.37:0/1502365641 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754011d00 con 0x7f47580b8430 2023-07-12T02:05:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.139+0000 7f475f7ff700 1 -- 172.21.15.37:0/1502365641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47580b8430 msgr2=0x7f47580cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.139+0000 7f475f7ff700 1 --2- 172.21.15.37:0/1502365641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47580b8430 0x7f47580cd320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4754009840 tx=0x7f4754009b50 comp rx=0 tx=0).stop 2023-07-12T02:05:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.139+0000 7f475f7ff700 1 -- 172.21.15.37:0/1502365641 shutdown_connections 2023-07-12T02:05:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.139+0000 7f475f7ff700 1 --2- 172.21.15.37:0/1502365641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47580b8430 0x7f47580cd320 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.139+0000 7f475f7ff700 1 -- 172.21.15.37:0/1502365641 >> 172.21.15.37:0/1502365641 conn(0x7f475806b3f0 msgr2=0x7f475806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.139+0000 7f475f7ff700 1 -- 172.21.15.37:0/1502365641 shutdown_connections 2023-07-12T02:05:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.139+0000 7f475f7ff700 1 -- 172.21.15.37:0/1502365641 wait complete. 2023-07-12T02:05:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.141+0000 7f475f7ff700 1 Processor -- start 2023-07-12T02:05:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.141+0000 7f475f7ff700 1 -- start start 2023-07-12T02:05:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.142+0000 7f475f7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47580b8430 0x7f47580c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.142+0000 7f475f7ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47580cfc60 0x7f475815e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.142+0000 7f475f7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47580d3730 0x7f4758159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.142+0000 7f475f7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47580ca550 con 0x7f47580d3730 2023-07-12T02:05:38.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.142+0000 7f475f7ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47580c9cb0 con 0x7f47580cfc60 2023-07-12T02:05:38.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.142+0000 7f475f7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47580c9f90 con 0x7f47580b8430 2023-07-12T02:05:38.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.143+0000 7f475dd9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47580d3730 0x7f4758159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:38.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.143+0000 7f475dd9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47580d3730 0x7f4758159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54558/0 (socket says 172.21.15.37:54558) 2023-07-12T02:05:38.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.143+0000 7f475dd9c700 1 -- 172.21.15.37:0/2052428844 learned_addr learned my addr 172.21.15.37:0/2052428844 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:38.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.143+0000 7f475d59b700 1 --2- 172.21.15.37:0/2052428844 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47580b8430 0x7f47580c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:38.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.143+0000 7f475cd9a700 1 --2- 172.21.15.37:0/2052428844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47580cfc60 0x7f475815e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:38.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.143+0000 7f475dd9c700 1 -- 172.21.15.37:0/2052428844 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47580b8430 msgr2=0x7f47580c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:38.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.143+0000 7f475dd9c700 1 --2- 172.21.15.37:0/2052428844 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47580b8430 0x7f47580c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:38.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.143+0000 7f475dd9c700 1 -- 172.21.15.37:0/2052428844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47580cfc60 msgr2=0x7f475815e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:38.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.143+0000 7f475dd9c700 1 --2- 172.21.15.37:0/2052428844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47580cfc60 0x7f475815e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:38.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.143+0000 7f475dd9c700 1 -- 172.21.15.37:0/2052428844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47540094a0 con 0x7f47580d3730 2023-07-12T02:05:38.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.143+0000 7f475dd9c700 1 --2- 172.21.15.37:0/2052428844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47580d3730 0x7f4758159cb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f475000cc20 tx=0x7f475000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:38.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.144+0000 7f474dffb700 1 -- 172.21.15.37:0/2052428844 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750003c00 con 0x7f47580d3730 2023-07-12T02:05:38.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.144+0000 7f474dffb700 1 -- 172.21.15.37:0/2052428844 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4750003d60 con 0x7f47580d3730 2023-07-12T02:05:38.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.144+0000 7f474dffb700 1 -- 172.21.15.37:0/2052428844 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475000aae0 con 0x7f47580d3730 2023-07-12T02:05:38.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.144+0000 7f475f7ff700 1 -- 172.21.15.37:0/2052428844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47580ca270 con 0x7f47580d3730 2023-07-12T02:05:38.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.144+0000 7f475f7ff700 1 -- 172.21.15.37:0/2052428844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475815e540 con 0x7f47580d3730 2023-07-12T02:05:38.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.145+0000 7f475f7ff700 1 -- 172.21.15.37:0/2052428844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475815dd20 con 0x7f47580d3730 2023-07-12T02:05:38.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.146+0000 7f474dffb700 1 -- 172.21.15.37:0/2052428844 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f475000ac40 con 0x7f47580d3730 2023-07-12T02:05:38.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.147+0000 7f474dffb700 1 --2- 172.21.15.37:0/2052428844 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f473c06ace0 0x7f473c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:38.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.147+0000 7f474dffb700 1 -- 172.21.15.37:0/2052428844 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f47500892e0 con 0x7f47580d3730 2023-07-12T02:05:38.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.148+0000 7f475d59b700 1 --2- 172.21.15.37:0/2052428844 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f473c06ace0 0x7f473c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:38.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.148+0000 7f475d59b700 1 --2- 172.21.15.37:0/2052428844 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f473c06ace0 0x7f473c06d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4754009b90 tx=0x7f475401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:38.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.152+0000 7f474dffb700 1 -- 172.21.15.37:0/2052428844 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f475815dd20 con 0x7f47580d3730 2023-07-12T02:05:38.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.359+0000 7f475f7ff700 1 -- 172.21.15.37:0/2052428844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f475815dd20 con 0x7f47580d3730 2023-07-12T02:05:38.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.360+0000 7f474dffb700 1 -- 172.21.15.37:0/2052428844 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f475815dd20 con 0x7f47580d3730 2023-07-12T02:05:38.364 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:05:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.362+0000 7f475f7ff700 1 -- 172.21.15.37:0/2052428844 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f473c06ace0 msgr2=0x7f473c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.362+0000 7f475f7ff700 1 --2- 172.21.15.37:0/2052428844 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f473c06ace0 0x7f473c06d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4754009b90 tx=0x7f475401c040 comp rx=0 tx=0).stop 2023-07-12T02:05:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.362+0000 7f475f7ff700 1 -- 172.21.15.37:0/2052428844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47580d3730 msgr2=0x7f4758159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.362+0000 7f475f7ff700 1 --2- 172.21.15.37:0/2052428844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47580d3730 0x7f4758159cb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f475000cc20 tx=0x7f475000cf30 comp rx=0 tx=0).stop 2023-07-12T02:05:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.362+0000 7f475f7ff700 1 -- 172.21.15.37:0/2052428844 shutdown_connections 2023-07-12T02:05:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.362+0000 7f475f7ff700 1 --2- 172.21.15.37:0/2052428844 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f473c06ace0 0x7f473c06d190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.362+0000 7f475f7ff700 1 --2- 172.21.15.37:0/2052428844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47580d3730 0x7f4758159cb0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.362+0000 7f475f7ff700 1 --2- 172.21.15.37:0/2052428844 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47580b8430 0x7f47580c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.362+0000 7f475f7ff700 1 --2- 172.21.15.37:0/2052428844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47580cfc60 0x7f475815e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.362+0000 7f475f7ff700 1 -- 172.21.15.37:0/2052428844 >> 172.21.15.37:0/2052428844 conn(0x7f475806b3f0 msgr2=0x7f475815ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.362+0000 7f475f7ff700 1 -- 172.21.15.37:0/2052428844 shutdown_connections 2023-07-12T02:05:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.362+0000 7f475f7ff700 1 -- 172.21.15.37:0/2052428844 wait complete. 2023-07-12T02:05:38.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-12T02:05:38.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.581+0000 7f87871ff700 1 Processor -- start 2023-07-12T02:05:38.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.581+0000 7f87871ff700 1 -- start start 2023-07-12T02:05:38.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.582+0000 7f87871ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f87800cfb90 0x7f8780167140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:38.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.582+0000 7f87871ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87800cd0c0 con 0x7f87800b8290 2023-07-12T02:05:38.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.582+0000 7f87871ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87800d2290 con 0x7f87800d1050 2023-07-12T02:05:38.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.582+0000 7f87871ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87800b58c0 con 0x7f87800cfb90 2023-07-12T02:05:38.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.583+0000 7f8784f9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f87800b8290 0x7f87800cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38182/0 (socket says 172.21.15.37:38182) 2023-07-12T02:05:38.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.583+0000 7f8784f9b700 1 -- 172.21.15.37:0/45525692 learned_addr learned my addr 172.21.15.37:0/45525692 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:38.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.583+0000 7f878579c700 1 --2- 172.21.15.37:0/45525692 >> v2:172.21.15.37:3300/0 conn(0x7f87800cfb90 0x7f8780167140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:38.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.583+0000 7f878579c700 1 -- 172.21.15.37:0/45525692 >> v1:172.21.15.196:6789/0 conn(0x7f87800d1050 legacy=0x7f87800cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:38.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.583+0000 7f878579c700 1 -- 172.21.15.37:0/45525692 >> v1:172.21.15.37:6789/0 conn(0x7f87800b8290 legacy=0x7f87800cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:38.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.583+0000 7f878579c700 1 -- 172.21.15.37:0/45525692 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87800b20f0 con 0x7f87800cfb90 2023-07-12T02:05:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.583+0000 7f878579c700 1 --2- 172.21.15.37:0/45525692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87800cfb90 0x7f8780167140 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8778009d90 tx=0x7f877800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ea8d0691f87514 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.584+0000 7f877f7fe700 1 -- 172.21.15.37:0/45525692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877800e070 con 0x7f87800cfb90 2023-07-12T02:05:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.584+0000 7f877f7fe700 1 -- 172.21.15.37:0/45525692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877800bbd0 con 0x7f87800cfb90 2023-07-12T02:05:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.584+0000 7f877f7fe700 1 -- 172.21.15.37:0/45525692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778012430 con 0x7f87800cfb90 2023-07-12T02:05:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.584+0000 7f87871ff700 1 -- 172.21.15.37:0/45525692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87800cfb90 msgr2=0x7f8780167140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.584+0000 7f87871ff700 1 --2- 172.21.15.37:0/45525692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87800cfb90 0x7f8780167140 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8778009d90 tx=0x7f877800b330 comp rx=0 tx=0).stop 2023-07-12T02:05:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.584+0000 7f87871ff700 1 -- 172.21.15.37:0/45525692 shutdown_connections 2023-07-12T02:05:38.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.584+0000 7f87871ff700 1 --2- 172.21.15.37:0/45525692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87800cfb90 0x7f8780167140 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:38.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.584+0000 7f87871ff700 1 -- 172.21.15.37:0/45525692 >> 172.21.15.37:0/45525692 conn(0x7f8780071660 msgr2=0x7f8780071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:38.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.584+0000 7f87871ff700 1 -- 172.21.15.37:0/45525692 shutdown_connections 2023-07-12T02:05:38.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.584+0000 7f87871ff700 1 -- 172.21.15.37:0/45525692 wait complete. 2023-07-12T02:05:38.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.586+0000 7f87871ff700 1 Processor -- start 2023-07-12T02:05:38.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.586+0000 7f87871ff700 1 -- start start 2023-07-12T02:05:38.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.587+0000 7f87871ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87800b8290 0x7f87801f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:38.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.587+0000 7f87871ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87800cfb90 0x7f878015e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.587+0000 7f87871ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87800d1050 0x7f8780153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.587+0000 7f87871ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878015e8c0 con 0x7f87800b8290 2023-07-12T02:05:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.587+0000 7f87871ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87800ca4f0 con 0x7f87800cfb90 2023-07-12T02:05:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.587+0000 7f87871ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87800c9be0 con 0x7f87800d1050 2023-07-12T02:05:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.588+0000 7f8784f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87800b8290 0x7f87801f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.588+0000 7f8784f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87800b8290 0x7f87801f5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54570/0 (socket says 172.21.15.37:54570) 2023-07-12T02:05:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.588+0000 7f8784f9b700 1 -- 172.21.15.37:0/914336712 learned_addr learned my addr 172.21.15.37:0/914336712 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.588+0000 7f878579c700 1 --2- 172.21.15.37:0/914336712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87800d1050 0x7f8780153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.588+0000 7f877ffff700 1 --2- 172.21.15.37:0/914336712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87800cfb90 0x7f878015e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:38.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.588+0000 7f8784f9b700 1 -- 172.21.15.37:0/914336712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87800d1050 msgr2=0x7f8780153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:38.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.588+0000 7f8784f9b700 1 --2- 172.21.15.37:0/914336712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87800d1050 0x7f8780153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:38.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.588+0000 7f8784f9b700 1 -- 172.21.15.37:0/914336712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87800cfb90 msgr2=0x7f878015e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:38.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.588+0000 7f8784f9b700 1 --2- 172.21.15.37:0/914336712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87800cfb90 0x7f878015e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:38.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.588+0000 7f8784f9b700 1 -- 172.21.15.37:0/914336712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778009a70 con 0x7f87800b8290 2023-07-12T02:05:38.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.588+0000 7f8784f9b700 1 --2- 172.21.15.37:0/914336712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87800b8290 0x7f87801f5ed0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f877400c520 tx=0x7f877400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:38.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.589+0000 7f877d7fa700 1 -- 172.21.15.37:0/914336712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774005d70 con 0x7f87800b8290 2023-07-12T02:05:38.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.589+0000 7f877d7fa700 1 -- 172.21.15.37:0/914336712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87740070d0 con 0x7f87800b8290 2023-07-12T02:05:38.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.589+0000 7f87871ff700 1 -- 172.21.15.37:0/914336712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87800c9ea0 con 0x7f87800b8290 2023-07-12T02:05:38.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.589+0000 7f877d7fa700 1 -- 172.21.15.37:0/914336712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774007440 con 0x7f87800b8290 2023-07-12T02:05:38.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.589+0000 7f87871ff700 1 -- 172.21.15.37:0/914336712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878015eaf0 con 0x7f87800b8290 2023-07-12T02:05:38.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.590+0000 7f87871ff700 1 -- 172.21.15.37:0/914336712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87800cd2f0 con 0x7f87800b8290 2023-07-12T02:05:38.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.591+0000 7f877d7fa700 1 -- 172.21.15.37:0/914336712 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f87740075a0 con 0x7f87800b8290 2023-07-12T02:05:38.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.592+0000 7f877d7fa700 1 --2- 172.21.15.37:0/914336712 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f876406ace0 0x7f876406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:38.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.592+0000 7f877d7fa700 1 -- 172.21.15.37:0/914336712 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8774088580 con 0x7f87800b8290 2023-07-12T02:05:38.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.592+0000 7f877ffff700 1 --2- 172.21.15.37:0/914336712 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f876406ace0 0x7f876406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:38.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.593+0000 7f877ffff700 1 --2- 172.21.15.37:0/914336712 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f876406ace0 0x7f876406d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f87800b17c0 tx=0x7f876c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:38.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.596+0000 7f877d7fa700 1 -- 172.21.15.37:0/914336712 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f87800cd2f0 con 0x7f87800b8290 2023-07-12T02:05:38.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.804+0000 7f87871ff700 1 -- 172.21.15.37:0/914336712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f87800cd2f0 con 0x7f87800b8290 2023-07-12T02:05:38.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.805+0000 7f877d7fa700 1 -- 172.21.15.37:0/914336712 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+126 (secure 0 0 0) 0x7f87800cd2f0 con 0x7f87800b8290 2023-07-12T02:05:38.809 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:38.809 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-12T02:05:38.809 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:38.809 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-07-12T02:05:38.809 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-07-12T02:05:38.810 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-12T02:05:38.810 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-12T02:05:38.810 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-07-12T02:05:38.810 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-07-12T02:05:38.810 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-12T02:05:38.810 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-12T02:05:38.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.807+0000 7f87871ff700 1 -- 172.21.15.37:0/914336712 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f876406ace0 msgr2=0x7f876406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:38.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.807+0000 7f87871ff700 1 --2- 172.21.15.37:0/914336712 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f876406ace0 0x7f876406d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f87800b17c0 tx=0x7f876c009040 comp rx=0 tx=0).stop 2023-07-12T02:05:38.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.807+0000 7f87871ff700 1 -- 172.21.15.37:0/914336712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87800b8290 msgr2=0x7f87801f5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:38.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.807+0000 7f87871ff700 1 --2- 172.21.15.37:0/914336712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87800b8290 0x7f87801f5ed0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f877400c520 tx=0x7f877400c830 comp rx=0 tx=0).stop 2023-07-12T02:05:38.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.807+0000 7f87871ff700 1 -- 172.21.15.37:0/914336712 shutdown_connections 2023-07-12T02:05:38.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.807+0000 7f87871ff700 1 --2- 172.21.15.37:0/914336712 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f876406ace0 0x7f876406d190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:38.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.807+0000 7f87871ff700 1 --2- 172.21.15.37:0/914336712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87800b8290 0x7f87801f5ed0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:38.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.807+0000 7f87871ff700 1 --2- 172.21.15.37:0/914336712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87800d1050 0x7f8780153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:38.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.807+0000 7f87871ff700 1 --2- 172.21.15.37:0/914336712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87800cfb90 0x7f878015e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:38.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.807+0000 7f87871ff700 1 -- 172.21.15.37:0/914336712 >> 172.21.15.37:0/914336712 conn(0x7f8780071660 msgr2=0x7f87800cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:38.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.807+0000 7f87871ff700 1 -- 172.21.15.37:0/914336712 shutdown_connections 2023-07-12T02:05:38.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:38.807+0000 7f87871ff700 1 -- 172.21.15.37:0/914336712 wait complete. 2023-07-12T02:05:38.828 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-12T02:05:38.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-12T02:05:39.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.030+0000 7efc043ff700 1 Processor -- start 2023-07-12T02:05:39.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.030+0000 7efc043ff700 1 -- start start 2023-07-12T02:05:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.031+0000 7efc043ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7efbfc0cd7d0 0x7efbfc159560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.031+0000 7efc043ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc15d240 con 0x7efbfc0adcd0 2023-07-12T02:05:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.031+0000 7efc043ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc0cb8b0 con 0x7efbfc156c50 2023-07-12T02:05:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.031+0000 7efc043ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbfc0cb6c0 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.031+0000 7efc0199a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efbfc0adcd0 0x7efbfc0cd0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38192/0 (socket says 172.21.15.37:38192) 2023-07-12T02:05:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.031+0000 7efc0199a700 1 -- 172.21.15.37:0/2471274561 learned_addr learned my addr 172.21.15.37:0/2471274561 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.032+0000 7efc0299c700 1 --2- 172.21.15.37:0/2471274561 >> v2:172.21.15.196:3300/0 conn(0x7efbfc0cd7d0 0x7efbfc159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.032+0000 7efc01199700 1 -- 172.21.15.37:0/2471274561 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267408914 0 0) 0x7efbfc15d240 con 0x7efbfc0adcd0 2023-07-12T02:05:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.032+0000 7efc01199700 1 -- 172.21.15.37:0/2471274561 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbe80057c0 con 0x7efbfc0adcd0 2023-07-12T02:05:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.032+0000 7efc01199700 1 -- 172.21.15.37:0/2471274561 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416555582 0 0) 0x7efbfc0cb8b0 con 0x7efbfc156c50 2023-07-12T02:05:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.032+0000 7efc01199700 1 -- 172.21.15.37:0/2471274561 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbfc15d240 con 0x7efbfc156c50 2023-07-12T02:05:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.032+0000 7efc0299c700 1 -- 172.21.15.37:0/2471274561 >> v1:172.21.15.196:6789/0 conn(0x7efbfc156c50 legacy=0x7efbfc0cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.032+0000 7efc0299c700 1 -- 172.21.15.37:0/2471274561 >> v1:172.21.15.37:6789/0 conn(0x7efbfc0adcd0 legacy=0x7efbfc0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.032+0000 7efc0299c700 1 -- 172.21.15.37:0/2471274561 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc0cbb90 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.033+0000 7efc0299c700 1 --2- 172.21.15.37:0/2471274561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efbfc0cd7d0 0x7efbfc159560 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009d90 tx=0x7efbf400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55d1bc1321e0ff1 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:39.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.033+0000 7efc01199700 1 -- 172.21.15.37:0/2471274561 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf400e070 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.033+0000 7efc01199700 1 -- 172.21.15.37:0/2471274561 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf400bb20 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.033+0000 7efc01199700 1 -- 172.21.15.37:0/2471274561 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4012430 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.033+0000 7efc043ff700 1 -- 172.21.15.37:0/2471274561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efbfc0cd7d0 msgr2=0x7efbfc159560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.033+0000 7efc043ff700 1 --2- 172.21.15.37:0/2471274561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efbfc0cd7d0 0x7efbfc159560 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009d90 tx=0x7efbf400b330 comp rx=0 tx=0).stop 2023-07-12T02:05:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.033+0000 7efc043ff700 1 -- 172.21.15.37:0/2471274561 shutdown_connections 2023-07-12T02:05:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.033+0000 7efc043ff700 1 --2- 172.21.15.37:0/2471274561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efbfc0cd7d0 0x7efbfc159560 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.033+0000 7efc043ff700 1 -- 172.21.15.37:0/2471274561 >> 172.21.15.37:0/2471274561 conn(0x7efbfc0b0390 msgr2=0x7efbfc0b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.034+0000 7efc043ff700 1 -- 172.21.15.37:0/2471274561 shutdown_connections 2023-07-12T02:05:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.034+0000 7efc043ff700 1 -- 172.21.15.37:0/2471274561 wait complete. 2023-07-12T02:05:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.035+0000 7efc043ff700 1 Processor -- start 2023-07-12T02:05:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.035+0000 7efc043ff700 1 -- start start 2023-07-12T02:05:39.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.036+0000 7efc043ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efbfc0adcd0 0x7efbfc152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:39.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.036+0000 7efc043ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbfc0cd7d0 0x7efbfc0b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.036+0000 7efc043ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efbfc156c50 0x7efbfc0ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.036+0000 7efc043ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc0b3830 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.036+0000 7efc043ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc0b3b10 con 0x7efbfc0adcd0 2023-07-12T02:05:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.036+0000 7efc043ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc0b3df0 con 0x7efbfc156c50 2023-07-12T02:05:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.037+0000 7efc0199a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbfc0cd7d0 0x7efbfc0b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.037+0000 7efc0199a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbfc0cd7d0 0x7efbfc0b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54582/0 (socket says 172.21.15.37:54582) 2023-07-12T02:05:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.037+0000 7efc0199a700 1 -- 172.21.15.37:0/731735892 learned_addr learned my addr 172.21.15.37:0/731735892 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.037+0000 7efc0299c700 1 --2- 172.21.15.37:0/731735892 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efbfc156c50 0x7efbfc0ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:39.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.037+0000 7efc0219b700 1 --2- 172.21.15.37:0/731735892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efbfc0adcd0 0x7efbfc152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:39.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.037+0000 7efc0199a700 1 -- 172.21.15.37:0/731735892 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efbfc156c50 msgr2=0x7efbfc0ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:39.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.037+0000 7efc0199a700 1 --2- 172.21.15.37:0/731735892 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efbfc156c50 0x7efbfc0ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:39.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.037+0000 7efc0199a700 1 -- 172.21.15.37:0/731735892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efbfc0adcd0 msgr2=0x7efbfc152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:39.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.037+0000 7efc0199a700 1 --2- 172.21.15.37:0/731735892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efbfc0adcd0 0x7efbfc152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:39.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.037+0000 7efc0199a700 1 -- 172.21.15.37:0/731735892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf4009a70 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.037+0000 7efc0199a700 1 --2- 172.21.15.37:0/731735892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbfc0cd7d0 0x7efbfc0b2f30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efbec00c700 tx=0x7efbec00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:39.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.038+0000 7efbf2ffd700 1 -- 172.21.15.37:0/731735892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec005d70 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.038+0000 7efbf2ffd700 1 -- 172.21.15.37:0/731735892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec0070d0 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.038+0000 7efbf2ffd700 1 -- 172.21.15.37:0/731735892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec007460 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.038+0000 7efc043ff700 1 -- 172.21.15.37:0/731735892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbfc0b40d0 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.038+0000 7efc043ff700 1 -- 172.21.15.37:0/731735892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbfc1531e0 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.039+0000 7efc043ff700 1 -- 172.21.15.37:0/731735892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbfc074180 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.040+0000 7efbf2ffd700 1 -- 172.21.15.37:0/731735892 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efbec0075c0 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.041+0000 7efbf2ffd700 1 --2- 172.21.15.37:0/731735892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efbe006ace0 0x7efbe006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:39.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.042+0000 7efbf2ffd700 1 -- 172.21.15.37:0/731735892 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7efbec088770 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.042+0000 7efc0219b700 1 --2- 172.21.15.37:0/731735892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efbe006ace0 0x7efbe006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:39.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.043+0000 7efc0219b700 1 --2- 172.21.15.37:0/731735892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efbe006ace0 0x7efbe006d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efbf80011e0 tx=0x7efbf8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:39.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.046+0000 7efbf2ffd700 1 -- 172.21.15.37:0/731735892 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7efbec053990 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.250+0000 7efc043ff700 1 -- 172.21.15.37:0/731735892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efbfc0cb470 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.345+0000 7efbf2ffd700 1 -- 172.21.15.37:0/731735892 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) v1 ==== 138+0+0 (secure 0 0 0) 0x7efbec056fb0 con 0x7efbfc0cd7d0 2023-07-12T02:05:39.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.348+0000 7efc043ff700 1 -- 172.21.15.37:0/731735892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efbe006ace0 msgr2=0x7efbe006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:39.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.348+0000 7efc043ff700 1 --2- 172.21.15.37:0/731735892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efbe006ace0 0x7efbe006d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efbf80011e0 tx=0x7efbf8009040 comp rx=0 tx=0).stop 2023-07-12T02:05:39.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.348+0000 7efc043ff700 1 -- 172.21.15.37:0/731735892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbfc0cd7d0 msgr2=0x7efbfc0b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:39.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.348+0000 7efc043ff700 1 --2- 172.21.15.37:0/731735892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbfc0cd7d0 0x7efbfc0b2f30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efbec00c700 tx=0x7efbec00ca10 comp rx=0 tx=0).stop 2023-07-12T02:05:39.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.348+0000 7efc043ff700 1 -- 172.21.15.37:0/731735892 shutdown_connections 2023-07-12T02:05:39.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.348+0000 7efc043ff700 1 --2- 172.21.15.37:0/731735892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efbe006ace0 0x7efbe006d190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.348+0000 7efc043ff700 1 --2- 172.21.15.37:0/731735892 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efbfc156c50 0x7efbfc0ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.348+0000 7efc043ff700 1 --2- 172.21.15.37:0/731735892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efbfc0adcd0 0x7efbfc152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.348+0000 7efc043ff700 1 --2- 172.21.15.37:0/731735892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbfc0cd7d0 0x7efbfc0b2f30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.348+0000 7efc043ff700 1 -- 172.21.15.37:0/731735892 >> 172.21.15.37:0/731735892 conn(0x7efbfc0b0390 msgr2=0x7efbfc155150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.349+0000 7efc043ff700 1 -- 172.21.15.37:0/731735892 shutdown_connections 2023-07-12T02:05:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.350+0000 7efc043ff700 1 -- 172.21.15.37:0/731735892 wait complete. 2023-07-12T02:05:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-07-12T02:05:39.373 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-12T02:05:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.577+0000 7f96f79ff700 1 Processor -- start 2023-07-12T02:05:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.577+0000 7f96f79ff700 1 -- start start 2023-07-12T02:05:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.579+0000 7f96f79ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f96f00d3730 0x7f96f00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.579+0000 7f96f79ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96f00cfa90 0x7f96f00d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.579+0000 7f96f79ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f00d0b20 con 0x7f96f00b8430 2023-07-12T02:05:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.579+0000 7f96f79ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f00cda30 con 0x7f96f00cfa90 2023-07-12T02:05:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.579+0000 7f96f79ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f00b8800 con 0x7f96f00d3730 2023-07-12T02:05:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.579+0000 7f96f5f9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96f00cfa90 0x7f96f00d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.579+0000 7f96f5f9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96f00cfa90 0x7f96f00d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54586/0 (socket says 172.21.15.37:54586) 2023-07-12T02:05:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.579+0000 7f96f579b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f96f00b8430 0x7f96f00cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38202/0 (socket says 172.21.15.37:38202) 2023-07-12T02:05:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.579+0000 7f96f5f9c700 1 -- 172.21.15.37:0/2196798216 learned_addr learned my addr 172.21.15.37:0/2196798216 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.579+0000 7f96f4f9a700 1 --2- 172.21.15.37:0/2196798216 >> v2:172.21.15.196:3300/0 conn(0x7f96f00d3730 0x7f96f00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.579+0000 7f96f5f9c700 1 -- 172.21.15.37:0/2196798216 >> v2:172.21.15.196:3300/0 conn(0x7f96f00d3730 msgr2=0x7f96f00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.579+0000 7f96f5f9c700 1 --2- 172.21.15.37:0/2196798216 >> v2:172.21.15.196:3300/0 conn(0x7f96f00d3730 0x7f96f00cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.579+0000 7f96f5f9c700 1 -- 172.21.15.37:0/2196798216 >> v1:172.21.15.37:6789/0 conn(0x7f96f00b8430 legacy=0x7f96f00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.579+0000 7f96f5f9c700 1 -- 172.21.15.37:0/2196798216 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f00cfe90 con 0x7f96f00cfa90 2023-07-12T02:05:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.580+0000 7f96f5f9c700 1 --2- 172.21.15.37:0/2196798216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00cfa90 0x7f96f00d0fb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f96f0160f50 tx=0x7f96e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e2283e97fb6cf1 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.580+0000 7f96e7fff700 1 -- 172.21.15.37:0/2196798216 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800e070 con 0x7f96f00cfa90 2023-07-12T02:05:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.580+0000 7f96e7fff700 1 -- 172.21.15.37:0/2196798216 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e800b9c0 con 0x7f96f00cfa90 2023-07-12T02:05:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.580+0000 7f96e7fff700 1 -- 172.21.15.37:0/2196798216 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800bd70 con 0x7f96f00cfa90 2023-07-12T02:05:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.581+0000 7f96f79ff700 1 -- 172.21.15.37:0/2196798216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00cfa90 msgr2=0x7f96f00d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.581+0000 7f96f79ff700 1 --2- 172.21.15.37:0/2196798216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00cfa90 0x7f96f00d0fb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f96f0160f50 tx=0x7f96e800b330 comp rx=0 tx=0).stop 2023-07-12T02:05:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.581+0000 7f96f79ff700 1 -- 172.21.15.37:0/2196798216 shutdown_connections 2023-07-12T02:05:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.581+0000 7f96f79ff700 1 --2- 172.21.15.37:0/2196798216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00cfa90 0x7f96f00d0fb0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.581+0000 7f96f79ff700 1 --2- 172.21.15.37:0/2196798216 >> v2:172.21.15.196:3300/0 conn(0x7f96f00d3730 0x7f96f00cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.581+0000 7f96f79ff700 1 -- 172.21.15.37:0/2196798216 >> 172.21.15.37:0/2196798216 conn(0x7f96f006b3f0 msgr2=0x7f96f006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.581+0000 7f96f79ff700 1 -- 172.21.15.37:0/2196798216 shutdown_connections 2023-07-12T02:05:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.581+0000 7f96f79ff700 1 -- 172.21.15.37:0/2196798216 wait complete. 2023-07-12T02:05:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.583+0000 7f96f79ff700 1 Processor -- start 2023-07-12T02:05:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.583+0000 7f96f79ff700 1 -- start start 2023-07-12T02:05:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.585+0000 7f96f79ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96f00b8430 0x7f96f015b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.585+0000 7f96f79ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00cfa90 0x7f96f00c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.585+0000 7f96f79ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96f00d3730 0x7f96f00b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.585+0000 7f96f79ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f015d390 con 0x7f96f00cfa90 2023-07-12T02:05:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.585+0000 7f96f79ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f015b7c0 con 0x7f96f00d3730 2023-07-12T02:05:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.585+0000 7f96f79ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f00c6fe0 con 0x7f96f00b8430 2023-07-12T02:05:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.585+0000 7f96f4f9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00cfa90 0x7f96f00c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.585+0000 7f96f4f9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00cfa90 0x7f96f00c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54596/0 (socket says 172.21.15.37:54596) 2023-07-12T02:05:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.585+0000 7f96f4f9a700 1 -- 172.21.15.37:0/1044741473 learned_addr learned my addr 172.21.15.37:0/1044741473 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.585+0000 7f96f579b700 1 --2- 172.21.15.37:0/1044741473 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96f00b8430 0x7f96f015b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.585+0000 7f96f5f9c700 1 --2- 172.21.15.37:0/1044741473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96f00d3730 0x7f96f00b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.585+0000 7f96f4f9a700 1 -- 172.21.15.37:0/1044741473 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96f00b8430 msgr2=0x7f96f015b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.585+0000 7f96f4f9a700 1 --2- 172.21.15.37:0/1044741473 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96f00b8430 0x7f96f015b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.585+0000 7f96f4f9a700 1 -- 172.21.15.37:0/1044741473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96f00d3730 msgr2=0x7f96f00b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.585+0000 7f96f4f9a700 1 --2- 172.21.15.37:0/1044741473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96f00d3730 0x7f96f00b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.585+0000 7f96f4f9a700 1 -- 172.21.15.37:0/1044741473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8009b30 con 0x7f96f00cfa90 2023-07-12T02:05:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.586+0000 7f96f4f9a700 1 --2- 172.21.15.37:0/1044741473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00cfa90 0x7f96f00c6670 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f96e000d830 tx=0x7f96e000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.586+0000 7f96e5ffb700 1 -- 172.21.15.37:0/1044741473 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00125f0 con 0x7f96f00cfa90 2023-07-12T02:05:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.586+0000 7f96e5ffb700 1 -- 172.21.15.37:0/1044741473 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e0012750 con 0x7f96f00cfa90 2023-07-12T02:05:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.586+0000 7f96e5ffb700 1 -- 172.21.15.37:0/1044741473 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0012b00 con 0x7f96f00cfa90 2023-07-12T02:05:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.586+0000 7f96f79ff700 1 -- 172.21.15.37:0/1044741473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f015ca60 con 0x7f96f00cfa90 2023-07-12T02:05:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.586+0000 7f96f79ff700 1 -- 172.21.15.37:0/1044741473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f015d020 con 0x7f96f00cfa90 2023-07-12T02:05:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.587+0000 7f96f79ff700 1 -- 172.21.15.37:0/1044741473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f004ea60 con 0x7f96f00cfa90 2023-07-12T02:05:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.588+0000 7f96e5ffb700 1 -- 172.21.15.37:0/1044741473 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f96e0012c60 con 0x7f96f00cfa90 2023-07-12T02:05:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.589+0000 7f96e5ffb700 1 --2- 172.21.15.37:0/1044741473 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f96d406ace0 0x7f96d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.589+0000 7f96e5ffb700 1 -- 172.21.15.37:0/1044741473 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f96e0089450 con 0x7f96f00cfa90 2023-07-12T02:05:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.590+0000 7f96f579b700 1 --2- 172.21.15.37:0/1044741473 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f96d406ace0 0x7f96d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.590+0000 7f96f579b700 1 --2- 172.21.15.37:0/1044741473 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f96d406ace0 0x7f96d406d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f96ec000f60 tx=0x7f96ec007ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:39.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.594+0000 7f96e5ffb700 1 -- 172.21.15.37:0/1044741473 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f96e0054640 con 0x7f96f00cfa90 2023-07-12T02:05:39.701 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:05:39.705 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:05:39.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:39.806+0000 7f96f79ff700 1 -- 172.21.15.37:0/1044741473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f96f00d1f20 con 0x7f96f00cfa90 2023-07-12T02:05:40.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.351+0000 7f96e5ffb700 1 -- 172.21.15.37:0/1044741473 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7f96e0057c60 con 0x7f96f00cfa90 2023-07-12T02:05:40.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.359+0000 7f96f79ff700 1 -- 172.21.15.37:0/1044741473 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f96d406ace0 msgr2=0x7f96d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:40.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.359+0000 7f96f79ff700 1 --2- 172.21.15.37:0/1044741473 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f96d406ace0 0x7f96d406d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f96ec000f60 tx=0x7f96ec007ed0 comp rx=0 tx=0).stop 2023-07-12T02:05:40.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.359+0000 7f96f79ff700 1 -- 172.21.15.37:0/1044741473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00cfa90 msgr2=0x7f96f00c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:40.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.359+0000 7f96f79ff700 1 --2- 172.21.15.37:0/1044741473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00cfa90 0x7f96f00c6670 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f96e000d830 tx=0x7f96e000db40 comp rx=0 tx=0).stop 2023-07-12T02:05:40.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.365+0000 7f96f79ff700 1 -- 172.21.15.37:0/1044741473 shutdown_connections 2023-07-12T02:05:40.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.365+0000 7f96f79ff700 1 --2- 172.21.15.37:0/1044741473 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f96d406ace0 0x7f96d406d190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:40.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.365+0000 7f96f79ff700 1 --2- 172.21.15.37:0/1044741473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96f00d3730 0x7f96f00b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:40.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.365+0000 7f96f79ff700 1 --2- 172.21.15.37:0/1044741473 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96f00b8430 0x7f96f015b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:40.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.365+0000 7f96f79ff700 1 --2- 172.21.15.37:0/1044741473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00cfa90 0x7f96f00c6670 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:40.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.365+0000 7f96f79ff700 1 -- 172.21.15.37:0/1044741473 >> 172.21.15.37:0/1044741473 conn(0x7f96f006b3f0 msgr2=0x7f96f00b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.368+0000 7f96f79ff700 1 -- 172.21.15.37:0/1044741473 shutdown_connections 2023-07-12T02:05:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.368+0000 7f96f79ff700 1 -- 172.21.15.37:0/1044741473 wait complete. 2023-07-12T02:05:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-07-12T02:05:40.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-12T02:05:40.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.641+0000 7fbe7ddff700 1 Processor -- start 2023-07-12T02:05:40.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.642+0000 7fbe7ddff700 1 -- start start 2023-07-12T02:05:40.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.643+0000 7fbe7ddff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbe780d3730 0x7fbe780cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:40.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.643+0000 7fbe7ddff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe780cfa90 0x7fbe780d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:40.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.643+0000 7fbe7ddff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe780d0b20 con 0x7fbe780b8430 2023-07-12T02:05:40.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.643+0000 7fbe7ddff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe780cda30 con 0x7fbe780d3730 2023-07-12T02:05:40.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.643+0000 7fbe7ddff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe780b8800 con 0x7fbe780cfa90 2023-07-12T02:05:40.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.643+0000 7fbe6ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbe780d3730 0x7fbe780cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:40.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.643+0000 7fbe6ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbe780d3730 0x7fbe780cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54600/0 (socket says 172.21.15.37:54600) 2023-07-12T02:05:40.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.643+0000 7fbe6ffff700 1 -- 172.21.15.37:0/3219634945 learned_addr learned my addr 172.21.15.37:0/3219634945 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:40.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.643+0000 7fbe77fff700 1 --2- 172.21.15.37:0/3219634945 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe780cfa90 0x7fbe780d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:40.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.644+0000 7fbe6ffff700 1 -- 172.21.15.37:0/3219634945 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe780cfa90 msgr2=0x7fbe780d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:40.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.644+0000 7fbe6ffff700 1 --2- 172.21.15.37:0/3219634945 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe780cfa90 0x7fbe780d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:40.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.644+0000 7fbe6ffff700 1 -- 172.21.15.37:0/3219634945 >> v1:172.21.15.196:6789/0 conn(0x7fbe780b8430 legacy=0x7fbe780cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:40.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.644+0000 7fbe6ffff700 1 -- 172.21.15.37:0/3219634945 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe780cfeb0 con 0x7fbe780d3730 2023-07-12T02:05:40.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.644+0000 7fbe6ffff700 1 --2- 172.21.15.37:0/3219634945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe780d3730 0x7fbe780cf550 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbe600098f0 tx=0x7fbe60009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5da9d03ef8e3d7a server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:40.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.644+0000 7fbe76ffd700 1 -- 172.21.15.37:0/3219634945 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6000b8a0 con 0x7fbe780d3730 2023-07-12T02:05:40.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.644+0000 7fbe76ffd700 1 -- 172.21.15.37:0/3219634945 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6000ba00 con 0x7fbe780d3730 2023-07-12T02:05:40.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.644+0000 7fbe76ffd700 1 -- 172.21.15.37:0/3219634945 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6000bd90 con 0x7fbe780d3730 2023-07-12T02:05:40.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.645+0000 7fbe7ddff700 1 -- 172.21.15.37:0/3219634945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe780d3730 msgr2=0x7fbe780cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:40.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.645+0000 7fbe7ddff700 1 --2- 172.21.15.37:0/3219634945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe780d3730 0x7fbe780cf550 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbe600098f0 tx=0x7fbe60009c00 comp rx=0 tx=0).stop 2023-07-12T02:05:40.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.645+0000 7fbe7ddff700 1 -- 172.21.15.37:0/3219634945 shutdown_connections 2023-07-12T02:05:40.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.645+0000 7fbe7ddff700 1 --2- 172.21.15.37:0/3219634945 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe780cfa90 0x7fbe780d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:40.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.645+0000 7fbe7ddff700 1 --2- 172.21.15.37:0/3219634945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe780d3730 0x7fbe780cf550 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:40.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.645+0000 7fbe7ddff700 1 -- 172.21.15.37:0/3219634945 >> 172.21.15.37:0/3219634945 conn(0x7fbe7806b3f0 msgr2=0x7fbe7806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:40.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.645+0000 7fbe7ddff700 1 -- 172.21.15.37:0/3219634945 shutdown_connections 2023-07-12T02:05:40.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.645+0000 7fbe7ddff700 1 -- 172.21.15.37:0/3219634945 wait complete. 2023-07-12T02:05:40.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.647+0000 7fbe7ddff700 1 Processor -- start 2023-07-12T02:05:40.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.647+0000 7fbe7ddff700 1 -- start start 2023-07-12T02:05:40.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe7ddff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe780b8430 0x7fbe78154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:40.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe7ddff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe780cfa90 0x7fbe7815e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:40.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe7ddff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe780d3730 0x7fbe780b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:40.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe7ddff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7815d8e0 con 0x7fbe780cfa90 2023-07-12T02:05:40.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe7ddff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7815ccd0 con 0x7fbe780b8430 2023-07-12T02:05:40.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe7ddff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7815cfb0 con 0x7fbe780d3730 2023-07-12T02:05:40.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe6ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe780cfa90 0x7fbe7815e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:40.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe6ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe780cfa90 0x7fbe7815e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54606/0 (socket says 172.21.15.37:54606) 2023-07-12T02:05:40.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe6ffff700 1 -- 172.21.15.37:0/1407577907 learned_addr learned my addr 172.21.15.37:0/1407577907 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:40.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe777fe700 1 --2- 172.21.15.37:0/1407577907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe780b8430 0x7fbe78154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:40.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe77fff700 1 --2- 172.21.15.37:0/1407577907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe780d3730 0x7fbe780b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:40.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe6ffff700 1 -- 172.21.15.37:0/1407577907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe780d3730 msgr2=0x7fbe780b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:40.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe6ffff700 1 --2- 172.21.15.37:0/1407577907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe780d3730 0x7fbe780b61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:40.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe6ffff700 1 -- 172.21.15.37:0/1407577907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe780b8430 msgr2=0x7fbe78154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:40.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe6ffff700 1 --2- 172.21.15.37:0/1407577907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe780b8430 0x7fbe78154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:40.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe6ffff700 1 -- 172.21.15.37:0/1407577907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe60009550 con 0x7fbe780cfa90 2023-07-12T02:05:40.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe77fff700 1 --2- 172.21.15.37:0/1407577907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe780d3730 0x7fbe780b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:40.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.648+0000 7fbe777fe700 1 --2- 172.21.15.37:0/1407577907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe780b8430 0x7fbe78154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:40.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.649+0000 7fbe6ffff700 1 --2- 172.21.15.37:0/1407577907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe780cfa90 0x7fbe7815e680 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009c40 tx=0x7fbe60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:40.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.649+0000 7fbe74ff9700 1 -- 172.21.15.37:0/1407577907 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe600036a0 con 0x7fbe780cfa90 2023-07-12T02:05:40.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.649+0000 7fbe74ff9700 1 -- 172.21.15.37:0/1407577907 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6001e070 con 0x7fbe780cfa90 2023-07-12T02:05:40.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.649+0000 7fbe7ddff700 1 -- 172.21.15.37:0/1407577907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7815d290 con 0x7fbe780cfa90 2023-07-12T02:05:40.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.649+0000 7fbe74ff9700 1 -- 172.21.15.37:0/1407577907 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe60003a60 con 0x7fbe780cfa90 2023-07-12T02:05:40.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.649+0000 7fbe7ddff700 1 -- 172.21.15.37:0/1407577907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe781550f0 con 0x7fbe780cfa90 2023-07-12T02:05:40.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.650+0000 7fbe7ddff700 1 -- 172.21.15.37:0/1407577907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7815da50 con 0x7fbe780cfa90 2023-07-12T02:05:40.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.652+0000 7fbe74ff9700 1 -- 172.21.15.37:0/1407577907 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe60003bc0 con 0x7fbe780cfa90 2023-07-12T02:05:40.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.653+0000 7fbe74ff9700 1 --2- 172.21.15.37:0/1407577907 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbe5806ace0 0x7fbe5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:40.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.653+0000 7fbe74ff9700 1 -- 172.21.15.37:0/1407577907 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6282+0+0 (secure 0 0 0) 0x7fbe60020070 con 0x7fbe780cfa90 2023-07-12T02:05:40.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.654+0000 7fbe777fe700 1 --2- 172.21.15.37:0/1407577907 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbe5806ace0 0x7fbe5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:40.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.654+0000 7fbe777fe700 1 --2- 172.21.15.37:0/1407577907 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbe5806ace0 0x7fbe5806d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbe68000f60 tx=0x7fbe68009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:40.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.657+0000 7fbe74ff9700 1 -- 172.21.15.37:0/1407577907 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbe60055fc0 con 0x7fbe780cfa90 2023-07-12T02:05:40.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:40.911+0000 7fbe7ddff700 1 -- 172.21.15.37:0/1407577907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbe7804ea60 con 0x7fbe780cfa90 2023-07-12T02:05:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.358+0000 7fbe74ff9700 1 -- 172.21.15.37:0/1407577907 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbe600595e0 con 0x7fbe780cfa90 2023-07-12T02:05:41.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.370+0000 7fbe7ddff700 1 -- 172.21.15.37:0/1407577907 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbe5806ace0 msgr2=0x7fbe5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:41.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.370+0000 7fbe7ddff700 1 --2- 172.21.15.37:0/1407577907 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbe5806ace0 0x7fbe5806d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbe68000f60 tx=0x7fbe68009040 comp rx=0 tx=0).stop 2023-07-12T02:05:41.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.370+0000 7fbe7ddff700 1 -- 172.21.15.37:0/1407577907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe780cfa90 msgr2=0x7fbe7815e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:41.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.370+0000 7fbe7ddff700 1 --2- 172.21.15.37:0/1407577907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe780cfa90 0x7fbe7815e680 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009c40 tx=0x7fbe60004750 comp rx=0 tx=0).stop 2023-07-12T02:05:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.378+0000 7fbe7ddff700 1 -- 172.21.15.37:0/1407577907 shutdown_connections 2023-07-12T02:05:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.378+0000 7fbe7ddff700 1 --2- 172.21.15.37:0/1407577907 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fbe5806ace0 0x7fbe5806d190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.378+0000 7fbe7ddff700 1 --2- 172.21.15.37:0/1407577907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe780d3730 0x7fbe780b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.378+0000 7fbe7ddff700 1 --2- 172.21.15.37:0/1407577907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe780b8430 0x7fbe78154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.378+0000 7fbe7ddff700 1 --2- 172.21.15.37:0/1407577907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe780cfa90 0x7fbe7815e680 secure :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009c40 tx=0x7fbe60004750 comp rx=0 tx=0).stop 2023-07-12T02:05:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.378+0000 7fbe7ddff700 1 -- 172.21.15.37:0/1407577907 >> 172.21.15.37:0/1407577907 conn(0x7fbe7806b3f0 msgr2=0x7fbe7815bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:41.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.382+0000 7fbe7ddff700 1 -- 172.21.15.37:0/1407577907 shutdown_connections 2023-07-12T02:05:41.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.385+0000 7fbe7ddff700 1 -- 172.21.15.37:0/1407577907 wait complete. 2023-07-12T02:05:41.402 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 6 and data pool 7 2023-07-12T02:05:41.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:05:41.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.619+0000 7efcfcbff700 1 Processor -- start 2023-07-12T02:05:41.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.619+0000 7efcfcbff700 1 -- start start 2023-07-12T02:05:41.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.621+0000 7efcfcbff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf80b4cc0 0x7efcf80cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:41.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.621+0000 7efcfcbff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf80cf3b0 con 0x7efcf80d1cd0 2023-07-12T02:05:41.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.621+0000 7efcfcbff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf80b86f0 con 0x7efcf80b8320 2023-07-12T02:05:41.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.621+0000 7efcfcbff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80cf0d0 con 0x7efcf80b4cc0 2023-07-12T02:05:41.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.621+0000 7efcf6d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efcf80d1cd0 0x7efcf80d0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38216/0 (socket says 172.21.15.37:38216) 2023-07-12T02:05:41.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.621+0000 7efcf6d9d700 1 -- 172.21.15.37:0/2705463779 learned_addr learned my addr 172.21.15.37:0/2705463779 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:41.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.621+0000 7efceffff700 1 --2- 172.21.15.37:0/2705463779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf80b4cc0 0x7efcf80cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:41.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.621+0000 7efcf5d9b700 1 -- 172.21.15.37:0/2705463779 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323592039 0 0) 0x7efcf80cf3b0 con 0x7efcf80d1cd0 2023-07-12T02:05:41.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.621+0000 7efcf5d9b700 1 -- 172.21.15.37:0/2705463779 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efce40035b0 con 0x7efcf80d1cd0 2023-07-12T02:05:41.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.622+0000 7efcf5d9b700 1 -- 172.21.15.37:0/2705463779 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3846094658 0 0) 0x7efce40035b0 con 0x7efcf80d1cd0 2023-07-12T02:05:41.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.622+0000 7efcf5d9b700 1 -- 172.21.15.37:0/2705463779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf80b4cc0 msgr2=0x7efcf80cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:41.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.622+0000 7efcf5d9b700 1 --2- 172.21.15.37:0/2705463779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf80b4cc0 0x7efcf80cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:41.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.622+0000 7efcf5d9b700 1 -- 172.21.15.37:0/2705463779 >> v1:172.21.15.196:6789/0 conn(0x7efcf80b8320 legacy=0x7efcf80b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:41.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.622+0000 7efcf5d9b700 1 -- 172.21.15.37:0/2705463779 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf80d22c0 con 0x7efcf80d1cd0 2023-07-12T02:05:41.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.622+0000 7efcf5d9b700 1 -- 172.21.15.37:0/2705463779 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7efcf00019f0 con 0x7efcf80d1cd0 2023-07-12T02:05:41.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.622+0000 7efcf5d9b700 1 -- 172.21.15.37:0/2705463779 >> v1:172.21.15.37:6789/0 conn(0x7efcf80d1cd0 legacy=0x7efcf80d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:41.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.622+0000 7efcf5d9b700 1 --2- 172.21.15.37:0/2705463779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efce4003a30 0x7efce4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:41.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.622+0000 7efcf5d9b700 1 --2- 172.21.15.37:0/2705463779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efce4004850 0x7efce4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:41.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.622+0000 7efcf5d9b700 1 --2- 172.21.15.37:0/2705463779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf80b4cc0 0x7efce40052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:41.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.622+0000 7efcf5d9b700 1 -- 172.21.15.37:0/2705463779 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80cf0d0 con 0x7efce4004850 2023-07-12T02:05:41.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.622+0000 7efcf5d9b700 1 -- 172.21.15.37:0/2705463779 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce400bbd0 con 0x7efce4003a30 2023-07-12T02:05:41.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.622+0000 7efcf5d9b700 1 -- 172.21.15.37:0/2705463779 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce400bd90 con 0x7efcf80b4cc0 2023-07-12T02:05:41.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.622+0000 7efceffff700 1 --2- 172.21.15.37:0/2705463779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efce4004850 0x7efce4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:41.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.622+0000 7efcf659c700 1 --2- 172.21.15.37:0/2705463779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efce4003a30 0x7efce4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:41.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.622+0000 7efcf6d9d700 1 --2- 172.21.15.37:0/2705463779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf80b4cc0 0x7efce40052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:41.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.623+0000 7efceffff700 1 -- 172.21.15.37:0/2705463779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf80b4cc0 msgr2=0x7efce40052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:41.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.623+0000 7efceffff700 1 --2- 172.21.15.37:0/2705463779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf80b4cc0 0x7efce40052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:41.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.623+0000 7efceffff700 1 -- 172.21.15.37:0/2705463779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efce4003a30 msgr2=0x7efce4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:41.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.623+0000 7efceffff700 1 --2- 172.21.15.37:0/2705463779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efce4003a30 0x7efce4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:41.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.623+0000 7efceffff700 1 -- 172.21.15.37:0/2705463779 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce40035b0 con 0x7efce4004850 2023-07-12T02:05:41.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.623+0000 7efceffff700 1 --2- 172.21.15.37:0/2705463779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efce4004850 0x7efce4004cc0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efce0009b30 tx=0x7efce4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490bc96fa57d9a41 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:41.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.623+0000 7efcf5d9b700 1 -- 172.21.15.37:0/2705463779 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce000e6c0 con 0x7efce4004850 2023-07-12T02:05:41.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.623+0000 7efcf5d9b700 1 -- 172.21.15.37:0/2705463779 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce000e820 con 0x7efce4004850 2023-07-12T02:05:41.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.623+0000 7efcf5d9b700 1 -- 172.21.15.37:0/2705463779 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce000eb90 con 0x7efce4004850 2023-07-12T02:05:41.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.624+0000 7efcfcbff700 1 -- 172.21.15.37:0/2705463779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efce4004850 msgr2=0x7efce4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:41.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.624+0000 7efcfcbff700 1 --2- 172.21.15.37:0/2705463779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efce4004850 0x7efce4004cc0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efce0009b30 tx=0x7efce4005880 comp rx=0 tx=0).stop 2023-07-12T02:05:41.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.624+0000 7efcf6d9d700 1 -- 172.21.15.37:0/2705463779 reap_dead start 2023-07-12T02:05:41.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.624+0000 7efcfcbff700 1 -- 172.21.15.37:0/2705463779 shutdown_connections 2023-07-12T02:05:41.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.624+0000 7efcfcbff700 1 -- 172.21.15.37:0/2705463779 >> 172.21.15.37:0/2705463779 conn(0x7efcf80722b0 msgr2=0x7efcf80cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:41.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.624+0000 7efcfcbff700 1 -- 172.21.15.37:0/2705463779 shutdown_connections 2023-07-12T02:05:41.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.624+0000 7efcfcbff700 1 -- 172.21.15.37:0/2705463779 wait complete. 2023-07-12T02:05:41.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.626+0000 7efcfcbff700 1 Processor -- start 2023-07-12T02:05:41.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.626+0000 7efcfcbff700 1 -- start start 2023-07-12T02:05:41.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.627+0000 7efcfcbff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcf81574f0 0x7efcf80a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:41.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.627+0000 7efcfcbff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf80aa450 0x7efcf815adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:41.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.627+0000 7efcfcbff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf815b2f0 0x7efcf80cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:41.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.627+0000 7efcfcbff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf815b750 con 0x7efcf80aa450 2023-07-12T02:05:41.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.627+0000 7efcfcbff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80ab500 con 0x7efcf81574f0 2023-07-12T02:05:41.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.627+0000 7efcfcbff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80aa8f0 con 0x7efcf815b2f0 2023-07-12T02:05:41.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.627+0000 7efceffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf80aa450 0x7efcf815adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:41.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.627+0000 7efceffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf80aa450 0x7efcf815adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54622/0 (socket says 172.21.15.37:54622) 2023-07-12T02:05:41.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.627+0000 7efceffff700 1 -- 172.21.15.37:0/2328317533 learned_addr learned my addr 172.21.15.37:0/2328317533 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.627+0000 7efcf659c700 1 --2- 172.21.15.37:0/2328317533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcf81574f0 0x7efcf80a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.627+0000 7efcf6d9d700 1 --2- 172.21.15.37:0/2328317533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf815b2f0 0x7efcf80cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.628+0000 7efceffff700 1 -- 172.21.15.37:0/2328317533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf815b2f0 msgr2=0x7efcf80cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.628+0000 7efceffff700 1 --2- 172.21.15.37:0/2328317533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf815b2f0 0x7efcf80cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.628+0000 7efceffff700 1 -- 172.21.15.37:0/2328317533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcf81574f0 msgr2=0x7efcf80a9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.628+0000 7efceffff700 1 --2- 172.21.15.37:0/2328317533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcf81574f0 0x7efcf80a9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.628+0000 7efceffff700 1 -- 172.21.15.37:0/2328317533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf80aabd0 con 0x7efcf80aa450 2023-07-12T02:05:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.628+0000 7efceffff700 1 --2- 172.21.15.37:0/2328317533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf80aa450 0x7efcf815adb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efce400bba0 tx=0x7efce00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.628+0000 7efceeffd700 1 -- 172.21.15.37:0/2328317533 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce000e6c0 con 0x7efcf80aa450 2023-07-12T02:05:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.628+0000 7efceeffd700 1 -- 172.21.15.37:0/2328317533 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce00038c0 con 0x7efcf80aa450 2023-07-12T02:05:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.628+0000 7efcfcbff700 1 -- 172.21.15.37:0/2328317533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf80aaeb0 con 0x7efcf80aa450 2023-07-12T02:05:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.628+0000 7efceeffd700 1 -- 172.21.15.37:0/2328317533 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce0003c70 con 0x7efcf80aa450 2023-07-12T02:05:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.628+0000 7efcfcbff700 1 -- 172.21.15.37:0/2328317533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf80cbf80 con 0x7efcf80aa450 2023-07-12T02:05:41.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.629+0000 7efcfcbff700 1 -- 172.21.15.37:0/2328317533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf815b6f0 con 0x7efcf80aa450 2023-07-12T02:05:41.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.630+0000 7efceeffd700 1 -- 172.21.15.37:0/2328317533 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efce0013470 con 0x7efcf80aa450 2023-07-12T02:05:41.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.632+0000 7efceeffd700 1 --2- 172.21.15.37:0/2328317533 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efcd806ace0 0x7efcd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:41.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.632+0000 7efceeffd700 1 -- 172.21.15.37:0/2328317533 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7efce008ae90 con 0x7efcf80aa450 2023-07-12T02:05:41.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.632+0000 7efcf659c700 1 --2- 172.21.15.37:0/2328317533 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efcd806ace0 0x7efcd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.633+0000 7efcf659c700 1 --2- 172.21.15.37:0/2328317533 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efcd806ace0 0x7efcd806d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efce8000c00 tx=0x7efce8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:41.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.636+0000 7efceeffd700 1 -- 172.21.15.37:0/2328317533 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7efcf815b6f0 con 0x7efcf80aa450 2023-07-12T02:05:41.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.845+0000 7efcfcbff700 1 -- 172.21.15.37:0/2328317533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcf815b6f0 con 0x7efcf80aa450 2023-07-12T02:05:41.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.847+0000 7efceeffd700 1 -- 172.21.15.37:0/2328317533 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18465 (secure 0 0 0) 0x7efcf815b6f0 con 0x7efcf80aa450 2023-07-12T02:05:41.850 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:41.851 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":40,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:05:40.913055+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:05:39.292112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-12T02:05:39.847178+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:05:41.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.849+0000 7efcfcbff700 1 -- 172.21.15.37:0/2328317533 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efcd806ace0 msgr2=0x7efcd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:41.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.849+0000 7efcfcbff700 1 --2- 172.21.15.37:0/2328317533 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efcd806ace0 0x7efcd806d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efce8000c00 tx=0x7efce8009040 comp rx=0 tx=0).stop 2023-07-12T02:05:41.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.849+0000 7efcfcbff700 1 -- 172.21.15.37:0/2328317533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf80aa450 msgr2=0x7efcf815adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:41.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.849+0000 7efcfcbff700 1 --2- 172.21.15.37:0/2328317533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf80aa450 0x7efcf815adb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efce400bba0 tx=0x7efce00047c0 comp rx=0 tx=0).stop 2023-07-12T02:05:41.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.849+0000 7efcfcbff700 1 -- 172.21.15.37:0/2328317533 shutdown_connections 2023-07-12T02:05:41.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.849+0000 7efcfcbff700 1 --2- 172.21.15.37:0/2328317533 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7efcd806ace0 0x7efcd806d190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:41.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.849+0000 7efcfcbff700 1 --2- 172.21.15.37:0/2328317533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf815b2f0 0x7efcf80cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:41.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.849+0000 7efcfcbff700 1 --2- 172.21.15.37:0/2328317533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcf81574f0 0x7efcf80a9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:41.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.849+0000 7efcfcbff700 1 --2- 172.21.15.37:0/2328317533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf80aa450 0x7efcf815adb0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:41.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.849+0000 7efcfcbff700 1 -- 172.21.15.37:0/2328317533 >> 172.21.15.37:0/2328317533 conn(0x7efce4004850 msgr2=0x7efcf8157fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:41.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.849+0000 7efcfcbff700 1 -- 172.21.15.37:0/2328317533 shutdown_connections 2023-07-12T02:05:41.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:41.849+0000 7efcfcbff700 1 -- 172.21.15.37:0/2328317533 wait complete. 2023-07-12T02:05:41.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:05:42.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.068+0000 7fde9b9ff700 1 Processor -- start 2023-07-12T02:05:42.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.068+0000 7fde9b9ff700 1 -- start start 2023-07-12T02:05:42.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.070+0000 7fde9b9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde940d2640 0x7fde940b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:42.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.070+0000 7fde9b9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde940cf8f0 0x7fde9415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:42.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.070+0000 7fde9b9ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde940d1790 con 0x7fde9415c460 2023-07-12T02:05:42.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.070+0000 7fde9b9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde940cedd0 con 0x7fde940cf8f0 2023-07-12T02:05:42.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.070+0000 7fde9b9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde940cd950 con 0x7fde940d2640 2023-07-12T02:05:42.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.070+0000 7fde99f9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde940cf8f0 0x7fde9415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:42.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.070+0000 7fde99f9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde940cf8f0 0x7fde9415fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56744/0 (socket says 172.21.15.37:56744) 2023-07-12T02:05:42.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.070+0000 7fde99f9c700 1 -- 172.21.15.37:0/2757272129 learned_addr learned my addr 172.21.15.37:0/2757272129 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:42.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.070+0000 7fde98f9a700 1 --2- 172.21.15.37:0/2757272129 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde940d2640 0x7fde940b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:42.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.070+0000 7fde99f9c700 1 -- 172.21.15.37:0/2757272129 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde940d2640 msgr2=0x7fde940b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:42.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.070+0000 7fde99f9c700 1 --2- 172.21.15.37:0/2757272129 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde940d2640 0x7fde940b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:42.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.070+0000 7fde99f9c700 1 -- 172.21.15.37:0/2757272129 >> v1:172.21.15.196:6789/0 conn(0x7fde9415c460 legacy=0x7fde940cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:42.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.070+0000 7fde99f9c700 1 -- 172.21.15.37:0/2757272129 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde940d14b0 con 0x7fde940cf8f0 2023-07-12T02:05:42.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.071+0000 7fde99f9c700 1 --2- 172.21.15.37:0/2757272129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde940cf8f0 0x7fde9415fe20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009e50 tx=0x7fde8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e31440bd03820e server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:42.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.071+0000 7fde8bfff700 1 -- 172.21.15.37:0/2757272129 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c00e070 con 0x7fde940cf8f0 2023-07-12T02:05:42.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.071+0000 7fde8bfff700 1 -- 172.21.15.37:0/2757272129 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c00b9c0 con 0x7fde940cf8f0 2023-07-12T02:05:42.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.071+0000 7fde8bfff700 1 -- 172.21.15.37:0/2757272129 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c00bd70 con 0x7fde940cf8f0 2023-07-12T02:05:42.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.071+0000 7fde9b9ff700 1 -- 172.21.15.37:0/2757272129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde940cf8f0 msgr2=0x7fde9415fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:42.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.071+0000 7fde9b9ff700 1 --2- 172.21.15.37:0/2757272129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde940cf8f0 0x7fde9415fe20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009e50 tx=0x7fde8c00b330 comp rx=0 tx=0).stop 2023-07-12T02:05:42.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.072+0000 7fde9b9ff700 1 -- 172.21.15.37:0/2757272129 shutdown_connections 2023-07-12T02:05:42.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.072+0000 7fde9b9ff700 1 --2- 172.21.15.37:0/2757272129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde940cf8f0 0x7fde9415fe20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:42.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.072+0000 7fde9b9ff700 1 --2- 172.21.15.37:0/2757272129 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde940d2640 0x7fde940b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:42.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.072+0000 7fde9b9ff700 1 -- 172.21.15.37:0/2757272129 >> 172.21.15.37:0/2757272129 conn(0x7fde94071660 msgr2=0x7fde94071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:42.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.072+0000 7fde9b9ff700 1 -- 172.21.15.37:0/2757272129 shutdown_connections 2023-07-12T02:05:42.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.072+0000 7fde9b9ff700 1 -- 172.21.15.37:0/2757272129 wait complete. 2023-07-12T02:05:42.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.073+0000 7fde9b9ff700 1 Processor -- start 2023-07-12T02:05:42.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.073+0000 7fde9b9ff700 1 -- start start 2023-07-12T02:05:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.074+0000 7fde9b9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde940cf8f0 0x7fde94158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.074+0000 7fde9b9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde940d2640 0x7fde940b6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.074+0000 7fde9b9ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde9415c460 0x7fde94155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.074+0000 7fde9b9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde940caff0 con 0x7fde940cf8f0 2023-07-12T02:05:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.074+0000 7fde9b9ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde940caa30 con 0x7fde9415c460 2023-07-12T02:05:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.074+0000 7fde9b9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde940cad10 con 0x7fde940d2640 2023-07-12T02:05:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.075+0000 7fde9979b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde940cf8f0 0x7fde94158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:42.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.075+0000 7fde9979b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde940cf8f0 0x7fde94158f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56756/0 (socket says 172.21.15.37:56756) 2023-07-12T02:05:42.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.075+0000 7fde9979b700 1 -- 172.21.15.37:0/2460187885 learned_addr learned my addr 172.21.15.37:0/2460187885 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:42.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.075+0000 7fde99f9c700 1 --2- 172.21.15.37:0/2460187885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde9415c460 0x7fde94155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:42.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.075+0000 7fde9979b700 1 -- 172.21.15.37:0/2460187885 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde940d2640 msgr2=0x7fde940b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:42.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.075+0000 7fde98f9a700 1 --2- 172.21.15.37:0/2460187885 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde940d2640 0x7fde940b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:42.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.075+0000 7fde9979b700 1 --2- 172.21.15.37:0/2460187885 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde940d2640 0x7fde940b6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:42.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.075+0000 7fde9979b700 1 -- 172.21.15.37:0/2460187885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde9415c460 msgr2=0x7fde94155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:42.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.075+0000 7fde9979b700 1 --2- 172.21.15.37:0/2460187885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde9415c460 0x7fde94155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:42.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.075+0000 7fde9979b700 1 -- 172.21.15.37:0/2460187885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c009b30 con 0x7fde940cf8f0 2023-07-12T02:05:42.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.075+0000 7fde99f9c700 1 --2- 172.21.15.37:0/2460187885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde9415c460 0x7fde94155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:42.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.075+0000 7fde9979b700 1 --2- 172.21.15.37:0/2460187885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde940cf8f0 0x7fde94158f90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fde9000c4e0 tx=0x7fde9000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:42.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.076+0000 7fde89ffb700 1 -- 172.21.15.37:0/2460187885 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde900052d0 con 0x7fde940cf8f0 2023-07-12T02:05:42.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.076+0000 7fde89ffb700 1 -- 172.21.15.37:0/2460187885 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde90005430 con 0x7fde940cf8f0 2023-07-12T02:05:42.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.076+0000 7fde89ffb700 1 -- 172.21.15.37:0/2460187885 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde900038c0 con 0x7fde940cf8f0 2023-07-12T02:05:42.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.076+0000 7fde9b9ff700 1 -- 172.21.15.37:0/2460187885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde941e4b30 con 0x7fde940cf8f0 2023-07-12T02:05:42.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.076+0000 7fde9b9ff700 1 -- 172.21.15.37:0/2460187885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde940b6eb0 con 0x7fde940cf8f0 2023-07-12T02:05:42.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.077+0000 7fde9b9ff700 1 -- 172.21.15.37:0/2460187885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde941e5050 con 0x7fde940cf8f0 2023-07-12T02:05:42.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.078+0000 7fde89ffb700 1 -- 172.21.15.37:0/2460187885 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde90003a20 con 0x7fde940cf8f0 2023-07-12T02:05:42.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.079+0000 7fde89ffb700 1 --2- 172.21.15.37:0/2460187885 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fde7806ace0 0x7fde7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:42.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.079+0000 7fde89ffb700 1 -- 172.21.15.37:0/2460187885 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fde90088ab0 con 0x7fde940cf8f0 2023-07-12T02:05:42.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.080+0000 7fde98f9a700 1 --2- 172.21.15.37:0/2460187885 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fde7806ace0 0x7fde7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:42.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.081+0000 7fde98f9a700 1 --2- 172.21.15.37:0/2460187885 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fde7806ace0 0x7fde7806d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fde940ce8e0 tx=0x7fde84008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.084+0000 7fde89ffb700 1 -- 172.21.15.37:0/2460187885 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fde941e5050 con 0x7fde940cf8f0 2023-07-12T02:05:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.292+0000 7fde9b9ff700 1 -- 172.21.15.37:0/2460187885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde940b7040 con 0x7fde940cf8f0 2023-07-12T02:05:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.293+0000 7fde89ffb700 1 -- 172.21.15.37:0/2460187885 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18465 (secure 0 0 0) 0x7fde90053a10 con 0x7fde940cf8f0 2023-07-12T02:05:42.297 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:42.297 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":40,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:05:40.913055+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:05:39.292112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-12T02:05:39.847178+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:05:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.295+0000 7fde9b9ff700 1 -- 172.21.15.37:0/2460187885 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fde7806ace0 msgr2=0x7fde7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.295+0000 7fde9b9ff700 1 --2- 172.21.15.37:0/2460187885 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fde7806ace0 0x7fde7806d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fde940ce8e0 tx=0x7fde84008040 comp rx=0 tx=0).stop 2023-07-12T02:05:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.295+0000 7fde9b9ff700 1 -- 172.21.15.37:0/2460187885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde940cf8f0 msgr2=0x7fde94158f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.295+0000 7fde9b9ff700 1 --2- 172.21.15.37:0/2460187885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde940cf8f0 0x7fde94158f90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fde9000c4e0 tx=0x7fde9000c8a0 comp rx=0 tx=0).stop 2023-07-12T02:05:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.295+0000 7fde9b9ff700 1 -- 172.21.15.37:0/2460187885 shutdown_connections 2023-07-12T02:05:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.295+0000 7fde9b9ff700 1 --2- 172.21.15.37:0/2460187885 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fde7806ace0 0x7fde7806d190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.295+0000 7fde9b9ff700 1 --2- 172.21.15.37:0/2460187885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde940cf8f0 0x7fde94158f90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.295+0000 7fde9b9ff700 1 --2- 172.21.15.37:0/2460187885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde9415c460 0x7fde94155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.295+0000 7fde9b9ff700 1 --2- 172.21.15.37:0/2460187885 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde940d2640 0x7fde940b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.295+0000 7fde9b9ff700 1 -- 172.21.15.37:0/2460187885 >> 172.21.15.37:0/2460187885 conn(0x7fde94071660 msgr2=0x7fde940b7470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.296+0000 7fde9b9ff700 1 -- 172.21.15.37:0/2460187885 shutdown_connections 2023-07-12T02:05:42.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.296+0000 7fde9b9ff700 1 -- 172.21.15.37:0/2460187885 wait complete. 2023-07-12T02:05:42.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-12T02:05:42.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.521+0000 7f7bca1ff700 1 Processor -- start 2023-07-12T02:05:42.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.521+0000 7f7bca1ff700 1 -- start start 2023-07-12T02:05:42.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.522+0000 7f7bca1ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7bc40b8430 0x7f7bc40cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:42.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.522+0000 7f7bca1ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7bc40d3730 0x7f7bc40cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:42.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.522+0000 7f7bca1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc40d0b20 con 0x7f7bc40cfa90 2023-07-12T02:05:42.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.522+0000 7f7bca1ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc40b8800 con 0x7f7bc40d3730 2023-07-12T02:05:42.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.522+0000 7f7bca1ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc40cfe90 con 0x7f7bc40b8430 2023-07-12T02:05:42.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.523+0000 7f7bc2ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7bc40d3730 0x7f7bc40cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:42.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.523+0000 7f7bc2ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7bc40d3730 0x7f7bc40cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56772/0 (socket says 172.21.15.37:56772) 2023-07-12T02:05:42.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.523+0000 7f7bc2ffd700 1 -- 172.21.15.37:0/3976249963 learned_addr learned my addr 172.21.15.37:0/3976249963 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:42.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.523+0000 7f7bc37fe700 1 --2- 172.21.15.37:0/3976249963 >> v2:172.21.15.196:3300/0 conn(0x7f7bc40b8430 0x7f7bc40cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:42.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.523+0000 7f7bc2ffd700 1 -- 172.21.15.37:0/3976249963 >> v2:172.21.15.196:3300/0 conn(0x7f7bc40b8430 msgr2=0x7f7bc40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:42.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.523+0000 7f7bc2ffd700 1 --2- 172.21.15.37:0/3976249963 >> v2:172.21.15.196:3300/0 conn(0x7f7bc40b8430 0x7f7bc40cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.523+0000 7f7bc2ffd700 1 -- 172.21.15.37:0/3976249963 >> v1:172.21.15.37:6789/0 conn(0x7f7bc40cfa90 legacy=0x7f7bc415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.523+0000 7f7bc2ffd700 1 -- 172.21.15.37:0/3976249963 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc40b4ee0 con 0x7f7bc40d3730 2023-07-12T02:05:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.523+0000 7f7bc2ffd700 1 --2- 172.21.15.37:0/3976249963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bc40d3730 0x7f7bc40cf550 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40cf520 tx=0x7f7bb8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa66c9e7db0ad10b server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.523+0000 7f7bc27fc700 1 -- 172.21.15.37:0/3976249963 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb800b870 con 0x7f7bc40d3730 2023-07-12T02:05:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.524+0000 7f7bc27fc700 1 -- 172.21.15.37:0/3976249963 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb800b9d0 con 0x7f7bc40d3730 2023-07-12T02:05:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.524+0000 7f7bc27fc700 1 -- 172.21.15.37:0/3976249963 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb800bd60 con 0x7f7bc40d3730 2023-07-12T02:05:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.524+0000 7f7bca1ff700 1 -- 172.21.15.37:0/3976249963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bc40d3730 msgr2=0x7f7bc40cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.524+0000 7f7bca1ff700 1 --2- 172.21.15.37:0/3976249963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bc40d3730 0x7f7bc40cf550 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40cf520 tx=0x7f7bb8009bd0 comp rx=0 tx=0).stop 2023-07-12T02:05:42.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.524+0000 7f7bca1ff700 1 -- 172.21.15.37:0/3976249963 shutdown_connections 2023-07-12T02:05:42.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.524+0000 7f7bca1ff700 1 --2- 172.21.15.37:0/3976249963 >> v2:172.21.15.196:3300/0 conn(0x7f7bc40b8430 0x7f7bc40cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:42.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.524+0000 7f7bca1ff700 1 --2- 172.21.15.37:0/3976249963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bc40d3730 0x7f7bc40cf550 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:42.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.524+0000 7f7bca1ff700 1 -- 172.21.15.37:0/3976249963 >> 172.21.15.37:0/3976249963 conn(0x7f7bc406b3f0 msgr2=0x7f7bc406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:42.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.524+0000 7f7bca1ff700 1 -- 172.21.15.37:0/3976249963 shutdown_connections 2023-07-12T02:05:42.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.524+0000 7f7bca1ff700 1 -- 172.21.15.37:0/3976249963 wait complete. 2023-07-12T02:05:42.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.527+0000 7f7bca1ff700 1 Processor -- start 2023-07-12T02:05:42.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.527+0000 7f7bca1ff700 1 -- start start 2023-07-12T02:05:42.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.528+0000 7f7bca1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bc40b8430 0x7f7bc41f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:42.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.528+0000 7f7bca1ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc40cfa90 0x7f7bc40cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:42.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.528+0000 7f7bca1ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bc40d3730 0x7f7bc41f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:42.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.528+0000 7f7bca1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40cab20 con 0x7f7bc40b8430 2023-07-12T02:05:42.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.528+0000 7f7bca1ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40cae00 con 0x7f7bc40d3730 2023-07-12T02:05:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.528+0000 7f7bca1ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40cb0e0 con 0x7f7bc40cfa90 2023-07-12T02:05:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.528+0000 7f7bc37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bc40b8430 0x7f7bc41f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.528+0000 7f7bc37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bc40b8430 0x7f7bc41f4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56788/0 (socket says 172.21.15.37:56788) 2023-07-12T02:05:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.528+0000 7f7bc37fe700 1 -- 172.21.15.37:0/2906275706 learned_addr learned my addr 172.21.15.37:0/2906275706 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.528+0000 7f7bc2ffd700 1 --2- 172.21.15.37:0/2906275706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc40cfa90 0x7f7bc40cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.528+0000 7f7bc3fff700 1 --2- 172.21.15.37:0/2906275706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bc40d3730 0x7f7bc41f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:42.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.529+0000 7f7bc37fe700 1 -- 172.21.15.37:0/2906275706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc40cfa90 msgr2=0x7f7bc40cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:42.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.529+0000 7f7bc37fe700 1 --2- 172.21.15.37:0/2906275706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc40cfa90 0x7f7bc40cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:42.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.529+0000 7f7bc37fe700 1 -- 172.21.15.37:0/2906275706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bc40d3730 msgr2=0x7f7bc41f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:42.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.529+0000 7f7bc37fe700 1 --2- 172.21.15.37:0/2906275706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bc40d3730 0x7f7bc41f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:42.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.529+0000 7f7bc37fe700 1 -- 172.21.15.37:0/2906275706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb8009550 con 0x7f7bc40b8430 2023-07-12T02:05:42.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.529+0000 7f7bc37fe700 1 --2- 172.21.15.37:0/2906275706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bc40b8430 0x7f7bc41f4cd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400d800 tx=0x7f7bb400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:42.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.529+0000 7f7babfff700 1 -- 172.21.15.37:0/2906275706 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb40125f0 con 0x7f7bc40b8430 2023-07-12T02:05:42.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.529+0000 7f7babfff700 1 -- 172.21.15.37:0/2906275706 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb4012750 con 0x7f7bc40b8430 2023-07-12T02:05:42.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.529+0000 7f7bca1ff700 1 -- 172.21.15.37:0/2906275706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc40cb3c0 con 0x7f7bc40b8430 2023-07-12T02:05:42.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.530+0000 7f7babfff700 1 -- 172.21.15.37:0/2906275706 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4012b00 con 0x7f7bc40b8430 2023-07-12T02:05:42.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.530+0000 7f7bca1ff700 1 -- 172.21.15.37:0/2906275706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc41f5210 con 0x7f7bc40b8430 2023-07-12T02:05:42.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.531+0000 7f7bca1ff700 1 -- 172.21.15.37:0/2906275706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc41f31b0 con 0x7f7bc40b8430 2023-07-12T02:05:42.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.532+0000 7f7babfff700 1 -- 172.21.15.37:0/2906275706 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7bb4012c60 con 0x7f7bc40b8430 2023-07-12T02:05:42.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.532+0000 7f7babfff700 1 --2- 172.21.15.37:0/2906275706 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7bb006ace0 0x7f7bb006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:42.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.533+0000 7f7babfff700 1 -- 172.21.15.37:0/2906275706 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7bb40896a0 con 0x7f7bc40b8430 2023-07-12T02:05:42.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.533+0000 7f7bc2ffd700 1 --2- 172.21.15.37:0/2906275706 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7bb006ace0 0x7f7bb006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:42.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.534+0000 7f7bc2ffd700 1 --2- 172.21.15.37:0/2906275706 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7bb006ace0 0x7f7bb006d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8000c00 tx=0x7f7bb8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:42.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.537+0000 7f7babfff700 1 -- 172.21.15.37:0/2906275706 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7bb4054570 con 0x7f7bc40b8430 2023-07-12T02:05:42.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:42.795+0000 7f7bca1ff700 1 -- 172.21.15.37:0/2906275706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7bc404ea60 con 0x7f7bc40b8430 2023-07-12T02:05:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.397+0000 7f7babfff700 1 -- 172.21.15.37:0/2906275706 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7bb4057b90 con 0x7f7bc40b8430 2023-07-12T02:05:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.400+0000 7f7bca1ff700 1 -- 172.21.15.37:0/2906275706 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7bb006ace0 msgr2=0x7f7bb006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.400+0000 7f7bca1ff700 1 --2- 172.21.15.37:0/2906275706 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7bb006ace0 0x7f7bb006d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8000c00 tx=0x7f7bb8008030 comp rx=0 tx=0).stop 2023-07-12T02:05:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.400+0000 7f7bca1ff700 1 -- 172.21.15.37:0/2906275706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bc40b8430 msgr2=0x7f7bc41f4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.400+0000 7f7bca1ff700 1 --2- 172.21.15.37:0/2906275706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bc40b8430 0x7f7bc41f4cd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400d800 tx=0x7f7bb400db10 comp rx=0 tx=0).stop 2023-07-12T02:05:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.400+0000 7f7bca1ff700 1 -- 172.21.15.37:0/2906275706 shutdown_connections 2023-07-12T02:05:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.400+0000 7f7bca1ff700 1 --2- 172.21.15.37:0/2906275706 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7bb006ace0 0x7f7bb006d190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.400+0000 7f7bca1ff700 1 --2- 172.21.15.37:0/2906275706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bc40b8430 0x7f7bc41f4cd0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.400+0000 7f7bca1ff700 1 --2- 172.21.15.37:0/2906275706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bc40d3730 0x7f7bc41f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.400+0000 7f7bca1ff700 1 --2- 172.21.15.37:0/2906275706 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc40cfa90 0x7f7bc40cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.400+0000 7f7bca1ff700 1 -- 172.21.15.37:0/2906275706 >> 172.21.15.37:0/2906275706 conn(0x7f7bc406b3f0 msgr2=0x7f7bc40d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.400+0000 7f7bca1ff700 1 -- 172.21.15.37:0/2906275706 shutdown_connections 2023-07-12T02:05:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.400+0000 7f7bca1ff700 1 -- 172.21.15.37:0/2906275706 wait complete. 2023-07-12T02:05:43.425 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-12T02:05:43.425 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-12T02:05:43.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.629+0000 7f97c81ff700 1 Processor -- start 2023-07-12T02:05:43.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.629+0000 7f97c81ff700 1 -- start start 2023-07-12T02:05:43.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.630+0000 7f97c81ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97c00b8430 0x7f97c00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:43.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.630+0000 7f97c81ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f97c00d3730 0x7f97c00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:43.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.630+0000 7f97c81ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c00d0b20 con 0x7f97c00cfa90 2023-07-12T02:05:43.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.630+0000 7f97c81ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c00b8800 con 0x7f97c00d3730 2023-07-12T02:05:43.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.630+0000 7f97c81ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00cfeb0 con 0x7f97c00b8430 2023-07-12T02:05:43.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.631+0000 7f97c5f9b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97c00b8430 0x7f97c00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:43.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.631+0000 7f97c579a700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f97c00d3730 0x7f97c00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:43.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.631+0000 7f97c579a700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f97c00d3730 0x7f97c00cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:49520/0 (socket says 172.21.15.37:49520) 2023-07-12T02:05:43.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.631+0000 7f97c579a700 1 -- 172.21.15.37:0/450156485 learned_addr learned my addr 172.21.15.37:0/450156485 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:43.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.631+0000 7f97c579a700 1 -- 172.21.15.37:0/450156485 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97c00b8430 msgr2=0x7f97c00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:43.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.631+0000 7f97c579a700 1 --2- 172.21.15.37:0/450156485 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97c00b8430 0x7f97c00cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:43.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.631+0000 7f97c579a700 1 -- 172.21.15.37:0/450156485 >> v1:172.21.15.196:6789/0 conn(0x7f97c00cfa90 legacy=0x7f97c015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:43.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.631+0000 7f97c579a700 1 -- 172.21.15.37:0/450156485 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c00b4ee0 con 0x7f97c00d3730 2023-07-12T02:05:43.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.631+0000 7f97c5f9b700 1 --2- 172.21.15.37:0/450156485 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97c00b8430 0x7f97c00cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:43.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.631+0000 7f97c4f99700 1 -- 172.21.15.37:0/450156485 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936856060 0 0) 0x7f97c00d0b20 con 0x7f97c00cfa90 2023-07-12T02:05:43.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.632+0000 7f97c579a700 1 --2- 172.21.15.37:0/450156485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c00d3730 0x7f97c00cf550 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f97b00098f0 tx=0x7f97b0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=feb6d3b92f34f788 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:43.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.632+0000 7f97c4f99700 1 -- 172.21.15.37:0/450156485 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0011830 con 0x7f97c00d3730 2023-07-12T02:05:43.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.632+0000 7f97c4f99700 1 -- 172.21.15.37:0/450156485 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b0011990 con 0x7f97c00d3730 2023-07-12T02:05:43.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.632+0000 7f97c4f99700 1 -- 172.21.15.37:0/450156485 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0011d20 con 0x7f97c00d3730 2023-07-12T02:05:43.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.632+0000 7f97c81ff700 1 -- 172.21.15.37:0/450156485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c00d3730 msgr2=0x7f97c00cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:43.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.632+0000 7f97c81ff700 1 --2- 172.21.15.37:0/450156485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c00d3730 0x7f97c00cf550 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f97b00098f0 tx=0x7f97b0009c00 comp rx=0 tx=0).stop 2023-07-12T02:05:43.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.633+0000 7f97c81ff700 1 -- 172.21.15.37:0/450156485 shutdown_connections 2023-07-12T02:05:43.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.633+0000 7f97c81ff700 1 --2- 172.21.15.37:0/450156485 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97c00b8430 0x7f97c00cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:43.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.633+0000 7f97c81ff700 1 --2- 172.21.15.37:0/450156485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c00d3730 0x7f97c00cf550 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:43.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.633+0000 7f97c81ff700 1 -- 172.21.15.37:0/450156485 >> 172.21.15.37:0/450156485 conn(0x7f97c006b3f0 msgr2=0x7f97c006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:43.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.633+0000 7f97c81ff700 1 -- 172.21.15.37:0/450156485 shutdown_connections 2023-07-12T02:05:43.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.633+0000 7f97c81ff700 1 -- 172.21.15.37:0/450156485 wait complete. 2023-07-12T02:05:43.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.634+0000 7f97c81ff700 1 Processor -- start 2023-07-12T02:05:43.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.635+0000 7f97c81ff700 1 -- start start 2023-07-12T02:05:43.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.635+0000 7f97c81ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c00b8430 0x7f97c0158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:43.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.636+0000 7f97c81ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c00cfa90 0x7f97c015c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:43.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.636+0000 7f97c81ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97c00d3730 0x7f97c00b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:43.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.636+0000 7f97c81ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00c6710 con 0x7f97c00cfa90 2023-07-12T02:05:43.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.636+0000 7f97c81ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00c69f0 con 0x7f97c00b8430 2023-07-12T02:05:43.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.636+0000 7f97c81ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00c6cd0 con 0x7f97c00d3730 2023-07-12T02:05:43.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.636+0000 7f97c579a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c00cfa90 0x7f97c015c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:43.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.636+0000 7f97c579a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c00cfa90 0x7f97c015c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56794/0 (socket says 172.21.15.37:56794) 2023-07-12T02:05:43.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.636+0000 7f97c579a700 1 -- 172.21.15.37:0/2690338326 learned_addr learned my addr 172.21.15.37:0/2690338326 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:43.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.636+0000 7f97c5f9b700 1 --2- 172.21.15.37:0/2690338326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c00b8430 0x7f97c0158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:43.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.636+0000 7f97c679c700 1 --2- 172.21.15.37:0/2690338326 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97c00d3730 0x7f97c00b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:43.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.636+0000 7f97c579a700 1 -- 172.21.15.37:0/2690338326 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97c00d3730 msgr2=0x7f97c00b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:43.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.636+0000 7f97c579a700 1 --2- 172.21.15.37:0/2690338326 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97c00d3730 0x7f97c00b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:43.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.636+0000 7f97c579a700 1 -- 172.21.15.37:0/2690338326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c00b8430 msgr2=0x7f97c0158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:43.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.636+0000 7f97c579a700 1 --2- 172.21.15.37:0/2690338326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c00b8430 0x7f97c0158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.636+0000 7f97c579a700 1 -- 172.21.15.37:0/2690338326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc0094a0 con 0x7f97c00cfa90 2023-07-12T02:05:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.636+0000 7f97c679c700 1 --2- 172.21.15.37:0/2690338326 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97c00d3730 0x7f97c00b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.637+0000 7f97c579a700 1 --2- 172.21.15.37:0/2690338326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c00cfa90 0x7f97c015c9a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f97c006c780 tx=0x7f97b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.637+0000 7f97b67fc700 1 -- 172.21.15.37:0/2690338326 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0004510 con 0x7f97c00cfa90 2023-07-12T02:05:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.637+0000 7f97b67fc700 1 -- 172.21.15.37:0/2690338326 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b00036a0 con 0x7f97c00cfa90 2023-07-12T02:05:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.637+0000 7f97c81ff700 1 -- 172.21.15.37:0/2690338326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b0009550 con 0x7f97c00cfa90 2023-07-12T02:05:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.637+0000 7f97b67fc700 1 -- 172.21.15.37:0/2690338326 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0003a10 con 0x7f97c00cfa90 2023-07-12T02:05:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.637+0000 7f97c81ff700 1 -- 172.21.15.37:0/2690338326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c00c7290 con 0x7f97c00cfa90 2023-07-12T02:05:43.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.638+0000 7f97c81ff700 1 -- 172.21.15.37:0/2690338326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c00c74b0 con 0x7f97c00cfa90 2023-07-12T02:05:43.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.639+0000 7f97b67fc700 1 -- 172.21.15.37:0/2690338326 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f97b0003b70 con 0x7f97c00cfa90 2023-07-12T02:05:43.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.641+0000 7f97b67fc700 1 --2- 172.21.15.37:0/2690338326 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f97a406ace0 0x7f97a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:43.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.641+0000 7f97b67fc700 1 -- 172.21.15.37:0/2690338326 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f97b008a710 con 0x7f97c00cfa90 2023-07-12T02:05:43.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.641+0000 7f97c5f9b700 1 --2- 172.21.15.37:0/2690338326 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f97a406ace0 0x7f97a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:43.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.642+0000 7f97c5f9b700 1 --2- 172.21.15.37:0/2690338326 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f97a406ace0 0x7f97a406d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009cd0 tx=0x7f97bc009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.645+0000 7f97b67fc700 1 -- 172.21.15.37:0/2690338326 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f97b0055720 con 0x7f97c00cfa90 2023-07-12T02:05:43.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:43.901+0000 7f97c81ff700 1 -- 172.21.15.37:0/2690338326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f97c004ea60 con 0x7f97c00cfa90 2023-07-12T02:05:44.280 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-07-12T02:05:44.277+0000 7ff967bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-12T02:05:44.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.399+0000 7f97b67fc700 1 -- 172.21.15.37:0/2690338326 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f97b0058d40 con 0x7f97c00cfa90 2023-07-12T02:05:44.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.402+0000 7f97c81ff700 1 -- 172.21.15.37:0/2690338326 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f97a406ace0 msgr2=0x7f97a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:44.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.402+0000 7f97c81ff700 1 --2- 172.21.15.37:0/2690338326 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f97a406ace0 0x7f97a406d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009cd0 tx=0x7f97bc009210 comp rx=0 tx=0).stop 2023-07-12T02:05:44.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.402+0000 7f97c81ff700 1 -- 172.21.15.37:0/2690338326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c00cfa90 msgr2=0x7f97c015c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:44.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.402+0000 7f97c81ff700 1 --2- 172.21.15.37:0/2690338326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c00cfa90 0x7f97c015c9a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f97c006c780 tx=0x7f97b0004750 comp rx=0 tx=0).stop 2023-07-12T02:05:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.402+0000 7f97c81ff700 1 -- 172.21.15.37:0/2690338326 shutdown_connections 2023-07-12T02:05:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.402+0000 7f97c81ff700 1 --2- 172.21.15.37:0/2690338326 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f97a406ace0 0x7f97a406d190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.402+0000 7f97c81ff700 1 --2- 172.21.15.37:0/2690338326 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97c00d3730 0x7f97c00b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.402+0000 7f97c81ff700 1 --2- 172.21.15.37:0/2690338326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c00b8430 0x7f97c0158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.402+0000 7f97c81ff700 1 --2- 172.21.15.37:0/2690338326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c00cfa90 0x7f97c015c9a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.402+0000 7f97c81ff700 1 -- 172.21.15.37:0/2690338326 >> 172.21.15.37:0/2690338326 conn(0x7f97c006b3f0 msgr2=0x7f97c00d19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.403+0000 7f97c81ff700 1 -- 172.21.15.37:0/2690338326 shutdown_connections 2023-07-12T02:05:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.403+0000 7f97c81ff700 1 -- 172.21.15.37:0/2690338326 wait complete. 2023-07-12T02:05:44.426 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-12T02:05:44.427 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:05:44.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.628+0000 7f0ec21ff700 1 Processor -- start 2023-07-12T02:05:44.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.628+0000 7f0ec21ff700 1 -- start start 2023-07-12T02:05:44.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.630+0000 7f0ec21ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ebc0b59d0 0x7f0ebc1671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:44.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.630+0000 7f0ec21ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc0d1790 con 0x7f0ebc15c460 2023-07-12T02:05:44.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.630+0000 7f0ec21ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc0cd950 con 0x7f0ebc0d2640 2023-07-12T02:05:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.630+0000 7f0ec21ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ebc0b5e10 con 0x7f0ebc0b59d0 2023-07-12T02:05:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.630+0000 7f0ebbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ebc0b59d0 0x7f0ebc1671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.630+0000 7f0ebb7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0ebc15c460 0x7f0ebc0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41594/0 (socket says 172.21.15.37:41594) 2023-07-12T02:05:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.630+0000 7f0ebb7fe700 1 -- 172.21.15.37:0/1356625942 learned_addr learned my addr 172.21.15.37:0/1356625942 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.630+0000 7f0ebbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ebc0b59d0 0x7f0ebc1671b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56802/0 (socket says 172.21.15.37:56802) 2023-07-12T02:05:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.630+0000 7f0ebbfff700 1 -- 172.21.15.37:0/1356625942 >> v1:172.21.15.196:6789/0 conn(0x7f0ebc0d2640 legacy=0x7f0ebc0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.630+0000 7f0ebbfff700 1 -- 172.21.15.37:0/1356625942 >> v1:172.21.15.37:6789/0 conn(0x7f0ebc15c460 legacy=0x7f0ebc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:44.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.630+0000 7f0ebbfff700 1 -- 172.21.15.37:0/1356625942 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc0d14b0 con 0x7f0ebc0b59d0 2023-07-12T02:05:44.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.631+0000 7f0ebbfff700 1 --2- 172.21.15.37:0/1356625942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ebc0b59d0 0x7f0ebc1671b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009d90 tx=0x7f0eb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d152c36f5bf1f3ef server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:44.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.631+0000 7f0eba7fc700 1 -- 172.21.15.37:0/1356625942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb400e070 con 0x7f0ebc0b59d0 2023-07-12T02:05:44.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.631+0000 7f0eba7fc700 1 -- 172.21.15.37:0/1356625942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb400bb90 con 0x7f0ebc0b59d0 2023-07-12T02:05:44.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.631+0000 7f0eba7fc700 1 -- 172.21.15.37:0/1356625942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4003a20 con 0x7f0ebc0b59d0 2023-07-12T02:05:44.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.631+0000 7f0ec21ff700 1 -- 172.21.15.37:0/1356625942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ebc0b59d0 msgr2=0x7f0ebc1671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:44.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.631+0000 7f0ec21ff700 1 --2- 172.21.15.37:0/1356625942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ebc0b59d0 0x7f0ebc1671b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009d90 tx=0x7f0eb400b330 comp rx=0 tx=0).stop 2023-07-12T02:05:44.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.631+0000 7f0ec21ff700 1 -- 172.21.15.37:0/1356625942 shutdown_connections 2023-07-12T02:05:44.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.631+0000 7f0ec21ff700 1 --2- 172.21.15.37:0/1356625942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ebc0b59d0 0x7f0ebc1671b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:44.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.631+0000 7f0ec21ff700 1 -- 172.21.15.37:0/1356625942 >> 172.21.15.37:0/1356625942 conn(0x7f0ebc071660 msgr2=0x7f0ebc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:44.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.631+0000 7f0ec21ff700 1 -- 172.21.15.37:0/1356625942 shutdown_connections 2023-07-12T02:05:44.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.632+0000 7f0ec21ff700 1 -- 172.21.15.37:0/1356625942 wait complete. 2023-07-12T02:05:44.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.633+0000 7f0ec21ff700 1 Processor -- start 2023-07-12T02:05:44.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.633+0000 7f0ec21ff700 1 -- start start 2023-07-12T02:05:44.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.634+0000 7f0ec21ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ebc0b59d0 0x7f0ebc1e6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:44.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.634+0000 7f0ec21ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ebc0d2640 0x7f0ebc0b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:44.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.634+0000 7f0ec21ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ebc15c460 0x7f0ebc0b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:44.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.634+0000 7f0ec21ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc143610 con 0x7f0ebc0d2640 2023-07-12T02:05:44.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.634+0000 7f0ec21ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc1562d0 con 0x7f0ebc15c460 2023-07-12T02:05:44.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.634+0000 7f0ec21ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc145b20 con 0x7f0ebc0b59d0 2023-07-12T02:05:44.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.635+0000 7f0ebaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ebc0d2640 0x7f0ebc0b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:44.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.635+0000 7f0ebaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ebc0d2640 0x7f0ebc0b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56816/0 (socket says 172.21.15.37:56816) 2023-07-12T02:05:44.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.635+0000 7f0ebaffd700 1 -- 172.21.15.37:0/1056217970 learned_addr learned my addr 172.21.15.37:0/1056217970 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:44.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.635+0000 7f0ebb7fe700 1 --2- 172.21.15.37:0/1056217970 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ebc0b59d0 0x7f0ebc1e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:44.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.635+0000 7f0ebbfff700 1 --2- 172.21.15.37:0/1056217970 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ebc15c460 0x7f0ebc0b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:44.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.635+0000 7f0ebaffd700 1 -- 172.21.15.37:0/1056217970 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ebc0b59d0 msgr2=0x7f0ebc1e6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:44.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.635+0000 7f0ebaffd700 1 --2- 172.21.15.37:0/1056217970 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ebc0b59d0 0x7f0ebc1e6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:44.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.635+0000 7f0ebaffd700 1 -- 172.21.15.37:0/1056217970 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ebc15c460 msgr2=0x7f0ebc0b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:44.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.635+0000 7f0ebaffd700 1 --2- 172.21.15.37:0/1056217970 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ebc15c460 0x7f0ebc0b72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:44.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.635+0000 7f0ebaffd700 1 -- 172.21.15.37:0/1056217970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb4009a70 con 0x7f0ebc0d2640 2023-07-12T02:05:44.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.635+0000 7f0ebaffd700 1 --2- 172.21.15.37:0/1056217970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ebc0d2640 0x7f0ebc0b6db0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000c4a0 tx=0x7f0eb000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:44.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.635+0000 7f0ea3fff700 1 -- 172.21.15.37:0/1056217970 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00054e0 con 0x7f0ebc0d2640 2023-07-12T02:05:44.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.636+0000 7f0ea3fff700 1 -- 172.21.15.37:0/1056217970 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb0003680 con 0x7f0ebc0d2640 2023-07-12T02:05:44.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.636+0000 7f0ec21ff700 1 -- 172.21.15.37:0/1056217970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ebc145e00 con 0x7f0ebc0d2640 2023-07-12T02:05:44.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.636+0000 7f0ea3fff700 1 -- 172.21.15.37:0/1056217970 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0003a30 con 0x7f0ebc0d2640 2023-07-12T02:05:44.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.636+0000 7f0ec21ff700 1 -- 172.21.15.37:0/1056217970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ebc143230 con 0x7f0ebc0d2640 2023-07-12T02:05:44.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.637+0000 7f0ec21ff700 1 -- 172.21.15.37:0/1056217970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ebc143750 con 0x7f0ebc0d2640 2023-07-12T02:05:44.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.638+0000 7f0ea3fff700 1 -- 172.21.15.37:0/1056217970 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0eb0003b90 con 0x7f0ebc0d2640 2023-07-12T02:05:44.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.639+0000 7f0ea3fff700 1 --2- 172.21.15.37:0/1056217970 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0ea806ace0 0x7f0ea806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:44.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.639+0000 7f0ea3fff700 1 -- 172.21.15.37:0/1056217970 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0eb0088ad0 con 0x7f0ebc0d2640 2023-07-12T02:05:44.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.639+0000 7f0ebb7fe700 1 --2- 172.21.15.37:0/1056217970 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0ea806ace0 0x7f0ea806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:44.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.640+0000 7f0ebb7fe700 1 --2- 172.21.15.37:0/1056217970 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0ea806ace0 0x7f0ea806d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0eac000f60 tx=0x7f0eac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:44.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.643+0000 7f0ea3fff700 1 -- 172.21.15.37:0/1056217970 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0ebc143750 con 0x7f0ebc0d2640 2023-07-12T02:05:44.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.897+0000 7f0ec21ff700 1 -- 172.21.15.37:0/1056217970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ebc143750 con 0x7f0ebc0d2640 2023-07-12T02:05:44.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.897+0000 7f0ea3fff700 1 -- 172.21.15.37:0/1056217970 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f0ebc143750 con 0x7f0ebc0d2640 2023-07-12T02:05:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:44.901 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/3548227069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3548227069},{"type":"v1","addr":"172.21.15.196:6836","nonce":3548227069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3838929749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3838929749},{"type":"v1","addr":"172.21.15.37:6834","nonce":3838929749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1710322730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":1710322730},{"type":"v1","addr":"172.21.15.196:6837","nonce":1710322730}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:05:40.912998+0000","modified":"2023-07-12T02:05:43.903236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5388},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5388":{"gid":5388,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/483849162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":483849162},{"type":"v1","addr":"172.21.15.37:6835","nonce":483849162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-12T02:05:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.899+0000 7f0ec21ff700 1 -- 172.21.15.37:0/1056217970 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0ea806ace0 msgr2=0x7f0ea806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.899+0000 7f0ec21ff700 1 --2- 172.21.15.37:0/1056217970 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0ea806ace0 0x7f0ea806d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0eac000f60 tx=0x7f0eac009040 comp rx=0 tx=0).stop 2023-07-12T02:05:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.899+0000 7f0ec21ff700 1 -- 172.21.15.37:0/1056217970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ebc0d2640 msgr2=0x7f0ebc0b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.899+0000 7f0ec21ff700 1 --2- 172.21.15.37:0/1056217970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ebc0d2640 0x7f0ebc0b6db0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000c4a0 tx=0x7f0eb000c860 comp rx=0 tx=0).stop 2023-07-12T02:05:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.900+0000 7f0ec21ff700 1 -- 172.21.15.37:0/1056217970 shutdown_connections 2023-07-12T02:05:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.900+0000 7f0ec21ff700 1 --2- 172.21.15.37:0/1056217970 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f0ea806ace0 0x7f0ea806d190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.900+0000 7f0ec21ff700 1 --2- 172.21.15.37:0/1056217970 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ebc15c460 0x7f0ebc0b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.900+0000 7f0ec21ff700 1 --2- 172.21.15.37:0/1056217970 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ebc0b59d0 0x7f0ebc1e6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.900+0000 7f0ec21ff700 1 --2- 172.21.15.37:0/1056217970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ebc0d2640 0x7f0ebc0b6db0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.900+0000 7f0ec21ff700 1 -- 172.21.15.37:0/1056217970 >> 172.21.15.37:0/1056217970 conn(0x7f0ebc071660 msgr2=0x7f0ebc15ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.900+0000 7f0ec21ff700 1 -- 172.21.15.37:0/1056217970 shutdown_connections 2023-07-12T02:05:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:44.900+0000 7f0ec21ff700 1 -- 172.21.15.37:0/1056217970 wait complete. 2023-07-12T02:05:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2023-07-12T02:05:44.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:05:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.117+0000 7fec219ff700 1 Processor -- start 2023-07-12T02:05:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.117+0000 7fec219ff700 1 -- start start 2023-07-12T02:05:45.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.118+0000 7fec219ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c0b59d0 0x7fec1c1671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.118+0000 7fec219ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1c0d1790 con 0x7fec1c15c460 2023-07-12T02:05:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.118+0000 7fec219ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1c0cd950 con 0x7fec1c0d2640 2023-07-12T02:05:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.118+0000 7fec219ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0cedd0 con 0x7fec1c0b59d0 2023-07-12T02:05:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.118+0000 7fec1affd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fec1c15c460 0x7fec1c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41604/0 (socket says 172.21.15.37:41604) 2023-07-12T02:05:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.118+0000 7fec1affd700 1 -- 172.21.15.37:0/1634851901 learned_addr learned my addr 172.21.15.37:0/1634851901 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:45.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.118+0000 7fec1b7fe700 1 --2- 172.21.15.37:0/1634851901 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c0b59d0 0x7fec1c1671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:45.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.119+0000 7fec19ffb700 1 -- 172.21.15.37:0/1634851901 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809914771 0 0) 0x7fec1c0d1790 con 0x7fec1c15c460 2023-07-12T02:05:45.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.119+0000 7fec19ffb700 1 -- 172.21.15.37:0/1634851901 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec040035b0 con 0x7fec1c15c460 2023-07-12T02:05:45.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.119+0000 7fec19ffb700 1 -- 172.21.15.37:0/1634851901 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880467385 0 0) 0x7fec1c0cd950 con 0x7fec1c0d2640 2023-07-12T02:05:45.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.119+0000 7fec19ffb700 1 -- 172.21.15.37:0/1634851901 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec1c0d1790 con 0x7fec1c0d2640 2023-07-12T02:05:45.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.119+0000 7fec19ffb700 1 -- 172.21.15.37:0/1634851901 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1515691442 0 0) 0x7fec040035b0 con 0x7fec1c15c460 2023-07-12T02:05:45.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.119+0000 7fec1b7fe700 1 -- 172.21.15.37:0/1634851901 >> v1:172.21.15.196:6789/0 conn(0x7fec1c0d2640 legacy=0x7fec1c0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:45.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.119+0000 7fec1b7fe700 1 -- 172.21.15.37:0/1634851901 >> v1:172.21.15.37:6789/0 conn(0x7fec1c15c460 legacy=0x7fec1c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:45.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.119+0000 7fec1b7fe700 1 -- 172.21.15.37:0/1634851901 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c0d14b0 con 0x7fec1c0b59d0 2023-07-12T02:05:45.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.119+0000 7fec1b7fe700 1 --2- 172.21.15.37:0/1634851901 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c0b59d0 0x7fec1c1671b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec14009dc0 tx=0x7fec1400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7865973ec9e4c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:45.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.120+0000 7fec19ffb700 1 -- 172.21.15.37:0/1634851901 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400e070 con 0x7fec1c0b59d0 2023-07-12T02:05:45.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.120+0000 7fec19ffb700 1 -- 172.21.15.37:0/1634851901 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec14003a20 con 0x7fec1c0b59d0 2023-07-12T02:05:45.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.120+0000 7fec19ffb700 1 -- 172.21.15.37:0/1634851901 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c001670 con 0x7fec1c0b59d0 2023-07-12T02:05:45.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.120+0000 7fec219ff700 1 -- 172.21.15.37:0/1634851901 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c0b59d0 msgr2=0x7fec1c1671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:45.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.120+0000 7fec219ff700 1 --2- 172.21.15.37:0/1634851901 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c0b59d0 0x7fec1c1671b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec14009dc0 tx=0x7fec1400b330 comp rx=0 tx=0).stop 2023-07-12T02:05:45.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.120+0000 7fec219ff700 1 -- 172.21.15.37:0/1634851901 shutdown_connections 2023-07-12T02:05:45.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.120+0000 7fec219ff700 1 --2- 172.21.15.37:0/1634851901 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c0b59d0 0x7fec1c1671b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.120+0000 7fec219ff700 1 -- 172.21.15.37:0/1634851901 >> 172.21.15.37:0/1634851901 conn(0x7fec1c071660 msgr2=0x7fec1c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:45.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.120+0000 7fec219ff700 1 -- 172.21.15.37:0/1634851901 shutdown_connections 2023-07-12T02:05:45.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.120+0000 7fec219ff700 1 -- 172.21.15.37:0/1634851901 wait complete. 2023-07-12T02:05:45.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.122+0000 7fec219ff700 1 Processor -- start 2023-07-12T02:05:45.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.122+0000 7fec219ff700 1 -- start start 2023-07-12T02:05:45.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.123+0000 7fec219ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec1c0b59d0 0x7fec1c153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:45.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.123+0000 7fec219ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec1c0d2640 0x7fec1c0cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:45.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.123+0000 7fec219ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c15c460 0x7fec1c0cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:45.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.123+0000 7fec219ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c1544c0 con 0x7fec1c0d2640 2023-07-12T02:05:45.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.123+0000 7fec219ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0cc220 con 0x7fec1c0b59d0 2023-07-12T02:05:45.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.123+0000 7fec219ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0cc500 con 0x7fec1c15c460 2023-07-12T02:05:45.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.123+0000 7fec1a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec1c0d2640 0x7fec1c0cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:45.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.123+0000 7fec1a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec1c0d2640 0x7fec1c0cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56826/0 (socket says 172.21.15.37:56826) 2023-07-12T02:05:45.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.123+0000 7fec1a7fc700 1 -- 172.21.15.37:0/3999979568 learned_addr learned my addr 172.21.15.37:0/3999979568 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:45.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.124+0000 7fec1affd700 1 --2- 172.21.15.37:0/3999979568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec1c0b59d0 0x7fec1c153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:45.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.124+0000 7fec1b7fe700 1 --2- 172.21.15.37:0/3999979568 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c15c460 0x7fec1c0cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:45.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.124+0000 7fec1a7fc700 1 -- 172.21.15.37:0/3999979568 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c15c460 msgr2=0x7fec1c0cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:45.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.124+0000 7fec1a7fc700 1 --2- 172.21.15.37:0/3999979568 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c15c460 0x7fec1c0cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.124+0000 7fec1a7fc700 1 -- 172.21.15.37:0/3999979568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec1c0b59d0 msgr2=0x7fec1c153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:45.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.124+0000 7fec1a7fc700 1 --2- 172.21.15.37:0/3999979568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec1c0b59d0 0x7fec1c153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.124+0000 7fec1a7fc700 1 -- 172.21.15.37:0/3999979568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec14009a70 con 0x7fec1c0d2640 2023-07-12T02:05:45.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.124+0000 7fec1b7fe700 1 --2- 172.21.15.37:0/3999979568 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c15c460 0x7fec1c0cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:45.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.124+0000 7fec1a7fc700 1 --2- 172.21.15.37:0/3999979568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec1c0d2640 0x7fec1c0cb6b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fec1000c500 tx=0x7fec1000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:45.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.124+0000 7fec03fff700 1 -- 172.21.15.37:0/3999979568 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec100052d0 con 0x7fec1c0d2640 2023-07-12T02:05:45.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.124+0000 7fec03fff700 1 -- 172.21.15.37:0/3999979568 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec10005450 con 0x7fec1c0d2640 2023-07-12T02:05:45.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.124+0000 7fec03fff700 1 -- 172.21.15.37:0/3999979568 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec100038c0 con 0x7fec1c0d2640 2023-07-12T02:05:45.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.124+0000 7fec219ff700 1 -- 172.21.15.37:0/3999979568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1c143a00 con 0x7fec1c0d2640 2023-07-12T02:05:45.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.125+0000 7fec219ff700 1 -- 172.21.15.37:0/3999979568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c143fc0 con 0x7fec1c0d2640 2023-07-12T02:05:45.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.126+0000 7fec219ff700 1 -- 172.21.15.37:0/3999979568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1c04ea60 con 0x7fec1c0d2640 2023-07-12T02:05:45.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.127+0000 7fec03fff700 1 -- 172.21.15.37:0/3999979568 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec10003a20 con 0x7fec1c0d2640 2023-07-12T02:05:45.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.128+0000 7fec03fff700 1 --2- 172.21.15.37:0/3999979568 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fec0806ace0 0x7fec0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:45.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.128+0000 7fec03fff700 1 -- 172.21.15.37:0/3999979568 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fec10088a80 con 0x7fec1c0d2640 2023-07-12T02:05:45.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.128+0000 7fec1affd700 1 --2- 172.21.15.37:0/3999979568 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fec0806ace0 0x7fec0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:45.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.129+0000 7fec1affd700 1 --2- 172.21.15.37:0/3999979568 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fec0806ace0 0x7fec0806d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fec0c005990 tx=0x7fec0c001b80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:45.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.132+0000 7fec03fff700 1 -- 172.21.15.37:0/3999979568 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fec100539f0 con 0x7fec1c0d2640 2023-07-12T02:05:45.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.339+0000 7fec219ff700 1 -- 172.21.15.37:0/3999979568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec1c0b4fa0 con 0x7fec1c0d2640 2023-07-12T02:05:45.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.340+0000 7fec03fff700 1 -- 172.21.15.37:0/3999979568 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18452 (secure 0 0 0) 0x7fec10057010 con 0x7fec1c0d2640 2023-07-12T02:05:45.344 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:45.344 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:05:42.352596+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:05:39.292112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-12T02:05:39.847178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:05:45.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.342+0000 7fec219ff700 1 -- 172.21.15.37:0/3999979568 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fec0806ace0 msgr2=0x7fec0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:45.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.342+0000 7fec219ff700 1 --2- 172.21.15.37:0/3999979568 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fec0806ace0 0x7fec0806d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fec0c005990 tx=0x7fec0c001b80 comp rx=0 tx=0).stop 2023-07-12T02:05:45.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.342+0000 7fec219ff700 1 -- 172.21.15.37:0/3999979568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec1c0d2640 msgr2=0x7fec1c0cb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:45.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.342+0000 7fec219ff700 1 --2- 172.21.15.37:0/3999979568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec1c0d2640 0x7fec1c0cb6b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fec1000c500 tx=0x7fec1000c8c0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.343+0000 7fec219ff700 1 -- 172.21.15.37:0/3999979568 shutdown_connections 2023-07-12T02:05:45.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.343+0000 7fec219ff700 1 --2- 172.21.15.37:0/3999979568 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fec0806ace0 0x7fec0806d190 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.343+0000 7fec219ff700 1 --2- 172.21.15.37:0/3999979568 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c15c460 0x7fec1c0cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.343+0000 7fec219ff700 1 --2- 172.21.15.37:0/3999979568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec1c0b59d0 0x7fec1c153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.343+0000 7fec219ff700 1 --2- 172.21.15.37:0/3999979568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec1c0d2640 0x7fec1c0cb6b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.343+0000 7fec219ff700 1 -- 172.21.15.37:0/3999979568 >> 172.21.15.37:0/3999979568 conn(0x7fec1c071660 msgr2=0x7fec1c0b5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:45.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.343+0000 7fec219ff700 1 -- 172.21.15.37:0/3999979568 shutdown_connections 2023-07-12T02:05:45.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.343+0000 7fec219ff700 1 -- 172.21.15.37:0/3999979568 wait complete. 2023-07-12T02:05:45.364 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-12T02:05:45.365 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-12T02:05:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.562+0000 7f276a7ff700 1 Processor -- start 2023-07-12T02:05:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.562+0000 7f276a7ff700 1 -- start start 2023-07-12T02:05:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.563+0000 7f276a7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f276415c460 0x7f27640b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.563+0000 7f276a7ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f27640d2640 0x7f27640cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.563+0000 7f276a7ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27640d1790 con 0x7f27640cf720 2023-07-12T02:05:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.563+0000 7f276a7ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27640cedd0 con 0x7f27640d2640 2023-07-12T02:05:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.563+0000 7f276a7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27640cd950 con 0x7f276415c460 2023-07-12T02:05:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.564+0000 7f27637fe700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f27640d2640 0x7f27640cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:45.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.564+0000 7f2763fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f276415c460 0x7f27640b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:45.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.564+0000 7f2763fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f276415c460 0x7f27640b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:60078/0 (socket says 172.21.15.37:60078) 2023-07-12T02:05:45.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.564+0000 7f2763fff700 1 -- 172.21.15.37:0/3979775665 learned_addr learned my addr 172.21.15.37:0/3979775665 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:45.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.565+0000 7f2763fff700 1 -- 172.21.15.37:0/3979775665 >> v2:172.21.15.196:3300/0 conn(0x7f27640d2640 msgr2=0x7f27640cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:45.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.565+0000 7f2763fff700 1 --2- 172.21.15.37:0/3979775665 >> v2:172.21.15.196:3300/0 conn(0x7f27640d2640 0x7f27640cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.565+0000 7f2763fff700 1 -- 172.21.15.37:0/3979775665 >> v1:172.21.15.196:6789/0 conn(0x7f27640cf720 legacy=0x7f27640d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:45.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.565+0000 7f2763fff700 1 -- 172.21.15.37:0/3979775665 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27640d14b0 con 0x7f276415c460 2023-07-12T02:05:45.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.565+0000 7f2763fff700 1 --2- 172.21.15.37:0/3979775665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f276415c460 0x7f27640b59d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f27540098f0 tx=0x7f2754009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=950a1a07403fc117 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:45.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.565+0000 7f2762ffd700 1 -- 172.21.15.37:0/3979775665 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754011830 con 0x7f276415c460 2023-07-12T02:05:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.565+0000 7f2762ffd700 1 -- 172.21.15.37:0/3979775665 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2754011990 con 0x7f276415c460 2023-07-12T02:05:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.565+0000 7f2762ffd700 1 -- 172.21.15.37:0/3979775665 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754011d20 con 0x7f276415c460 2023-07-12T02:05:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.566+0000 7f276a7ff700 1 -- 172.21.15.37:0/3979775665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f276415c460 msgr2=0x7f27640b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.566+0000 7f276a7ff700 1 --2- 172.21.15.37:0/3979775665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f276415c460 0x7f27640b59d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f27540098f0 tx=0x7f2754009c00 comp rx=0 tx=0).stop 2023-07-12T02:05:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.566+0000 7f276a7ff700 1 -- 172.21.15.37:0/3979775665 shutdown_connections 2023-07-12T02:05:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.566+0000 7f276a7ff700 1 --2- 172.21.15.37:0/3979775665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f276415c460 0x7f27640b59d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.566+0000 7f276a7ff700 1 --2- 172.21.15.37:0/3979775665 >> v2:172.21.15.196:3300/0 conn(0x7f27640d2640 0x7f27640cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.566+0000 7f276a7ff700 1 -- 172.21.15.37:0/3979775665 >> 172.21.15.37:0/3979775665 conn(0x7f2764071660 msgr2=0x7f2764071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.566+0000 7f276a7ff700 1 -- 172.21.15.37:0/3979775665 shutdown_connections 2023-07-12T02:05:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.566+0000 7f276a7ff700 1 -- 172.21.15.37:0/3979775665 wait complete. 2023-07-12T02:05:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.568+0000 7f276a7ff700 1 Processor -- start 2023-07-12T02:05:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.568+0000 7f276a7ff700 1 -- start start 2023-07-12T02:05:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.569+0000 7f276a7ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27640cf720 0x7f27641f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.569+0000 7f276a7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27640d2640 0x7f27640c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.569+0000 7f276a7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f276415c460 0x7f27640c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.569+0000 7f276a7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27640c8e90 con 0x7f27640d2640 2023-07-12T02:05:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.569+0000 7f276a7ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27640c9170 con 0x7f27640cf720 2023-07-12T02:05:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.569+0000 7f276a7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27640c9450 con 0x7f276415c460 2023-07-12T02:05:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.569+0000 7f27637fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27640d2640 0x7f27640c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.569+0000 7f27637fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27640d2640 0x7f27640c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56838/0 (socket says 172.21.15.37:56838) 2023-07-12T02:05:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.569+0000 7f27637fe700 1 -- 172.21.15.37:0/3326481720 learned_addr learned my addr 172.21.15.37:0/3326481720 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.569+0000 7f2763fff700 1 --2- 172.21.15.37:0/3326481720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27640cf720 0x7f27641f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.569+0000 7f2768d9c700 1 --2- 172.21.15.37:0/3326481720 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f276415c460 0x7f27640c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.570+0000 7f27637fe700 1 -- 172.21.15.37:0/3326481720 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f276415c460 msgr2=0x7f27640c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.570+0000 7f27637fe700 1 --2- 172.21.15.37:0/3326481720 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f276415c460 0x7f27640c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.570+0000 7f27637fe700 1 -- 172.21.15.37:0/3326481720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27640cf720 msgr2=0x7f27641f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.570+0000 7f27637fe700 1 --2- 172.21.15.37:0/3326481720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27640cf720 0x7f27641f6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.570+0000 7f27637fe700 1 -- 172.21.15.37:0/3326481720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2754009550 con 0x7f27640d2640 2023-07-12T02:05:45.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.570+0000 7f27637fe700 1 --2- 172.21.15.37:0/3326481720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27640d2640 0x7f27640c85f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f275800e870 tx=0x7f275800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:45.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.570+0000 7f2760ff9700 1 -- 172.21.15.37:0/3326481720 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758009590 con 0x7f27640d2640 2023-07-12T02:05:45.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.570+0000 7f2760ff9700 1 -- 172.21.15.37:0/3326481720 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2758013680 con 0x7f27640d2640 2023-07-12T02:05:45.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.570+0000 7f276a7ff700 1 -- 172.21.15.37:0/3326481720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27640cae20 con 0x7f27640d2640 2023-07-12T02:05:45.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.570+0000 7f2760ff9700 1 -- 172.21.15.37:0/3326481720 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27580139f0 con 0x7f27640d2640 2023-07-12T02:05:45.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.570+0000 7f276a7ff700 1 -- 172.21.15.37:0/3326481720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27640c6bf0 con 0x7f27640d2640 2023-07-12T02:05:45.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.571+0000 7f276a7ff700 1 -- 172.21.15.37:0/3326481720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27640cb190 con 0x7f27640d2640 2023-07-12T02:05:45.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.572+0000 7f2760ff9700 1 -- 172.21.15.37:0/3326481720 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2758013b50 con 0x7f27640d2640 2023-07-12T02:05:45.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.573+0000 7f2760ff9700 1 --2- 172.21.15.37:0/3326481720 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f275006ace0 0x7f275006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:45.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.573+0000 7f2760ff9700 1 -- 172.21.15.37:0/3326481720 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f27580894e0 con 0x7f27640d2640 2023-07-12T02:05:45.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.573+0000 7f2763fff700 1 --2- 172.21.15.37:0/3326481720 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f275006ace0 0x7f275006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:45.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.574+0000 7f2763fff700 1 --2- 172.21.15.37:0/3326481720 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f275006ace0 0x7f275006d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2754000c00 tx=0x7f2754008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:45.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.578+0000 7f2760ff9700 1 -- 172.21.15.37:0/3326481720 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f2758054440 con 0x7f27640d2640 2023-07-12T02:05:45.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.778+0000 7f276a7ff700 1 -- 172.21.15.37:0/3326481720 --> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27640c92e0 con 0x7f275006ace0 2023-07-12T02:05:45.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.789+0000 7f2760ff9700 1 -- 172.21.15.37:0/3326481720 <== mgr.4099 v2:172.21.15.196:6832/3490435896 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310747 (secure 0 0 0) 0x7f27640c92e0 con 0x7f275006ace0 2023-07-12T02:05:45.796 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:45.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.793+0000 7f276a7ff700 1 -- 172.21.15.37:0/3326481720 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f275006ace0 msgr2=0x7f275006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:45.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.793+0000 7f276a7ff700 1 --2- 172.21.15.37:0/3326481720 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f275006ace0 0x7f275006d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2754000c00 tx=0x7f2754008030 comp rx=0 tx=0).stop 2023-07-12T02:05:45.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.793+0000 7f276a7ff700 1 -- 172.21.15.37:0/3326481720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27640d2640 msgr2=0x7f27640c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:45.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.793+0000 7f276a7ff700 1 --2- 172.21.15.37:0/3326481720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27640d2640 0x7f27640c85f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f275800e870 tx=0x7f275800eb80 comp rx=0 tx=0).stop 2023-07-12T02:05:45.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.793+0000 7f276a7ff700 1 -- 172.21.15.37:0/3326481720 shutdown_connections 2023-07-12T02:05:45.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.793+0000 7f276a7ff700 1 --2- 172.21.15.37:0/3326481720 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f275006ace0 0x7f275006d190 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.793+0000 7f276a7ff700 1 --2- 172.21.15.37:0/3326481720 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f276415c460 0x7f27640c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.793+0000 7f276a7ff700 1 --2- 172.21.15.37:0/3326481720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27640cf720 0x7f27641f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.793+0000 7f276a7ff700 1 --2- 172.21.15.37:0/3326481720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27640d2640 0x7f27640c85f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:45.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.793+0000 7f276a7ff700 1 -- 172.21.15.37:0/3326481720 >> 172.21.15.37:0/3326481720 conn(0x7f2764071660 msgr2=0x7f2764153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:45.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.793+0000 7f276a7ff700 1 -- 172.21.15.37:0/3326481720 shutdown_connections 2023-07-12T02:05:45.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:45.793+0000 7f276a7ff700 1 -- 172.21.15.37:0/3326481720 wait complete. 2023-07-12T02:05:45.800 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-12T02:05:45.815 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-07-12T02:05:45.372372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221020,"kb_used_data":4848,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753700,"statfs":{"total":773094113280,"available":772867788800,"internally_reserved":0,"allocated":4964352,"data_stored":2837934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001799"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.377236+0000","last_change":"2023-07-12T02:05:41.366956+0000","last_active":"2023-07-12T02:05:41.377236+0000","last_peered":"2023-07-12T02:05:41.377236+0000","last_clean":"2023-07-12T02:05:41.377236+0000","last_became_active":"2023-07-12T02:05:41.366647+0000","last_became_peered":"2023-07-12T02:05:41.366647+0000","last_unstale":"2023-07-12T02:05:41.377236+0000","last_undegraded":"2023-07-12T02:05:41.377236+0000","last_fullsized":"2023-07-12T02:05:41.377236+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:58:04.431111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.392111+0000","last_change":"2023-07-12T02:05:41.390825+0000","last_active":"2023-07-12T02:05:41.392111+0000","last_peered":"2023-07-12T02:05:41.392111+0000","last_clean":"2023-07-12T02:05:41.392111+0000","last_became_active":"2023-07-12T02:05:41.390541+0000","last_became_peered":"2023-07-12T02:05:41.390541+0000","last_unstale":"2023-07-12T02:05:41.392111+0000","last_undegraded":"2023-07-12T02:05:41.392111+0000","last_fullsized":"2023-07-12T02:05:41.392111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:59:53.687487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357938+0000","last_change":"2023-07-12T02:05:41.374309+0000","last_active":"2023-07-12T02:05:42.357938+0000","last_peered":"2023-07-12T02:05:42.357938+0000","last_clean":"2023-07-12T02:05:42.357938+0000","last_became_active":"2023-07-12T02:05:41.374023+0000","last_became_peered":"2023-07-12T02:05:41.374023+0000","last_unstale":"2023-07-12T02:05:42.357938+0000","last_undegraded":"2023-07-12T02:05:42.357938+0000","last_fullsized":"2023-07-12T02:05:42.357938+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:00:41.754163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359257+0000","last_change":"2023-07-12T02:05:41.392654+0000","last_active":"2023-07-12T02:05:42.359257+0000","last_peered":"2023-07-12T02:05:42.359257+0000","last_clean":"2023-07-12T02:05:42.359257+0000","last_became_active":"2023-07-12T02:05:41.392384+0000","last_became_peered":"2023-07-12T02:05:41.392384+0000","last_unstale":"2023-07-12T02:05:42.359257+0000","last_undegraded":"2023-07-12T02:05:42.359257+0000","last_fullsized":"2023-07-12T02:05:42.359257+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:30.571537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.393282+0000","last_change":"2023-07-12T02:05:41.391247+0000","last_active":"2023-07-12T02:05:41.393282+0000","last_peered":"2023-07-12T02:05:41.393282+0000","last_clean":"2023-07-12T02:05:41.393282+0000","last_became_active":"2023-07-12T02:05:41.390946+0000","last_became_peered":"2023-07-12T02:05:41.390946+0000","last_unstale":"2023-07-12T02:05:41.393282+0000","last_undegraded":"2023-07-12T02:05:41.393282+0000","last_fullsized":"2023-07-12T02:05:41.393282+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:25.650296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.394480+0000","last_change":"2023-07-12T02:05:41.383351+0000","last_active":"2023-07-12T02:05:41.394480+0000","last_peered":"2023-07-12T02:05:41.394480+0000","last_clean":"2023-07-12T02:05:41.394480+0000","last_became_active":"2023-07-12T02:05:41.382983+0000","last_became_peered":"2023-07-12T02:05:41.382983+0000","last_unstale":"2023-07-12T02:05:41.394480+0000","last_undegraded":"2023-07-12T02:05:41.394480+0000","last_fullsized":"2023-07-12T02:05:41.394480+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:53:28.556905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.376495+0000","last_change":"2023-07-12T02:05:41.368708+0000","last_active":"2023-07-12T02:05:41.376495+0000","last_peered":"2023-07-12T02:05:41.376495+0000","last_clean":"2023-07-12T02:05:41.376495+0000","last_became_active":"2023-07-12T02:05:41.368410+0000","last_became_peered":"2023-07-12T02:05:41.368410+0000","last_unstale":"2023-07-12T02:05:41.376495+0000","last_undegraded":"2023-07-12T02:05:41.376495+0000","last_fullsized":"2023-07-12T02:05:41.376495+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:59:53.687487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359007+0000","last_change":"2023-07-12T02:05:41.386378+0000","last_active":"2023-07-12T02:05:42.359007+0000","last_peered":"2023-07-12T02:05:42.359007+0000","last_clean":"2023-07-12T02:05:42.359007+0000","last_became_active":"2023-07-12T02:05:41.386105+0000","last_became_peered":"2023-07-12T02:05:41.386105+0000","last_unstale":"2023-07-12T02:05:42.359007+0000","last_undegraded":"2023-07-12T02:05:42.359007+0000","last_fullsized":"2023-07-12T02:05:42.359007+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:04:52.451181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359636+0000","last_change":"2023-07-12T02:05:41.390933+0000","last_active":"2023-07-12T02:05:42.359636+0000","last_peered":"2023-07-12T02:05:42.359636+0000","last_clean":"2023-07-12T02:05:42.359636+0000","last_became_active":"2023-07-12T02:05:41.390635+0000","last_became_peered":"2023-07-12T02:05:41.390635+0000","last_unstale":"2023-07-12T02:05:42.359636+0000","last_undegraded":"2023-07-12T02:05:42.359636+0000","last_fullsized":"2023-07-12T02:05:42.359636+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:53:59.219826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359672+0000","last_change":"2023-07-12T02:05:41.389621+0000","last_active":"2023-07-12T02:05:42.359672+0000","last_peered":"2023-07-12T02:05:42.359672+0000","last_clean":"2023-07-12T02:05:42.359672+0000","last_became_active":"2023-07-12T02:05:41.389140+0000","last_became_peered":"2023-07-12T02:05:41.389140+0000","last_unstale":"2023-07-12T02:05:42.359672+0000","last_undegraded":"2023-07-12T02:05:42.359672+0000","last_fullsized":"2023-07-12T02:05:42.359672+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:19:31.133369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359320+0000","last_change":"2023-07-12T02:05:41.389440+0000","last_active":"2023-07-12T02:05:42.359320+0000","last_peered":"2023-07-12T02:05:42.359320+0000","last_clean":"2023-07-12T02:05:42.359320+0000","last_became_active":"2023-07-12T02:05:41.389079+0000","last_became_peered":"2023-07-12T02:05:41.389079+0000","last_unstale":"2023-07-12T02:05:42.359320+0000","last_undegraded":"2023-07-12T02:05:42.359320+0000","last_fullsized":"2023-07-12T02:05:42.359320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:11:14.466984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.380177+0000","last_change":"2023-07-12T02:05:41.370302+0000","last_active":"2023-07-12T02:05:41.380177+0000","last_peered":"2023-07-12T02:05:41.380177+0000","last_clean":"2023-07-12T02:05:41.380177+0000","last_became_active":"2023-07-12T02:05:41.369681+0000","last_became_peered":"2023-07-12T02:05:41.369681+0000","last_unstale":"2023-07-12T02:05:41.380177+0000","last_undegraded":"2023-07-12T02:05:41.380177+0000","last_fullsized":"2023-07-12T02:05:41.380177+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:30:09.555266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360467+0000","last_change":"2023-07-12T02:05:41.396675+0000","last_active":"2023-07-12T02:05:42.360467+0000","last_peered":"2023-07-12T02:05:42.360467+0000","last_clean":"2023-07-12T02:05:42.360467+0000","last_became_active":"2023-07-12T02:05:41.396220+0000","last_became_peered":"2023-07-12T02:05:41.396220+0000","last_unstale":"2023-07-12T02:05:42.360467+0000","last_undegraded":"2023-07-12T02:05:42.360467+0000","last_fullsized":"2023-07-12T02:05:42.360467+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:28:17.980445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359447+0000","last_change":"2023-07-12T02:05:41.386341+0000","last_active":"2023-07-12T02:05:42.359447+0000","last_peered":"2023-07-12T02:05:42.359447+0000","last_clean":"2023-07-12T02:05:42.359447+0000","last_became_active":"2023-07-12T02:05:41.385866+0000","last_became_peered":"2023-07-12T02:05:41.385866+0000","last_unstale":"2023-07-12T02:05:42.359447+0000","last_undegraded":"2023-07-12T02:05:42.359447+0000","last_fullsized":"2023-07-12T02:05:42.359447+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:30:09.555266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.396441+0000","last_change":"2023-07-12T02:05:41.376705+0000","last_active":"2023-07-12T02:05:41.396441+0000","last_peered":"2023-07-12T02:05:41.396441+0000","last_clean":"2023-07-12T02:05:41.396441+0000","last_became_active":"2023-07-12T02:05:41.376388+0000","last_became_peered":"2023-07-12T02:05:41.376388+0000","last_unstale":"2023-07-12T02:05:41.396441+0000","last_undegraded":"2023-07-12T02:05:41.396441+0000","last_fullsized":"2023-07-12T02:05:41.396441+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:14:08.147510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359477+0000","last_change":"2023-07-12T02:05:41.393003+0000","last_active":"2023-07-12T02:05:42.359477+0000","last_peered":"2023-07-12T02:05:42.359477+0000","last_clean":"2023-07-12T02:05:42.359477+0000","last_became_active":"2023-07-12T02:05:41.392727+0000","last_became_peered":"2023-07-12T02:05:41.392727+0000","last_unstale":"2023-07-12T02:05:42.359477+0000","last_undegraded":"2023-07-12T02:05:42.359477+0000","last_fullsized":"2023-07-12T02:05:42.359477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T14:04:05.645016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357769+0000","last_change":"2023-07-12T02:05:41.373440+0000","last_active":"2023-07-12T02:05:42.357769+0000","last_peered":"2023-07-12T02:05:42.357769+0000","last_clean":"2023-07-12T02:05:42.357769+0000","last_became_active":"2023-07-12T02:05:41.373177+0000","last_became_peered":"2023-07-12T02:05:41.373177+0000","last_unstale":"2023-07-12T02:05:42.357769+0000","last_undegraded":"2023-07-12T02:05:42.357769+0000","last_fullsized":"2023-07-12T02:05:42.357769+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:57:33.641833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357709+0000","last_change":"2023-07-12T02:05:41.390916+0000","last_active":"2023-07-12T02:05:42.357709+0000","last_peered":"2023-07-12T02:05:42.357709+0000","last_clean":"2023-07-12T02:05:42.357709+0000","last_became_active":"2023-07-12T02:05:41.390685+0000","last_became_peered":"2023-07-12T02:05:41.390685+0000","last_unstale":"2023-07-12T02:05:42.357709+0000","last_undegraded":"2023-07-12T02:05:42.357709+0000","last_fullsized":"2023-07-12T02:05:42.357709+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:41:01.635468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359765+0000","last_change":"2023-07-12T02:05:41.390345+0000","last_active":"2023-07-12T02:05:42.359765+0000","last_peered":"2023-07-12T02:05:42.359765+0000","last_clean":"2023-07-12T02:05:42.359765+0000","last_became_active":"2023-07-12T02:05:41.390057+0000","last_became_peered":"2023-07-12T02:05:41.390057+0000","last_unstale":"2023-07-12T02:05:42.359765+0000","last_undegraded":"2023-07-12T02:05:42.359765+0000","last_fullsized":"2023-07-12T02:05:42.359765+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:09:10.334576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360619+0000","last_change":"2023-07-12T02:05:41.393055+0000","last_active":"2023-07-12T02:05:42.360619+0000","last_peered":"2023-07-12T02:05:42.360619+0000","last_clean":"2023-07-12T02:05:42.360619+0000","last_became_active":"2023-07-12T02:05:41.392682+0000","last_became_peered":"2023-07-12T02:05:41.392682+0000","last_unstale":"2023-07-12T02:05:42.360619+0000","last_undegraded":"2023-07-12T02:05:42.360619+0000","last_fullsized":"2023-07-12T02:05:42.360619+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:39:25.768953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.400256+0000","last_change":"2023-07-12T02:05:41.394705+0000","last_active":"2023-07-12T02:05:41.400256+0000","last_peered":"2023-07-12T02:05:41.400256+0000","last_clean":"2023-07-12T02:05:41.400256+0000","last_became_active":"2023-07-12T02:05:41.394278+0000","last_became_peered":"2023-07-12T02:05:41.394278+0000","last_unstale":"2023-07-12T02:05:41.400256+0000","last_undegraded":"2023-07-12T02:05:41.400256+0000","last_fullsized":"2023-07-12T02:05:41.400256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:34:32.086669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359672+0000","last_change":"2023-07-12T02:05:41.386144+0000","last_active":"2023-07-12T02:05:42.359672+0000","last_peered":"2023-07-12T02:05:42.359672+0000","last_clean":"2023-07-12T02:05:42.359672+0000","last_became_active":"2023-07-12T02:05:41.385532+0000","last_became_peered":"2023-07-12T02:05:41.385532+0000","last_unstale":"2023-07-12T02:05:42.359672+0000","last_undegraded":"2023-07-12T02:05:42.359672+0000","last_fullsized":"2023-07-12T02:05:42.359672+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:34:21.766154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359624+0000","last_change":"2023-07-12T02:05:41.379049+0000","last_active":"2023-07-12T02:05:42.359624+0000","last_peered":"2023-07-12T02:05:42.359624+0000","last_clean":"2023-07-12T02:05:42.359624+0000","last_became_active":"2023-07-12T02:05:41.378436+0000","last_became_peered":"2023-07-12T02:05:41.378436+0000","last_unstale":"2023-07-12T02:05:42.359624+0000","last_undegraded":"2023-07-12T02:05:42.359624+0000","last_fullsized":"2023-07-12T02:05:42.359624+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:28:17.980445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359382+0000","last_change":"2023-07-12T02:05:41.374458+0000","last_active":"2023-07-12T02:05:42.359382+0000","last_peered":"2023-07-12T02:05:42.359382+0000","last_clean":"2023-07-12T02:05:42.359382+0000","last_became_active":"2023-07-12T02:05:41.374162+0000","last_became_peered":"2023-07-12T02:05:41.374162+0000","last_unstale":"2023-07-12T02:05:42.359382+0000","last_undegraded":"2023-07-12T02:05:42.359382+0000","last_fullsized":"2023-07-12T02:05:42.359382+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:21:00.107822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359632+0000","last_change":"2023-07-12T02:05:41.375587+0000","last_active":"2023-07-12T02:05:42.359632+0000","last_peered":"2023-07-12T02:05:42.359632+0000","last_clean":"2023-07-12T02:05:42.359632+0000","last_became_active":"2023-07-12T02:05:41.375293+0000","last_became_peered":"2023-07-12T02:05:41.375293+0000","last_unstale":"2023-07-12T02:05:42.359632+0000","last_undegraded":"2023-07-12T02:05:42.359632+0000","last_fullsized":"2023-07-12T02:05:42.359632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:39:25.768953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360609+0000","last_change":"2023-07-12T02:05:41.395572+0000","last_active":"2023-07-12T02:05:42.360609+0000","last_peered":"2023-07-12T02:05:42.360609+0000","last_clean":"2023-07-12T02:05:42.360609+0000","last_became_active":"2023-07-12T02:05:41.395236+0000","last_became_peered":"2023-07-12T02:05:41.395236+0000","last_unstale":"2023-07-12T02:05:42.360609+0000","last_undegraded":"2023-07-12T02:05:42.360609+0000","last_fullsized":"2023-07-12T02:05:42.360609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:18:17.564601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357646+0000","last_change":"2023-07-12T02:05:41.377111+0000","last_active":"2023-07-12T02:05:42.357646+0000","last_peered":"2023-07-12T02:05:42.357646+0000","last_clean":"2023-07-12T02:05:42.357646+0000","last_became_active":"2023-07-12T02:05:41.376850+0000","last_became_peered":"2023-07-12T02:05:41.376850+0000","last_unstale":"2023-07-12T02:05:42.357646+0000","last_undegraded":"2023-07-12T02:05:42.357646+0000","last_fullsized":"2023-07-12T02:05:42.357646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:06:53.160066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.380199+0000","last_change":"2023-07-12T02:05:41.370370+0000","last_active":"2023-07-12T02:05:41.380199+0000","last_peered":"2023-07-12T02:05:41.380199+0000","last_clean":"2023-07-12T02:05:41.380199+0000","last_became_active":"2023-07-12T02:05:41.370084+0000","last_became_peered":"2023-07-12T02:05:41.370084+0000","last_unstale":"2023-07-12T02:05:41.380199+0000","last_undegraded":"2023-07-12T02:05:41.380199+0000","last_fullsized":"2023-07-12T02:05:41.380199+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:58:04.431111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359626+0000","last_change":"2023-07-12T02:05:41.371744+0000","last_active":"2023-07-12T02:05:42.359626+0000","last_peered":"2023-07-12T02:05:42.359626+0000","last_clean":"2023-07-12T02:05:42.359626+0000","last_became_active":"2023-07-12T02:05:41.371453+0000","last_became_peered":"2023-07-12T02:05:41.371453+0000","last_unstale":"2023-07-12T02:05:42.359626+0000","last_undegraded":"2023-07-12T02:05:42.359626+0000","last_fullsized":"2023-07-12T02:05:42.359626+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:18:17.564601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357452+0000","last_change":"2023-07-12T02:05:41.370402+0000","last_active":"2023-07-12T02:05:42.357452+0000","last_peered":"2023-07-12T02:05:42.357452+0000","last_clean":"2023-07-12T02:05:42.357452+0000","last_became_active":"2023-07-12T02:05:41.370056+0000","last_became_peered":"2023-07-12T02:05:41.370056+0000","last_unstale":"2023-07-12T02:05:42.357452+0000","last_undegraded":"2023-07-12T02:05:42.357452+0000","last_fullsized":"2023-07-12T02:05:42.357452+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:24:17.462199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.396463+0000","last_change":"2023-07-12T02:05:41.378464+0000","last_active":"2023-07-12T02:05:41.396463+0000","last_peered":"2023-07-12T02:05:41.396463+0000","last_clean":"2023-07-12T02:05:41.396463+0000","last_became_active":"2023-07-12T02:05:41.376694+0000","last_became_peered":"2023-07-12T02:05:41.376694+0000","last_unstale":"2023-07-12T02:05:41.396463+0000","last_undegraded":"2023-07-12T02:05:41.396463+0000","last_fullsized":"2023-07-12T02:05:41.396463+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:38:29.182446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360351+0000","last_change":"2023-07-12T02:05:41.368883+0000","last_active":"2023-07-12T02:05:42.360351+0000","last_peered":"2023-07-12T02:05:42.360351+0000","last_clean":"2023-07-12T02:05:42.360351+0000","last_became_active":"2023-07-12T02:05:41.367830+0000","last_became_peered":"2023-07-12T02:05:41.367830+0000","last_unstale":"2023-07-12T02:05:42.360351+0000","last_undegraded":"2023-07-12T02:05:42.360351+0000","last_fullsized":"2023-07-12T02:05:42.360351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:33:45.931288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.399826+0000","last_change":"2023-07-12T02:05:41.397067+0000","last_active":"2023-07-12T02:05:41.399826+0000","last_peered":"2023-07-12T02:05:41.399826+0000","last_clean":"2023-07-12T02:05:41.399826+0000","last_became_active":"2023-07-12T02:05:41.396771+0000","last_became_peered":"2023-07-12T02:05:41.396771+0000","last_unstale":"2023-07-12T02:05:41.399826+0000","last_undegraded":"2023-07-12T02:05:41.399826+0000","last_fullsized":"2023-07-12T02:05:41.399826+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:35:48.065444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.394849+0000","last_change":"2023-07-12T02:05:40.370821+0000","last_active":"2023-07-12T02:05:41.394849+0000","last_peered":"2023-07-12T02:05:41.394849+0000","last_clean":"2023-07-12T02:05:41.394849+0000","last_became_active":"2023-07-12T02:05:40.370495+0000","last_became_peered":"2023-07-12T02:05:40.370495+0000","last_unstale":"2023-07-12T02:05:41.394849+0000","last_undegraded":"2023-07-12T02:05:41.394849+0000","last_fullsized":"2023-07-12T02:05:41.394849+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:58:31.331993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359816+0000","last_change":"2023-07-12T02:05:41.372605+0000","last_active":"2023-07-12T02:05:42.359816+0000","last_peered":"2023-07-12T02:05:42.359816+0000","last_clean":"2023-07-12T02:05:42.359816+0000","last_became_active":"2023-07-12T02:05:41.372115+0000","last_became_peered":"2023-07-12T02:05:41.372115+0000","last_unstale":"2023-07-12T02:05:42.359816+0000","last_undegraded":"2023-07-12T02:05:42.359816+0000","last_fullsized":"2023-07-12T02:05:42.359816+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:36:55.254373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357860+0000","last_change":"2023-07-12T02:05:40.366801+0000","last_active":"2023-07-12T02:05:42.357860+0000","last_peered":"2023-07-12T02:05:42.357860+0000","last_clean":"2023-07-12T02:05:42.357860+0000","last_became_active":"2023-07-12T02:05:40.366507+0000","last_became_peered":"2023-07-12T02:05:40.366507+0000","last_unstale":"2023-07-12T02:05:42.357860+0000","last_undegraded":"2023-07-12T02:05:42.357860+0000","last_fullsized":"2023-07-12T02:05:42.357860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:10:13.637560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.400547+0000","last_change":"2023-07-12T02:05:41.398447+0000","last_active":"2023-07-12T02:05:41.400547+0000","last_peered":"2023-07-12T02:05:41.400547+0000","last_clean":"2023-07-12T02:05:41.400547+0000","last_became_active":"2023-07-12T02:05:41.398135+0000","last_became_peered":"2023-07-12T02:05:41.398135+0000","last_unstale":"2023-07-12T02:05:41.400547+0000","last_undegraded":"2023-07-12T02:05:41.400547+0000","last_fullsized":"2023-07-12T02:05:41.400547+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:39:15.739727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.384716+0000","last_change":"2023-07-12T02:05:40.372166+0000","last_active":"2023-07-12T02:05:41.384716+0000","last_peered":"2023-07-12T02:05:41.384716+0000","last_clean":"2023-07-12T02:05:41.384716+0000","last_became_active":"2023-07-12T02:05:40.371784+0000","last_became_peered":"2023-07-12T02:05:40.371784+0000","last_unstale":"2023-07-12T02:05:41.384716+0000","last_undegraded":"2023-07-12T02:05:41.384716+0000","last_fullsized":"2023-07-12T02:05:41.384716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:33:34.218127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.386270+0000","last_change":"2023-07-12T02:05:41.383478+0000","last_active":"2023-07-12T02:05:41.386270+0000","last_peered":"2023-07-12T02:05:41.386270+0000","last_clean":"2023-07-12T02:05:41.386270+0000","last_became_active":"2023-07-12T02:05:41.383202+0000","last_became_peered":"2023-07-12T02:05:41.383202+0000","last_unstale":"2023-07-12T02:05:41.386270+0000","last_undegraded":"2023-07-12T02:05:41.386270+0000","last_fullsized":"2023-07-12T02:05:41.386270+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:44:42.078918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.381178+0000","last_change":"2023-07-12T02:05:40.375181+0000","last_active":"2023-07-12T02:05:41.381178+0000","last_peered":"2023-07-12T02:05:41.381178+0000","last_clean":"2023-07-12T02:05:41.381178+0000","last_became_active":"2023-07-12T02:05:40.374887+0000","last_became_peered":"2023-07-12T02:05:40.374887+0000","last_unstale":"2023-07-12T02:05:41.381178+0000","last_undegraded":"2023-07-12T02:05:41.381178+0000","last_fullsized":"2023-07-12T02:05:41.381178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:30:08.552703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357456+0000","last_change":"2023-07-12T02:05:41.378419+0000","last_active":"2023-07-12T02:05:42.357456+0000","last_peered":"2023-07-12T02:05:42.357456+0000","last_clean":"2023-07-12T02:05:42.357456+0000","last_became_active":"2023-07-12T02:05:41.378141+0000","last_became_peered":"2023-07-12T02:05:41.378141+0000","last_unstale":"2023-07-12T02:05:42.357456+0000","last_undegraded":"2023-07-12T02:05:42.357456+0000","last_fullsized":"2023-07-12T02:05:42.357456+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:37:41.059502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.394309+0000","last_change":"2023-07-12T02:05:40.374186+0000","last_active":"2023-07-12T02:05:41.394309+0000","last_peered":"2023-07-12T02:05:41.394309+0000","last_clean":"2023-07-12T02:05:41.394309+0000","last_became_active":"2023-07-12T02:05:40.373775+0000","last_became_peered":"2023-07-12T02:05:40.373775+0000","last_unstale":"2023-07-12T02:05:41.394309+0000","last_undegraded":"2023-07-12T02:05:41.394309+0000","last_fullsized":"2023-07-12T02:05:41.394309+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:27:04.606604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359635+0000","last_change":"2023-07-12T02:05:41.389384+0000","last_active":"2023-07-12T02:05:42.359635+0000","last_peered":"2023-07-12T02:05:42.359635+0000","last_clean":"2023-07-12T02:05:42.359635+0000","last_became_active":"2023-07-12T02:05:41.389222+0000","last_became_peered":"2023-07-12T02:05:41.389222+0000","last_unstale":"2023-07-12T02:05:42.359635+0000","last_undegraded":"2023-07-12T02:05:42.359635+0000","last_fullsized":"2023-07-12T02:05:42.359635+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:58:04.431111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357827+0000","last_change":"2023-07-12T02:05:40.374194+0000","last_active":"2023-07-12T02:05:42.357827+0000","last_peered":"2023-07-12T02:05:42.357827+0000","last_clean":"2023-07-12T02:05:42.357827+0000","last_became_active":"2023-07-12T02:05:40.373897+0000","last_became_peered":"2023-07-12T02:05:40.373897+0000","last_unstale":"2023-07-12T02:05:42.357827+0000","last_undegraded":"2023-07-12T02:05:42.357827+0000","last_fullsized":"2023-07-12T02:05:42.357827+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:28:56.247779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359256+0000","last_change":"2023-07-12T02:05:41.385827+0000","last_active":"2023-07-12T02:05:42.359256+0000","last_peered":"2023-07-12T02:05:42.359256+0000","last_clean":"2023-07-12T02:05:42.359256+0000","last_became_active":"2023-07-12T02:05:41.385509+0000","last_became_peered":"2023-07-12T02:05:41.385509+0000","last_unstale":"2023-07-12T02:05:42.359256+0000","last_undegraded":"2023-07-12T02:05:42.359256+0000","last_fullsized":"2023-07-12T02:05:42.359256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:27:05.609167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.360431+0000","last_change":"2023-07-12T02:05:40.373357+0000","last_active":"2023-07-12T02:05:41.360431+0000","last_peered":"2023-07-12T02:05:41.360431+0000","last_clean":"2023-07-12T02:05:41.360431+0000","last_became_active":"2023-07-12T02:05:40.373061+0000","last_became_peered":"2023-07-12T02:05:40.373061+0000","last_unstale":"2023-07-12T02:05:41.360431+0000","last_undegraded":"2023-07-12T02:05:41.360431+0000","last_fullsized":"2023-07-12T02:05:41.360431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:27:04.606604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359409+0000","last_change":"2023-07-12T02:05:41.379196+0000","last_active":"2023-07-12T02:05:42.359409+0000","last_peered":"2023-07-12T02:05:42.359409+0000","last_clean":"2023-07-12T02:05:42.359409+0000","last_became_active":"2023-07-12T02:05:41.378837+0000","last_became_peered":"2023-07-12T02:05:41.378837+0000","last_unstale":"2023-07-12T02:05:42.359409+0000","last_undegraded":"2023-07-12T02:05:42.359409+0000","last_fullsized":"2023-07-12T02:05:42.359409+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:33:45.931288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359146+0000","last_change":"2023-07-12T02:05:40.371528+0000","last_active":"2023-07-12T02:05:42.359146+0000","last_peered":"2023-07-12T02:05:42.359146+0000","last_clean":"2023-07-12T02:05:42.359146+0000","last_became_active":"2023-07-12T02:05:40.371254+0000","last_became_peered":"2023-07-12T02:05:40.371254+0000","last_unstale":"2023-07-12T02:05:42.359146+0000","last_undegraded":"2023-07-12T02:05:42.359146+0000","last_fullsized":"2023-07-12T02:05:42.359146+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:30.821517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357831+0000","last_change":"2023-07-12T02:05:41.390893+0000","last_active":"2023-07-12T02:05:42.357831+0000","last_peered":"2023-07-12T02:05:42.357831+0000","last_clean":"2023-07-12T02:05:42.357831+0000","last_became_active":"2023-07-12T02:05:41.390585+0000","last_became_peered":"2023-07-12T02:05:41.390585+0000","last_unstale":"2023-07-12T02:05:42.357831+0000","last_undegraded":"2023-07-12T02:05:42.357831+0000","last_fullsized":"2023-07-12T02:05:42.357831+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:40:09.062654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357899+0000","last_change":"2023-07-12T02:05:40.368765+0000","last_active":"2023-07-12T02:05:42.357899+0000","last_peered":"2023-07-12T02:05:42.357899+0000","last_clean":"2023-07-12T02:05:42.357899+0000","last_became_active":"2023-07-12T02:05:40.368353+0000","last_became_peered":"2023-07-12T02:05:40.368353+0000","last_unstale":"2023-07-12T02:05:42.357899+0000","last_undegraded":"2023-07-12T02:05:42.357899+0000","last_fullsized":"2023-07-12T02:05:42.357899+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:51.817291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.377258+0000","last_change":"2023-07-12T02:05:41.368898+0000","last_active":"2023-07-12T02:05:41.377258+0000","last_peered":"2023-07-12T02:05:41.377258+0000","last_clean":"2023-07-12T02:05:41.377258+0000","last_became_active":"2023-07-12T02:05:41.368613+0000","last_became_peered":"2023-07-12T02:05:41.368613+0000","last_unstale":"2023-07-12T02:05:41.377258+0000","last_undegraded":"2023-07-12T02:05:41.377258+0000","last_fullsized":"2023-07-12T02:05:41.377258+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:13:12.918856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359800+0000","last_change":"2023-07-12T02:05:40.373103+0000","last_active":"2023-07-12T02:05:42.359800+0000","last_peered":"2023-07-12T02:05:42.359800+0000","last_clean":"2023-07-12T02:05:42.359800+0000","last_became_active":"2023-07-12T02:05:40.372809+0000","last_became_peered":"2023-07-12T02:05:40.372809+0000","last_unstale":"2023-07-12T02:05:42.359800+0000","last_undegraded":"2023-07-12T02:05:42.359800+0000","last_fullsized":"2023-07-12T02:05:42.359800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:33:47.294318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.400687+0000","last_change":"2023-07-12T02:05:41.398095+0000","last_active":"2023-07-12T02:05:41.400687+0000","last_peered":"2023-07-12T02:05:41.400687+0000","last_clean":"2023-07-12T02:05:41.400687+0000","last_became_active":"2023-07-12T02:05:41.397815+0000","last_became_peered":"2023-07-12T02:05:41.397815+0000","last_unstale":"2023-07-12T02:05:41.400687+0000","last_undegraded":"2023-07-12T02:05:41.400687+0000","last_fullsized":"2023-07-12T02:05:41.400687+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:07:41.711909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.384547+0000","last_change":"2023-07-12T02:05:40.376233+0000","last_active":"2023-07-12T02:05:41.384547+0000","last_peered":"2023-07-12T02:05:41.384547+0000","last_clean":"2023-07-12T02:05:41.384547+0000","last_became_active":"2023-07-12T02:05:40.375907+0000","last_became_peered":"2023-07-12T02:05:40.375907+0000","last_unstale":"2023-07-12T02:05:41.384547+0000","last_undegraded":"2023-07-12T02:05:41.384547+0000","last_fullsized":"2023-07-12T02:05:41.384547+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:53:58.217263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.381250+0000","last_change":"2023-07-12T02:05:41.371645+0000","last_active":"2023-07-12T02:05:41.381250+0000","last_peered":"2023-07-12T02:05:41.381250+0000","last_clean":"2023-07-12T02:05:41.381250+0000","last_became_active":"2023-07-12T02:05:41.371312+0000","last_became_peered":"2023-07-12T02:05:41.371312+0000","last_unstale":"2023-07-12T02:05:41.381250+0000","last_undegraded":"2023-07-12T02:05:41.381250+0000","last_fullsized":"2023-07-12T02:05:41.381250+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:11:14.466984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360802+0000","last_change":"2023-07-12T02:05:40.370573+0000","last_active":"2023-07-12T02:05:42.360802+0000","last_peered":"2023-07-12T02:05:42.360802+0000","last_clean":"2023-07-12T02:05:42.360802+0000","last_became_active":"2023-07-12T02:05:40.370266+0000","last_became_peered":"2023-07-12T02:05:40.370266+0000","last_unstale":"2023-07-12T02:05:42.360802+0000","last_undegraded":"2023-07-12T02:05:42.360802+0000","last_fullsized":"2023-07-12T02:05:42.360802+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:20:34.350253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359710+0000","last_change":"2023-07-12T02:05:41.392344+0000","last_active":"2023-07-12T02:05:42.359710+0000","last_peered":"2023-07-12T02:05:42.359710+0000","last_clean":"2023-07-12T02:05:42.359710+0000","last_became_active":"2023-07-12T02:05:41.392005+0000","last_became_peered":"2023-07-12T02:05:41.392005+0000","last_unstale":"2023-07-12T02:05:42.359710+0000","last_undegraded":"2023-07-12T02:05:42.359710+0000","last_fullsized":"2023-07-12T02:05:42.359710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:46.155819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.400274+0000","last_change":"2023-07-12T02:05:40.374949+0000","last_active":"2023-07-12T02:05:41.400274+0000","last_peered":"2023-07-12T02:05:41.400274+0000","last_clean":"2023-07-12T02:05:41.400274+0000","last_became_active":"2023-07-12T02:05:40.374692+0000","last_became_peered":"2023-07-12T02:05:40.374692+0000","last_unstale":"2023-07-12T02:05:41.400274+0000","last_undegraded":"2023-07-12T02:05:41.400274+0000","last_fullsized":"2023-07-12T02:05:41.400274+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:23:27.834900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359656+0000","last_change":"2023-07-12T02:05:41.389004+0000","last_active":"2023-07-12T02:05:42.359656+0000","last_peered":"2023-07-12T02:05:42.359656+0000","last_clean":"2023-07-12T02:05:42.359656+0000","last_became_active":"2023-07-12T02:05:41.388699+0000","last_became_peered":"2023-07-12T02:05:41.388699+0000","last_unstale":"2023-07-12T02:05:42.359656+0000","last_undegraded":"2023-07-12T02:05:42.359656+0000","last_fullsized":"2023-07-12T02:05:42.359656+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:39:15.739727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.356386+0000","last_change":"2023-07-12T02:05:40.372749+0000","last_active":"2023-07-12T02:05:41.356386+0000","last_peered":"2023-07-12T02:05:41.356386+0000","last_clean":"2023-07-12T02:05:41.356386+0000","last_became_active":"2023-07-12T02:05:40.372449+0000","last_became_peered":"2023-07-12T02:05:40.372449+0000","last_unstale":"2023-07-12T02:05:41.356386+0000","last_undegraded":"2023-07-12T02:05:41.356386+0000","last_fullsized":"2023-07-12T02:05:41.356386+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:27:04.606604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.400194+0000","last_change":"2023-07-12T02:05:41.393574+0000","last_active":"2023-07-12T02:05:41.400194+0000","last_peered":"2023-07-12T02:05:41.400194+0000","last_clean":"2023-07-12T02:05:41.400194+0000","last_became_active":"2023-07-12T02:05:41.393266+0000","last_became_peered":"2023-07-12T02:05:41.393266+0000","last_unstale":"2023-07-12T02:05:41.400194+0000","last_undegraded":"2023-07-12T02:05:41.400194+0000","last_fullsized":"2023-07-12T02:05:41.400194+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:52:04.425131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.373549+0000","last_change":"2023-07-12T02:05:40.375507+0000","last_active":"2023-07-12T02:05:41.373549+0000","last_peered":"2023-07-12T02:05:41.373549+0000","last_clean":"2023-07-12T02:05:41.373549+0000","last_became_active":"2023-07-12T02:05:40.375241+0000","last_became_peered":"2023-07-12T02:05:40.375241+0000","last_unstale":"2023-07-12T02:05:41.373549+0000","last_undegraded":"2023-07-12T02:05:41.373549+0000","last_fullsized":"2023-07-12T02:05:41.373549+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:04:51.448618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.387228+0000","last_change":"2023-07-12T02:05:41.382438+0000","last_active":"2023-07-12T02:05:41.387228+0000","last_peered":"2023-07-12T02:05:41.387228+0000","last_clean":"2023-07-12T02:05:41.387228+0000","last_became_active":"2023-07-12T02:05:41.382105+0000","last_became_peered":"2023-07-12T02:05:41.382105+0000","last_unstale":"2023-07-12T02:05:41.387228+0000","last_undegraded":"2023-07-12T02:05:41.387228+0000","last_fullsized":"2023-07-12T02:05:41.387228+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:30.571537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359364+0000","last_change":"2023-07-12T02:05:40.367829+0000","last_active":"2023-07-12T02:05:42.359364+0000","last_peered":"2023-07-12T02:05:42.359364+0000","last_clean":"2023-07-12T02:05:42.359364+0000","last_became_active":"2023-07-12T02:05:40.367256+0000","last_became_peered":"2023-07-12T02:05:40.367256+0000","last_unstale":"2023-07-12T02:05:42.359364+0000","last_undegraded":"2023-07-12T02:05:42.359364+0000","last_fullsized":"2023-07-12T02:05:42.359364+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:16:38.542138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360714+0000","last_change":"2023-07-12T02:05:41.366609+0000","last_active":"2023-07-12T02:05:42.360714+0000","last_peered":"2023-07-12T02:05:42.360714+0000","last_clean":"2023-07-12T02:05:42.360714+0000","last_became_active":"2023-07-12T02:05:41.366071+0000","last_became_peered":"2023-07-12T02:05:41.366071+0000","last_unstale":"2023-07-12T02:05:42.360714+0000","last_undegraded":"2023-07-12T02:05:42.360714+0000","last_fullsized":"2023-07-12T02:05:42.360714+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:36:55.254373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360694+0000","last_change":"2023-07-12T02:05:40.375460+0000","last_active":"2023-07-12T02:05:42.360694+0000","last_peered":"2023-07-12T02:05:42.360694+0000","last_clean":"2023-07-12T02:05:42.360694+0000","last_became_active":"2023-07-12T02:05:40.375188+0000","last_became_peered":"2023-07-12T02:05:40.375188+0000","last_unstale":"2023-07-12T02:05:42.360694+0000","last_undegraded":"2023-07-12T02:05:42.360694+0000","last_fullsized":"2023-07-12T02:05:42.360694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:09:09.332013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359832+0000","last_change":"2023-07-12T02:05:41.397072+0000","last_active":"2023-07-12T02:05:42.359832+0000","last_peered":"2023-07-12T02:05:42.359832+0000","last_clean":"2023-07-12T02:05:42.359832+0000","last_became_active":"2023-07-12T02:05:41.396784+0000","last_became_peered":"2023-07-12T02:05:41.396784+0000","last_unstale":"2023-07-12T02:05:42.359832+0000","last_undegraded":"2023-07-12T02:05:42.359832+0000","last_fullsized":"2023-07-12T02:05:42.359832+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:45:44.173260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357983+0000","last_change":"2023-07-12T02:05:40.373948+0000","last_active":"2023-07-12T02:05:42.357983+0000","last_peered":"2023-07-12T02:05:42.357983+0000","last_clean":"2023-07-12T02:05:42.357983+0000","last_became_active":"2023-07-12T02:05:40.373653+0000","last_became_peered":"2023-07-12T02:05:40.373653+0000","last_unstale":"2023-07-12T02:05:42.357983+0000","last_undegraded":"2023-07-12T02:05:42.357983+0000","last_fullsized":"2023-07-12T02:05:42.357983+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:19:44.862563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359880+0000","last_change":"2023-07-12T02:05:41.398505+0000","last_active":"2023-07-12T02:05:42.359880+0000","last_peered":"2023-07-12T02:05:42.359880+0000","last_clean":"2023-07-12T02:05:42.359880+0000","last_became_active":"2023-07-12T02:05:41.398199+0000","last_became_peered":"2023-07-12T02:05:41.398199+0000","last_unstale":"2023-07-12T02:05:42.359880+0000","last_undegraded":"2023-07-12T02:05:42.359880+0000","last_fullsized":"2023-07-12T02:05:42.359880+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:20:35.352816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.383503+0000","last_change":"2023-07-12T02:05:40.373623+0000","last_active":"2023-07-12T02:05:41.383503+0000","last_peered":"2023-07-12T02:05:41.383503+0000","last_clean":"2023-07-12T02:05:41.383503+0000","last_became_active":"2023-07-12T02:05:40.372851+0000","last_became_peered":"2023-07-12T02:05:40.372851+0000","last_unstale":"2023-07-12T02:05:41.383503+0000","last_undegraded":"2023-07-12T02:05:41.383503+0000","last_fullsized":"2023-07-12T02:05:41.383503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:13:11.916294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359886+0000","last_change":"2023-07-12T02:05:41.381388+0000","last_active":"2023-07-12T02:05:42.359886+0000","last_peered":"2023-07-12T02:05:42.359886+0000","last_clean":"2023-07-12T02:05:42.359886+0000","last_became_active":"2023-07-12T02:05:41.381063+0000","last_became_peered":"2023-07-12T02:05:41.381063+0000","last_unstale":"2023-07-12T02:05:42.359886+0000","last_undegraded":"2023-07-12T02:05:42.359886+0000","last_fullsized":"2023-07-12T02:05:42.359886+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:57:33.138298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.371947+0000","last_change":"2023-07-12T02:05:40.364765+0000","last_active":"2023-07-12T02:05:41.371947+0000","last_peered":"2023-07-12T02:05:41.371947+0000","last_clean":"2023-07-12T02:05:41.371947+0000","last_became_active":"2023-07-12T02:05:40.364489+0000","last_became_peered":"2023-07-12T02:05:40.364489+0000","last_unstale":"2023-07-12T02:05:41.371947+0000","last_undegraded":"2023-07-12T02:05:41.371947+0000","last_fullsized":"2023-07-12T02:05:41.371947+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:22:08.173950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.394458+0000","last_change":"2023-07-12T02:05:41.379909+0000","last_active":"2023-07-12T02:05:41.394458+0000","last_peered":"2023-07-12T02:05:41.394458+0000","last_clean":"2023-07-12T02:05:41.394458+0000","last_became_active":"2023-07-12T02:05:41.379612+0000","last_became_peered":"2023-07-12T02:05:41.379612+0000","last_unstale":"2023-07-12T02:05:41.394458+0000","last_undegraded":"2023-07-12T02:05:41.394458+0000","last_fullsized":"2023-07-12T02:05:41.394458+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:55:45.097858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.394379+0000","last_change":"2023-07-12T02:05:40.376433+0000","last_active":"2023-07-12T02:05:41.394379+0000","last_peered":"2023-07-12T02:05:41.394379+0000","last_clean":"2023-07-12T02:05:41.394379+0000","last_became_active":"2023-07-12T02:05:40.376120+0000","last_became_peered":"2023-07-12T02:05:40.376120+0000","last_unstale":"2023-07-12T02:05:41.394379+0000","last_undegraded":"2023-07-12T02:05:41.394379+0000","last_fullsized":"2023-07-12T02:05:41.394379+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:30.821517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.379249+0000","last_change":"2023-07-12T02:05:41.373011+0000","last_active":"2023-07-12T02:05:41.379249+0000","last_peered":"2023-07-12T02:05:41.379249+0000","last_clean":"2023-07-12T02:05:41.379249+0000","last_became_active":"2023-07-12T02:05:41.372475+0000","last_became_peered":"2023-07-12T02:05:41.372475+0000","last_unstale":"2023-07-12T02:05:41.379249+0000","last_undegraded":"2023-07-12T02:05:41.379249+0000","last_fullsized":"2023-07-12T02:05:41.379249+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:49:49.202641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.360598+0000","last_change":"2023-07-12T02:05:40.371588+0000","last_active":"2023-07-12T02:05:41.360598+0000","last_peered":"2023-07-12T02:05:41.360598+0000","last_clean":"2023-07-12T02:05:41.360598+0000","last_became_active":"2023-07-12T02:05:40.371307+0000","last_became_peered":"2023-07-12T02:05:40.371307+0000","last_unstale":"2023-07-12T02:05:41.360598+0000","last_undegraded":"2023-07-12T02:05:41.360598+0000","last_fullsized":"2023-07-12T02:05:41.360598+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:29.568974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360651+0000","last_change":"2023-07-12T02:05:41.367215+0000","last_active":"2023-07-12T02:05:42.360651+0000","last_peered":"2023-07-12T02:05:42.360651+0000","last_clean":"2023-07-12T02:05:42.360651+0000","last_became_active":"2023-07-12T02:05:41.366742+0000","last_became_peered":"2023-07-12T02:05:41.366742+0000","last_unstale":"2023-07-12T02:05:42.360651+0000","last_undegraded":"2023-07-12T02:05:42.360651+0000","last_fullsized":"2023-07-12T02:05:42.360651+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:46.155819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359793+0000","last_change":"2023-07-12T02:05:40.373022+0000","last_active":"2023-07-12T02:05:42.359793+0000","last_peered":"2023-07-12T02:05:42.359793+0000","last_clean":"2023-07-12T02:05:42.359793+0000","last_became_active":"2023-07-12T02:05:40.372678+0000","last_became_peered":"2023-07-12T02:05:40.372678+0000","last_unstale":"2023-07-12T02:05:42.359793+0000","last_undegraded":"2023-07-12T02:05:42.359793+0000","last_fullsized":"2023-07-12T02:05:42.359793+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:13:11.916294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359127+0000","last_change":"2023-07-12T02:05:41.385726+0000","last_active":"2023-07-12T02:05:42.359127+0000","last_peered":"2023-07-12T02:05:42.359127+0000","last_clean":"2023-07-12T02:05:42.359127+0000","last_became_active":"2023-07-12T02:05:41.385460+0000","last_became_peered":"2023-07-12T02:05:41.385460+0000","last_unstale":"2023-07-12T02:05:42.359127+0000","last_undegraded":"2023-07-12T02:05:42.359127+0000","last_fullsized":"2023-07-12T02:05:42.359127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:23:28.837463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.356185+0000","last_change":"2023-07-12T02:05:40.372801+0000","last_active":"2023-07-12T02:05:41.356185+0000","last_peered":"2023-07-12T02:05:41.356185+0000","last_clean":"2023-07-12T02:05:41.356185+0000","last_became_active":"2023-07-12T02:05:40.372456+0000","last_became_peered":"2023-07-12T02:05:40.372456+0000","last_unstale":"2023-07-12T02:05:41.356185+0000","last_undegraded":"2023-07-12T02:05:41.356185+0000","last_fullsized":"2023-07-12T02:05:41.356185+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:23:27.834900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357446+0000","last_change":"2023-07-12T02:05:41.378279+0000","last_active":"2023-07-12T02:05:42.357446+0000","last_peered":"2023-07-12T02:05:42.357446+0000","last_clean":"2023-07-12T02:05:42.357446+0000","last_became_active":"2023-07-12T02:05:41.378001+0000","last_became_peered":"2023-07-12T02:05:41.378001+0000","last_unstale":"2023-07-12T02:05:42.357446+0000","last_undegraded":"2023-07-12T02:05:42.357446+0000","last_fullsized":"2023-07-12T02:05:42.357446+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:41:06.314659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359388+0000","last_change":"2023-07-12T02:05:40.377273+0000","last_active":"2023-07-12T02:05:42.359388+0000","last_peered":"2023-07-12T02:05:42.359388+0000","last_clean":"2023-07-12T02:05:42.359388+0000","last_became_active":"2023-07-12T02:05:40.376926+0000","last_became_peered":"2023-07-12T02:05:40.376926+0000","last_unstale":"2023-07-12T02:05:42.359388+0000","last_undegraded":"2023-07-12T02:05:42.359388+0000","last_fullsized":"2023-07-12T02:05:42.359388+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:59:52.684925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.363012+0000","last_change":"2023-07-12T02:03:52.304302+0000","last_active":"2023-07-12T02:05:41.363012+0000","last_peered":"2023-07-12T02:05:41.363012+0000","last_clean":"2023-07-12T02:05:41.363012+0000","last_became_active":"2023-07-12T02:03:52.303905+0000","last_became_peered":"2023-07-12T02:03:52.303905+0000","last_unstale":"2023-07-12T02:05:41.363012+0000","last_undegraded":"2023-07-12T02:05:41.363012+0000","last_fullsized":"2023-07-12T02:05:41.363012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:33:02.070061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359941+0000","last_change":"2023-07-12T02:05:41.392206+0000","last_active":"2023-07-12T02:05:42.359941+0000","last_peered":"2023-07-12T02:05:42.359941+0000","last_clean":"2023-07-12T02:05:42.359941+0000","last_became_active":"2023-07-12T02:05:41.391505+0000","last_became_peered":"2023-07-12T02:05:41.391505+0000","last_unstale":"2023-07-12T02:05:42.359941+0000","last_undegraded":"2023-07-12T02:05:42.359941+0000","last_fullsized":"2023-07-12T02:05:42.359941+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:43:22.417967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.374372+0000","last_change":"2023-07-12T02:05:40.368664+0000","last_active":"2023-07-12T02:05:41.374372+0000","last_peered":"2023-07-12T02:05:41.374372+0000","last_clean":"2023-07-12T02:05:41.374372+0000","last_became_active":"2023-07-12T02:05:40.368361+0000","last_became_peered":"2023-07-12T02:05:40.368361+0000","last_unstale":"2023-07-12T02:05:41.374372+0000","last_undegraded":"2023-07-12T02:05:41.374372+0000","last_fullsized":"2023-07-12T02:05:41.374372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:29.568974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.360699+0000","last_change":"2023-07-12T02:03:51.909547+0000","last_active":"2023-07-12T02:05:41.360699+0000","last_peered":"2023-07-12T02:05:41.360699+0000","last_clean":"2023-07-12T02:05:41.360699+0000","last_became_active":"2023-07-12T02:03:51.909159+0000","last_became_peered":"2023-07-12T02:03:51.909159+0000","last_unstale":"2023-07-12T02:05:41.360699+0000","last_undegraded":"2023-07-12T02:05:41.360699+0000","last_fullsized":"2023-07-12T02:05:41.360699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:09:25.008909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359476+0000","last_change":"2023-07-12T02:05:41.391604+0000","last_active":"2023-07-12T02:05:42.359476+0000","last_peered":"2023-07-12T02:05:42.359476+0000","last_clean":"2023-07-12T02:05:42.359476+0000","last_became_active":"2023-07-12T02:05:41.391206+0000","last_became_peered":"2023-07-12T02:05:41.391206+0000","last_unstale":"2023-07-12T02:05:42.359476+0000","last_undegraded":"2023-07-12T02:05:42.359476+0000","last_fullsized":"2023-07-12T02:05:42.359476+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:25.650296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.357187+0000","last_change":"2023-07-12T02:05:40.376717+0000","last_active":"2023-07-12T02:05:41.357187+0000","last_peered":"2023-07-12T02:05:41.357187+0000","last_clean":"2023-07-12T02:05:41.357187+0000","last_became_active":"2023-07-12T02:05:40.376422+0000","last_became_peered":"2023-07-12T02:05:40.376422+0000","last_unstale":"2023-07-12T02:05:41.357187+0000","last_undegraded":"2023-07-12T02:05:41.357187+0000","last_fullsized":"2023-07-12T02:05:41.357187+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:39:14.737164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360245+0000","last_change":"2023-07-12T02:03:51.904989+0000","last_active":"2023-07-12T02:05:42.360245+0000","last_peered":"2023-07-12T02:05:42.360245+0000","last_clean":"2023-07-12T02:05:42.360245+0000","last_became_active":"2023-07-12T02:03:51.904497+0000","last_became_peered":"2023-07-12T02:03:51.904497+0000","last_unstale":"2023-07-12T02:05:42.360245+0000","last_undegraded":"2023-07-12T02:05:42.360245+0000","last_fullsized":"2023-07-12T02:05:42.360245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T14:02:16.186940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359759+0000","last_change":"2023-07-12T02:05:41.389443+0000","last_active":"2023-07-12T02:05:42.359759+0000","last_peered":"2023-07-12T02:05:42.359759+0000","last_clean":"2023-07-12T02:05:42.359759+0000","last_became_active":"2023-07-12T02:05:41.388799+0000","last_became_peered":"2023-07-12T02:05:41.388799+0000","last_unstale":"2023-07-12T02:05:42.359759+0000","last_undegraded":"2023-07-12T02:05:42.359759+0000","last_fullsized":"2023-07-12T02:05:42.359759+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:14:53.987394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.395327+0000","last_change":"2023-07-12T02:05:40.374820+0000","last_active":"2023-07-12T02:05:41.395327+0000","last_peered":"2023-07-12T02:05:41.395327+0000","last_clean":"2023-07-12T02:05:41.395327+0000","last_became_active":"2023-07-12T02:05:40.374578+0000","last_became_peered":"2023-07-12T02:05:40.374578+0000","last_unstale":"2023-07-12T02:05:41.395327+0000","last_undegraded":"2023-07-12T02:05:41.395327+0000","last_fullsized":"2023-07-12T02:05:41.395327+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:19:30.130807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.361654+0000","last_change":"2023-07-12T02:03:51.909324+0000","last_active":"2023-07-12T02:05:41.361654+0000","last_peered":"2023-07-12T02:05:41.361654+0000","last_clean":"2023-07-12T02:05:41.361654+0000","last_became_active":"2023-07-12T02:03:51.908982+0000","last_became_peered":"2023-07-12T02:03:51.908982+0000","last_unstale":"2023-07-12T02:05:41.361654+0000","last_undegraded":"2023-07-12T02:05:41.361654+0000","last_fullsized":"2023-07-12T02:05:41.361654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:52:09.761751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.356105+0000","last_change":"2023-07-12T02:03:44.783225+0000","last_active":"2023-07-12T02:05:41.356105+0000","last_peered":"2023-07-12T02:05:41.356105+0000","last_clean":"2023-07-12T02:05:41.356105+0000","last_became_active":"2023-07-12T02:03:44.782048+0000","last_became_peered":"2023-07-12T02:03:44.782048+0000","last_unstale":"2023-07-12T02:05:41.356105+0000","last_undegraded":"2023-07-12T02:05:41.356105+0000","last_fullsized":"2023-07-12T02:05:41.356105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:43.565472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:43.565472+0000","last_clean_scrub_stamp":"2023-07-12T02:03:43.565472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:02:55.671829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.371743+0000","last_change":"2023-07-12T02:05:41.365778+0000","last_active":"2023-07-12T02:05:41.371743+0000","last_peered":"2023-07-12T02:05:41.371743+0000","last_clean":"2023-07-12T02:05:41.371743+0000","last_became_active":"2023-07-12T02:05:41.365452+0000","last_became_peered":"2023-07-12T02:05:41.365452+0000","last_unstale":"2023-07-12T02:05:41.371743+0000","last_undegraded":"2023-07-12T02:05:41.371743+0000","last_fullsized":"2023-07-12T02:05:41.371743+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:25.650296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.362920+0000","last_change":"2023-07-12T02:05:40.374680+0000","last_active":"2023-07-12T02:05:41.362920+0000","last_peered":"2023-07-12T02:05:41.362920+0000","last_clean":"2023-07-12T02:05:41.362920+0000","last_became_active":"2023-07-12T02:05:40.374250+0000","last_became_peered":"2023-07-12T02:05:40.374250+0000","last_unstale":"2023-07-12T02:05:41.362920+0000","last_undegraded":"2023-07-12T02:05:41.362920+0000","last_fullsized":"2023-07-12T02:05:41.362920+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:03:02.458231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.356296+0000","last_change":"2023-07-12T02:03:51.909395+0000","last_active":"2023-07-12T02:05:41.356296+0000","last_peered":"2023-07-12T02:05:41.356296+0000","last_clean":"2023-07-12T02:05:41.356296+0000","last_became_active":"2023-07-12T02:03:51.909125+0000","last_became_peered":"2023-07-12T02:03:51.909125+0000","last_unstale":"2023-07-12T02:05:41.356296+0000","last_undegraded":"2023-07-12T02:05:41.356296+0000","last_fullsized":"2023-07-12T02:05:41.356296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:44:42.366005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.383446+0000","last_change":"2023-07-12T02:05:41.374970+0000","last_active":"2023-07-12T02:05:41.383446+0000","last_peered":"2023-07-12T02:05:41.383446+0000","last_clean":"2023-07-12T02:05:41.383446+0000","last_became_active":"2023-07-12T02:05:41.374708+0000","last_became_peered":"2023-07-12T02:05:41.374708+0000","last_unstale":"2023-07-12T02:05:41.383446+0000","last_undegraded":"2023-07-12T02:05:41.383446+0000","last_fullsized":"2023-07-12T02:05:41.383446+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:16:39.544700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.363024+0000","last_change":"2023-07-12T02:05:40.368912+0000","last_active":"2023-07-12T02:05:41.363024+0000","last_peered":"2023-07-12T02:05:41.363024+0000","last_clean":"2023-07-12T02:05:41.363024+0000","last_became_active":"2023-07-12T02:05:40.368655+0000","last_became_peered":"2023-07-12T02:05:40.368655+0000","last_unstale":"2023-07-12T02:05:41.363024+0000","last_undegraded":"2023-07-12T02:05:41.363024+0000","last_fullsized":"2023-07-12T02:05:41.363024+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:19:09.352847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.357127+0000","last_change":"2023-07-12T02:03:52.304880+0000","last_active":"2023-07-12T02:05:41.357127+0000","last_peered":"2023-07-12T02:05:41.357127+0000","last_clean":"2023-07-12T02:05:41.357127+0000","last_became_active":"2023-07-12T02:03:52.304598+0000","last_became_peered":"2023-07-12T02:03:52.304598+0000","last_unstale":"2023-07-12T02:05:41.357127+0000","last_undegraded":"2023-07-12T02:05:41.357127+0000","last_fullsized":"2023-07-12T02:05:41.357127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:17:41.675294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.400238+0000","last_change":"2023-07-12T02:05:41.394539+0000","last_active":"2023-07-12T02:05:41.400238+0000","last_peered":"2023-07-12T02:05:41.400238+0000","last_clean":"2023-07-12T02:05:41.400238+0000","last_became_active":"2023-07-12T02:05:41.394023+0000","last_became_peered":"2023-07-12T02:05:41.394023+0000","last_unstale":"2023-07-12T02:05:41.400238+0000","last_undegraded":"2023-07-12T02:05:41.400238+0000","last_fullsized":"2023-07-12T02:05:41.400238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:25:27.853003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357642+0000","last_change":"2023-07-12T02:05:40.369805+0000","last_active":"2023-07-12T02:05:42.357642+0000","last_peered":"2023-07-12T02:05:42.357642+0000","last_clean":"2023-07-12T02:05:42.357642+0000","last_became_active":"2023-07-12T02:05:40.369515+0000","last_became_peered":"2023-07-12T02:05:40.369515+0000","last_unstale":"2023-07-12T02:05:42.357642+0000","last_undegraded":"2023-07-12T02:05:42.357642+0000","last_fullsized":"2023-07-12T02:05:42.357642+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:02:40.133599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.363128+0000","last_change":"2023-07-12T02:03:51.906406+0000","last_active":"2023-07-12T02:05:41.363128+0000","last_peered":"2023-07-12T02:05:41.363128+0000","last_clean":"2023-07-12T02:05:41.363128+0000","last_became_active":"2023-07-12T02:03:51.905875+0000","last_became_peered":"2023-07-12T02:03:51.905875+0000","last_unstale":"2023-07-12T02:05:41.363128+0000","last_undegraded":"2023-07-12T02:05:41.363128+0000","last_fullsized":"2023-07-12T02:05:41.363128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:17:10.118098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.394497+0000","last_change":"2023-07-12T02:05:41.387170+0000","last_active":"2023-07-12T02:05:41.394497+0000","last_peered":"2023-07-12T02:05:41.394497+0000","last_clean":"2023-07-12T02:05:41.394497+0000","last_became_active":"2023-07-12T02:05:41.386847+0000","last_became_peered":"2023-07-12T02:05:41.386847+0000","last_unstale":"2023-07-12T02:05:41.394497+0000","last_undegraded":"2023-07-12T02:05:41.394497+0000","last_fullsized":"2023-07-12T02:05:41.394497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:27:31.357049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.356511+0000","last_change":"2023-07-12T02:05:40.376312+0000","last_active":"2023-07-12T02:05:41.356511+0000","last_peered":"2023-07-12T02:05:41.356511+0000","last_clean":"2023-07-12T02:05:41.356511+0000","last_became_active":"2023-07-12T02:05:40.375086+0000","last_became_peered":"2023-07-12T02:05:40.375086+0000","last_unstale":"2023-07-12T02:05:41.356511+0000","last_undegraded":"2023-07-12T02:05:41.356511+0000","last_fullsized":"2023-07-12T02:05:41.356511+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:16:38.542138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359959+0000","last_change":"2023-07-12T02:03:51.908137+0000","last_active":"2023-07-12T02:05:42.359959+0000","last_peered":"2023-07-12T02:05:42.359959+0000","last_clean":"2023-07-12T02:05:42.359959+0000","last_became_active":"2023-07-12T02:03:51.907900+0000","last_became_peered":"2023-07-12T02:03:51.907900+0000","last_unstale":"2023-07-12T02:05:42.359959+0000","last_undegraded":"2023-07-12T02:05:42.359959+0000","last_fullsized":"2023-07-12T02:05:42.359959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:45:59.117845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":796273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52800000000000002}]},{"osd":1,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.66800000000000004}]},{"osd":2,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.505}]},{"osd":3,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":0.54700000000000004}]},{"osd":4,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.621}]},{"osd":5,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.47599999999999998}]},{"osd":6,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.69099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":206487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":7.1230000000000002,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.67100000000000004}]},{"osd":1,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":7.2460000000000004,"5min":7.2460000000000004,"15min":7.2460000000000004},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.62}]},{"osd":3,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.79400000000000004}]},{"osd":4,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.83399999999999996}]},{"osd":7,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.72399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":205885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 12 02:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.379}]},{"osd":2,"last update":"Wed Jul 12 02:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Jul 12 02:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.42699999999999999}]},{"osd":4,"last update":"Wed Jul 12 02:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.499},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.68300000000000005}]},{"osd":5,"last update":"Wed Jul 12 02:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Wed Jul 12 02:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed Jul 12 02:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.53500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1056768,"data_stored":795198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul 12 02:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.2690000000000001,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":3.0419999999999998,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":0.52300000000000002}]},{"osd":2,"last update":"Wed Jul 12 02:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.1869999999999998,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":3.0840000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":0.45300000000000001}]},{"osd":3,"last update":"Wed Jul 12 02:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Jul 12 02:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.753}]},{"osd":5,"last update":"Wed Jul 12 02:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.73799999999999999}]},{"osd":6,"last update":"Wed Jul 12 02:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.81000000000000005}]},{"osd":7,"last update":"Wed Jul 12 02:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.79400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":207401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.38},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.49199999999999999}]},{"osd":1,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.443},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.41599999999999998}]},{"osd":3,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.48399999999999999}]},{"osd":4,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.76000000000000001}]},{"osd":5,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.85299999999999998}]},{"osd":6,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.91100000000000003}]},{"osd":7,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.877}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":206453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.497},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42899999999999999}]},{"osd":1,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55800000000000005}]},{"osd":2,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.53100000000000003}]},{"osd":4,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.63600000000000001}]},{"osd":5,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.77900000000000003}]},{"osd":6,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.746},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.79200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":214352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":6.6660000000000004,"5min":6.6660000000000004,"15min":6.6660000000000004},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.5810000000000004,"5min":6.5810000000000004,"15min":6.5810000000000004},"last":0.59599999999999997}]},{"osd":1,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":6.524,"5min":6.524,"15min":6.524},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.73199999999999998}]},{"osd":2,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":0.628}]},{"osd":3,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.753},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.66700000000000004}]},{"osd":6,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.80800000000000005}]},{"osd":7,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.81599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":205885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.75900000000000001}]},{"osd":1,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.61899999999999999}]},{"osd":3,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.77500000000000002}]},{"osd":4,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.50900000000000001}]},{"osd":6,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.54100000000000004}]},{"osd":7,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.69599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-12T02:05:45.822 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-12T02:05:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.053+0000 7fa95c7ff700 1 Processor -- start 2023-07-12T02:05:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.053+0000 7fa95c7ff700 1 -- start start 2023-07-12T02:05:46.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.054+0000 7fa95c7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9540b59d0 0x7fa9541671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:46.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.054+0000 7fa95c7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9540d1790 con 0x7fa95415c460 2023-07-12T02:05:46.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.054+0000 7fa95c7ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9540cd950 con 0x7fa9540d2640 2023-07-12T02:05:46.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.054+0000 7fa95c7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9540cedd0 con 0x7fa9540b59d0 2023-07-12T02:05:46.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.055+0000 7fa95a59b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa95415c460 0x7fa9540cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41610/0 (socket says 172.21.15.37:41610) 2023-07-12T02:05:46.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.055+0000 7fa95a59b700 1 -- 172.21.15.37:0/496619249 learned_addr learned my addr 172.21.15.37:0/496619249 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:46.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.055+0000 7fa95ad9c700 1 --2- 172.21.15.37:0/496619249 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9540b59d0 0x7fa9541671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:46.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.055+0000 7fa959599700 1 -- 172.21.15.37:0/496619249 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041838888 0 0) 0x7fa9540d1790 con 0x7fa95415c460 2023-07-12T02:05:46.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.055+0000 7fa959599700 1 -- 172.21.15.37:0/496619249 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9400035b0 con 0x7fa95415c460 2023-07-12T02:05:46.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.055+0000 7fa959599700 1 -- 172.21.15.37:0/496619249 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697447635 0 0) 0x7fa9540cd950 con 0x7fa9540d2640 2023-07-12T02:05:46.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.055+0000 7fa959599700 1 -- 172.21.15.37:0/496619249 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9540d1790 con 0x7fa9540d2640 2023-07-12T02:05:46.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.055+0000 7fa959599700 1 -- 172.21.15.37:0/496619249 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1163933984 0 0) 0x7fa9400035b0 con 0x7fa95415c460 2023-07-12T02:05:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.055+0000 7fa959599700 1 -- 172.21.15.37:0/496619249 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9540b59d0 msgr2=0x7fa9541671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.055+0000 7fa959599700 1 --2- 172.21.15.37:0/496619249 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9540b59d0 0x7fa9541671b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.055+0000 7fa959599700 1 -- 172.21.15.37:0/496619249 >> v1:172.21.15.196:6789/0 conn(0x7fa9540d2640 legacy=0x7fa9540cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.055+0000 7fa959599700 1 -- 172.21.15.37:0/496619249 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9540d14b0 con 0x7fa95415c460 2023-07-12T02:05:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.055+0000 7fa959599700 1 -- 172.21.15.37:0/496619249 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7fa950001670 con 0x7fa95415c460 2023-07-12T02:05:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.055+0000 7fa959599700 1 -- 172.21.15.37:0/496619249 >> v1:172.21.15.37:6789/0 conn(0x7fa95415c460 legacy=0x7fa9540cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.056+0000 7fa959599700 1 --2- 172.21.15.37:0/496619249 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9540b59d0 0x7fa940003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.056+0000 7fa959599700 1 --2- 172.21.15.37:0/496619249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa940004120 0x7fa940004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.056+0000 7fa959599700 1 --2- 172.21.15.37:0/496619249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa940004d90 0x7fa940005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.056+0000 7fa959599700 1 -- 172.21.15.37:0/496619249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9540cedd0 con 0x7fa940004120 2023-07-12T02:05:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.056+0000 7fa959599700 1 -- 172.21.15.37:0/496619249 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94000bc00 con 0x7fa940004d90 2023-07-12T02:05:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.056+0000 7fa959599700 1 -- 172.21.15.37:0/496619249 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94000bdc0 con 0x7fa9540b59d0 2023-07-12T02:05:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.056+0000 7fa959d9a700 1 --2- 172.21.15.37:0/496619249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa940004120 0x7fa940004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.056+0000 7fa95ad9c700 1 --2- 172.21.15.37:0/496619249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa940004d90 0x7fa940005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.056+0000 7fa95a59b700 1 --2- 172.21.15.37:0/496619249 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9540b59d0 0x7fa940003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.056+0000 7fa959d9a700 1 -- 172.21.15.37:0/496619249 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9540b59d0 msgr2=0x7fa940003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.056+0000 7fa959d9a700 1 --2- 172.21.15.37:0/496619249 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9540b59d0 0x7fa940003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.056+0000 7fa959d9a700 1 -- 172.21.15.37:0/496619249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa940004d90 msgr2=0x7fa940005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.056+0000 7fa959d9a700 1 --2- 172.21.15.37:0/496619249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa940004d90 0x7fa940005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.056+0000 7fa959d9a700 1 -- 172.21.15.37:0/496619249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9400035b0 con 0x7fa940004120 2023-07-12T02:05:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.056+0000 7fa959d9a700 1 --2- 172.21.15.37:0/496619249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa940004120 0x7fa940004850 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa944007fd0 tx=0x7fa940005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb29af2ceedf511 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.057+0000 7fa959599700 1 -- 172.21.15.37:0/496619249 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944001430 con 0x7fa940004120 2023-07-12T02:05:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.057+0000 7fa959599700 1 -- 172.21.15.37:0/496619249 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9440052d0 con 0x7fa940004120 2023-07-12T02:05:46.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.057+0000 7fa959599700 1 -- 172.21.15.37:0/496619249 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944001d40 con 0x7fa940004120 2023-07-12T02:05:46.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.057+0000 7fa95c7ff700 1 -- 172.21.15.37:0/496619249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa940004120 msgr2=0x7fa940004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:46.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.057+0000 7fa95c7ff700 1 --2- 172.21.15.37:0/496619249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa940004120 0x7fa940004850 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa944007fd0 tx=0x7fa940005880 comp rx=0 tx=0).stop 2023-07-12T02:05:46.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.057+0000 7fa95ad9c700 1 -- 172.21.15.37:0/496619249 reap_dead start 2023-07-12T02:05:46.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.057+0000 7fa95c7ff700 1 -- 172.21.15.37:0/496619249 shutdown_connections 2023-07-12T02:05:46.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.057+0000 7fa95c7ff700 1 -- 172.21.15.37:0/496619249 >> 172.21.15.37:0/496619249 conn(0x7fa954071660 msgr2=0x7fa954071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:46.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.057+0000 7fa95c7ff700 1 -- 172.21.15.37:0/496619249 shutdown_connections 2023-07-12T02:05:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.057+0000 7fa95c7ff700 1 -- 172.21.15.37:0/496619249 wait complete. 2023-07-12T02:05:46.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.059+0000 7fa95c7ff700 1 Processor -- start 2023-07-12T02:05:46.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.059+0000 7fa95c7ff700 1 -- start start 2023-07-12T02:05:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.060+0000 7fa95c7ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa940004120 0x7fa95414fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.060+0000 7fa95c7ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa95414ecb0 0x7fa954151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.060+0000 7fa95c7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa954153140 0x7fa95414dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.060+0000 7fa95c7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa954150440 con 0x7fa954153140 2023-07-12T02:05:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.060+0000 7fa95c7ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa954151d60 con 0x7fa95414ecb0 2023-07-12T02:05:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.060+0000 7fa95c7ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9540ca870 con 0x7fa940004120 2023-07-12T02:05:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.061+0000 7fa95ad9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa954153140 0x7fa95414dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.061+0000 7fa95ad9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa954153140 0x7fa95414dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56846/0 (socket says 172.21.15.37:56846) 2023-07-12T02:05:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.061+0000 7fa95ad9c700 1 -- 172.21.15.37:0/1918336645 learned_addr learned my addr 172.21.15.37:0/1918336645 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.061+0000 7fa95a59b700 1 --2- 172.21.15.37:0/1918336645 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa940004120 0x7fa95414fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.061+0000 7fa959d9a700 1 --2- 172.21.15.37:0/1918336645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa95414ecb0 0x7fa954151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.061+0000 7fa95ad9c700 1 -- 172.21.15.37:0/1918336645 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa940004120 msgr2=0x7fa95414fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.061+0000 7fa95ad9c700 1 --2- 172.21.15.37:0/1918336645 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa940004120 0x7fa95414fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.061+0000 7fa95ad9c700 1 -- 172.21.15.37:0/1918336645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa95414ecb0 msgr2=0x7fa954151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.061+0000 7fa95ad9c700 1 --2- 172.21.15.37:0/1918336645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa95414ecb0 0x7fa954151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.061+0000 7fa95ad9c700 1 -- 172.21.15.37:0/1918336645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9540c9ed0 con 0x7fa954153140 2023-07-12T02:05:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.061+0000 7fa95a59b700 1 --2- 172.21.15.37:0/1918336645 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa940004120 0x7fa95414fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.061+0000 7fa959d9a700 1 --2- 172.21.15.37:0/1918336645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa95414ecb0 0x7fa954151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.061+0000 7fa95ad9c700 1 --2- 172.21.15.37:0/1918336645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa954153140 0x7fa95414dba0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa9540ce580 tx=0x7fa94c011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.062+0000 7fa94affd700 1 -- 172.21.15.37:0/1918336645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c00e040 con 0x7fa954153140 2023-07-12T02:05:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.062+0000 7fa94affd700 1 -- 172.21.15.37:0/1918336645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c00f040 con 0x7fa954153140 2023-07-12T02:05:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.062+0000 7fa94affd700 1 -- 172.21.15.37:0/1918336645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c00fdb0 con 0x7fa954153140 2023-07-12T02:05:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.062+0000 7fa95c7ff700 1 -- 172.21.15.37:0/1918336645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9540ca1b0 con 0x7fa954153140 2023-07-12T02:05:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.062+0000 7fa95c7ff700 1 -- 172.21.15.37:0/1918336645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9541500e0 con 0x7fa954153140 2023-07-12T02:05:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.063+0000 7fa95c7ff700 1 -- 172.21.15.37:0/1918336645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9540ca9b0 con 0x7fa954153140 2023-07-12T02:05:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.064+0000 7fa94affd700 1 -- 172.21.15.37:0/1918336645 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa94c015430 con 0x7fa954153140 2023-07-12T02:05:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.065+0000 7fa94affd700 1 --2- 172.21.15.37:0/1918336645 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa93806ace0 0x7fa93806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.065+0000 7fa94affd700 1 -- 172.21.15.37:0/1918336645 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa94c089a70 con 0x7fa954153140 2023-07-12T02:05:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.065+0000 7fa95a59b700 1 --2- 172.21.15.37:0/1918336645 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa93806ace0 0x7fa93806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.066+0000 7fa95a59b700 1 --2- 172.21.15.37:0/1918336645 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa93806ace0 0x7fa93806d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa950000c00 tx=0x7fa950009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.069+0000 7fa94affd700 1 -- 172.21.15.37:0/1918336645 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa9540ca9b0 con 0x7fa954153140 2023-07-12T02:05:46.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.273+0000 7fa95c7ff700 1 -- 172.21.15.37:0/1918336645 --> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9540cd5e0 con 0x7fa93806ace0 2023-07-12T02:05:46.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.282+0000 7fa94affd700 1 -- 172.21.15.37:0/1918336645 <== mgr.4099 v2:172.21.15.196:6832/3490435896 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310747 (secure 0 0 0) 0x7fa950004870 con 0x7fa93806ace0 2023-07-12T02:05:46.289 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:46.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.286+0000 7fa95c7ff700 1 -- 172.21.15.37:0/1918336645 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa93806ace0 msgr2=0x7fa93806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:46.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.286+0000 7fa95c7ff700 1 --2- 172.21.15.37:0/1918336645 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa93806ace0 0x7fa93806d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa950000c00 tx=0x7fa950009040 comp rx=0 tx=0).stop 2023-07-12T02:05:46.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.286+0000 7fa95c7ff700 1 -- 172.21.15.37:0/1918336645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa954153140 msgr2=0x7fa95414dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:46.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.286+0000 7fa95c7ff700 1 --2- 172.21.15.37:0/1918336645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa954153140 0x7fa95414dba0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa9540ce580 tx=0x7fa94c011f80 comp rx=0 tx=0).stop 2023-07-12T02:05:46.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.286+0000 7fa95c7ff700 1 -- 172.21.15.37:0/1918336645 shutdown_connections 2023-07-12T02:05:46.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.286+0000 7fa95c7ff700 1 --2- 172.21.15.37:0/1918336645 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fa93806ace0 0x7fa93806d190 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.286+0000 7fa95c7ff700 1 --2- 172.21.15.37:0/1918336645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa954153140 0x7fa95414dba0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.286+0000 7fa95c7ff700 1 --2- 172.21.15.37:0/1918336645 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa940004120 0x7fa95414fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.286+0000 7fa95c7ff700 1 --2- 172.21.15.37:0/1918336645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa95414ecb0 0x7fa954151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.286+0000 7fa95c7ff700 1 -- 172.21.15.37:0/1918336645 >> 172.21.15.37:0/1918336645 conn(0x7fa954071660 msgr2=0x7fa95415f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.286+0000 7fa95c7ff700 1 -- 172.21.15.37:0/1918336645 shutdown_connections 2023-07-12T02:05:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.286+0000 7fa95c7ff700 1 -- 172.21.15.37:0/1918336645 wait complete. 2023-07-12T02:05:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-12T02:05:46.307 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-07-12T02:05:45.372372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221020,"kb_used_data":4848,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753700,"statfs":{"total":773094113280,"available":772867788800,"internally_reserved":0,"allocated":4964352,"data_stored":2837934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001799"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.377236+0000","last_change":"2023-07-12T02:05:41.366956+0000","last_active":"2023-07-12T02:05:41.377236+0000","last_peered":"2023-07-12T02:05:41.377236+0000","last_clean":"2023-07-12T02:05:41.377236+0000","last_became_active":"2023-07-12T02:05:41.366647+0000","last_became_peered":"2023-07-12T02:05:41.366647+0000","last_unstale":"2023-07-12T02:05:41.377236+0000","last_undegraded":"2023-07-12T02:05:41.377236+0000","last_fullsized":"2023-07-12T02:05:41.377236+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:58:04.431111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.392111+0000","last_change":"2023-07-12T02:05:41.390825+0000","last_active":"2023-07-12T02:05:41.392111+0000","last_peered":"2023-07-12T02:05:41.392111+0000","last_clean":"2023-07-12T02:05:41.392111+0000","last_became_active":"2023-07-12T02:05:41.390541+0000","last_became_peered":"2023-07-12T02:05:41.390541+0000","last_unstale":"2023-07-12T02:05:41.392111+0000","last_undegraded":"2023-07-12T02:05:41.392111+0000","last_fullsized":"2023-07-12T02:05:41.392111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:59:53.687487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357938+0000","last_change":"2023-07-12T02:05:41.374309+0000","last_active":"2023-07-12T02:05:42.357938+0000","last_peered":"2023-07-12T02:05:42.357938+0000","last_clean":"2023-07-12T02:05:42.357938+0000","last_became_active":"2023-07-12T02:05:41.374023+0000","last_became_peered":"2023-07-12T02:05:41.374023+0000","last_unstale":"2023-07-12T02:05:42.357938+0000","last_undegraded":"2023-07-12T02:05:42.357938+0000","last_fullsized":"2023-07-12T02:05:42.357938+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:00:41.754163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359257+0000","last_change":"2023-07-12T02:05:41.392654+0000","last_active":"2023-07-12T02:05:42.359257+0000","last_peered":"2023-07-12T02:05:42.359257+0000","last_clean":"2023-07-12T02:05:42.359257+0000","last_became_active":"2023-07-12T02:05:41.392384+0000","last_became_peered":"2023-07-12T02:05:41.392384+0000","last_unstale":"2023-07-12T02:05:42.359257+0000","last_undegraded":"2023-07-12T02:05:42.359257+0000","last_fullsized":"2023-07-12T02:05:42.359257+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:30.571537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.393282+0000","last_change":"2023-07-12T02:05:41.391247+0000","last_active":"2023-07-12T02:05:41.393282+0000","last_peered":"2023-07-12T02:05:41.393282+0000","last_clean":"2023-07-12T02:05:41.393282+0000","last_became_active":"2023-07-12T02:05:41.390946+0000","last_became_peered":"2023-07-12T02:05:41.390946+0000","last_unstale":"2023-07-12T02:05:41.393282+0000","last_undegraded":"2023-07-12T02:05:41.393282+0000","last_fullsized":"2023-07-12T02:05:41.393282+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:25.650296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.394480+0000","last_change":"2023-07-12T02:05:41.383351+0000","last_active":"2023-07-12T02:05:41.394480+0000","last_peered":"2023-07-12T02:05:41.394480+0000","last_clean":"2023-07-12T02:05:41.394480+0000","last_became_active":"2023-07-12T02:05:41.382983+0000","last_became_peered":"2023-07-12T02:05:41.382983+0000","last_unstale":"2023-07-12T02:05:41.394480+0000","last_undegraded":"2023-07-12T02:05:41.394480+0000","last_fullsized":"2023-07-12T02:05:41.394480+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:53:28.556905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.376495+0000","last_change":"2023-07-12T02:05:41.368708+0000","last_active":"2023-07-12T02:05:41.376495+0000","last_peered":"2023-07-12T02:05:41.376495+0000","last_clean":"2023-07-12T02:05:41.376495+0000","last_became_active":"2023-07-12T02:05:41.368410+0000","last_became_peered":"2023-07-12T02:05:41.368410+0000","last_unstale":"2023-07-12T02:05:41.376495+0000","last_undegraded":"2023-07-12T02:05:41.376495+0000","last_fullsized":"2023-07-12T02:05:41.376495+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:59:53.687487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359007+0000","last_change":"2023-07-12T02:05:41.386378+0000","last_active":"2023-07-12T02:05:42.359007+0000","last_peered":"2023-07-12T02:05:42.359007+0000","last_clean":"2023-07-12T02:05:42.359007+0000","last_became_active":"2023-07-12T02:05:41.386105+0000","last_became_peered":"2023-07-12T02:05:41.386105+0000","last_unstale":"2023-07-12T02:05:42.359007+0000","last_undegraded":"2023-07-12T02:05:42.359007+0000","last_fullsized":"2023-07-12T02:05:42.359007+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:04:52.451181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359636+0000","last_change":"2023-07-12T02:05:41.390933+0000","last_active":"2023-07-12T02:05:42.359636+0000","last_peered":"2023-07-12T02:05:42.359636+0000","last_clean":"2023-07-12T02:05:42.359636+0000","last_became_active":"2023-07-12T02:05:41.390635+0000","last_became_peered":"2023-07-12T02:05:41.390635+0000","last_unstale":"2023-07-12T02:05:42.359636+0000","last_undegraded":"2023-07-12T02:05:42.359636+0000","last_fullsized":"2023-07-12T02:05:42.359636+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:53:59.219826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359672+0000","last_change":"2023-07-12T02:05:41.389621+0000","last_active":"2023-07-12T02:05:42.359672+0000","last_peered":"2023-07-12T02:05:42.359672+0000","last_clean":"2023-07-12T02:05:42.359672+0000","last_became_active":"2023-07-12T02:05:41.389140+0000","last_became_peered":"2023-07-12T02:05:41.389140+0000","last_unstale":"2023-07-12T02:05:42.359672+0000","last_undegraded":"2023-07-12T02:05:42.359672+0000","last_fullsized":"2023-07-12T02:05:42.359672+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:19:31.133369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359320+0000","last_change":"2023-07-12T02:05:41.389440+0000","last_active":"2023-07-12T02:05:42.359320+0000","last_peered":"2023-07-12T02:05:42.359320+0000","last_clean":"2023-07-12T02:05:42.359320+0000","last_became_active":"2023-07-12T02:05:41.389079+0000","last_became_peered":"2023-07-12T02:05:41.389079+0000","last_unstale":"2023-07-12T02:05:42.359320+0000","last_undegraded":"2023-07-12T02:05:42.359320+0000","last_fullsized":"2023-07-12T02:05:42.359320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:11:14.466984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.380177+0000","last_change":"2023-07-12T02:05:41.370302+0000","last_active":"2023-07-12T02:05:41.380177+0000","last_peered":"2023-07-12T02:05:41.380177+0000","last_clean":"2023-07-12T02:05:41.380177+0000","last_became_active":"2023-07-12T02:05:41.369681+0000","last_became_peered":"2023-07-12T02:05:41.369681+0000","last_unstale":"2023-07-12T02:05:41.380177+0000","last_undegraded":"2023-07-12T02:05:41.380177+0000","last_fullsized":"2023-07-12T02:05:41.380177+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:30:09.555266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360467+0000","last_change":"2023-07-12T02:05:41.396675+0000","last_active":"2023-07-12T02:05:42.360467+0000","last_peered":"2023-07-12T02:05:42.360467+0000","last_clean":"2023-07-12T02:05:42.360467+0000","last_became_active":"2023-07-12T02:05:41.396220+0000","last_became_peered":"2023-07-12T02:05:41.396220+0000","last_unstale":"2023-07-12T02:05:42.360467+0000","last_undegraded":"2023-07-12T02:05:42.360467+0000","last_fullsized":"2023-07-12T02:05:42.360467+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:28:17.980445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359447+0000","last_change":"2023-07-12T02:05:41.386341+0000","last_active":"2023-07-12T02:05:42.359447+0000","last_peered":"2023-07-12T02:05:42.359447+0000","last_clean":"2023-07-12T02:05:42.359447+0000","last_became_active":"2023-07-12T02:05:41.385866+0000","last_became_peered":"2023-07-12T02:05:41.385866+0000","last_unstale":"2023-07-12T02:05:42.359447+0000","last_undegraded":"2023-07-12T02:05:42.359447+0000","last_fullsized":"2023-07-12T02:05:42.359447+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:30:09.555266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.396441+0000","last_change":"2023-07-12T02:05:41.376705+0000","last_active":"2023-07-12T02:05:41.396441+0000","last_peered":"2023-07-12T02:05:41.396441+0000","last_clean":"2023-07-12T02:05:41.396441+0000","last_became_active":"2023-07-12T02:05:41.376388+0000","last_became_peered":"2023-07-12T02:05:41.376388+0000","last_unstale":"2023-07-12T02:05:41.396441+0000","last_undegraded":"2023-07-12T02:05:41.396441+0000","last_fullsized":"2023-07-12T02:05:41.396441+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:14:08.147510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359477+0000","last_change":"2023-07-12T02:05:41.393003+0000","last_active":"2023-07-12T02:05:42.359477+0000","last_peered":"2023-07-12T02:05:42.359477+0000","last_clean":"2023-07-12T02:05:42.359477+0000","last_became_active":"2023-07-12T02:05:41.392727+0000","last_became_peered":"2023-07-12T02:05:41.392727+0000","last_unstale":"2023-07-12T02:05:42.359477+0000","last_undegraded":"2023-07-12T02:05:42.359477+0000","last_fullsized":"2023-07-12T02:05:42.359477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T14:04:05.645016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357769+0000","last_change":"2023-07-12T02:05:41.373440+0000","last_active":"2023-07-12T02:05:42.357769+0000","last_peered":"2023-07-12T02:05:42.357769+0000","last_clean":"2023-07-12T02:05:42.357769+0000","last_became_active":"2023-07-12T02:05:41.373177+0000","last_became_peered":"2023-07-12T02:05:41.373177+0000","last_unstale":"2023-07-12T02:05:42.357769+0000","last_undegraded":"2023-07-12T02:05:42.357769+0000","last_fullsized":"2023-07-12T02:05:42.357769+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:57:33.641833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357709+0000","last_change":"2023-07-12T02:05:41.390916+0000","last_active":"2023-07-12T02:05:42.357709+0000","last_peered":"2023-07-12T02:05:42.357709+0000","last_clean":"2023-07-12T02:05:42.357709+0000","last_became_active":"2023-07-12T02:05:41.390685+0000","last_became_peered":"2023-07-12T02:05:41.390685+0000","last_unstale":"2023-07-12T02:05:42.357709+0000","last_undegraded":"2023-07-12T02:05:42.357709+0000","last_fullsized":"2023-07-12T02:05:42.357709+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:41:01.635468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359765+0000","last_change":"2023-07-12T02:05:41.390345+0000","last_active":"2023-07-12T02:05:42.359765+0000","last_peered":"2023-07-12T02:05:42.359765+0000","last_clean":"2023-07-12T02:05:42.359765+0000","last_became_active":"2023-07-12T02:05:41.390057+0000","last_became_peered":"2023-07-12T02:05:41.390057+0000","last_unstale":"2023-07-12T02:05:42.359765+0000","last_undegraded":"2023-07-12T02:05:42.359765+0000","last_fullsized":"2023-07-12T02:05:42.359765+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:09:10.334576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360619+0000","last_change":"2023-07-12T02:05:41.393055+0000","last_active":"2023-07-12T02:05:42.360619+0000","last_peered":"2023-07-12T02:05:42.360619+0000","last_clean":"2023-07-12T02:05:42.360619+0000","last_became_active":"2023-07-12T02:05:41.392682+0000","last_became_peered":"2023-07-12T02:05:41.392682+0000","last_unstale":"2023-07-12T02:05:42.360619+0000","last_undegraded":"2023-07-12T02:05:42.360619+0000","last_fullsized":"2023-07-12T02:05:42.360619+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:39:25.768953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.400256+0000","last_change":"2023-07-12T02:05:41.394705+0000","last_active":"2023-07-12T02:05:41.400256+0000","last_peered":"2023-07-12T02:05:41.400256+0000","last_clean":"2023-07-12T02:05:41.400256+0000","last_became_active":"2023-07-12T02:05:41.394278+0000","last_became_peered":"2023-07-12T02:05:41.394278+0000","last_unstale":"2023-07-12T02:05:41.400256+0000","last_undegraded":"2023-07-12T02:05:41.400256+0000","last_fullsized":"2023-07-12T02:05:41.400256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:34:32.086669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359672+0000","last_change":"2023-07-12T02:05:41.386144+0000","last_active":"2023-07-12T02:05:42.359672+0000","last_peered":"2023-07-12T02:05:42.359672+0000","last_clean":"2023-07-12T02:05:42.359672+0000","last_became_active":"2023-07-12T02:05:41.385532+0000","last_became_peered":"2023-07-12T02:05:41.385532+0000","last_unstale":"2023-07-12T02:05:42.359672+0000","last_undegraded":"2023-07-12T02:05:42.359672+0000","last_fullsized":"2023-07-12T02:05:42.359672+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:34:21.766154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359624+0000","last_change":"2023-07-12T02:05:41.379049+0000","last_active":"2023-07-12T02:05:42.359624+0000","last_peered":"2023-07-12T02:05:42.359624+0000","last_clean":"2023-07-12T02:05:42.359624+0000","last_became_active":"2023-07-12T02:05:41.378436+0000","last_became_peered":"2023-07-12T02:05:41.378436+0000","last_unstale":"2023-07-12T02:05:42.359624+0000","last_undegraded":"2023-07-12T02:05:42.359624+0000","last_fullsized":"2023-07-12T02:05:42.359624+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:28:17.980445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359382+0000","last_change":"2023-07-12T02:05:41.374458+0000","last_active":"2023-07-12T02:05:42.359382+0000","last_peered":"2023-07-12T02:05:42.359382+0000","last_clean":"2023-07-12T02:05:42.359382+0000","last_became_active":"2023-07-12T02:05:41.374162+0000","last_became_peered":"2023-07-12T02:05:41.374162+0000","last_unstale":"2023-07-12T02:05:42.359382+0000","last_undegraded":"2023-07-12T02:05:42.359382+0000","last_fullsized":"2023-07-12T02:05:42.359382+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:21:00.107822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359632+0000","last_change":"2023-07-12T02:05:41.375587+0000","last_active":"2023-07-12T02:05:42.359632+0000","last_peered":"2023-07-12T02:05:42.359632+0000","last_clean":"2023-07-12T02:05:42.359632+0000","last_became_active":"2023-07-12T02:05:41.375293+0000","last_became_peered":"2023-07-12T02:05:41.375293+0000","last_unstale":"2023-07-12T02:05:42.359632+0000","last_undegraded":"2023-07-12T02:05:42.359632+0000","last_fullsized":"2023-07-12T02:05:42.359632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:39:25.768953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360609+0000","last_change":"2023-07-12T02:05:41.395572+0000","last_active":"2023-07-12T02:05:42.360609+0000","last_peered":"2023-07-12T02:05:42.360609+0000","last_clean":"2023-07-12T02:05:42.360609+0000","last_became_active":"2023-07-12T02:05:41.395236+0000","last_became_peered":"2023-07-12T02:05:41.395236+0000","last_unstale":"2023-07-12T02:05:42.360609+0000","last_undegraded":"2023-07-12T02:05:42.360609+0000","last_fullsized":"2023-07-12T02:05:42.360609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:18:17.564601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357646+0000","last_change":"2023-07-12T02:05:41.377111+0000","last_active":"2023-07-12T02:05:42.357646+0000","last_peered":"2023-07-12T02:05:42.357646+0000","last_clean":"2023-07-12T02:05:42.357646+0000","last_became_active":"2023-07-12T02:05:41.376850+0000","last_became_peered":"2023-07-12T02:05:41.376850+0000","last_unstale":"2023-07-12T02:05:42.357646+0000","last_undegraded":"2023-07-12T02:05:42.357646+0000","last_fullsized":"2023-07-12T02:05:42.357646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:06:53.160066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.380199+0000","last_change":"2023-07-12T02:05:41.370370+0000","last_active":"2023-07-12T02:05:41.380199+0000","last_peered":"2023-07-12T02:05:41.380199+0000","last_clean":"2023-07-12T02:05:41.380199+0000","last_became_active":"2023-07-12T02:05:41.370084+0000","last_became_peered":"2023-07-12T02:05:41.370084+0000","last_unstale":"2023-07-12T02:05:41.380199+0000","last_undegraded":"2023-07-12T02:05:41.380199+0000","last_fullsized":"2023-07-12T02:05:41.380199+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:58:04.431111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359626+0000","last_change":"2023-07-12T02:05:41.371744+0000","last_active":"2023-07-12T02:05:42.359626+0000","last_peered":"2023-07-12T02:05:42.359626+0000","last_clean":"2023-07-12T02:05:42.359626+0000","last_became_active":"2023-07-12T02:05:41.371453+0000","last_became_peered":"2023-07-12T02:05:41.371453+0000","last_unstale":"2023-07-12T02:05:42.359626+0000","last_undegraded":"2023-07-12T02:05:42.359626+0000","last_fullsized":"2023-07-12T02:05:42.359626+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:18:17.564601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357452+0000","last_change":"2023-07-12T02:05:41.370402+0000","last_active":"2023-07-12T02:05:42.357452+0000","last_peered":"2023-07-12T02:05:42.357452+0000","last_clean":"2023-07-12T02:05:42.357452+0000","last_became_active":"2023-07-12T02:05:41.370056+0000","last_became_peered":"2023-07-12T02:05:41.370056+0000","last_unstale":"2023-07-12T02:05:42.357452+0000","last_undegraded":"2023-07-12T02:05:42.357452+0000","last_fullsized":"2023-07-12T02:05:42.357452+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:24:17.462199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.396463+0000","last_change":"2023-07-12T02:05:41.378464+0000","last_active":"2023-07-12T02:05:41.396463+0000","last_peered":"2023-07-12T02:05:41.396463+0000","last_clean":"2023-07-12T02:05:41.396463+0000","last_became_active":"2023-07-12T02:05:41.376694+0000","last_became_peered":"2023-07-12T02:05:41.376694+0000","last_unstale":"2023-07-12T02:05:41.396463+0000","last_undegraded":"2023-07-12T02:05:41.396463+0000","last_fullsized":"2023-07-12T02:05:41.396463+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:38:29.182446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360351+0000","last_change":"2023-07-12T02:05:41.368883+0000","last_active":"2023-07-12T02:05:42.360351+0000","last_peered":"2023-07-12T02:05:42.360351+0000","last_clean":"2023-07-12T02:05:42.360351+0000","last_became_active":"2023-07-12T02:05:41.367830+0000","last_became_peered":"2023-07-12T02:05:41.367830+0000","last_unstale":"2023-07-12T02:05:42.360351+0000","last_undegraded":"2023-07-12T02:05:42.360351+0000","last_fullsized":"2023-07-12T02:05:42.360351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:33:45.931288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.399826+0000","last_change":"2023-07-12T02:05:41.397067+0000","last_active":"2023-07-12T02:05:41.399826+0000","last_peered":"2023-07-12T02:05:41.399826+0000","last_clean":"2023-07-12T02:05:41.399826+0000","last_became_active":"2023-07-12T02:05:41.396771+0000","last_became_peered":"2023-07-12T02:05:41.396771+0000","last_unstale":"2023-07-12T02:05:41.399826+0000","last_undegraded":"2023-07-12T02:05:41.399826+0000","last_fullsized":"2023-07-12T02:05:41.399826+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:35:48.065444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.394849+0000","last_change":"2023-07-12T02:05:40.370821+0000","last_active":"2023-07-12T02:05:41.394849+0000","last_peered":"2023-07-12T02:05:41.394849+0000","last_clean":"2023-07-12T02:05:41.394849+0000","last_became_active":"2023-07-12T02:05:40.370495+0000","last_became_peered":"2023-07-12T02:05:40.370495+0000","last_unstale":"2023-07-12T02:05:41.394849+0000","last_undegraded":"2023-07-12T02:05:41.394849+0000","last_fullsized":"2023-07-12T02:05:41.394849+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:58:31.331993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359816+0000","last_change":"2023-07-12T02:05:41.372605+0000","last_active":"2023-07-12T02:05:42.359816+0000","last_peered":"2023-07-12T02:05:42.359816+0000","last_clean":"2023-07-12T02:05:42.359816+0000","last_became_active":"2023-07-12T02:05:41.372115+0000","last_became_peered":"2023-07-12T02:05:41.372115+0000","last_unstale":"2023-07-12T02:05:42.359816+0000","last_undegraded":"2023-07-12T02:05:42.359816+0000","last_fullsized":"2023-07-12T02:05:42.359816+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:36:55.254373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357860+0000","last_change":"2023-07-12T02:05:40.366801+0000","last_active":"2023-07-12T02:05:42.357860+0000","last_peered":"2023-07-12T02:05:42.357860+0000","last_clean":"2023-07-12T02:05:42.357860+0000","last_became_active":"2023-07-12T02:05:40.366507+0000","last_became_peered":"2023-07-12T02:05:40.366507+0000","last_unstale":"2023-07-12T02:05:42.357860+0000","last_undegraded":"2023-07-12T02:05:42.357860+0000","last_fullsized":"2023-07-12T02:05:42.357860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:10:13.637560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.400547+0000","last_change":"2023-07-12T02:05:41.398447+0000","last_active":"2023-07-12T02:05:41.400547+0000","last_peered":"2023-07-12T02:05:41.400547+0000","last_clean":"2023-07-12T02:05:41.400547+0000","last_became_active":"2023-07-12T02:05:41.398135+0000","last_became_peered":"2023-07-12T02:05:41.398135+0000","last_unstale":"2023-07-12T02:05:41.400547+0000","last_undegraded":"2023-07-12T02:05:41.400547+0000","last_fullsized":"2023-07-12T02:05:41.400547+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:39:15.739727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.384716+0000","last_change":"2023-07-12T02:05:40.372166+0000","last_active":"2023-07-12T02:05:41.384716+0000","last_peered":"2023-07-12T02:05:41.384716+0000","last_clean":"2023-07-12T02:05:41.384716+0000","last_became_active":"2023-07-12T02:05:40.371784+0000","last_became_peered":"2023-07-12T02:05:40.371784+0000","last_unstale":"2023-07-12T02:05:41.384716+0000","last_undegraded":"2023-07-12T02:05:41.384716+0000","last_fullsized":"2023-07-12T02:05:41.384716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:33:34.218127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.386270+0000","last_change":"2023-07-12T02:05:41.383478+0000","last_active":"2023-07-12T02:05:41.386270+0000","last_peered":"2023-07-12T02:05:41.386270+0000","last_clean":"2023-07-12T02:05:41.386270+0000","last_became_active":"2023-07-12T02:05:41.383202+0000","last_became_peered":"2023-07-12T02:05:41.383202+0000","last_unstale":"2023-07-12T02:05:41.386270+0000","last_undegraded":"2023-07-12T02:05:41.386270+0000","last_fullsized":"2023-07-12T02:05:41.386270+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:44:42.078918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.381178+0000","last_change":"2023-07-12T02:05:40.375181+0000","last_active":"2023-07-12T02:05:41.381178+0000","last_peered":"2023-07-12T02:05:41.381178+0000","last_clean":"2023-07-12T02:05:41.381178+0000","last_became_active":"2023-07-12T02:05:40.374887+0000","last_became_peered":"2023-07-12T02:05:40.374887+0000","last_unstale":"2023-07-12T02:05:41.381178+0000","last_undegraded":"2023-07-12T02:05:41.381178+0000","last_fullsized":"2023-07-12T02:05:41.381178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:30:08.552703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357456+0000","last_change":"2023-07-12T02:05:41.378419+0000","last_active":"2023-07-12T02:05:42.357456+0000","last_peered":"2023-07-12T02:05:42.357456+0000","last_clean":"2023-07-12T02:05:42.357456+0000","last_became_active":"2023-07-12T02:05:41.378141+0000","last_became_peered":"2023-07-12T02:05:41.378141+0000","last_unstale":"2023-07-12T02:05:42.357456+0000","last_undegraded":"2023-07-12T02:05:42.357456+0000","last_fullsized":"2023-07-12T02:05:42.357456+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:37:41.059502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.394309+0000","last_change":"2023-07-12T02:05:40.374186+0000","last_active":"2023-07-12T02:05:41.394309+0000","last_peered":"2023-07-12T02:05:41.394309+0000","last_clean":"2023-07-12T02:05:41.394309+0000","last_became_active":"2023-07-12T02:05:40.373775+0000","last_became_peered":"2023-07-12T02:05:40.373775+0000","last_unstale":"2023-07-12T02:05:41.394309+0000","last_undegraded":"2023-07-12T02:05:41.394309+0000","last_fullsized":"2023-07-12T02:05:41.394309+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:27:04.606604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359635+0000","last_change":"2023-07-12T02:05:41.389384+0000","last_active":"2023-07-12T02:05:42.359635+0000","last_peered":"2023-07-12T02:05:42.359635+0000","last_clean":"2023-07-12T02:05:42.359635+0000","last_became_active":"2023-07-12T02:05:41.389222+0000","last_became_peered":"2023-07-12T02:05:41.389222+0000","last_unstale":"2023-07-12T02:05:42.359635+0000","last_undegraded":"2023-07-12T02:05:42.359635+0000","last_fullsized":"2023-07-12T02:05:42.359635+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:58:04.431111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357827+0000","last_change":"2023-07-12T02:05:40.374194+0000","last_active":"2023-07-12T02:05:42.357827+0000","last_peered":"2023-07-12T02:05:42.357827+0000","last_clean":"2023-07-12T02:05:42.357827+0000","last_became_active":"2023-07-12T02:05:40.373897+0000","last_became_peered":"2023-07-12T02:05:40.373897+0000","last_unstale":"2023-07-12T02:05:42.357827+0000","last_undegraded":"2023-07-12T02:05:42.357827+0000","last_fullsized":"2023-07-12T02:05:42.357827+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:28:56.247779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359256+0000","last_change":"2023-07-12T02:05:41.385827+0000","last_active":"2023-07-12T02:05:42.359256+0000","last_peered":"2023-07-12T02:05:42.359256+0000","last_clean":"2023-07-12T02:05:42.359256+0000","last_became_active":"2023-07-12T02:05:41.385509+0000","last_became_peered":"2023-07-12T02:05:41.385509+0000","last_unstale":"2023-07-12T02:05:42.359256+0000","last_undegraded":"2023-07-12T02:05:42.359256+0000","last_fullsized":"2023-07-12T02:05:42.359256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:27:05.609167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.360431+0000","last_change":"2023-07-12T02:05:40.373357+0000","last_active":"2023-07-12T02:05:41.360431+0000","last_peered":"2023-07-12T02:05:41.360431+0000","last_clean":"2023-07-12T02:05:41.360431+0000","last_became_active":"2023-07-12T02:05:40.373061+0000","last_became_peered":"2023-07-12T02:05:40.373061+0000","last_unstale":"2023-07-12T02:05:41.360431+0000","last_undegraded":"2023-07-12T02:05:41.360431+0000","last_fullsized":"2023-07-12T02:05:41.360431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:27:04.606604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359409+0000","last_change":"2023-07-12T02:05:41.379196+0000","last_active":"2023-07-12T02:05:42.359409+0000","last_peered":"2023-07-12T02:05:42.359409+0000","last_clean":"2023-07-12T02:05:42.359409+0000","last_became_active":"2023-07-12T02:05:41.378837+0000","last_became_peered":"2023-07-12T02:05:41.378837+0000","last_unstale":"2023-07-12T02:05:42.359409+0000","last_undegraded":"2023-07-12T02:05:42.359409+0000","last_fullsized":"2023-07-12T02:05:42.359409+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:33:45.931288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359146+0000","last_change":"2023-07-12T02:05:40.371528+0000","last_active":"2023-07-12T02:05:42.359146+0000","last_peered":"2023-07-12T02:05:42.359146+0000","last_clean":"2023-07-12T02:05:42.359146+0000","last_became_active":"2023-07-12T02:05:40.371254+0000","last_became_peered":"2023-07-12T02:05:40.371254+0000","last_unstale":"2023-07-12T02:05:42.359146+0000","last_undegraded":"2023-07-12T02:05:42.359146+0000","last_fullsized":"2023-07-12T02:05:42.359146+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:30.821517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357831+0000","last_change":"2023-07-12T02:05:41.390893+0000","last_active":"2023-07-12T02:05:42.357831+0000","last_peered":"2023-07-12T02:05:42.357831+0000","last_clean":"2023-07-12T02:05:42.357831+0000","last_became_active":"2023-07-12T02:05:41.390585+0000","last_became_peered":"2023-07-12T02:05:41.390585+0000","last_unstale":"2023-07-12T02:05:42.357831+0000","last_undegraded":"2023-07-12T02:05:42.357831+0000","last_fullsized":"2023-07-12T02:05:42.357831+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:40:09.062654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357899+0000","last_change":"2023-07-12T02:05:40.368765+0000","last_active":"2023-07-12T02:05:42.357899+0000","last_peered":"2023-07-12T02:05:42.357899+0000","last_clean":"2023-07-12T02:05:42.357899+0000","last_became_active":"2023-07-12T02:05:40.368353+0000","last_became_peered":"2023-07-12T02:05:40.368353+0000","last_unstale":"2023-07-12T02:05:42.357899+0000","last_undegraded":"2023-07-12T02:05:42.357899+0000","last_fullsized":"2023-07-12T02:05:42.357899+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:51.817291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.377258+0000","last_change":"2023-07-12T02:05:41.368898+0000","last_active":"2023-07-12T02:05:41.377258+0000","last_peered":"2023-07-12T02:05:41.377258+0000","last_clean":"2023-07-12T02:05:41.377258+0000","last_became_active":"2023-07-12T02:05:41.368613+0000","last_became_peered":"2023-07-12T02:05:41.368613+0000","last_unstale":"2023-07-12T02:05:41.377258+0000","last_undegraded":"2023-07-12T02:05:41.377258+0000","last_fullsized":"2023-07-12T02:05:41.377258+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:13:12.918856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359800+0000","last_change":"2023-07-12T02:05:40.373103+0000","last_active":"2023-07-12T02:05:42.359800+0000","last_peered":"2023-07-12T02:05:42.359800+0000","last_clean":"2023-07-12T02:05:42.359800+0000","last_became_active":"2023-07-12T02:05:40.372809+0000","last_became_peered":"2023-07-12T02:05:40.372809+0000","last_unstale":"2023-07-12T02:05:42.359800+0000","last_undegraded":"2023-07-12T02:05:42.359800+0000","last_fullsized":"2023-07-12T02:05:42.359800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:33:47.294318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.400687+0000","last_change":"2023-07-12T02:05:41.398095+0000","last_active":"2023-07-12T02:05:41.400687+0000","last_peered":"2023-07-12T02:05:41.400687+0000","last_clean":"2023-07-12T02:05:41.400687+0000","last_became_active":"2023-07-12T02:05:41.397815+0000","last_became_peered":"2023-07-12T02:05:41.397815+0000","last_unstale":"2023-07-12T02:05:41.400687+0000","last_undegraded":"2023-07-12T02:05:41.400687+0000","last_fullsized":"2023-07-12T02:05:41.400687+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:07:41.711909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.384547+0000","last_change":"2023-07-12T02:05:40.376233+0000","last_active":"2023-07-12T02:05:41.384547+0000","last_peered":"2023-07-12T02:05:41.384547+0000","last_clean":"2023-07-12T02:05:41.384547+0000","last_became_active":"2023-07-12T02:05:40.375907+0000","last_became_peered":"2023-07-12T02:05:40.375907+0000","last_unstale":"2023-07-12T02:05:41.384547+0000","last_undegraded":"2023-07-12T02:05:41.384547+0000","last_fullsized":"2023-07-12T02:05:41.384547+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:53:58.217263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.381250+0000","last_change":"2023-07-12T02:05:41.371645+0000","last_active":"2023-07-12T02:05:41.381250+0000","last_peered":"2023-07-12T02:05:41.381250+0000","last_clean":"2023-07-12T02:05:41.381250+0000","last_became_active":"2023-07-12T02:05:41.371312+0000","last_became_peered":"2023-07-12T02:05:41.371312+0000","last_unstale":"2023-07-12T02:05:41.381250+0000","last_undegraded":"2023-07-12T02:05:41.381250+0000","last_fullsized":"2023-07-12T02:05:41.381250+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:11:14.466984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360802+0000","last_change":"2023-07-12T02:05:40.370573+0000","last_active":"2023-07-12T02:05:42.360802+0000","last_peered":"2023-07-12T02:05:42.360802+0000","last_clean":"2023-07-12T02:05:42.360802+0000","last_became_active":"2023-07-12T02:05:40.370266+0000","last_became_peered":"2023-07-12T02:05:40.370266+0000","last_unstale":"2023-07-12T02:05:42.360802+0000","last_undegraded":"2023-07-12T02:05:42.360802+0000","last_fullsized":"2023-07-12T02:05:42.360802+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:20:34.350253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359710+0000","last_change":"2023-07-12T02:05:41.392344+0000","last_active":"2023-07-12T02:05:42.359710+0000","last_peered":"2023-07-12T02:05:42.359710+0000","last_clean":"2023-07-12T02:05:42.359710+0000","last_became_active":"2023-07-12T02:05:41.392005+0000","last_became_peered":"2023-07-12T02:05:41.392005+0000","last_unstale":"2023-07-12T02:05:42.359710+0000","last_undegraded":"2023-07-12T02:05:42.359710+0000","last_fullsized":"2023-07-12T02:05:42.359710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:46.155819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.400274+0000","last_change":"2023-07-12T02:05:40.374949+0000","last_active":"2023-07-12T02:05:41.400274+0000","last_peered":"2023-07-12T02:05:41.400274+0000","last_clean":"2023-07-12T02:05:41.400274+0000","last_became_active":"2023-07-12T02:05:40.374692+0000","last_became_peered":"2023-07-12T02:05:40.374692+0000","last_unstale":"2023-07-12T02:05:41.400274+0000","last_undegraded":"2023-07-12T02:05:41.400274+0000","last_fullsized":"2023-07-12T02:05:41.400274+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:23:27.834900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359656+0000","last_change":"2023-07-12T02:05:41.389004+0000","last_active":"2023-07-12T02:05:42.359656+0000","last_peered":"2023-07-12T02:05:42.359656+0000","last_clean":"2023-07-12T02:05:42.359656+0000","last_became_active":"2023-07-12T02:05:41.388699+0000","last_became_peered":"2023-07-12T02:05:41.388699+0000","last_unstale":"2023-07-12T02:05:42.359656+0000","last_undegraded":"2023-07-12T02:05:42.359656+0000","last_fullsized":"2023-07-12T02:05:42.359656+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:39:15.739727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.356386+0000","last_change":"2023-07-12T02:05:40.372749+0000","last_active":"2023-07-12T02:05:41.356386+0000","last_peered":"2023-07-12T02:05:41.356386+0000","last_clean":"2023-07-12T02:05:41.356386+0000","last_became_active":"2023-07-12T02:05:40.372449+0000","last_became_peered":"2023-07-12T02:05:40.372449+0000","last_unstale":"2023-07-12T02:05:41.356386+0000","last_undegraded":"2023-07-12T02:05:41.356386+0000","last_fullsized":"2023-07-12T02:05:41.356386+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:27:04.606604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.400194+0000","last_change":"2023-07-12T02:05:41.393574+0000","last_active":"2023-07-12T02:05:41.400194+0000","last_peered":"2023-07-12T02:05:41.400194+0000","last_clean":"2023-07-12T02:05:41.400194+0000","last_became_active":"2023-07-12T02:05:41.393266+0000","last_became_peered":"2023-07-12T02:05:41.393266+0000","last_unstale":"2023-07-12T02:05:41.400194+0000","last_undegraded":"2023-07-12T02:05:41.400194+0000","last_fullsized":"2023-07-12T02:05:41.400194+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:52:04.425131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.373549+0000","last_change":"2023-07-12T02:05:40.375507+0000","last_active":"2023-07-12T02:05:41.373549+0000","last_peered":"2023-07-12T02:05:41.373549+0000","last_clean":"2023-07-12T02:05:41.373549+0000","last_became_active":"2023-07-12T02:05:40.375241+0000","last_became_peered":"2023-07-12T02:05:40.375241+0000","last_unstale":"2023-07-12T02:05:41.373549+0000","last_undegraded":"2023-07-12T02:05:41.373549+0000","last_fullsized":"2023-07-12T02:05:41.373549+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:04:51.448618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.387228+0000","last_change":"2023-07-12T02:05:41.382438+0000","last_active":"2023-07-12T02:05:41.387228+0000","last_peered":"2023-07-12T02:05:41.387228+0000","last_clean":"2023-07-12T02:05:41.387228+0000","last_became_active":"2023-07-12T02:05:41.382105+0000","last_became_peered":"2023-07-12T02:05:41.382105+0000","last_unstale":"2023-07-12T02:05:41.387228+0000","last_undegraded":"2023-07-12T02:05:41.387228+0000","last_fullsized":"2023-07-12T02:05:41.387228+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:30.571537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359364+0000","last_change":"2023-07-12T02:05:40.367829+0000","last_active":"2023-07-12T02:05:42.359364+0000","last_peered":"2023-07-12T02:05:42.359364+0000","last_clean":"2023-07-12T02:05:42.359364+0000","last_became_active":"2023-07-12T02:05:40.367256+0000","last_became_peered":"2023-07-12T02:05:40.367256+0000","last_unstale":"2023-07-12T02:05:42.359364+0000","last_undegraded":"2023-07-12T02:05:42.359364+0000","last_fullsized":"2023-07-12T02:05:42.359364+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:16:38.542138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360714+0000","last_change":"2023-07-12T02:05:41.366609+0000","last_active":"2023-07-12T02:05:42.360714+0000","last_peered":"2023-07-12T02:05:42.360714+0000","last_clean":"2023-07-12T02:05:42.360714+0000","last_became_active":"2023-07-12T02:05:41.366071+0000","last_became_peered":"2023-07-12T02:05:41.366071+0000","last_unstale":"2023-07-12T02:05:42.360714+0000","last_undegraded":"2023-07-12T02:05:42.360714+0000","last_fullsized":"2023-07-12T02:05:42.360714+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:36:55.254373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360694+0000","last_change":"2023-07-12T02:05:40.375460+0000","last_active":"2023-07-12T02:05:42.360694+0000","last_peered":"2023-07-12T02:05:42.360694+0000","last_clean":"2023-07-12T02:05:42.360694+0000","last_became_active":"2023-07-12T02:05:40.375188+0000","last_became_peered":"2023-07-12T02:05:40.375188+0000","last_unstale":"2023-07-12T02:05:42.360694+0000","last_undegraded":"2023-07-12T02:05:42.360694+0000","last_fullsized":"2023-07-12T02:05:42.360694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:09:09.332013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359832+0000","last_change":"2023-07-12T02:05:41.397072+0000","last_active":"2023-07-12T02:05:42.359832+0000","last_peered":"2023-07-12T02:05:42.359832+0000","last_clean":"2023-07-12T02:05:42.359832+0000","last_became_active":"2023-07-12T02:05:41.396784+0000","last_became_peered":"2023-07-12T02:05:41.396784+0000","last_unstale":"2023-07-12T02:05:42.359832+0000","last_undegraded":"2023-07-12T02:05:42.359832+0000","last_fullsized":"2023-07-12T02:05:42.359832+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:45:44.173260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357983+0000","last_change":"2023-07-12T02:05:40.373948+0000","last_active":"2023-07-12T02:05:42.357983+0000","last_peered":"2023-07-12T02:05:42.357983+0000","last_clean":"2023-07-12T02:05:42.357983+0000","last_became_active":"2023-07-12T02:05:40.373653+0000","last_became_peered":"2023-07-12T02:05:40.373653+0000","last_unstale":"2023-07-12T02:05:42.357983+0000","last_undegraded":"2023-07-12T02:05:42.357983+0000","last_fullsized":"2023-07-12T02:05:42.357983+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:19:44.862563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359880+0000","last_change":"2023-07-12T02:05:41.398505+0000","last_active":"2023-07-12T02:05:42.359880+0000","last_peered":"2023-07-12T02:05:42.359880+0000","last_clean":"2023-07-12T02:05:42.359880+0000","last_became_active":"2023-07-12T02:05:41.398199+0000","last_became_peered":"2023-07-12T02:05:41.398199+0000","last_unstale":"2023-07-12T02:05:42.359880+0000","last_undegraded":"2023-07-12T02:05:42.359880+0000","last_fullsized":"2023-07-12T02:05:42.359880+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:20:35.352816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.383503+0000","last_change":"2023-07-12T02:05:40.373623+0000","last_active":"2023-07-12T02:05:41.383503+0000","last_peered":"2023-07-12T02:05:41.383503+0000","last_clean":"2023-07-12T02:05:41.383503+0000","last_became_active":"2023-07-12T02:05:40.372851+0000","last_became_peered":"2023-07-12T02:05:40.372851+0000","last_unstale":"2023-07-12T02:05:41.383503+0000","last_undegraded":"2023-07-12T02:05:41.383503+0000","last_fullsized":"2023-07-12T02:05:41.383503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:13:11.916294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359886+0000","last_change":"2023-07-12T02:05:41.381388+0000","last_active":"2023-07-12T02:05:42.359886+0000","last_peered":"2023-07-12T02:05:42.359886+0000","last_clean":"2023-07-12T02:05:42.359886+0000","last_became_active":"2023-07-12T02:05:41.381063+0000","last_became_peered":"2023-07-12T02:05:41.381063+0000","last_unstale":"2023-07-12T02:05:42.359886+0000","last_undegraded":"2023-07-12T02:05:42.359886+0000","last_fullsized":"2023-07-12T02:05:42.359886+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:57:33.138298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.371947+0000","last_change":"2023-07-12T02:05:40.364765+0000","last_active":"2023-07-12T02:05:41.371947+0000","last_peered":"2023-07-12T02:05:41.371947+0000","last_clean":"2023-07-12T02:05:41.371947+0000","last_became_active":"2023-07-12T02:05:40.364489+0000","last_became_peered":"2023-07-12T02:05:40.364489+0000","last_unstale":"2023-07-12T02:05:41.371947+0000","last_undegraded":"2023-07-12T02:05:41.371947+0000","last_fullsized":"2023-07-12T02:05:41.371947+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:22:08.173950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.394458+0000","last_change":"2023-07-12T02:05:41.379909+0000","last_active":"2023-07-12T02:05:41.394458+0000","last_peered":"2023-07-12T02:05:41.394458+0000","last_clean":"2023-07-12T02:05:41.394458+0000","last_became_active":"2023-07-12T02:05:41.379612+0000","last_became_peered":"2023-07-12T02:05:41.379612+0000","last_unstale":"2023-07-12T02:05:41.394458+0000","last_undegraded":"2023-07-12T02:05:41.394458+0000","last_fullsized":"2023-07-12T02:05:41.394458+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:55:45.097858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.394379+0000","last_change":"2023-07-12T02:05:40.376433+0000","last_active":"2023-07-12T02:05:41.394379+0000","last_peered":"2023-07-12T02:05:41.394379+0000","last_clean":"2023-07-12T02:05:41.394379+0000","last_became_active":"2023-07-12T02:05:40.376120+0000","last_became_peered":"2023-07-12T02:05:40.376120+0000","last_unstale":"2023-07-12T02:05:41.394379+0000","last_undegraded":"2023-07-12T02:05:41.394379+0000","last_fullsized":"2023-07-12T02:05:41.394379+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:30.821517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.379249+0000","last_change":"2023-07-12T02:05:41.373011+0000","last_active":"2023-07-12T02:05:41.379249+0000","last_peered":"2023-07-12T02:05:41.379249+0000","last_clean":"2023-07-12T02:05:41.379249+0000","last_became_active":"2023-07-12T02:05:41.372475+0000","last_became_peered":"2023-07-12T02:05:41.372475+0000","last_unstale":"2023-07-12T02:05:41.379249+0000","last_undegraded":"2023-07-12T02:05:41.379249+0000","last_fullsized":"2023-07-12T02:05:41.379249+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:49:49.202641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.360598+0000","last_change":"2023-07-12T02:05:40.371588+0000","last_active":"2023-07-12T02:05:41.360598+0000","last_peered":"2023-07-12T02:05:41.360598+0000","last_clean":"2023-07-12T02:05:41.360598+0000","last_became_active":"2023-07-12T02:05:40.371307+0000","last_became_peered":"2023-07-12T02:05:40.371307+0000","last_unstale":"2023-07-12T02:05:41.360598+0000","last_undegraded":"2023-07-12T02:05:41.360598+0000","last_fullsized":"2023-07-12T02:05:41.360598+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:29.568974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360651+0000","last_change":"2023-07-12T02:05:41.367215+0000","last_active":"2023-07-12T02:05:42.360651+0000","last_peered":"2023-07-12T02:05:42.360651+0000","last_clean":"2023-07-12T02:05:42.360651+0000","last_became_active":"2023-07-12T02:05:41.366742+0000","last_became_peered":"2023-07-12T02:05:41.366742+0000","last_unstale":"2023-07-12T02:05:42.360651+0000","last_undegraded":"2023-07-12T02:05:42.360651+0000","last_fullsized":"2023-07-12T02:05:42.360651+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:51:46.155819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359793+0000","last_change":"2023-07-12T02:05:40.373022+0000","last_active":"2023-07-12T02:05:42.359793+0000","last_peered":"2023-07-12T02:05:42.359793+0000","last_clean":"2023-07-12T02:05:42.359793+0000","last_became_active":"2023-07-12T02:05:40.372678+0000","last_became_peered":"2023-07-12T02:05:40.372678+0000","last_unstale":"2023-07-12T02:05:42.359793+0000","last_undegraded":"2023-07-12T02:05:42.359793+0000","last_fullsized":"2023-07-12T02:05:42.359793+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:13:11.916294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359127+0000","last_change":"2023-07-12T02:05:41.385726+0000","last_active":"2023-07-12T02:05:42.359127+0000","last_peered":"2023-07-12T02:05:42.359127+0000","last_clean":"2023-07-12T02:05:42.359127+0000","last_became_active":"2023-07-12T02:05:41.385460+0000","last_became_peered":"2023-07-12T02:05:41.385460+0000","last_unstale":"2023-07-12T02:05:42.359127+0000","last_undegraded":"2023-07-12T02:05:42.359127+0000","last_fullsized":"2023-07-12T02:05:42.359127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:23:28.837463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.356185+0000","last_change":"2023-07-12T02:05:40.372801+0000","last_active":"2023-07-12T02:05:41.356185+0000","last_peered":"2023-07-12T02:05:41.356185+0000","last_clean":"2023-07-12T02:05:41.356185+0000","last_became_active":"2023-07-12T02:05:40.372456+0000","last_became_peered":"2023-07-12T02:05:40.372456+0000","last_unstale":"2023-07-12T02:05:41.356185+0000","last_undegraded":"2023-07-12T02:05:41.356185+0000","last_fullsized":"2023-07-12T02:05:41.356185+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:23:27.834900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357446+0000","last_change":"2023-07-12T02:05:41.378279+0000","last_active":"2023-07-12T02:05:42.357446+0000","last_peered":"2023-07-12T02:05:42.357446+0000","last_clean":"2023-07-12T02:05:42.357446+0000","last_became_active":"2023-07-12T02:05:41.378001+0000","last_became_peered":"2023-07-12T02:05:41.378001+0000","last_unstale":"2023-07-12T02:05:42.357446+0000","last_undegraded":"2023-07-12T02:05:42.357446+0000","last_fullsized":"2023-07-12T02:05:42.357446+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:41:06.314659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359388+0000","last_change":"2023-07-12T02:05:40.377273+0000","last_active":"2023-07-12T02:05:42.359388+0000","last_peered":"2023-07-12T02:05:42.359388+0000","last_clean":"2023-07-12T02:05:42.359388+0000","last_became_active":"2023-07-12T02:05:40.376926+0000","last_became_peered":"2023-07-12T02:05:40.376926+0000","last_unstale":"2023-07-12T02:05:42.359388+0000","last_undegraded":"2023-07-12T02:05:42.359388+0000","last_fullsized":"2023-07-12T02:05:42.359388+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:59:52.684925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.363012+0000","last_change":"2023-07-12T02:03:52.304302+0000","last_active":"2023-07-12T02:05:41.363012+0000","last_peered":"2023-07-12T02:05:41.363012+0000","last_clean":"2023-07-12T02:05:41.363012+0000","last_became_active":"2023-07-12T02:03:52.303905+0000","last_became_peered":"2023-07-12T02:03:52.303905+0000","last_unstale":"2023-07-12T02:05:41.363012+0000","last_undegraded":"2023-07-12T02:05:41.363012+0000","last_fullsized":"2023-07-12T02:05:41.363012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:33:02.070061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359941+0000","last_change":"2023-07-12T02:05:41.392206+0000","last_active":"2023-07-12T02:05:42.359941+0000","last_peered":"2023-07-12T02:05:42.359941+0000","last_clean":"2023-07-12T02:05:42.359941+0000","last_became_active":"2023-07-12T02:05:41.391505+0000","last_became_peered":"2023-07-12T02:05:41.391505+0000","last_unstale":"2023-07-12T02:05:42.359941+0000","last_undegraded":"2023-07-12T02:05:42.359941+0000","last_fullsized":"2023-07-12T02:05:42.359941+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:43:22.417967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.374372+0000","last_change":"2023-07-12T02:05:40.368664+0000","last_active":"2023-07-12T02:05:41.374372+0000","last_peered":"2023-07-12T02:05:41.374372+0000","last_clean":"2023-07-12T02:05:41.374372+0000","last_became_active":"2023-07-12T02:05:40.368361+0000","last_became_peered":"2023-07-12T02:05:40.368361+0000","last_unstale":"2023-07-12T02:05:41.374372+0000","last_undegraded":"2023-07-12T02:05:41.374372+0000","last_fullsized":"2023-07-12T02:05:41.374372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:02:29.568974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.360699+0000","last_change":"2023-07-12T02:03:51.909547+0000","last_active":"2023-07-12T02:05:41.360699+0000","last_peered":"2023-07-12T02:05:41.360699+0000","last_clean":"2023-07-12T02:05:41.360699+0000","last_became_active":"2023-07-12T02:03:51.909159+0000","last_became_peered":"2023-07-12T02:03:51.909159+0000","last_unstale":"2023-07-12T02:05:41.360699+0000","last_undegraded":"2023-07-12T02:05:41.360699+0000","last_fullsized":"2023-07-12T02:05:41.360699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:09:25.008909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359476+0000","last_change":"2023-07-12T02:05:41.391604+0000","last_active":"2023-07-12T02:05:42.359476+0000","last_peered":"2023-07-12T02:05:42.359476+0000","last_clean":"2023-07-12T02:05:42.359476+0000","last_became_active":"2023-07-12T02:05:41.391206+0000","last_became_peered":"2023-07-12T02:05:41.391206+0000","last_unstale":"2023-07-12T02:05:42.359476+0000","last_undegraded":"2023-07-12T02:05:42.359476+0000","last_fullsized":"2023-07-12T02:05:42.359476+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:25.650296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.357187+0000","last_change":"2023-07-12T02:05:40.376717+0000","last_active":"2023-07-12T02:05:41.357187+0000","last_peered":"2023-07-12T02:05:41.357187+0000","last_clean":"2023-07-12T02:05:41.357187+0000","last_became_active":"2023-07-12T02:05:40.376422+0000","last_became_peered":"2023-07-12T02:05:40.376422+0000","last_unstale":"2023-07-12T02:05:41.357187+0000","last_undegraded":"2023-07-12T02:05:41.357187+0000","last_fullsized":"2023-07-12T02:05:41.357187+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:39:14.737164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.360245+0000","last_change":"2023-07-12T02:03:51.904989+0000","last_active":"2023-07-12T02:05:42.360245+0000","last_peered":"2023-07-12T02:05:42.360245+0000","last_clean":"2023-07-12T02:05:42.360245+0000","last_became_active":"2023-07-12T02:03:51.904497+0000","last_became_peered":"2023-07-12T02:03:51.904497+0000","last_unstale":"2023-07-12T02:05:42.360245+0000","last_undegraded":"2023-07-12T02:05:42.360245+0000","last_fullsized":"2023-07-12T02:05:42.360245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T14:02:16.186940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359759+0000","last_change":"2023-07-12T02:05:41.389443+0000","last_active":"2023-07-12T02:05:42.359759+0000","last_peered":"2023-07-12T02:05:42.359759+0000","last_clean":"2023-07-12T02:05:42.359759+0000","last_became_active":"2023-07-12T02:05:41.388799+0000","last_became_peered":"2023-07-12T02:05:41.388799+0000","last_unstale":"2023-07-12T02:05:42.359759+0000","last_undegraded":"2023-07-12T02:05:42.359759+0000","last_fullsized":"2023-07-12T02:05:42.359759+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:14:53.987394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.395327+0000","last_change":"2023-07-12T02:05:40.374820+0000","last_active":"2023-07-12T02:05:41.395327+0000","last_peered":"2023-07-12T02:05:41.395327+0000","last_clean":"2023-07-12T02:05:41.395327+0000","last_became_active":"2023-07-12T02:05:40.374578+0000","last_became_peered":"2023-07-12T02:05:40.374578+0000","last_unstale":"2023-07-12T02:05:41.395327+0000","last_undegraded":"2023-07-12T02:05:41.395327+0000","last_fullsized":"2023-07-12T02:05:41.395327+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:19:30.130807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.361654+0000","last_change":"2023-07-12T02:03:51.909324+0000","last_active":"2023-07-12T02:05:41.361654+0000","last_peered":"2023-07-12T02:05:41.361654+0000","last_clean":"2023-07-12T02:05:41.361654+0000","last_became_active":"2023-07-12T02:03:51.908982+0000","last_became_peered":"2023-07-12T02:03:51.908982+0000","last_unstale":"2023-07-12T02:05:41.361654+0000","last_undegraded":"2023-07-12T02:05:41.361654+0000","last_fullsized":"2023-07-12T02:05:41.361654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:52:09.761751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.356105+0000","last_change":"2023-07-12T02:03:44.783225+0000","last_active":"2023-07-12T02:05:41.356105+0000","last_peered":"2023-07-12T02:05:41.356105+0000","last_clean":"2023-07-12T02:05:41.356105+0000","last_became_active":"2023-07-12T02:03:44.782048+0000","last_became_peered":"2023-07-12T02:03:44.782048+0000","last_unstale":"2023-07-12T02:05:41.356105+0000","last_undegraded":"2023-07-12T02:05:41.356105+0000","last_fullsized":"2023-07-12T02:05:41.356105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:43.565472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:43.565472+0000","last_clean_scrub_stamp":"2023-07-12T02:03:43.565472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:02:55.671829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.371743+0000","last_change":"2023-07-12T02:05:41.365778+0000","last_active":"2023-07-12T02:05:41.371743+0000","last_peered":"2023-07-12T02:05:41.371743+0000","last_clean":"2023-07-12T02:05:41.371743+0000","last_became_active":"2023-07-12T02:05:41.365452+0000","last_became_peered":"2023-07-12T02:05:41.365452+0000","last_unstale":"2023-07-12T02:05:41.371743+0000","last_undegraded":"2023-07-12T02:05:41.371743+0000","last_fullsized":"2023-07-12T02:05:41.371743+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:25.650296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.362920+0000","last_change":"2023-07-12T02:05:40.374680+0000","last_active":"2023-07-12T02:05:41.362920+0000","last_peered":"2023-07-12T02:05:41.362920+0000","last_clean":"2023-07-12T02:05:41.362920+0000","last_became_active":"2023-07-12T02:05:40.374250+0000","last_became_peered":"2023-07-12T02:05:40.374250+0000","last_unstale":"2023-07-12T02:05:41.362920+0000","last_undegraded":"2023-07-12T02:05:41.362920+0000","last_fullsized":"2023-07-12T02:05:41.362920+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:03:02.458231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.356296+0000","last_change":"2023-07-12T02:03:51.909395+0000","last_active":"2023-07-12T02:05:41.356296+0000","last_peered":"2023-07-12T02:05:41.356296+0000","last_clean":"2023-07-12T02:05:41.356296+0000","last_became_active":"2023-07-12T02:03:51.909125+0000","last_became_peered":"2023-07-12T02:03:51.909125+0000","last_unstale":"2023-07-12T02:05:41.356296+0000","last_undegraded":"2023-07-12T02:05:41.356296+0000","last_fullsized":"2023-07-12T02:05:41.356296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:44:42.366005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.383446+0000","last_change":"2023-07-12T02:05:41.374970+0000","last_active":"2023-07-12T02:05:41.383446+0000","last_peered":"2023-07-12T02:05:41.383446+0000","last_clean":"2023-07-12T02:05:41.383446+0000","last_became_active":"2023-07-12T02:05:41.374708+0000","last_became_peered":"2023-07-12T02:05:41.374708+0000","last_unstale":"2023-07-12T02:05:41.383446+0000","last_undegraded":"2023-07-12T02:05:41.383446+0000","last_fullsized":"2023-07-12T02:05:41.383446+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:16:39.544700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.363024+0000","last_change":"2023-07-12T02:05:40.368912+0000","last_active":"2023-07-12T02:05:41.363024+0000","last_peered":"2023-07-12T02:05:41.363024+0000","last_clean":"2023-07-12T02:05:41.363024+0000","last_became_active":"2023-07-12T02:05:40.368655+0000","last_became_peered":"2023-07-12T02:05:40.368655+0000","last_unstale":"2023-07-12T02:05:41.363024+0000","last_undegraded":"2023-07-12T02:05:41.363024+0000","last_fullsized":"2023-07-12T02:05:41.363024+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:19:09.352847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.357127+0000","last_change":"2023-07-12T02:03:52.304880+0000","last_active":"2023-07-12T02:05:41.357127+0000","last_peered":"2023-07-12T02:05:41.357127+0000","last_clean":"2023-07-12T02:05:41.357127+0000","last_became_active":"2023-07-12T02:03:52.304598+0000","last_became_peered":"2023-07-12T02:03:52.304598+0000","last_unstale":"2023-07-12T02:05:41.357127+0000","last_undegraded":"2023-07-12T02:05:41.357127+0000","last_fullsized":"2023-07-12T02:05:41.357127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:17:41.675294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.400238+0000","last_change":"2023-07-12T02:05:41.394539+0000","last_active":"2023-07-12T02:05:41.400238+0000","last_peered":"2023-07-12T02:05:41.400238+0000","last_clean":"2023-07-12T02:05:41.400238+0000","last_became_active":"2023-07-12T02:05:41.394023+0000","last_became_peered":"2023-07-12T02:05:41.394023+0000","last_unstale":"2023-07-12T02:05:41.400238+0000","last_undegraded":"2023-07-12T02:05:41.400238+0000","last_fullsized":"2023-07-12T02:05:41.400238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:25:27.853003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.357642+0000","last_change":"2023-07-12T02:05:40.369805+0000","last_active":"2023-07-12T02:05:42.357642+0000","last_peered":"2023-07-12T02:05:42.357642+0000","last_clean":"2023-07-12T02:05:42.357642+0000","last_became_active":"2023-07-12T02:05:40.369515+0000","last_became_peered":"2023-07-12T02:05:40.369515+0000","last_unstale":"2023-07-12T02:05:42.357642+0000","last_undegraded":"2023-07-12T02:05:42.357642+0000","last_fullsized":"2023-07-12T02:05:42.357642+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:02:40.133599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.363128+0000","last_change":"2023-07-12T02:03:51.906406+0000","last_active":"2023-07-12T02:05:41.363128+0000","last_peered":"2023-07-12T02:05:41.363128+0000","last_clean":"2023-07-12T02:05:41.363128+0000","last_became_active":"2023-07-12T02:03:51.905875+0000","last_became_peered":"2023-07-12T02:03:51.905875+0000","last_unstale":"2023-07-12T02:05:41.363128+0000","last_undegraded":"2023-07-12T02:05:41.363128+0000","last_fullsized":"2023-07-12T02:05:41.363128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:17:10.118098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.394497+0000","last_change":"2023-07-12T02:05:41.387170+0000","last_active":"2023-07-12T02:05:41.394497+0000","last_peered":"2023-07-12T02:05:41.394497+0000","last_clean":"2023-07-12T02:05:41.394497+0000","last_became_active":"2023-07-12T02:05:41.386847+0000","last_became_peered":"2023-07-12T02:05:41.386847+0000","last_unstale":"2023-07-12T02:05:41.394497+0000","last_undegraded":"2023-07-12T02:05:41.394497+0000","last_fullsized":"2023-07-12T02:05:41.394497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:40.344824+0000","last_clean_scrub_stamp":"2023-07-12T02:05:40.344824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:27:31.357049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-12T02:05:41.356511+0000","last_change":"2023-07-12T02:05:40.376312+0000","last_active":"2023-07-12T02:05:41.356511+0000","last_peered":"2023-07-12T02:05:41.356511+0000","last_clean":"2023-07-12T02:05:41.356511+0000","last_became_active":"2023-07-12T02:05:40.375086+0000","last_became_peered":"2023-07-12T02:05:40.375086+0000","last_unstale":"2023-07-12T02:05:41.356511+0000","last_undegraded":"2023-07-12T02:05:41.356511+0000","last_fullsized":"2023-07-12T02:05:41.356511+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:05:39.342261+0000","last_clean_scrub_stamp":"2023-07-12T02:05:39.342261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:16:38.542138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-12T02:05:42.359959+0000","last_change":"2023-07-12T02:03:51.908137+0000","last_active":"2023-07-12T02:05:42.359959+0000","last_peered":"2023-07-12T02:05:42.359959+0000","last_clean":"2023-07-12T02:05:42.359959+0000","last_became_active":"2023-07-12T02:03:51.907900+0000","last_became_peered":"2023-07-12T02:03:51.907900+0000","last_unstale":"2023-07-12T02:05:42.359959+0000","last_undegraded":"2023-07-12T02:05:42.359959+0000","last_fullsized":"2023-07-12T02:05:42.359959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:03:50.886749+0000","last_clean_scrub_stamp":"2023-07-12T02:03:50.886749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:45:59.117845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":796273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52800000000000002}]},{"osd":1,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.66800000000000004}]},{"osd":2,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.505}]},{"osd":3,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":0.54700000000000004}]},{"osd":4,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.621}]},{"osd":5,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.47599999999999998}]},{"osd":6,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.69099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":206487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":7.1230000000000002,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.67100000000000004}]},{"osd":1,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":7.2460000000000004,"5min":7.2460000000000004,"15min":7.2460000000000004},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.62}]},{"osd":3,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.79400000000000004}]},{"osd":4,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.83399999999999996}]},{"osd":7,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.72399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":205885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 12 02:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.379}]},{"osd":2,"last update":"Wed Jul 12 02:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Jul 12 02:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.42699999999999999}]},{"osd":4,"last update":"Wed Jul 12 02:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.499},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.68300000000000005}]},{"osd":5,"last update":"Wed Jul 12 02:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Wed Jul 12 02:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed Jul 12 02:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.53500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1056768,"data_stored":795198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul 12 02:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.2690000000000001,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":3.0419999999999998,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":0.52300000000000002}]},{"osd":2,"last update":"Wed Jul 12 02:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.1869999999999998,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":3.0840000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":0.45300000000000001}]},{"osd":3,"last update":"Wed Jul 12 02:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Jul 12 02:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.753}]},{"osd":5,"last update":"Wed Jul 12 02:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.73799999999999999}]},{"osd":6,"last update":"Wed Jul 12 02:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.81000000000000005}]},{"osd":7,"last update":"Wed Jul 12 02:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.79400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":207401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.38},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.49199999999999999}]},{"osd":1,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.443},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.41599999999999998}]},{"osd":3,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.48399999999999999}]},{"osd":4,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.76000000000000001}]},{"osd":5,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.85299999999999998}]},{"osd":6,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.91100000000000003}]},{"osd":7,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.877}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":206453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.497},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42899999999999999}]},{"osd":1,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55800000000000005}]},{"osd":2,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.53100000000000003}]},{"osd":4,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.63600000000000001}]},{"osd":5,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.77900000000000003}]},{"osd":6,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed Jul 12 02:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.746},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.79200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":214352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":6.6660000000000004,"5min":6.6660000000000004,"15min":6.6660000000000004},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.5810000000000004,"5min":6.5810000000000004,"15min":6.5810000000000004},"last":0.59599999999999997}]},{"osd":1,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":6.524,"5min":6.524,"15min":6.524},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.73199999999999998}]},{"osd":2,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":0.628}]},{"osd":3,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.753},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.66700000000000004}]},{"osd":6,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.80800000000000005}]},{"osd":7,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.81599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":205885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.75900000000000001}]},{"osd":1,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.61899999999999999}]},{"osd":3,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.77500000000000002}]},{"osd":4,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.50900000000000001}]},{"osd":6,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.54100000000000004}]},{"osd":7,"last update":"Wed Jul 12 02:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.69599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-12T02:05:46.314 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-12T02:05:46.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-12T02:05:46.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.552+0000 7f9e2f3ff700 1 Processor -- start 2023-07-12T02:05:46.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.553+0000 7f9e2f3ff700 1 -- start start 2023-07-12T02:05:46.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.554+0000 7f9e2f3ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e280cd0a0 0x7f9e280adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:46.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.554+0000 7f9e2f3ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e280ca1f0 0x7f9e280ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.554+0000 7f9e2f3ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e280c9750 con 0x7f9e2815c690 2023-07-12T02:05:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.554+0000 7f9e2f3ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e280cabb0 con 0x7f9e280ca1f0 2023-07-12T02:05:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.554+0000 7f9e2f3ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e280cf1c0 con 0x7f9e280cd0a0 2023-07-12T02:05:46.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.554+0000 7f9e2d99c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e280ca1f0 0x7f9e280ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:46.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.554+0000 7f9e2d19b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9e2815c690 0x7f9e2806c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41622/0 (socket says 172.21.15.37:41622) 2023-07-12T02:05:46.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.554+0000 7f9e2d99c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e280ca1f0 0x7f9e280ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56856/0 (socket says 172.21.15.37:56856) 2023-07-12T02:05:46.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.554+0000 7f9e2d19b700 1 -- 172.21.15.37:0/2643844481 learned_addr learned my addr 172.21.15.37:0/2643844481 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:46.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.555+0000 7f9e2c99a700 1 --2- 172.21.15.37:0/2643844481 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e280cd0a0 0x7f9e280adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:46.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.555+0000 7f9e2d99c700 1 -- 172.21.15.37:0/2643844481 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e280cd0a0 msgr2=0x7f9e280adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:46.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.555+0000 7f9e2d99c700 1 --2- 172.21.15.37:0/2643844481 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e280cd0a0 0x7f9e280adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.555+0000 7f9e2d99c700 1 -- 172.21.15.37:0/2643844481 >> v1:172.21.15.37:6789/0 conn(0x7f9e2815c690 legacy=0x7f9e2806c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:46.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.555+0000 7f9e1ffff700 1 -- 172.21.15.37:0/2643844481 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345980077 0 0) 0x7f9e280c9750 con 0x7f9e2815c690 2023-07-12T02:05:46.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.555+0000 7f9e2d99c700 1 -- 172.21.15.37:0/2643844481 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e280cd610 con 0x7f9e280ca1f0 2023-07-12T02:05:46.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.555+0000 7f9e2c99a700 1 --2- 172.21.15.37:0/2643844481 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e280cd0a0 0x7f9e280adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:46.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.555+0000 7f9e2d99c700 1 --2- 172.21.15.37:0/2643844481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e280ca1f0 0x7f9e280ca670 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9e20009d90 tx=0x7f9e2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65a208fd4bae875 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.555+0000 7f9e1ffff700 1 -- 172.21.15.37:0/2643844481 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2000e070 con 0x7f9e280ca1f0 2023-07-12T02:05:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.555+0000 7f9e1ffff700 1 -- 172.21.15.37:0/2643844481 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2000bbd0 con 0x7f9e280ca1f0 2023-07-12T02:05:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.555+0000 7f9e1ffff700 1 -- 172.21.15.37:0/2643844481 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e20012430 con 0x7f9e280ca1f0 2023-07-12T02:05:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.556+0000 7f9e2f3ff700 1 -- 172.21.15.37:0/2643844481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e280ca1f0 msgr2=0x7f9e280ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.556+0000 7f9e2f3ff700 1 --2- 172.21.15.37:0/2643844481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e280ca1f0 0x7f9e280ca670 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9e20009d90 tx=0x7f9e2000b330 comp rx=0 tx=0).stop 2023-07-12T02:05:46.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.556+0000 7f9e2f3ff700 1 -- 172.21.15.37:0/2643844481 shutdown_connections 2023-07-12T02:05:46.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.556+0000 7f9e2f3ff700 1 --2- 172.21.15.37:0/2643844481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e280ca1f0 0x7f9e280ca670 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.556+0000 7f9e2f3ff700 1 --2- 172.21.15.37:0/2643844481 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e280cd0a0 0x7f9e280adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.556+0000 7f9e2f3ff700 1 -- 172.21.15.37:0/2643844481 >> 172.21.15.37:0/2643844481 conn(0x7f9e280b0fd0 msgr2=0x7f9e280ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:46.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.556+0000 7f9e2f3ff700 1 -- 172.21.15.37:0/2643844481 shutdown_connections 2023-07-12T02:05:46.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.556+0000 7f9e2f3ff700 1 -- 172.21.15.37:0/2643844481 wait complete. 2023-07-12T02:05:46.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.558+0000 7f9e2f3ff700 1 Processor -- start 2023-07-12T02:05:46.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.558+0000 7f9e2f3ff700 1 -- start start 2023-07-12T02:05:46.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.559+0000 7f9e2f3ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e280ca1f0 0x7f9e28152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:46.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.559+0000 7f9e2f3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e280cd0a0 0x7f9e28159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:46.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.559+0000 7f9e2f3ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e2815c690 0x7f9e28069f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:46.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.559+0000 7f9e2f3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2815a6d0 con 0x7f9e280cd0a0 2023-07-12T02:05:46.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.559+0000 7f9e2f3ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2815a9b0 con 0x7f9e280ca1f0 2023-07-12T02:05:46.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.559+0000 7f9e2f3ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2815ac90 con 0x7f9e2815c690 2023-07-12T02:05:46.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.559+0000 7f9e2c99a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e280cd0a0 0x7f9e28159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:46.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.559+0000 7f9e2c99a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e280cd0a0 0x7f9e28159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56870/0 (socket says 172.21.15.37:56870) 2023-07-12T02:05:46.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.559+0000 7f9e2c99a700 1 -- 172.21.15.37:0/1214371029 learned_addr learned my addr 172.21.15.37:0/1214371029 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:46.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.559+0000 7f9e2d99c700 1 --2- 172.21.15.37:0/1214371029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e2815c690 0x7f9e28069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:46.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.559+0000 7f9e2d19b700 1 --2- 172.21.15.37:0/1214371029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e280ca1f0 0x7f9e28152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:46.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.560+0000 7f9e2c99a700 1 -- 172.21.15.37:0/1214371029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e2815c690 msgr2=0x7f9e28069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:46.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.560+0000 7f9e2c99a700 1 --2- 172.21.15.37:0/1214371029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e2815c690 0x7f9e28069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.560+0000 7f9e2c99a700 1 -- 172.21.15.37:0/1214371029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e280ca1f0 msgr2=0x7f9e28152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:46.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.560+0000 7f9e2c99a700 1 --2- 172.21.15.37:0/1214371029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e280ca1f0 0x7f9e28152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.560+0000 7f9e2c99a700 1 -- 172.21.15.37:0/1214371029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e20009a70 con 0x7f9e280cd0a0 2023-07-12T02:05:46.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.560+0000 7f9e2c99a700 1 --2- 172.21.15.37:0/1214371029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e280cd0a0 0x7f9e28159c80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9e1800c750 tx=0x7f9e1800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:46.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.560+0000 7f9e1dffb700 1 -- 172.21.15.37:0/1214371029 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18011800 con 0x7f9e280cd0a0 2023-07-12T02:05:46.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.560+0000 7f9e1dffb700 1 -- 172.21.15.37:0/1214371029 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e18011960 con 0x7f9e280cd0a0 2023-07-12T02:05:46.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.560+0000 7f9e2f3ff700 1 -- 172.21.15.37:0/1214371029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2815af70 con 0x7f9e280cd0a0 2023-07-12T02:05:46.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.560+0000 7f9e1dffb700 1 -- 172.21.15.37:0/1214371029 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18011cd0 con 0x7f9e280cd0a0 2023-07-12T02:05:46.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.560+0000 7f9e2f3ff700 1 -- 172.21.15.37:0/1214371029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e28153340 con 0x7f9e280cd0a0 2023-07-12T02:05:46.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.561+0000 7f9e2f3ff700 1 -- 172.21.15.37:0/1214371029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e280c2ae0 con 0x7f9e280cd0a0 2023-07-12T02:05:46.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.562+0000 7f9e1dffb700 1 -- 172.21.15.37:0/1214371029 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9e18021350 con 0x7f9e280cd0a0 2023-07-12T02:05:46.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.564+0000 7f9e1dffb700 1 --2- 172.21.15.37:0/1214371029 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9e0c06ace0 0x7f9e0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:46.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.564+0000 7f9e1dffb700 1 -- 172.21.15.37:0/1214371029 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9e18089590 con 0x7f9e280cd0a0 2023-07-12T02:05:46.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.564+0000 7f9e2d19b700 1 --2- 172.21.15.37:0/1214371029 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9e0c06ace0 0x7f9e0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:46.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.565+0000 7f9e2d19b700 1 --2- 172.21.15.37:0/1214371029 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9e0c06ace0 0x7f9e0c06d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9e24000f60 tx=0x7f9e24007c90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:46.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.568+0000 7f9e1dffb700 1 -- 172.21.15.37:0/1214371029 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9e280c2ae0 con 0x7f9e280cd0a0 2023-07-12T02:05:46.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.856+0000 7f9e2f3ff700 1 -- 172.21.15.37:0/1214371029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9e280c2ae0 con 0x7f9e280cd0a0 2023-07-12T02:05:46.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.860+0000 7f9e1dffb700 1 -- 172.21.15.37:0/1214371029 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f9e280c2ae0 con 0x7f9e280cd0a0 2023-07-12T02:05:46.864 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-12T02:05:46.864 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDDCa5kRgbdIhAAz7y/7oTRqD+BzAGhG1mhjg== 2023-07-12T02:05:46.864 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-07-12T02:05:46.864 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-07-12T02:05:46.865 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-12T02:05:46.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.862+0000 7f9e2f3ff700 1 -- 172.21.15.37:0/1214371029 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9e0c06ace0 msgr2=0x7f9e0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:46.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.863+0000 7f9e2f3ff700 1 --2- 172.21.15.37:0/1214371029 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9e0c06ace0 0x7f9e0c06d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9e24000f60 tx=0x7f9e24007c90 comp rx=0 tx=0).stop 2023-07-12T02:05:46.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.863+0000 7f9e2f3ff700 1 -- 172.21.15.37:0/1214371029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e280cd0a0 msgr2=0x7f9e28159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:46.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.863+0000 7f9e2f3ff700 1 --2- 172.21.15.37:0/1214371029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e280cd0a0 0x7f9e28159c80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9e1800c750 tx=0x7f9e1800ca60 comp rx=0 tx=0).stop 2023-07-12T02:05:46.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.863+0000 7f9e2f3ff700 1 -- 172.21.15.37:0/1214371029 shutdown_connections 2023-07-12T02:05:46.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.863+0000 7f9e2f3ff700 1 --2- 172.21.15.37:0/1214371029 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f9e0c06ace0 0x7f9e0c06d190 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.863+0000 7f9e2f3ff700 1 --2- 172.21.15.37:0/1214371029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e2815c690 0x7f9e28069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.863+0000 7f9e2f3ff700 1 --2- 172.21.15.37:0/1214371029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e280ca1f0 0x7f9e28152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.863+0000 7f9e2f3ff700 1 --2- 172.21.15.37:0/1214371029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e280cd0a0 0x7f9e28159c80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.863+0000 7f9e2f3ff700 1 -- 172.21.15.37:0/1214371029 >> 172.21.15.37:0/1214371029 conn(0x7f9e280b0fd0 msgr2=0x7f9e28072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.863+0000 7f9e2f3ff700 1 -- 172.21.15.37:0/1214371029 shutdown_connections 2023-07-12T02:05:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:46.863+0000 7f9e2f3ff700 1 -- 172.21.15.37:0/1214371029 wait complete. 2023-07-12T02:05:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-07-12T02:05:46.884 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:05:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.082+0000 7f4d349ff700 1 Processor -- start 2023-07-12T02:05:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.082+0000 7f4d349ff700 1 -- start start 2023-07-12T02:05:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.083+0000 7f4d349ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d300d2640 0x7f4d300b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:47.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.083+0000 7f4d349ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d300cf8f0 0x7f4d3015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:47.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.083+0000 7f4d349ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d300d1790 con 0x7f4d3015c460 2023-07-12T02:05:47.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.083+0000 7f4d349ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d300cedd0 con 0x7f4d300cf8f0 2023-07-12T02:05:47.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.083+0000 7f4d349ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300cd950 con 0x7f4d300d2640 2023-07-12T02:05:47.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.083+0000 7f4d2ed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d300cf8f0 0x7f4d3015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.083+0000 7f4d2ed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d300cf8f0 0x7f4d3015fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56886/0 (socket says 172.21.15.37:56886) 2023-07-12T02:05:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.083+0000 7f4d2ed9d700 1 -- 172.21.15.37:0/1065131505 learned_addr learned my addr 172.21.15.37:0/1065131505 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.083+0000 7f4d2e59c700 1 --1- 172.21.15.37:0/1065131505 >> v1:172.21.15.37:6789/0 conn(0x7f4d3015c460 0x7f4d300cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41634/0 (socket says 172.21.15.37:41634) 2023-07-12T02:05:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.084+0000 7f4d27fff700 1 --2- 172.21.15.37:0/1065131505 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d300d2640 0x7f4d300b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.084+0000 7f4d2ed9d700 1 -- 172.21.15.37:0/1065131505 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d300d2640 msgr2=0x7f4d300b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.084+0000 7f4d2ed9d700 1 --2- 172.21.15.37:0/1065131505 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d300d2640 0x7f4d300b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.084+0000 7f4d2ed9d700 1 -- 172.21.15.37:0/1065131505 >> v1:172.21.15.37:6789/0 conn(0x7f4d3015c460 legacy=0x7f4d300cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.084+0000 7f4d2ed9d700 1 -- 172.21.15.37:0/1065131505 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d300d14b0 con 0x7f4d300cf8f0 2023-07-12T02:05:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.084+0000 7f4d2ed9d700 1 --2- 172.21.15.37:0/1065131505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300cf8f0 0x7f4d3015fe20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009e50 tx=0x7f4d2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf44b71d73aec58 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.084+0000 7f4d2dd9b700 1 -- 172.21.15.37:0/1065131505 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2800e070 con 0x7f4d300cf8f0 2023-07-12T02:05:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.084+0000 7f4d2dd9b700 1 -- 172.21.15.37:0/1065131505 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2800b9c0 con 0x7f4d300cf8f0 2023-07-12T02:05:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.084+0000 7f4d2dd9b700 1 -- 172.21.15.37:0/1065131505 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2800bd70 con 0x7f4d300cf8f0 2023-07-12T02:05:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.085+0000 7f4d349ff700 1 -- 172.21.15.37:0/1065131505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300cf8f0 msgr2=0x7f4d3015fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.085+0000 7f4d349ff700 1 --2- 172.21.15.37:0/1065131505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300cf8f0 0x7f4d3015fe20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009e50 tx=0x7f4d2800b330 comp rx=0 tx=0).stop 2023-07-12T02:05:47.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.085+0000 7f4d349ff700 1 -- 172.21.15.37:0/1065131505 shutdown_connections 2023-07-12T02:05:47.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.085+0000 7f4d349ff700 1 --2- 172.21.15.37:0/1065131505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300cf8f0 0x7f4d3015fe20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:47.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.085+0000 7f4d349ff700 1 --2- 172.21.15.37:0/1065131505 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d300d2640 0x7f4d300b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:47.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.085+0000 7f4d349ff700 1 -- 172.21.15.37:0/1065131505 >> 172.21.15.37:0/1065131505 conn(0x7f4d30071660 msgr2=0x7f4d30071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:47.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.085+0000 7f4d349ff700 1 -- 172.21.15.37:0/1065131505 shutdown_connections 2023-07-12T02:05:47.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.085+0000 7f4d349ff700 1 -- 172.21.15.37:0/1065131505 wait complete. 2023-07-12T02:05:47.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.087+0000 7f4d349ff700 1 Processor -- start 2023-07-12T02:05:47.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.087+0000 7f4d349ff700 1 -- start start 2023-07-12T02:05:47.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.088+0000 7f4d349ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d300cf8f0 0x7f4d30158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:47.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.088+0000 7f4d349ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300d2640 0x7f4d300b6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:47.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.088+0000 7f4d349ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d3015c460 0x7f4d30155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:47.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.088+0000 7f4d349ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300caff0 con 0x7f4d300d2640 2023-07-12T02:05:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.088+0000 7f4d349ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300caa30 con 0x7f4d3015c460 2023-07-12T02:05:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.088+0000 7f4d349ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300cad10 con 0x7f4d300cf8f0 2023-07-12T02:05:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.088+0000 7f4d27fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300d2640 0x7f4d300b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.088+0000 7f4d27fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300d2640 0x7f4d300b6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56892/0 (socket says 172.21.15.37:56892) 2023-07-12T02:05:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.088+0000 7f4d27fff700 1 -- 172.21.15.37:0/455391912 learned_addr learned my addr 172.21.15.37:0/455391912 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.088+0000 7f4d2e59c700 1 --2- 172.21.15.37:0/455391912 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d300cf8f0 0x7f4d30158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.088+0000 7f4d2ed9d700 1 --2- 172.21.15.37:0/455391912 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d3015c460 0x7f4d30155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.089+0000 7f4d27fff700 1 -- 172.21.15.37:0/455391912 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d300cf8f0 msgr2=0x7f4d30158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.089+0000 7f4d27fff700 1 --2- 172.21.15.37:0/455391912 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d300cf8f0 0x7f4d30158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.089+0000 7f4d27fff700 1 -- 172.21.15.37:0/455391912 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d3015c460 msgr2=0x7f4d30155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.089+0000 7f4d27fff700 1 --2- 172.21.15.37:0/455391912 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d3015c460 0x7f4d30155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.089+0000 7f4d27fff700 1 -- 172.21.15.37:0/455391912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d28009b30 con 0x7f4d300d2640 2023-07-12T02:05:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.089+0000 7f4d2ed9d700 1 --2- 172.21.15.37:0/455391912 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d3015c460 0x7f4d30155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.089+0000 7f4d27fff700 1 --2- 172.21.15.37:0/455391912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300d2640 0x7f4d300b6970 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800d800 tx=0x7f4d1800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.089+0000 7f4d26ffd700 1 -- 172.21.15.37:0/455391912 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d180125f0 con 0x7f4d300d2640 2023-07-12T02:05:47.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.089+0000 7f4d26ffd700 1 -- 172.21.15.37:0/455391912 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d18012750 con 0x7f4d300d2640 2023-07-12T02:05:47.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.089+0000 7f4d349ff700 1 -- 172.21.15.37:0/455391912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d301e4b30 con 0x7f4d300d2640 2023-07-12T02:05:47.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.089+0000 7f4d26ffd700 1 -- 172.21.15.37:0/455391912 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18012b00 con 0x7f4d300d2640 2023-07-12T02:05:47.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.089+0000 7f4d349ff700 1 -- 172.21.15.37:0/455391912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d300b6eb0 con 0x7f4d300d2640 2023-07-12T02:05:47.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.090+0000 7f4d349ff700 1 -- 172.21.15.37:0/455391912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d300b7070 con 0x7f4d300d2640 2023-07-12T02:05:47.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.091+0000 7f4d26ffd700 1 -- 172.21.15.37:0/455391912 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4d18012c60 con 0x7f4d300d2640 2023-07-12T02:05:47.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.092+0000 7f4d26ffd700 1 --2- 172.21.15.37:0/455391912 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f4d1006ace0 0x7f4d1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:47.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.092+0000 7f4d26ffd700 1 -- 172.21.15.37:0/455391912 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4d18089850 con 0x7f4d300d2640 2023-07-12T02:05:47.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.093+0000 7f4d2e59c700 1 --2- 172.21.15.37:0/455391912 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f4d1006ace0 0x7f4d1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:47.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.093+0000 7f4d2e59c700 1 --2- 172.21.15.37:0/455391912 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f4d1006ace0 0x7f4d1006d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4d20000f60 tx=0x7f4d20007ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:47.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.097+0000 7f4d26ffd700 1 -- 172.21.15.37:0/455391912 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f4d18054850 con 0x7f4d300d2640 2023-07-12T02:05:47.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.352+0000 7f4d349ff700 1 -- 172.21.15.37:0/455391912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d3004ea60 con 0x7f4d300d2640 2023-07-12T02:05:47.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.352+0000 7f4d26ffd700 1 -- 172.21.15.37:0/455391912 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f4d18057e70 con 0x7f4d300d2640 2023-07-12T02:05:47.356 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:47.356 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6836/3548227069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3548227069},{"type":"v1","addr":"172.21.15.196:6836","nonce":3548227069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3838929749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3838929749},{"type":"v1","addr":"172.21.15.37:6834","nonce":3838929749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1710322730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":1710322730},{"type":"v1","addr":"172.21.15.196:6837","nonce":1710322730}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:05:40.912998+0000","modified":"2023-07-12T02:05:43.903236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5388},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5388":{"gid":5388,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/483849162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":483849162},{"type":"v1","addr":"172.21.15.37:6835","nonce":483849162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-12T02:05:47.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.355+0000 7f4d349ff700 1 -- 172.21.15.37:0/455391912 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f4d1006ace0 msgr2=0x7f4d1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.355+0000 7f4d349ff700 1 --2- 172.21.15.37:0/455391912 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f4d1006ace0 0x7f4d1006d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4d20000f60 tx=0x7f4d20007ed0 comp rx=0 tx=0).stop 2023-07-12T02:05:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.355+0000 7f4d349ff700 1 -- 172.21.15.37:0/455391912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300d2640 msgr2=0x7f4d300b6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.355+0000 7f4d349ff700 1 --2- 172.21.15.37:0/455391912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300d2640 0x7f4d300b6970 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800d800 tx=0x7f4d1800db10 comp rx=0 tx=0).stop 2023-07-12T02:05:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.355+0000 7f4d349ff700 1 -- 172.21.15.37:0/455391912 shutdown_connections 2023-07-12T02:05:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.355+0000 7f4d349ff700 1 --2- 172.21.15.37:0/455391912 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f4d1006ace0 0x7f4d1006d190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.355+0000 7f4d349ff700 1 --2- 172.21.15.37:0/455391912 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d3015c460 0x7f4d30155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.355+0000 7f4d349ff700 1 --2- 172.21.15.37:0/455391912 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d300cf8f0 0x7f4d30158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.355+0000 7f4d349ff700 1 --2- 172.21.15.37:0/455391912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300d2640 0x7f4d300b6970 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.355+0000 7f4d349ff700 1 -- 172.21.15.37:0/455391912 >> 172.21.15.37:0/455391912 conn(0x7f4d30071660 msgr2=0x7f4d300b7470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.355+0000 7f4d349ff700 1 -- 172.21.15.37:0/455391912 shutdown_connections 2023-07-12T02:05:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.355+0000 7f4d349ff700 1 -- 172.21.15.37:0/455391912 wait complete. 2023-07-12T02:05:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2023-07-12T02:05:47.778 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-12T02:05:40.912998+0000', 'modified': '2023-07-12T02:05:43.903236+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5388}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5388': {'gid': 5388, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.37:6835/483849162', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 483849162}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 483849162}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-12T02:05:47.778 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-12T02:05:47.779 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-12T02:05:47.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.984+0000 7fb8b35ff700 1 Processor -- start 2023-07-12T02:05:47.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.984+0000 7fb8b35ff700 1 -- start start 2023-07-12T02:05:47.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.985+0000 7fb8b35ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8ac0d2640 0x7fb8ac0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:47.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.985+0000 7fb8b35ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ac0d1790 con 0x7fb8ac15c460 2023-07-12T02:05:47.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.985+0000 7fb8b35ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ac0cd950 con 0x7fb8ac0cf8f0 2023-07-12T02:05:47.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.985+0000 7fb8b35ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0cedd0 con 0x7fb8ac0d2640 2023-07-12T02:05:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.985+0000 7fb8b139b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb8ac15c460 0x7fb8ac0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41650/0 (socket says 172.21.15.37:41650) 2023-07-12T02:05:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.985+0000 7fb8b139b700 1 -- 172.21.15.37:0/4070773587 learned_addr learned my addr 172.21.15.37:0/4070773587 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/4070773587 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8ac0d2640 0x7fb8ac0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 -- 172.21.15.37:0/4070773587 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096035775 0 0) 0x7fb8ac0d1790 con 0x7fb8ac15c460 2023-07-12T02:05:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 -- 172.21.15.37:0/4070773587 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8980035b0 con 0x7fb8ac15c460 2023-07-12T02:05:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 -- 172.21.15.37:0/4070773587 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282626746 0 0) 0x7fb8ac0cd950 con 0x7fb8ac0cf8f0 2023-07-12T02:05:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 -- 172.21.15.37:0/4070773587 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8ac0d1790 con 0x7fb8ac0cf8f0 2023-07-12T02:05:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 -- 172.21.15.37:0/4070773587 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3220277235 0 0) 0x7fb8980035b0 con 0x7fb8ac15c460 2023-07-12T02:05:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 -- 172.21.15.37:0/4070773587 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8ac0d2640 msgr2=0x7fb8ac0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 --2- 172.21.15.37:0/4070773587 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8ac0d2640 0x7fb8ac0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 -- 172.21.15.37:0/4070773587 >> v1:172.21.15.196:6789/0 conn(0x7fb8ac0cf8f0 legacy=0x7fb8ac15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 -- 172.21.15.37:0/4070773587 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac0d14b0 con 0x7fb8ac15c460 2023-07-12T02:05:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 -- 172.21.15.37:0/4070773587 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7fb8a8001670 con 0x7fb8ac15c460 2023-07-12T02:05:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/4070773587 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8ac0d2640 0x7fb8ac0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:05:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 -- 172.21.15.37:0/4070773587 >> v1:172.21.15.37:6789/0 conn(0x7fb8ac15c460 legacy=0x7fb8ac0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 --2- 172.21.15.37:0/4070773587 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb898003bc0 0x7fb898003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 --2- 172.21.15.37:0/4070773587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb898004850 0x7fb898004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 --2- 172.21.15.37:0/4070773587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb898005250 0x7fb89800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 -- 172.21.15.37:0/4070773587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0cedd0 con 0x7fb898004850 2023-07-12T02:05:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 -- 172.21.15.37:0/4070773587 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89800c160 con 0x7fb898005250 2023-07-12T02:05:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.986+0000 7fb8a3fff700 1 -- 172.21.15.37:0/4070773587 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89800c320 con 0x7fb898003bc0 2023-07-12T02:05:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.987+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/4070773587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb898004850 0x7fb898004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.987+0000 7fb8b139b700 1 --2- 172.21.15.37:0/4070773587 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb898003bc0 0x7fb898003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.987+0000 7fb8b1b9c700 1 --2- 172.21.15.37:0/4070773587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb898005250 0x7fb89800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.987+0000 7fb8b0b9a700 1 -- 172.21.15.37:0/4070773587 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb898003bc0 msgr2=0x7fb898003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.987+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/4070773587 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb898003bc0 0x7fb898003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.987+0000 7fb8b0b9a700 1 -- 172.21.15.37:0/4070773587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb898005250 msgr2=0x7fb89800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.987+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/4070773587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb898005250 0x7fb89800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.987+0000 7fb8b0b9a700 1 -- 172.21.15.37:0/4070773587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8980035b0 con 0x7fb898004850 2023-07-12T02:05:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.987+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/4070773587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb898004850 0x7fb898004cc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac15fd80 tx=0x7fb898005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b261510f5ddf6d server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:47.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.987+0000 7fb8a3fff700 1 -- 172.21.15.37:0/4070773587 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c009730 con 0x7fb898004850 2023-07-12T02:05:47.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.987+0000 7fb8a3fff700 1 -- 172.21.15.37:0/4070773587 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c004030 con 0x7fb898004850 2023-07-12T02:05:47.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.988+0000 7fb8a3fff700 1 -- 172.21.15.37:0/4070773587 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0043a0 con 0x7fb898004850 2023-07-12T02:05:47.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.988+0000 7fb8b35ff700 1 -- 172.21.15.37:0/4070773587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb898004850 msgr2=0x7fb898004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:47.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.988+0000 7fb8b35ff700 1 --2- 172.21.15.37:0/4070773587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb898004850 0x7fb898004cc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac15fd80 tx=0x7fb898005880 comp rx=0 tx=0).stop 2023-07-12T02:05:47.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.988+0000 7fb8b1b9c700 1 -- 172.21.15.37:0/4070773587 reap_dead start 2023-07-12T02:05:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.988+0000 7fb8b35ff700 1 -- 172.21.15.37:0/4070773587 shutdown_connections 2023-07-12T02:05:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.988+0000 7fb8b35ff700 1 -- 172.21.15.37:0/4070773587 >> 172.21.15.37:0/4070773587 conn(0x7fb8ac071660 msgr2=0x7fb8ac071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.988+0000 7fb8b35ff700 1 -- 172.21.15.37:0/4070773587 shutdown_connections 2023-07-12T02:05:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.988+0000 7fb8b35ff700 1 -- 172.21.15.37:0/4070773587 wait complete. 2023-07-12T02:05:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.990+0000 7fb8b35ff700 1 Processor -- start 2023-07-12T02:05:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.990+0000 7fb8b35ff700 1 -- start start 2023-07-12T02:05:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.991+0000 7fb8b35ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb898004850 0x7fb8ac0c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.991+0000 7fb8b35ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8ac14db80 0x7fb8ac1f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.991+0000 7fb8b35ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8ac1f5cc0 0x7fb8ac1546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.991+0000 7fb8b35ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac1f6130 con 0x7fb898004850 2023-07-12T02:05:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.991+0000 7fb8b35ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0cd010 con 0x7fb8ac14db80 2023-07-12T02:05:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.991+0000 7fb8b35ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0cc400 con 0x7fb8ac1f5cc0 2023-07-12T02:05:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.991+0000 7fb8b139b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb898004850 0x7fb8ac0c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.991+0000 7fb8b139b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb898004850 0x7fb8ac0c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56912/0 (socket says 172.21.15.37:56912) 2023-07-12T02:05:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.991+0000 7fb8b139b700 1 -- 172.21.15.37:0/1548125823 learned_addr learned my addr 172.21.15.37:0/1548125823 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.991+0000 7fb8b1b9c700 1 --2- 172.21.15.37:0/1548125823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8ac1f5cc0 0x7fb8ac1546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.991+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/1548125823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8ac14db80 0x7fb8ac1f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.992+0000 7fb8b139b700 1 -- 172.21.15.37:0/1548125823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8ac1f5cc0 msgr2=0x7fb8ac1546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.992+0000 7fb8b139b700 1 --2- 172.21.15.37:0/1548125823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8ac1f5cc0 0x7fb8ac1546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.992+0000 7fb8b139b700 1 -- 172.21.15.37:0/1548125823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8ac14db80 msgr2=0x7fb8ac1f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.992+0000 7fb8b139b700 1 --2- 172.21.15.37:0/1548125823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8ac14db80 0x7fb8ac1f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.992+0000 7fb8b139b700 1 -- 172.21.15.37:0/1548125823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac0cc6e0 con 0x7fb898004850 2023-07-12T02:05:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.992+0000 7fb8b139b700 1 --2- 172.21.15.37:0/1548125823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb898004850 0x7fb8ac0c9c50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80072c0 tx=0x7fb8a80075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:48.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.992+0000 7fb8a1ffb700 1 -- 172.21.15.37:0/1548125823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a800f6c0 con 0x7fb898004850 2023-07-12T02:05:48.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.992+0000 7fb8a1ffb700 1 -- 172.21.15.37:0/1548125823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a800f820 con 0x7fb898004850 2023-07-12T02:05:48.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.992+0000 7fb8a1ffb700 1 -- 172.21.15.37:0/1548125823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a800fbd0 con 0x7fb898004850 2023-07-12T02:05:48.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.992+0000 7fb8b35ff700 1 -- 172.21.15.37:0/1548125823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ac0cc9c0 con 0x7fb898004850 2023-07-12T02:05:48.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.992+0000 7fb8b35ff700 1 -- 172.21.15.37:0/1548125823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac0ca190 con 0x7fb898004850 2023-07-12T02:05:48.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.994+0000 7fb8a1ffb700 1 -- 172.21.15.37:0/1548125823 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb8a800fd30 con 0x7fb898004850 2023-07-12T02:05:48.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.995+0000 7fb8a1ffb700 1 --2- 172.21.15.37:0/1548125823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb89006ad10 0x7fb89006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.995+0000 7fb8a1ffb700 1 -- 172.21.15.37:0/1548125823 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb8a80894e0 con 0x7fb898004850 2023-07-12T02:05:48.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.996+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/1548125823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb89006ad10 0x7fb89006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.996+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/1548125823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb89006ad10 0x7fb89006d1c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb89c000c00 tx=0x7fb89c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:48.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.997+0000 7fb8c6e74b80 1 Processor -- start 2023-07-12T02:05:48.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.997+0000 7fb8c6e74b80 1 -- start start 2023-07-12T02:05:48.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.998+0000 7fb8c6e74b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14e6d60 0x561ea14e7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.998+0000 7fb8c6e74b80 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea150aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.998+0000 7fb8c6e74b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14c1b60 0x561ea14c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.998+0000 7fb8c6e74b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea1438ea0 con 0x561ea14e6d60 2023-07-12T02:05:48.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.998+0000 7fb8c6e74b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea13ac600 con 0x561ea14c1b60 2023-07-12T02:05:48.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.998+0000 7fb8c6e74b80 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ea141b910 con 0x561ea14ec1a0 2023-07-12T02:05:48.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.999+0000 7fb8b139b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14e6d60 0x561ea14e7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.999+0000 7fb8b139b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14e6d60 0x561ea14e7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56926/0 (socket says 172.21.15.37:56926) 2023-07-12T02:05:48.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.999+0000 7fb8b139b700 1 -- 172.21.15.37:0/1664678885 learned_addr learned my addr 172.21.15.37:0/1664678885 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:48.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.999+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/1664678885 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea150aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.999+0000 7fb8b1b9c700 1 --2- 172.21.15.37:0/1664678885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14c1b60 0x561ea14c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.999+0000 7fb8b139b700 1 -- 172.21.15.37:0/1664678885 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 msgr2=0x561ea150aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:48.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.999+0000 7fb8b139b700 1 --2- 172.21.15.37:0/1664678885 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea150aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.999+0000 7fb8b139b700 1 -- 172.21.15.37:0/1664678885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14c1b60 msgr2=0x561ea14c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:48.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.999+0000 7fb8b139b700 1 --2- 172.21.15.37:0/1664678885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14c1b60 0x561ea14c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.999+0000 7fb8b139b700 1 -- 172.21.15.37:0/1664678885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ea1208790 con 0x561ea14e6d60 2023-07-12T02:05:48.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.999+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/1664678885 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea150aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:48.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.999+0000 7fb8b139b700 1 --2- 172.21.15.37:0/1664678885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14e6d60 0x561ea14e7130 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8057e00 tx=0x7fb8a8057b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d7ccc2e62b62b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:48.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.999+0000 7fb88effd700 1 -- 172.21.15.37:0/1664678885 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80878a0 con 0x561ea14e6d60 2023-07-12T02:05:48.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.999+0000 7fb88effd700 1 -- 172.21.15.37:0/1664678885 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a80890c0 con 0x561ea14e6d60 2023-07-12T02:05:48.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:47.999+0000 7fb88effd700 1 -- 172.21.15.37:0/1664678885 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80575f0 con 0x561ea14e6d60 2023-07-12T02:05:48.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.000+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/1664678885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14e6d60 msgr2=0x561ea14e7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:48.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.000+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/1664678885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14e6d60 0x561ea14e7130 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8057e00 tx=0x7fb8a8057b30 comp rx=0 tx=0).stop 2023-07-12T02:05:48.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.000+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/1664678885 shutdown_connections 2023-07-12T02:05:48.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.000+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/1664678885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14e6d60 0x561ea14e7130 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.000+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/1664678885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14c1b60 0x561ea14c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.000+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/1664678885 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea150aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.000+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/1664678885 >> 172.21.15.37:0/1664678885 conn(0x561ea14b9320 msgr2=0x561ea15095c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:48.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.000+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/1664678885 shutdown_connections 2023-07-12T02:05:48.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.000+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/1664678885 wait complete. 2023-07-12T02:05:48.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.001+0000 7fb8c6e74b80 1 -- start start 2023-07-12T02:05:48.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.001+0000 7fb8c6e74b80 1 Processor -- start 2023-07-12T02:05:48.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.002+0000 7fb8c6e74b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea14ee980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.002+0000 7fb8c6e74b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14e6d60 0x561ea1501b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.002+0000 7fb8c6e74b80 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea1502070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.002+0000 7fb8c6e74b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea1414be0 con 0x561ea14c1b60 2023-07-12T02:05:48.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.002+0000 7fb8c6e74b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea13d25b0 con 0x561ea14e6d60 2023-07-12T02:05:48.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.002+0000 7fb8c6e74b80 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ea13b8910 con 0x561ea14ec1a0 2023-07-12T02:05:48.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.002+0000 7fb8c6e74b80 10 client.0 _ll_register_callbacks cb 0x561ea13d0b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-12T02:05:48.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.002+0000 7fb8b139b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea14ee980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.003+0000 7fb8b139b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea14ee980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56930/0 (socket says 172.21.15.37:56930) 2023-07-12T02:05:48.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.003+0000 7fb8b139b700 1 -- 172.21.15.37:0/3593210787 learned_addr learned my addr 172.21.15.37:0/3593210787 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:48.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.003+0000 7fb8b1b9c700 1 --2- 172.21.15.37:0/3593210787 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea1502070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.003+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/3593210787 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14e6d60 0x561ea1501b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.003+0000 7fb8b139b700 1 -- 172.21.15.37:0/3593210787 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 msgr2=0x561ea1502070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:48.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.003+0000 7fb8b139b700 1 --2- 172.21.15.37:0/3593210787 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea1502070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.003+0000 7fb8b139b700 1 -- 172.21.15.37:0/3593210787 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14e6d60 msgr2=0x561ea1501b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:48.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.003+0000 7fb8b139b700 1 --2- 172.21.15.37:0/3593210787 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14e6d60 0x561ea1501b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.003+0000 7fb8b139b700 1 -- 172.21.15.37:0/3593210787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac0ca190 con 0x561ea14c1b60 2023-07-12T02:05:48.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.003+0000 7fb8b1b9c700 1 --2- 172.21.15.37:0/3593210787 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea1502070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:48.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.003+0000 7fb8b139b700 1 --2- 172.21.15.37:0/3593210787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea14ee980 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8057e00 tx=0x7fb8a8001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994f75ec7a5284aa server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:48.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.003+0000 7fb887fff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-12T02:05:48.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.003+0000 7fb887fff700 1 -- 172.21.15.37:0/3593210787 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a805ffc0 con 0x561ea14c1b60 2023-07-12T02:05:48.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.003+0000 7fb887fff700 1 -- 172.21.15.37:0/3593210787 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb8a8060120 con 0x561ea14c1b60 2023-07-12T02:05:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.003+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/3593210787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ea14b6930 con 0x561ea14c1b60 2023-07-12T02:05:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.003+0000 7fb887fff700 1 -- 172.21.15.37:0/3593210787 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8a8087af0 con 0x561ea14c1b60 2023-07-12T02:05:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.004+0000 7fb8c6e74b80 10 client.5565 fetch_fsmap learned FSMap version 18 2023-07-12T02:05:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.004+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/3593210787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x561ea12f50a0 con 0x561ea14c1b60 2023-07-12T02:05:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.004+0000 7fb887fff700 1 -- 172.21.15.37:0/3593210787 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561ea14b6930 con 0x561ea14c1b60 2023-07-12T02:05:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.004+0000 7fb887fff700 1 -- 172.21.15.37:0/3593210787 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 18) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fb8a8087c50 con 0x561ea14c1b60 2023-07-12T02:05:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.004+0000 7fb8c6e74b80 10 client.5565 fetch_fsmap finished waiting for FSMap version 18 2023-07-12T02:05:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.004+0000 7fb8c6e74b80 10 client.5565 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-12T02:05:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.004+0000 7fb8c6e74b80 20 client.5565 populate_metadata read hostname 'smithi037' 2023-07-12T02:05:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.004+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/3593210787 >> [v2:172.21.15.37:6833/483849162,v1:172.21.15.37:6835/483849162] conn(0x561ea150af30 0x561ea150b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.004+0000 7fb8c6e74b80 4 client.5565 mds_command: new command op to 5388 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-12T02:05:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.004+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/3593210787 --> [v2:172.21.15.37:6833/483849162,v1:172.21.15.37:6835/483849162] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ea14930e0 con 0x561ea150af30 2023-07-12T02:05:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.004+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/3593210787 >> [v2:172.21.15.37:6833/483849162,v1:172.21.15.37:6835/483849162] conn(0x561ea150af30 0x561ea150b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.005+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/3593210787 >> [v2:172.21.15.37:6833/483849162,v1:172.21.15.37:6835/483849162] conn(0x561ea150af30 0x561ea150b300 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=752c170f6e906d4 server_cookie=2de7f76878a8b018 in_seq=0 out_seq=0 2023-07-12T02:05:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.005+0000 7fb887fff700 10 client.5565 ms_handle_connect on v2:172.21.15.37:6833/483849162 2023-07-12T02:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.005+0000 7fb887fff700 1 -- 172.21.15.37:0/3593210787 <== mds.0 v2:172.21.15.37:6833/483849162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561ea14930e0 con 0x561ea150af30 2023-07-12T02:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.005+0000 7fb887fff700 10 client.5565 handle_command_reply: tid=0 2023-07-12T02:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.005+0000 7fb8c6e74b80 1 client.5565 shutdown 2023-07-12T02:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.006+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/3593210787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 msgr2=0x561ea14ee980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.006+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/3593210787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea14ee980 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8057e00 tx=0x7fb8a8001d40 comp rx=0 tx=0).stop 2023-07-12T02:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.006+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/3593210787 shutdown_connections 2023-07-12T02:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.006+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/3593210787 >> [v2:172.21.15.37:6833/483849162,v1:172.21.15.37:6835/483849162] conn(0x561ea150af30 0x561ea150b300 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.006+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/3593210787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea14ee980 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.006+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/3593210787 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea1502070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.006+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/3593210787 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14e6d60 0x561ea1501b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.006+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/3593210787 >> 172.21.15.37:0/3593210787 conn(0x561ea14b9320 msgr2=0x561ea14bdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.006+0000 7fb887fff700 0 client.5565 ms_handle_reset on v2:172.21.15.37:6833/483849162 2023-07-12T02:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.006+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/3593210787 shutdown_connections 2023-07-12T02:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.006+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/3593210787 wait complete. 2023-07-12T02:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.006+0000 7fb8c6e74b80 20 client.5565 trim_cache size 0 max 16384 2023-07-12T02:05:48.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.024+0000 7fb8c6e74b80 1 Processor -- start 2023-07-12T02:05:48.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.025+0000 7fb8c6e74b80 1 -- start start 2023-07-12T02:05:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.025+0000 7fb8c6e74b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea1518320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.025+0000 7fb8c6e74b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14e6d60 0x561ea14e62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.025+0000 7fb8c6e74b80 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea14befc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.025+0000 7fb8c6e74b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea1209390 con 0x561ea14c1b60 2023-07-12T02:05:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.025+0000 7fb8c6e74b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea14c4b10 con 0x561ea14e6d60 2023-07-12T02:05:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.025+0000 7fb8c6e74b80 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ea14c6010 con 0x561ea14ec1a0 2023-07-12T02:05:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.026+0000 7fb8b139b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea1518320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.026+0000 7fb8b139b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea1518320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56936/0 (socket says 172.21.15.37:56936) 2023-07-12T02:05:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.026+0000 7fb8b139b700 1 -- 172.21.15.37:0/196975956 learned_addr learned my addr 172.21.15.37:0/196975956 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:48.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.026+0000 7fb8b1b9c700 1 --2- 172.21.15.37:0/196975956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea14befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.026+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/196975956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14e6d60 0x561ea14e62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.026+0000 7fb8b139b700 1 -- 172.21.15.37:0/196975956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 msgr2=0x561ea14befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:48.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.026+0000 7fb8b139b700 1 --2- 172.21.15.37:0/196975956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea14befc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.026+0000 7fb8b139b700 1 -- 172.21.15.37:0/196975956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14e6d60 msgr2=0x561ea14e62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:48.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.026+0000 7fb8b139b700 1 --2- 172.21.15.37:0/196975956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14e6d60 0x561ea14e62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.026+0000 7fb8b139b700 1 -- 172.21.15.37:0/196975956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ea13dab10 con 0x561ea14c1b60 2023-07-12T02:05:48.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.026+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/196975956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14e6d60 0x561ea14e62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:48.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.026+0000 7fb8b139b700 1 --2- 172.21.15.37:0/196975956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea1518320 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8056450 tx=0x7fb8a8083070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc02b79a3ce7f16 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.026+0000 7fb88f7fe700 1 -- 172.21.15.37:0/196975956 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8054090 con 0x561ea14c1b60 2023-07-12T02:05:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.026+0000 7fb88f7fe700 1 -- 172.21.15.37:0/196975956 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a80541f0 con 0x561ea14c1b60 2023-07-12T02:05:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.026+0000 7fb88f7fe700 1 -- 172.21.15.37:0/196975956 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80601c0 con 0x561ea14c1b60 2023-07-12T02:05:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.027+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/196975956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 msgr2=0x561ea1518320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.027+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/196975956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea1518320 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8056450 tx=0x7fb8a8083070 comp rx=0 tx=0).stop 2023-07-12T02:05:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.027+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/196975956 shutdown_connections 2023-07-12T02:05:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.027+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/196975956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea1518320 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.027+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/196975956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea14befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.027+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/196975956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14e6d60 0x561ea14e62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.027+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/196975956 >> 172.21.15.37:0/196975956 conn(0x561ea14b9320 msgr2=0x561ea150b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.027+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/196975956 shutdown_connections 2023-07-12T02:05:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.027+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/196975956 wait complete. 2023-07-12T02:05:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.028+0000 7fb8c6e74b80 1 -- start start 2023-07-12T02:05:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.028+0000 7fb8c6e74b80 1 Processor -- start 2023-07-12T02:05:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.029+0000 7fb8c6e74b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea15031b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.029+0000 7fb8c6e74b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14e6d60 0x561ea1517ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.029+0000 7fb8c6e74b80 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea15180e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.029+0000 7fb8c6e74b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea150d2d0 con 0x561ea14c1b60 2023-07-12T02:05:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.029+0000 7fb8c6e74b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea14eb040 con 0x561ea14e6d60 2023-07-12T02:05:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.029+0000 7fb8c6e74b80 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ea150cd10 con 0x561ea14ec1a0 2023-07-12T02:05:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.029+0000 7fb8c6e74b80 10 client.0 _ll_register_callbacks cb 0x7fb8a8057d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-12T02:05:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.029+0000 7fb8b139b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea15031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.029+0000 7fb8b139b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea15031b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56938/0 (socket says 172.21.15.37:56938) 2023-07-12T02:05:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.029+0000 7fb8b139b700 1 -- 172.21.15.37:0/4171378256 learned_addr learned my addr 172.21.15.37:0/4171378256 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.029+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/4171378256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14e6d60 0x561ea1517ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.029+0000 7fb8b1b9c700 1 --2- 172.21.15.37:0/4171378256 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea15180e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.030+0000 7fb8b139b700 1 -- 172.21.15.37:0/4171378256 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 msgr2=0x561ea15180e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:48.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.030+0000 7fb8b139b700 1 --2- 172.21.15.37:0/4171378256 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea15180e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.030+0000 7fb8b139b700 1 -- 172.21.15.37:0/4171378256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14e6d60 msgr2=0x561ea1517ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:48.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.030+0000 7fb8b139b700 1 --2- 172.21.15.37:0/4171378256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14e6d60 0x561ea1517ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.030+0000 7fb8b139b700 1 -- 172.21.15.37:0/4171378256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ea12f50a0 con 0x561ea14c1b60 2023-07-12T02:05:48.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.030+0000 7fb8b139b700 1 --2- 172.21.15.37:0/4171378256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea15031b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8007950 tx=0x7fb8a80544c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98974bf3079bb54e server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:48.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.030+0000 7fb887fff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-12T02:05:48.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.030+0000 7fb887fff700 1 -- 172.21.15.37:0/4171378256 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8087cf0 con 0x561ea14c1b60 2023-07-12T02:05:48.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.030+0000 7fb887fff700 1 -- 172.21.15.37:0/4171378256 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb8a8054010 con 0x561ea14c1b60 2023-07-12T02:05:48.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.030+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/4171378256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb8a80890c0 con 0x561ea14c1b60 2023-07-12T02:05:48.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.030+0000 7fb887fff700 1 -- 172.21.15.37:0/4171378256 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8a8081420 con 0x561ea14c1b60 2023-07-12T02:05:48.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.030+0000 7fb8c6e74b80 10 client.5571 fetch_fsmap learned FSMap version 18 2023-07-12T02:05:48.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.030+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/4171378256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x561ea12691d0 con 0x561ea14c1b60 2023-07-12T02:05:48.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.031+0000 7fb887fff700 1 -- 172.21.15.37:0/4171378256 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a80890c0 con 0x561ea14c1b60 2023-07-12T02:05:48.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.031+0000 7fb887fff700 1 -- 172.21.15.37:0/4171378256 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 18) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fb8a806fad0 con 0x561ea14c1b60 2023-07-12T02:05:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.031+0000 7fb8c6e74b80 10 client.5571 fetch_fsmap finished waiting for FSMap version 18 2023-07-12T02:05:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.031+0000 7fb8c6e74b80 10 client.5571 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-12T02:05:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.031+0000 7fb8c6e74b80 20 client.5571 populate_metadata read hostname 'smithi037' 2023-07-12T02:05:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.031+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/4171378256 >> [v2:172.21.15.37:6833/483849162,v1:172.21.15.37:6835/483849162] conn(0x561ea14bd620 0x561ea1500f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.031+0000 7fb8c6e74b80 4 client.5571 mds_command: new command op to 5388 tid=0[{"prefix": "status"}] 2023-07-12T02:05:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.031+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/4171378256 --> [v2:172.21.15.37:6833/483849162,v1:172.21.15.37:6835/483849162] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561ea140dd20 con 0x561ea14bd620 2023-07-12T02:05:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.031+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/4171378256 >> [v2:172.21.15.37:6833/483849162,v1:172.21.15.37:6835/483849162] conn(0x561ea14bd620 0x561ea1500f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb8b0b9a700 1 --2- 172.21.15.37:0/4171378256 >> [v2:172.21.15.37:6833/483849162,v1:172.21.15.37:6835/483849162] conn(0x561ea14bd620 0x561ea1500f60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65a5465ef4caa4f8 server_cookie=5b4e9e1d1fa43149 in_seq=0 out_seq=0 2023-07-12T02:05:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb887fff700 10 client.5571 ms_handle_connect on v2:172.21.15.37:6833/483849162 2023-07-12T02:05:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb887fff700 1 -- 172.21.15.37:0/4171378256 <== mds.0 v2:172.21.15.37:6833/483849162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x561ea140dd20 con 0x561ea14bd620 2023-07-12T02:05:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb887fff700 10 client.5571 handle_command_reply: tid=0 2023-07-12T02:05:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb8c6e74b80 1 client.5571 shutdown 2023-07-12T02:05:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/4171378256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 msgr2=0x561ea15031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/4171378256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea15031b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8007950 tx=0x7fb8a80544c0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/4171378256 shutdown_connections 2023-07-12T02:05:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/4171378256 >> [v2:172.21.15.37:6833/483849162,v1:172.21.15.37:6835/483849162] conn(0x561ea14bd620 0x561ea1500f60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/4171378256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561ea14c1b60 0x561ea15031b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/4171378256 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x561ea14ec1a0 0x561ea15180e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb8c6e74b80 1 --2- 172.21.15.37:0/4171378256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ea14e6d60 0x561ea1517ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/4171378256 >> 172.21.15.37:0/4171378256 conn(0x561ea14b9320 msgr2=0x561ea150b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb887fff700 0 client.5571 ms_handle_reset on v2:172.21.15.37:6833/483849162 2023-07-12T02:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/4171378256 shutdown_connections 2023-07-12T02:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb8c6e74b80 1 -- 172.21.15.37:0/4171378256 wait complete. 2023-07-12T02:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.032+0000 7fb8c6e74b80 20 client.5571 trim_cache size 0 max 16384 2023-07-12T02:05:48.044 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-12T02:05:48.044 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "e0d485b9-796c-494c-84d4-d32d9c18c85f", 2023-07-12T02:05:48.044 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-12T02:05:48.044 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5388, 2023-07-12T02:05:48.044 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-12T02:05:48.045 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-12T02:05:48.045 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-12T02:05:48.045 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 6.6798451419999996, 2023-07-12T02:05:48.045 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 18, 2023-07-12T02:05:48.045 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 41, 2023-07-12T02:05:48.045 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 41, 2023-07-12T02:05:48.045 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 15.511281532 2023-07-12T02:05:48.045 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-12T02:05:48.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.033+0000 7fb8b35ff700 1 -- 172.21.15.37:0/1548125823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb89006ad10 msgr2=0x7fb89006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:48.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.033+0000 7fb8b35ff700 1 --2- 172.21.15.37:0/1548125823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb89006ad10 0x7fb89006d1c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb89c000c00 tx=0x7fb89c008030 comp rx=0 tx=0).stop 2023-07-12T02:05:48.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.033+0000 7fb8b35ff700 1 -- 172.21.15.37:0/1548125823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb898004850 msgr2=0x7fb8ac0c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.033+0000 7fb8b35ff700 1 --2- 172.21.15.37:0/1548125823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb898004850 0x7fb8ac0c9c50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80072c0 tx=0x7fb8a80075d0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.033+0000 7fb8b35ff700 1 -- 172.21.15.37:0/1548125823 shutdown_connections 2023-07-12T02:05:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.033+0000 7fb8b35ff700 1 --2- 172.21.15.37:0/1548125823 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fb89006ad10 0x7fb89006d1c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.033+0000 7fb8b35ff700 1 --2- 172.21.15.37:0/1548125823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb898004850 0x7fb8ac0c9c50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.033+0000 7fb8b35ff700 1 --2- 172.21.15.37:0/1548125823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8ac1f5cc0 0x7fb8ac1546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.033+0000 7fb8b35ff700 1 --2- 172.21.15.37:0/1548125823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8ac14db80 0x7fb8ac1f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.033+0000 7fb8b35ff700 1 -- 172.21.15.37:0/1548125823 >> 172.21.15.37:0/1548125823 conn(0x7fb8ac071660 msgr2=0x7fb8ac0b7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.033+0000 7fb8b35ff700 1 -- 172.21.15.37:0/1548125823 shutdown_connections 2023-07-12T02:05:48.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.033+0000 7fb8b35ff700 1 -- 172.21.15.37:0/1548125823 wait complete. 2023-07-12T02:05:48.054 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-12T02:05:48.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.251+0000 7f0171dff700 1 Processor -- start 2023-07-12T02:05:48.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.251+0000 7f0171dff700 1 -- start start 2023-07-12T02:05:48.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.252+0000 7f0171dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f016c15c460 0x7f016c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.252+0000 7f0171dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016c0d1790 con 0x7f016c0d2640 2023-07-12T02:05:48.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.252+0000 7f0171dff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016c0cd950 con 0x7f016c0cf8f0 2023-07-12T02:05:48.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.252+0000 7f0171dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c0cedd0 con 0x7f016c15c460 2023-07-12T02:05:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.253+0000 7f016affd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f016c0d2640 0x7f016c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41658/0 (socket says 172.21.15.37:41658) 2023-07-12T02:05:48.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.253+0000 7f016affd700 1 -- 172.21.15.37:0/1083427852 learned_addr learned my addr 172.21.15.37:0/1083427852 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:05:48.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.253+0000 7f016b7fe700 1 --2- 172.21.15.37:0/1083427852 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f016c15c460 0x7f016c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.253+0000 7f016a7fc700 1 -- 172.21.15.37:0/1083427852 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920169410 0 0) 0x7f016c0d1790 con 0x7f016c0d2640 2023-07-12T02:05:48.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.253+0000 7f016a7fc700 1 -- 172.21.15.37:0/1083427852 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01540035b0 con 0x7f016c0d2640 2023-07-12T02:05:48.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.253+0000 7f016a7fc700 1 -- 172.21.15.37:0/1083427852 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971650934 0 0) 0x7f016c0cd950 con 0x7f016c0cf8f0 2023-07-12T02:05:48.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.253+0000 7f016a7fc700 1 -- 172.21.15.37:0/1083427852 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f016c0d1790 con 0x7f016c0cf8f0 2023-07-12T02:05:48.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.253+0000 7f016a7fc700 1 -- 172.21.15.37:0/1083427852 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3987327080 0 0) 0x7f01540035b0 con 0x7f016c0d2640 2023-07-12T02:05:48.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.253+0000 7f016a7fc700 1 -- 172.21.15.37:0/1083427852 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f016c15c460 msgr2=0x7f016c0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:48.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.253+0000 7f016a7fc700 1 --2- 172.21.15.37:0/1083427852 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f016c15c460 0x7f016c0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.253+0000 7f016a7fc700 1 -- 172.21.15.37:0/1083427852 >> v1:172.21.15.196:6789/0 conn(0x7f016c0cf8f0 legacy=0x7f016c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:48.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.253+0000 7f016a7fc700 1 -- 172.21.15.37:0/1083427852 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c0d14b0 con 0x7f016c0d2640 2023-07-12T02:05:48.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.253+0000 7f016a7fc700 1 -- 172.21.15.37:0/1083427852 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 504325054 0 0) 0x7f0160001670 con 0x7f016c0d2640 2023-07-12T02:05:48.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.253+0000 7f016a7fc700 1 -- 172.21.15.37:0/1083427852 >> v1:172.21.15.37:6789/0 conn(0x7f016c0d2640 legacy=0x7f016c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:48.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.254+0000 7f016a7fc700 1 --2- 172.21.15.37:0/1083427852 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f016c15c460 0x7f0154003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.254+0000 7f016a7fc700 1 --2- 172.21.15.37:0/1083427852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0154004170 0x7f0154004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.254+0000 7f016a7fc700 1 --2- 172.21.15.37:0/1083427852 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0154004d90 0x7f0154005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.254+0000 7f016a7fc700 1 -- 172.21.15.37:0/1083427852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c0cedd0 con 0x7f0154004170 2023-07-12T02:05:48.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.254+0000 7f016a7fc700 1 -- 172.21.15.37:0/1083427852 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015400bc50 con 0x7f0154004d90 2023-07-12T02:05:48.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.254+0000 7f016a7fc700 1 -- 172.21.15.37:0/1083427852 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015400be10 con 0x7f016c15c460 2023-07-12T02:05:48.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.254+0000 7f016affd700 1 --2- 172.21.15.37:0/1083427852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0154004170 0x7f0154004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.254+0000 7f016b7fe700 1 --2- 172.21.15.37:0/1083427852 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f016c15c460 0x7f0154003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.254+0000 7f016bfff700 1 --2- 172.21.15.37:0/1083427852 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0154004d90 0x7f0154005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.254+0000 7f016affd700 1 -- 172.21.15.37:0/1083427852 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f016c15c460 msgr2=0x7f0154003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.254+0000 7f016affd700 1 --2- 172.21.15.37:0/1083427852 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f016c15c460 0x7f0154003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.254+0000 7f016affd700 1 -- 172.21.15.37:0/1083427852 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0154004d90 msgr2=0x7f0154005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:05:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.254+0000 7f016affd700 1 --2- 172.21.15.37:0/1083427852 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0154004d90 0x7f0154005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.254+0000 7f016affd700 1 -- 172.21.15.37:0/1083427852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01540035b0 con 0x7f0154004170 2023-07-12T02:05:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.254+0000 7f016bfff700 1 --2- 172.21.15.37:0/1083427852 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0154004d90 0x7f0154005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:05:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.254+0000 7f016affd700 1 --2- 172.21.15.37:0/1083427852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0154004170 0x7f0154004850 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0160001eb0 tx=0x7f0154005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62765ae186b956ed server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.255+0000 7f016a7fc700 1 -- 172.21.15.37:0/1083427852 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016000cc10 con 0x7f0154004170 2023-07-12T02:05:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.255+0000 7f016a7fc700 1 -- 172.21.15.37:0/1083427852 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016000cd70 con 0x7f0154004170 2023-07-12T02:05:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.255+0000 7f016a7fc700 1 -- 172.21.15.37:0/1083427852 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160005ba0 con 0x7f0154004170 2023-07-12T02:05:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.255+0000 7f0171dff700 1 -- 172.21.15.37:0/1083427852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0154004170 msgr2=0x7f0154004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.255+0000 7f0171dff700 1 --2- 172.21.15.37:0/1083427852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0154004170 0x7f0154004850 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0160001eb0 tx=0x7f0154005880 comp rx=0 tx=0).stop 2023-07-12T02:05:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.255+0000 7f016bfff700 1 -- 172.21.15.37:0/1083427852 reap_dead start 2023-07-12T02:05:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.255+0000 7f0171dff700 1 -- 172.21.15.37:0/1083427852 shutdown_connections 2023-07-12T02:05:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.255+0000 7f0171dff700 1 -- 172.21.15.37:0/1083427852 >> 172.21.15.37:0/1083427852 conn(0x7f016c071660 msgr2=0x7f016c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:48.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.255+0000 7f0171dff700 1 -- 172.21.15.37:0/1083427852 shutdown_connections 2023-07-12T02:05:48.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.255+0000 7f0171dff700 1 -- 172.21.15.37:0/1083427852 wait complete. 2023-07-12T02:05:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.257+0000 7f0171dff700 1 Processor -- start 2023-07-12T02:05:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.258+0000 7f0171dff700 1 -- start start 2023-07-12T02:05:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.258+0000 7f0171dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0154004170 0x7f016c14db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.258+0000 7f0171dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f016c1522e0 0x7f016c1f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.258+0000 7f0171dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f016c0caca0 0x7f016c151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.259+0000 7f0171dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c150f70 con 0x7f016c1522e0 2023-07-12T02:05:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.259+0000 7f0171dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c152af0 con 0x7f016c0caca0 2023-07-12T02:05:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.259+0000 7f0171dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c1f33e0 con 0x7f0154004170 2023-07-12T02:05:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.259+0000 7f016affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f016c1522e0 0x7f016c1f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.259+0000 7f016affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f016c1522e0 0x7f016c1f2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56968/0 (socket says 172.21.15.37:56968) 2023-07-12T02:05:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.259+0000 7f016affd700 1 -- 172.21.15.37:0/3451131344 learned_addr learned my addr 172.21.15.37:0/3451131344 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:05:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.259+0000 7f016bfff700 1 --2- 172.21.15.37:0/3451131344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f016c0caca0 0x7f016c151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.259+0000 7f016b7fe700 1 --2- 172.21.15.37:0/3451131344 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0154004170 0x7f016c14db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.259+0000 7f016affd700 1 -- 172.21.15.37:0/3451131344 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0154004170 msgr2=0x7f016c14db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.259+0000 7f016affd700 1 --2- 172.21.15.37:0/3451131344 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0154004170 0x7f016c14db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.259+0000 7f016affd700 1 -- 172.21.15.37:0/3451131344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f016c0caca0 msgr2=0x7f016c151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:48.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.259+0000 7f016affd700 1 --2- 172.21.15.37:0/3451131344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f016c0caca0 0x7f016c151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.259+0000 7f016affd700 1 -- 172.21.15.37:0/3451131344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c153f50 con 0x7f016c1522e0 2023-07-12T02:05:48.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.259+0000 7f016bfff700 1 --2- 172.21.15.37:0/3451131344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f016c0caca0 0x7f016c151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:05:48.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.259+0000 7f016affd700 1 --2- 172.21.15.37:0/3451131344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f016c1522e0 0x7f016c1f2ea0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f015400bc20 tx=0x7f0160001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:48.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.260+0000 7f0153fff700 1 -- 172.21.15.37:0/3451131344 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016000cee0 con 0x7f016c1522e0 2023-07-12T02:05:48.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.260+0000 7f0153fff700 1 -- 172.21.15.37:0/3451131344 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01600015a0 con 0x7f016c1522e0 2023-07-12T02:05:48.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.260+0000 7f0153fff700 1 -- 172.21.15.37:0/3451131344 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01600072f0 con 0x7f016c1522e0 2023-07-12T02:05:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.260+0000 7f0171dff700 1 -- 172.21.15.37:0/3451131344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016c152810 con 0x7f016c1522e0 2023-07-12T02:05:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.260+0000 7f0171dff700 1 -- 172.21.15.37:0/3451131344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016c1544d0 con 0x7f016c1522e0 2023-07-12T02:05:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.261+0000 7f0171dff700 1 -- 172.21.15.37:0/3451131344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016c04ea60 con 0x7f016c1522e0 2023-07-12T02:05:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.262+0000 7f0153fff700 1 -- 172.21.15.37:0/3451131344 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0160019030 con 0x7f016c1522e0 2023-07-12T02:05:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.263+0000 7f0153fff700 1 --2- 172.21.15.37:0/3451131344 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f015806ace0 0x7f015806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:05:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.263+0000 7f0153fff700 1 -- 172.21.15.37:0/3451131344 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f016008a930 con 0x7f016c1522e0 2023-07-12T02:05:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.264+0000 7f016b7fe700 1 --2- 172.21.15.37:0/3451131344 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f015806ace0 0x7f015806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:05:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.265+0000 7f016b7fe700 1 --2- 172.21.15.37:0/3451131344 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f015806ace0 0x7f015806d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f015c0099c0 tx=0x7f015c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:05:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.268+0000 7f0153fff700 1 -- 172.21.15.37:0/3451131344 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0160055810 con 0x7f016c1522e0 2023-07-12T02:05:48.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.522+0000 7f0171dff700 1 -- 172.21.15.37:0/3451131344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f016c150f50 con 0x7f016c1522e0 2023-07-12T02:05:48.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.523+0000 7f0153fff700 1 -- 172.21.15.37:0/3451131344 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0160058e30 con 0x7f016c1522e0 2023-07-12T02:05:48.527 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-12T02:05:48.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.525+0000 7f0171dff700 1 -- 172.21.15.37:0/3451131344 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f015806ace0 msgr2=0x7f015806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:48.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.525+0000 7f0171dff700 1 --2- 172.21.15.37:0/3451131344 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f015806ace0 0x7f015806d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f015c0099c0 tx=0x7f015c008040 comp rx=0 tx=0).stop 2023-07-12T02:05:48.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.525+0000 7f0171dff700 1 -- 172.21.15.37:0/3451131344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f016c1522e0 msgr2=0x7f016c1f2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:05:48.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.525+0000 7f0171dff700 1 --2- 172.21.15.37:0/3451131344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f016c1522e0 0x7f016c1f2ea0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f015400bc20 tx=0x7f0160001930 comp rx=0 tx=0).stop 2023-07-12T02:05:48.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.525+0000 7f0171dff700 1 -- 172.21.15.37:0/3451131344 shutdown_connections 2023-07-12T02:05:48.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.525+0000 7f0171dff700 1 --2- 172.21.15.37:0/3451131344 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f015806ace0 0x7f015806d190 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.525+0000 7f0171dff700 1 --2- 172.21.15.37:0/3451131344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f016c0caca0 0x7f016c151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.525+0000 7f0171dff700 1 --2- 172.21.15.37:0/3451131344 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0154004170 0x7f016c14db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.525+0000 7f0171dff700 1 --2- 172.21.15.37:0/3451131344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f016c1522e0 0x7f016c1f2ea0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:05:48.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.525+0000 7f0171dff700 1 -- 172.21.15.37:0/3451131344 >> 172.21.15.37:0/3451131344 conn(0x7f016c071660 msgr2=0x7f016c15c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:05:48.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.525+0000 7f0171dff700 1 -- 172.21.15.37:0/3451131344 shutdown_connections 2023-07-12T02:05:48.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:05:48.525+0000 7f0171dff700 1 -- 172.21.15.37:0/3451131344 wait complete. 2023-07-12T02:05:48.546 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-12T02:05:48.547 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-12T02:05:48.547 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-12T02:05:48.547 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-12T02:05:48.548 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-12T02:05:48.548 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-12T02:05:48.548 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-12T02:05:48.548 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-12T02:05:48.549 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-12T02:05:48.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:48.549 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-12T02:05:48.596 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-12T02:05:48.596 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-12T02:05:48.596 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-12T02:05:48.596 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:05:48.596 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-12T02:05:48.596 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-12T02:05:48.597 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41633sec preferred_lft 41633sec 2023-07-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:05:48.598 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 06:d8:34:67:3f:34 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::7cee:51ff:fe1e:d7b/64 scope link 2023-07-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:05:48.599 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-12T02:05:48.600 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 06:d8:34:67:3f:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-12T02:05:48.600 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::4d8:34ff:fe67:3f34/64 scope link 2023-07-12T02:05:48.600 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:05:48.600 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-12T02:05:48.600 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 3a:59:3b:92:98:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-12T02:05:48.600 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::3859:3bff:fe92:9826/64 scope link 2023-07-12T02:05:48.600 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:05:48.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:48.602 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-12T02:05:48.709 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-12T02:05:48.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:48.712 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-12T02:05:48.761 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-12T02:05:48.761 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-12T02:05:48.761 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-12T02:05:48.761 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-12T02:05:48.761 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-12T02:05:48.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:48.763 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-12T02:05:48.763 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-12T02:05:48.763 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-12T02:05:48.763 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-12T02:05:48.764 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-12T02:05:48.764 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-12T02:05:48.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:48.934 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-12T02:05:48.980 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-12T02:05:48.980 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-12T02:05:48.981 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-12T02:05:48.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:48.981 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-12T02:05:49.091 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-12T02:05:49.092 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-12T02:05:49.137 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-12T02:05:49.138 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-12T02:05:49.138 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-12T02:05:49.222 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-12T02:05:49.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:49.222 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-12T02:05:49.367 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-12T02:05:49.368 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-12T02:05:49.368 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-07-12T02:05:49.385 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-12T02:05:49.385 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-12T02:05:49.385 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-07-12T02:05:49.385 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.196:3300,172.21.15.196:3301" 2023-07-12T02:05:49.385 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-12T02:05:49.408 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-12T02:05:49.408 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-12T02:05:49.408 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-07-12T02:05:49.408 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.196:3300,172.21.15.196:3301" 2023-07-12T02:05:49.409 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-12T02:05:49.409 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.196:6789,172.21.15.196:6790" 2023-07-12T02:05:49.409 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.196:6789,172.21.15.196:6790:/ 2023-07-12T02:05:49.409 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e0d485b9-796c-494c-84d4-d32d9c18c85f" will pass to kernel 2023-07-12T02:05:49.413 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-12T02:05:49.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:49.414 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-12T02:05:49.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:49.485 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:05:49.586 INFO:teuthology.orchestra.run.smithi037.stdout:client5428 2023-07-12T02:05:49.586 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:05:49.587 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:05:49.632 DEBUG:teuthology.orchestra.run.smithi037:> mktemp -d --suffix=xfstests-dev 2023-07-12T02:05:49.717 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.MWP0gTBaNBxfstests-dev 2023-07-12T02:05:49.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:49.718 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.MWP0gTBaNBxfstests-dev) 2023-07-12T02:05:49.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:49.829 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.MWP0gTBaNBxfstests-dev) 2023-07-12T02:05:49.880 INFO:teuthology.orchestra.run.smithi037.stderr:Cloning into '/tmp/tmp.MWP0gTBaNBxfstests-dev'... 2023-07-12T02:05:50.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:50.728 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-07-12T02:05:50.781 DEBUG:teuthology.orchestra.run.smithi037:> mktemp -d --suffix=test 2023-07-12T02:05:50.826 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.JoBPUdJofOtest 2023-07-12T02:05:50.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:05:50.827 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-07-12T02:05:50.914 DEBUG:teuthology.orchestra.run.smithi037:> mktemp -d --suffix=scratch 2023-07-12T02:05:50.959 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:05:50.959 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-07-12T02:05:50.960 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-07-12T02:05:52.116 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:10:21 ago on Wed 12 Jul 2023 01:55:31 AM UTC. 2023-07-12T02:05:53.475 INFO:teuthology.orchestra.run.smithi037.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-07-12T02:05:53.476 INFO:teuthology.orchestra.run.smithi037.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-07-12T02:05:53.477 INFO:teuthology.orchestra.run.smithi037.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-07-12T02:05:53.478 INFO:teuthology.orchestra.run.smithi037.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-07-12T02:05:53.479 INFO:teuthology.orchestra.run.smithi037.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-07-12T02:05:53.481 INFO:teuthology.orchestra.run.smithi037.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-07-12T02:05:53.483 INFO:teuthology.orchestra.run.smithi037.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-07-12T02:05:53.484 INFO:teuthology.orchestra.run.smithi037.stdout:Package gcc-8.5.0-19.el8.x86_64 is already installed. 2023-07-12T02:05:53.487 INFO:teuthology.orchestra.run.smithi037.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-07-12T02:05:53.488 INFO:teuthology.orchestra.run.smithi037.stdout:Package lvm2-8:2.03.14-9.el8.x86_64 is already installed. 2023-07-12T02:05:53.489 INFO:teuthology.orchestra.run.smithi037.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-07-12T02:05:53.490 INFO:teuthology.orchestra.run.smithi037.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-07-12T02:05:53.491 INFO:teuthology.orchestra.run.smithi037.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-07-12T02:05:53.492 INFO:teuthology.orchestra.run.smithi037.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-07-12T02:05:53.493 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.8-6.el8.x86_64 is already installed. 2023-07-12T02:05:53.494 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-07-12T02:05:53.496 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-12T02:05:53.497 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-12T02:05:53.498 INFO:teuthology.orchestra.run.smithi037.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-07-12T02:05:53.499 INFO:teuthology.orchestra.run.smithi037.stdout:Package libuuid-devel-2.32.1-42.el8.x86_64 is already installed. 2023-07-12T02:05:53.500 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-devel-5.0.0-12.el8.x86_64 is already installed. 2023-07-12T02:05:53.502 INFO:teuthology.orchestra.run.smithi037.stdout:Package sqlite-3.26.0-17.el8.x86_64 is already installed. 2023-07-12T02:05:53.507 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-07-12T02:05:53.695 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-12T02:05:53.698 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2023-07-12T02:05:53.698 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2023-07-12T02:05:53.699 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2023-07-12T02:05:53.699 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-12T02:05:53.699 INFO:teuthology.orchestra.run.smithi037.stdout: dump x86_64 1:0.4-0.36.b46.el8 baseos 164 k 2023-07-12T02:05:53.699 INFO:teuthology.orchestra.run.smithi037.stdout: fio x86_64 3.19-4.el8 appstream 538 k 2023-07-12T02:05:53.699 INFO:teuthology.orchestra.run.smithi037.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-07-12T02:05:53.699 INFO:teuthology.orchestra.run.smithi037.stdout: python2 x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 110 k 2023-07-12T02:05:53.699 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2023-07-12T02:05:53.700 INFO:teuthology.orchestra.run.smithi037.stdout: cpp x86_64 8.5.0-20.el8 baseos 10 M 2023-07-12T02:05:53.700 INFO:teuthology.orchestra.run.smithi037.stdout: gcc x86_64 8.5.0-20.el8 baseos 24 M 2023-07-12T02:05:53.700 INFO:teuthology.orchestra.run.smithi037.stdout: gcc-gdb-plugin x86_64 8.5.0-20.el8 appstream 121 k 2023-07-12T02:05:53.700 INFO:teuthology.orchestra.run.smithi037.stdout: gcc-plugin-annobin x86_64 8.5.0-20.el8 baseos 36 k 2023-07-12T02:05:53.700 INFO:teuthology.orchestra.run.smithi037.stdout: libgcc x86_64 8.5.0-20.el8 baseos 81 k 2023-07-12T02:05:53.700 INFO:teuthology.orchestra.run.smithi037.stdout: libgomp x86_64 8.5.0-20.el8 baseos 208 k 2023-07-12T02:05:53.700 INFO:teuthology.orchestra.run.smithi037.stdout: sqlite x86_64 3.26.0-18.el8 baseos 668 k 2023-07-12T02:05:53.701 INFO:teuthology.orchestra.run.smithi037.stdout: sqlite-libs x86_64 3.26.0-18.el8 baseos 581 k 2023-07-12T02:05:53.701 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-07-12T02:05:53.701 INFO:teuthology.orchestra.run.smithi037.stdout: daxctl-libs x86_64 71.1-7.el8 baseos 42 k 2023-07-12T02:05:53.701 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemblk x86_64 1.6.1-1.el8 appstream 92 k 2023-07-12T02:05:53.701 INFO:teuthology.orchestra.run.smithi037.stdout: ndctl-libs x86_64 71.1-7.el8 baseos 80 k 2023-07-12T02:05:53.701 INFO:teuthology.orchestra.run.smithi037.stdout: python2-libs x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 6.5 M 2023-07-12T02:05:53.701 INFO:teuthology.orchestra.run.smithi037.stdout: python2-pip-wheel noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 892 k 2023-07-12T02:05:53.701 INFO:teuthology.orchestra.run.smithi037.stdout: python2-setuptools-wheel noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 287 k 2023-07-12T02:05:53.702 INFO:teuthology.orchestra.run.smithi037.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module_el8+299+aa6e9afa appstream 44 k 2023-07-12T02:05:53.702 INFO:teuthology.orchestra.run.smithi037.stdout: rmt x86_64 2:1.5.3-13.el8 baseos 51 k 2023-07-12T02:05:53.702 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2023-07-12T02:05:53.702 INFO:teuthology.orchestra.run.smithi037.stdout: python2-pip noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 1.8 M 2023-07-12T02:05:53.702 INFO:teuthology.orchestra.run.smithi037.stdout: python2-setuptools noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 702 k 2023-07-12T02:05:53.702 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling module streams: 2023-07-12T02:05:53.702 INFO:teuthology.orchestra.run.smithi037.stdout: python27 2.7 2023-07-12T02:05:53.703 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:53.703 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-12T02:05:53.703 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2023-07-12T02:05:53.703 INFO:teuthology.orchestra.run.smithi037.stdout:Install 14 Packages 2023-07-12T02:05:53.703 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 8 Packages 2023-07-12T02:05:53.703 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:05:53.704 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 47 M 2023-07-12T02:05:53.704 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-12T02:05:57.765 INFO:teuthology.orchestra.run.smithi037.stdout:(1/22): libpmemblk-1.6.1-1.el8.x86_64.rpm 27 kB/s | 92 kB 00:03 2023-07-12T02:05:57.790 INFO:teuthology.orchestra.run.smithi037.stdout:(2/22): python2-2.7.18-12.module_el8+299+aa6e9a 32 kB/s | 110 kB 00:03 2023-07-12T02:05:58.640 INFO:teuthology.orchestra.run.smithi037.stdout:(3/22): fio-3.19-4.el8.x86_64.rpm 125 kB/s | 538 kB 00:04 2023-07-12T02:06:01.324 INFO:teuthology.orchestra.run.smithi037.stdout:(4/22): python2-pip-wheel-9.0.3-19.module_el8+2 333 kB/s | 892 kB 00:02 2023-07-12T02:06:01.407 INFO:teuthology.orchestra.run.smithi037.stdout:(5/22): python2-pip-9.0.3-19.module_el8+299+aa6 515 kB/s | 1.8 MB 00:03 2023-07-12T02:06:02.049 INFO:teuthology.orchestra.run.smithi037.stdout:(6/22): python2-setuptools-wheel-39.0.1-13.modu 448 kB/s | 287 kB 00:00 2023-07-12T02:06:02.216 INFO:teuthology.orchestra.run.smithi037.stdout:(7/22): python2-wheel-wheel-0.31.1-3.module_el8 268 kB/s | 44 kB 00:00 2023-07-12T02:06:02.383 INFO:teuthology.orchestra.run.smithi037.stdout:(8/22): daxctl-libs-71.1-7.el8.x86_64.rpm 254 kB/s | 42 kB 00:00 2023-07-12T02:06:02.483 INFO:teuthology.orchestra.run.smithi037.stdout:(9/22): dump-0.4-0.36.b46.el8.x86_64.rpm 1.6 MB/s | 164 kB 00:00 2023-07-12T02:06:02.550 INFO:teuthology.orchestra.run.smithi037.stdout:(10/22): ndctl-libs-71.1-7.el8.x86_64.rpm 1.2 MB/s | 80 kB 00:00 2023-07-12T02:06:02.609 INFO:teuthology.orchestra.run.smithi037.stdout:(11/22): rmt-1.5.3-13.el8.x86_64.rpm 885 kB/s | 51 kB 00:00 2023-07-12T02:06:03.193 INFO:teuthology.orchestra.run.smithi037.stdout:(12/22): indent-2.2.13-2.el8.x86_64.rpm 320 kB/s | 187 kB 00:00 2023-07-12T02:06:04.018 INFO:teuthology.orchestra.run.smithi037.stdout:(13/22): python2-setuptools-39.0.1-13.module_el 261 kB/s | 702 kB 00:02 2023-07-12T02:06:04.043 INFO:teuthology.orchestra.run.smithi037.stdout:(14/22): gcc-gdb-plugin-8.5.0-20.el8.x86_64.rpm 142 kB/s | 121 kB 00:00 2023-07-12T02:06:04.993 INFO:teuthology.orchestra.run.smithi037.stdout:(15/22): cpp-8.5.0-20.el8.x86_64.rpm 11 MB/s | 10 MB 00:00 2023-07-12T02:06:05.060 INFO:teuthology.orchestra.run.smithi037.stdout:(16/22): gcc-plugin-annobin-8.5.0-20.el8.x86_64 539 kB/s | 36 kB 00:00 2023-07-12T02:06:05.119 INFO:teuthology.orchestra.run.smithi037.stdout:(17/22): libgcc-8.5.0-20.el8.x86_64.rpm 1.4 MB/s | 81 kB 00:00 2023-07-12T02:06:05.186 INFO:teuthology.orchestra.run.smithi037.stdout:(18/22): libgomp-8.5.0-20.el8.x86_64.rpm 3.1 MB/s | 208 kB 00:00 2023-07-12T02:06:05.295 INFO:teuthology.orchestra.run.smithi037.stdout:(19/22): sqlite-3.26.0-18.el8.x86_64.rpm 6.0 MB/s | 668 kB 00:00 2023-07-12T02:06:05.395 INFO:teuthology.orchestra.run.smithi037.stdout:(20/22): sqlite-libs-3.26.0-18.el8.x86_64.rpm 5.7 MB/s | 581 kB 00:00 2023-07-12T02:06:05.828 INFO:teuthology.orchestra.run.smithi037.stdout:(21/22): gcc-8.5.0-20.el8.x86_64.rpm 13 MB/s | 24 MB 00:01 2023-07-12T02:06:10.074 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:06:10.079 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:06:11.055 INFO:teuthology.orchestra.run.smithi037.stdout:(22/22): python2-libs-2.7.18-12.module_el8+299+ 498 kB/s | 6.5 MB 00:13 2023-07-12T02:06:11.056 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-12T02:06:11.056 INFO:teuthology.orchestra.run.smithi037.stdout:Total 2.7 MB/s | 47 MB 00:17 2023-07-12T02:06:11.778 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-12T02:06:11.899 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-12T02:06:11.899 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-12T02:06:12.397 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-12T02:06:12.402 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-12T02:06:13.599 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-12T02:06:13.736 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libgcc-8.5.0-20.el8.x86_64 1/30 2023-07-12T02:06:13.889 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libgcc-8.5.0-20.el8.x86_64 1/30 2023-07-12T02:06:14.051 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : sqlite-libs-3.26.0-18.el8.x86_64 2/30 2023-07-12T02:06:14.228 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 3/30 2023-07-12T02:06:14.320 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 3/30 2023-07-12T02:06:14.461 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 4/30 2023-07-12T02:06:14.546 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 4/30 2023-07-12T02:06:14.652 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 5/30 2023-07-12T02:06:14.744 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 5/30 2023-07-12T02:06:14.886 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libgomp-8.5.0-20.el8.x86_64 6/30 2023-07-12T02:06:15.943 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libgomp-8.5.0-20.el8.x86_64 6/30 2023-07-12T02:06:16.269 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : cpp-8.5.0-20.el8.x86_64 7/30 2023-07-12T02:06:18.153 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cpp-8.5.0-20.el8.x86_64 7/30 2023-07-12T02:06:18.377 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : gcc-8.5.0-20.el8.x86_64 8/30 2023-07-12T02:06:18.495 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: gcc-8.5.0-20.el8.x86_64 8/30 2023-07-12T02:06:18.666 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 9/30 2023-07-12T02:06:18.811 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 10/30 2023-07-12T02:06:20.409 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 11/30 2023-07-12T02:06:21.181 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 12/30 2023-07-12T02:06:21.816 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 13/30 2023-07-12T02:06:22.018 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 14/30 2023-07-12T02:06:22.169 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 15/30 2023-07-12T02:06:22.216 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 15/30 2023-07-12T02:06:22.368 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 16/30 2023-07-12T02:06:22.535 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : gcc-gdb-plugin-8.5.0-20.el8.x86_64 17/30 2023-07-12T02:06:22.615 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-20.el8.x86_64 17/30 2023-07-12T02:06:22.777 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : gcc-plugin-annobin-8.5.0-20.el8.x86_64 18/30 2023-07-12T02:06:22.913 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: gcc-plugin-annobin-8.5.0-20.el8.x86_64 18/30 2023-07-12T02:06:23.155 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fio-3.19-4.el8.x86_64 19/30 2023-07-12T02:06:23.387 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : sqlite-3.26.0-18.el8.x86_64 20/30 2023-07-12T02:06:23.564 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : indent-2.2.13-2.el8.x86_64 21/30 2023-07-12T02:06:23.694 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 22/30 2023-07-12T02:06:23.695 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : gcc-gdb-plugin-8.5.0-19.el8.x86_64 23/30 2023-07-12T02:06:23.920 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-19.el8.x86_64 23/30 2023-07-12T02:06:23.920 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : gcc-plugin-annobin-8.5.0-19.el8.x86_64 24/30 2023-07-12T02:06:24.053 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: gcc-plugin-annobin-8.5.0-19.el8.x86_64 24/30 2023-07-12T02:06:24.076 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: gcc-8.5.0-19.el8.x86_64 25/30 2023-07-12T02:06:24.278 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : gcc-8.5.0-19.el8.x86_64 25/30 2023-07-12T02:06:24.410 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : sqlite-3.26.0-17.el8.x86_64 26/30 2023-07-12T02:06:24.544 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : sqlite-libs-3.26.0-17.el8.x86_64 27/30 2023-07-12T02:06:24.560 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cpp-8.5.0-19.el8.x86_64 28/30 2023-07-12T02:06:24.669 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : cpp-8.5.0-19.el8.x86_64 28/30 2023-07-12T02:06:24.670 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libgcc-8.5.0-19.el8.x86_64 29/30 2023-07-12T02:06:24.869 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libgcc-8.5.0-19.el8.x86_64 29/30 2023-07-12T02:06:24.885 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libgomp-8.5.0-19.el8.x86_64 30/30 2023-07-12T02:06:24.885 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libgomp-8.5.0-19.el8.x86_64 30/30 2023-07-12T02:06:25.733 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libgomp-8.5.0-19.el8.x86_64 30/30 2023-07-12T02:06:25.734 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fio-3.19-4.el8.x86_64 1/30 2023-07-12T02:06:25.734 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/30 2023-07-12T02:06:25.734 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 3/30 2023-07-12T02:06:25.734 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 4/30 2023-07-12T02:06:25.734 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 5/30 2023-07-12T02:06:25.734 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/30 2023-07-12T02:06:25.734 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 7/30 2023-07-12T02:06:25.735 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 8/30 2023-07-12T02:06:25.735 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 9/30 2023-07-12T02:06:25.735 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 10/30 2023-07-12T02:06:25.735 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/30 2023-07-12T02:06:25.735 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 12/30 2023-07-12T02:06:25.735 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 13/30 2023-07-12T02:06:25.735 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : indent-2.2.13-2.el8.x86_64 14/30 2023-07-12T02:06:25.735 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gcc-gdb-plugin-8.5.0-20.el8.x86_64 15/30 2023-07-12T02:06:25.736 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gcc-gdb-plugin-8.5.0-19.el8.x86_64 16/30 2023-07-12T02:06:25.736 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cpp-8.5.0-20.el8.x86_64 17/30 2023-07-12T02:06:25.736 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cpp-8.5.0-19.el8.x86_64 18/30 2023-07-12T02:06:25.736 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gcc-8.5.0-20.el8.x86_64 19/30 2023-07-12T02:06:25.736 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gcc-8.5.0-19.el8.x86_64 20/30 2023-07-12T02:06:25.736 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gcc-plugin-annobin-8.5.0-20.el8.x86_64 21/30 2023-07-12T02:06:25.736 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gcc-plugin-annobin-8.5.0-19.el8.x86_64 22/30 2023-07-12T02:06:25.737 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgcc-8.5.0-20.el8.x86_64 23/30 2023-07-12T02:06:25.737 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgcc-8.5.0-19.el8.x86_64 24/30 2023-07-12T02:06:25.737 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgomp-8.5.0-20.el8.x86_64 25/30 2023-07-12T02:06:25.737 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgomp-8.5.0-19.el8.x86_64 26/30 2023-07-12T02:06:25.737 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : sqlite-3.26.0-18.el8.x86_64 27/30 2023-07-12T02:06:25.737 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : sqlite-3.26.0-17.el8.x86_64 28/30 2023-07-12T02:06:25.738 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : sqlite-libs-3.26.0-18.el8.x86_64 29/30 2023-07-12T02:06:26.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : sqlite-libs-3.26.0-17.el8.x86_64 30/30 2023-07-12T02:06:26.643 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:06:26.643 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2023-07-12T02:06:26.643 INFO:teuthology.orchestra.run.smithi037.stdout: cpp-8.5.0-20.el8.x86_64 gcc-8.5.0-20.el8.x86_64 2023-07-12T02:06:26.643 INFO:teuthology.orchestra.run.smithi037.stdout: gcc-gdb-plugin-8.5.0-20.el8.x86_64 gcc-plugin-annobin-8.5.0-20.el8.x86_64 2023-07-12T02:06:26.644 INFO:teuthology.orchestra.run.smithi037.stdout: libgcc-8.5.0-20.el8.x86_64 libgomp-8.5.0-20.el8.x86_64 2023-07-12T02:06:26.644 INFO:teuthology.orchestra.run.smithi037.stdout: sqlite-3.26.0-18.el8.x86_64 sqlite-libs-3.26.0-18.el8.x86_64 2023-07-12T02:06:26.644 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-12T02:06:26.645 INFO:teuthology.orchestra.run.smithi037.stdout: daxctl-libs-71.1-7.el8.x86_64 2023-07-12T02:06:26.645 INFO:teuthology.orchestra.run.smithi037.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-07-12T02:06:26.645 INFO:teuthology.orchestra.run.smithi037.stdout: fio-3.19-4.el8.x86_64 2023-07-12T02:06:26.645 INFO:teuthology.orchestra.run.smithi037.stdout: indent-2.2.13-2.el8.x86_64 2023-07-12T02:06:26.646 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-07-12T02:06:26.646 INFO:teuthology.orchestra.run.smithi037.stdout: ndctl-libs-71.1-7.el8.x86_64 2023-07-12T02:06:26.646 INFO:teuthology.orchestra.run.smithi037.stdout: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-07-12T02:06:26.646 INFO:teuthology.orchestra.run.smithi037.stdout: python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-07-12T02:06:26.647 INFO:teuthology.orchestra.run.smithi037.stdout: python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-07-12T02:06:26.647 INFO:teuthology.orchestra.run.smithi037.stdout: python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-07-12T02:06:26.647 INFO:teuthology.orchestra.run.smithi037.stdout: python2-setuptools-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-07-12T02:06:26.648 INFO:teuthology.orchestra.run.smithi037.stdout: python2-setuptools-wheel-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-07-12T02:06:26.648 INFO:teuthology.orchestra.run.smithi037.stdout: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e9afa.noarch 2023-07-12T02:06:26.648 INFO:teuthology.orchestra.run.smithi037.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-07-12T02:06:26.648 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:06:26.649 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-12T02:06:26.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo useradd -m fsgqa 2023-07-12T02:06:26.898 INFO:teuthology.orchestra.run.smithi037.stderr:useradd: user 'fsgqa' already exists 2023-07-12T02:06:26.901 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-12T02:06:26.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo groupadd fsgqa 2023-07-12T02:06:26.969 INFO:teuthology.orchestra.run.smithi037.stderr:groupadd: group 'fsgqa' already exists 2023-07-12T02:06:26.971 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-12T02:06:26.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo useradd fsgqa2 2023-07-12T02:06:27.810 DEBUG:teuthology.orchestra.run.smithi037:> sudo useradd 123456-fsgqa 2023-07-12T02:06:28.626 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-07-12T02:06:28.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.823+0000 7f05fd9ff700 1 Processor -- start 2023-07-12T02:06:28.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.823+0000 7f05fd9ff700 1 -- start start 2023-07-12T02:06:28.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.824+0000 7f05fd9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05f8156be0 0x7f05f80cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:06:28.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.824+0000 7f05fd9ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f05f80cd600 0x7f05f80cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:06:28.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.824+0000 7f05fd9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05f80cb4f0 0x7f05f8070340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:06:28.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.824+0000 7f05fd9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f8156fb0 con 0x7f05f8156be0 2023-07-12T02:06:28.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.824+0000 7f05fd9ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f815da40 con 0x7f05f80cd600 2023-07-12T02:06:28.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.824+0000 7f05fd9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f80cbc00 con 0x7f05f80cb4f0 2023-07-12T02:06:28.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.824+0000 7f05f6ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05f8156be0 0x7f05f80cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:06:28.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.825+0000 7f05f6ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05f8156be0 0x7f05f80cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60294/0 (socket says 172.21.15.37:60294) 2023-07-12T02:06:28.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.825+0000 7f05f6ffd700 1 -- 172.21.15.37:0/3775086512 learned_addr learned my addr 172.21.15.37:0/3775086512 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:06:28.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.825+0000 7f05f67fc700 1 --2- 172.21.15.37:0/3775086512 >> v2:172.21.15.196:3300/0 conn(0x7f05f80cd600 0x7f05f80cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:06:28.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.825+0000 7f05f77fe700 1 --2- 172.21.15.37:0/3775086512 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05f80cb4f0 0x7f05f8070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:06:28.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.825+0000 7f05f6ffd700 1 -- 172.21.15.37:0/3775086512 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05f80cb4f0 msgr2=0x7f05f8070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:06:28.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.825+0000 7f05f6ffd700 1 --2- 172.21.15.37:0/3775086512 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05f80cb4f0 0x7f05f8070340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:28.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.825+0000 7f05f6ffd700 1 -- 172.21.15.37:0/3775086512 >> v2:172.21.15.196:3300/0 conn(0x7f05f80cd600 msgr2=0x7f05f80cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:06:28.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.825+0000 7f05f6ffd700 1 --2- 172.21.15.37:0/3775086512 >> v2:172.21.15.196:3300/0 conn(0x7f05f80cd600 0x7f05f80cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:28.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.825+0000 7f05f6ffd700 1 -- 172.21.15.37:0/3775086512 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f80cda50 con 0x7f05f8156be0 2023-07-12T02:06:28.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.825+0000 7f05f77fe700 1 --2- 172.21.15.37:0/3775086512 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05f80cb4f0 0x7f05f8070340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:06:28.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.825+0000 7f05f6ffd700 1 --2- 172.21.15.37:0/3775086512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f8156be0 0x7f05f80cd0c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f05f80c2280 tx=0x7f05e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0396a74d21566c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:06:28.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.826+0000 7f05f5ffb700 1 -- 172.21.15.37:0/3775086512 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e8011830 con 0x7f05f8156be0 2023-07-12T02:06:28.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.826+0000 7f05f5ffb700 1 -- 172.21.15.37:0/3775086512 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e8011990 con 0x7f05f8156be0 2023-07-12T02:06:28.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.826+0000 7f05f5ffb700 1 -- 172.21.15.37:0/3775086512 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e8011d20 con 0x7f05f8156be0 2023-07-12T02:06:28.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.826+0000 7f05fd9ff700 1 -- 172.21.15.37:0/3775086512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f8156be0 msgr2=0x7f05f80cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:06:28.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.826+0000 7f05fd9ff700 1 --2- 172.21.15.37:0/3775086512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f8156be0 0x7f05f80cd0c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f05f80c2280 tx=0x7f05e8009c00 comp rx=0 tx=0).stop 2023-07-12T02:06:28.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.826+0000 7f05fd9ff700 1 -- 172.21.15.37:0/3775086512 shutdown_connections 2023-07-12T02:06:28.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.826+0000 7f05fd9ff700 1 --2- 172.21.15.37:0/3775086512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f8156be0 0x7f05f80cd0c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:28.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.826+0000 7f05fd9ff700 1 --2- 172.21.15.37:0/3775086512 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05f80cb4f0 0x7f05f8070340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:28.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.826+0000 7f05fd9ff700 1 --2- 172.21.15.37:0/3775086512 >> v2:172.21.15.196:3300/0 conn(0x7f05f80cd600 0x7f05f80cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:28.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.826+0000 7f05fd9ff700 1 -- 172.21.15.37:0/3775086512 >> 172.21.15.37:0/3775086512 conn(0x7f05f80b0390 msgr2=0x7f05f80b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:06:28.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.826+0000 7f05fd9ff700 1 -- 172.21.15.37:0/3775086512 shutdown_connections 2023-07-12T02:06:28.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.826+0000 7f05fd9ff700 1 -- 172.21.15.37:0/3775086512 wait complete. 2023-07-12T02:06:28.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.828+0000 7f05fd9ff700 1 Processor -- start 2023-07-12T02:06:28.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.828+0000 7f05fd9ff700 1 -- start start 2023-07-12T02:06:28.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.829+0000 7f05fd9ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05f80cb4f0 0x7f05f8149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:06:28.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.829+0000 7f05fd9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f80cd600 0x7f05f80c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:06:28.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.829+0000 7f05fd9ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05f8156be0 0x7f05f815b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:06:28.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.829+0000 7f05fd9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f814a250 con 0x7f05f80cd600 2023-07-12T02:06:28.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.829+0000 7f05fd9ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f80c2420 con 0x7f05f8156be0 2023-07-12T02:06:28.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.829+0000 7f05fd9ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f8153770 con 0x7f05f80cb4f0 2023-07-12T02:06:28.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.830+0000 7f05f67fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f80cd600 0x7f05f80c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:06:28.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.830+0000 7f05f67fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f80cd600 0x7f05f80c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60308/0 (socket says 172.21.15.37:60308) 2023-07-12T02:06:28.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.830+0000 7f05f67fc700 1 -- 172.21.15.37:0/1937514786 learned_addr learned my addr 172.21.15.37:0/1937514786 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:06:28.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.830+0000 7f05f77fe700 1 --2- 172.21.15.37:0/1937514786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05f8156be0 0x7f05f815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:06:28.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.830+0000 7f05f6ffd700 1 --2- 172.21.15.37:0/1937514786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05f80cb4f0 0x7f05f8149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:06:28.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.830+0000 7f05f67fc700 1 -- 172.21.15.37:0/1937514786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05f80cb4f0 msgr2=0x7f05f8149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:06:28.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.830+0000 7f05f67fc700 1 --2- 172.21.15.37:0/1937514786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05f80cb4f0 0x7f05f8149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:28.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.830+0000 7f05f67fc700 1 -- 172.21.15.37:0/1937514786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05f8156be0 msgr2=0x7f05f815b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:06:28.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.830+0000 7f05f67fc700 1 --2- 172.21.15.37:0/1937514786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05f8156be0 0x7f05f815b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:28.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.830+0000 7f05f67fc700 1 -- 172.21.15.37:0/1937514786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e8009550 con 0x7f05f80cd600 2023-07-12T02:06:28.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.830+0000 7f05f6ffd700 1 --2- 172.21.15.37:0/1937514786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05f80cb4f0 0x7f05f8149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:06:28.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.830+0000 7f05f67fc700 1 --2- 172.21.15.37:0/1937514786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f80cd600 0x7f05f80c49d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00e9b0 tx=0x7f05ec00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:06:28.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.831+0000 7f05dffff700 1 -- 172.21.15.37:0/1937514786 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec009710 con 0x7f05f80cd600 2023-07-12T02:06:28.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.831+0000 7f05dffff700 1 -- 172.21.15.37:0/1937514786 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ec00c850 con 0x7f05f80cd600 2023-07-12T02:06:28.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.831+0000 7f05dffff700 1 -- 172.21.15.37:0/1937514786 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec00cbc0 con 0x7f05f80cd600 2023-07-12T02:06:28.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.831+0000 7f05fd9ff700 1 -- 172.21.15.37:0/1937514786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f80c7aa0 con 0x7f05f80cd600 2023-07-12T02:06:28.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.831+0000 7f05fd9ff700 1 -- 172.21.15.37:0/1937514786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f80c8040 con 0x7f05f80cd600 2023-07-12T02:06:28.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.832+0000 7f05fd9ff700 1 -- 172.21.15.37:0/1937514786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f80c2590 con 0x7f05f80cd600 2023-07-12T02:06:28.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.833+0000 7f05dffff700 1 -- 172.21.15.37:0/1937514786 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f05ec00cd20 con 0x7f05f80cd600 2023-07-12T02:06:28.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.834+0000 7f05dffff700 1 --2- 172.21.15.37:0/1937514786 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f05e406ad10 0x7f05e406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:06:28.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.834+0000 7f05dffff700 1 -- 172.21.15.37:0/1937514786 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f05ec089680 con 0x7f05f80cd600 2023-07-12T02:06:28.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.834+0000 7f05f6ffd700 1 --2- 172.21.15.37:0/1937514786 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f05e406ad10 0x7f05e406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:06:28.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.835+0000 7f05f6ffd700 1 --2- 172.21.15.37:0/1937514786 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f05e406ad10 0x7f05e406d1c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f05e8014040 tx=0x7f05e8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:06:28.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:28.838+0000 7f05dffff700 1 -- 172.21.15.37:0/1937514786 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f05ec054550 con 0x7f05f80cd600 2023-07-12T02:06:29.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.123+0000 7f05fd9ff700 1 -- 172.21.15.37:0/1937514786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f05f804ea60 con 0x7f05f80cd600 2023-07-12T02:06:29.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.123+0000 7f05dffff700 1 -- 172.21.15.37:0/1937514786 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f05ec057b70 con 0x7f05f80cd600 2023-07-12T02:06:29.127 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:06:29.127 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","modified":"2023-07-12T02:02:41.504969Z","created":"2023-07-12T02:02:41.504969Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-07-12T02:06:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.125+0000 7f05fd9ff700 1 -- 172.21.15.37:0/1937514786 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f05e406ad10 msgr2=0x7f05e406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:06:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.125+0000 7f05fd9ff700 1 --2- 172.21.15.37:0/1937514786 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f05e406ad10 0x7f05e406d1c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f05e8014040 tx=0x7f05e8008030 comp rx=0 tx=0).stop 2023-07-12T02:06:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.125+0000 7f05fd9ff700 1 -- 172.21.15.37:0/1937514786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f80cd600 msgr2=0x7f05f80c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.125+0000 7f05fd9ff700 1 --2- 172.21.15.37:0/1937514786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f80cd600 0x7f05f80c49d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00e9b0 tx=0x7f05ec00ecc0 comp rx=0 tx=0).stop 2023-07-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.125+0000 7f05fd9ff700 1 -- 172.21.15.37:0/1937514786 shutdown_connections 2023-07-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.125+0000 7f05fd9ff700 1 --2- 172.21.15.37:0/1937514786 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f05e406ad10 0x7f05e406d1c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.125+0000 7f05fd9ff700 1 --2- 172.21.15.37:0/1937514786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05f8156be0 0x7f05f815b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.126+0000 7f05fd9ff700 1 --2- 172.21.15.37:0/1937514786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05f80cb4f0 0x7f05f8149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.126+0000 7f05fd9ff700 1 --2- 172.21.15.37:0/1937514786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f80cd600 0x7f05f80c49d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.126+0000 7f05fd9ff700 1 -- 172.21.15.37:0/1937514786 >> 172.21.15.37:0/1937514786 conn(0x7f05f80b0390 msgr2=0x7f05f80ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:06:29.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.126+0000 7f05fd9ff700 1 -- 172.21.15.37:0/1937514786 shutdown_connections 2023-07-12T02:06:29.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.126+0000 7f05fd9ff700 1 -- 172.21.15.37:0/1937514786 wait complete. 2023-07-12T02:06:29.131 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 1 2023-07-12T02:06:29.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-07-12T02:06:29.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.346+0000 7f49e9dff700 1 Processor -- start 2023-07-12T02:06:29.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.346+0000 7f49e9dff700 1 -- start start 2023-07-12T02:06:29.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.347+0000 7f49e9dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49e415c460 0x7f49e40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:06:29.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.347+0000 7f49e9dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49e40d2640 0x7f49e40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:06:29.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.347+0000 7f49e9dff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e40d1790 con 0x7f49e40cf720 2023-07-12T02:06:29.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.347+0000 7f49e9dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e40cedd0 con 0x7f49e40d2640 2023-07-12T02:06:29.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.347+0000 7f49e9dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40cd950 con 0x7f49e415c460 2023-07-12T02:06:29.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.347+0000 7f49e2ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49e40d2640 0x7f49e40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:06:29.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.347+0000 7f49e2ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49e40d2640 0x7f49e40cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60314/0 (socket says 172.21.15.37:60314) 2023-07-12T02:06:29.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.347+0000 7f49e2ffd700 1 -- 172.21.15.37:0/659633453 learned_addr learned my addr 172.21.15.37:0/659633453 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:06:29.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.348+0000 7f49e2ffd700 1 -- 172.21.15.37:0/659633453 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49e415c460 msgr2=0x7f49e40b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:06:29.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.348+0000 7f49e2ffd700 1 --2- 172.21.15.37:0/659633453 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49e415c460 0x7f49e40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:29.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.348+0000 7f49e2ffd700 1 -- 172.21.15.37:0/659633453 >> v1:172.21.15.196:6789/0 conn(0x7f49e40cf720 legacy=0x7f49e40d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:06:29.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.348+0000 7f49e2ffd700 1 -- 172.21.15.37:0/659633453 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e40d14b0 con 0x7f49e40d2640 2023-07-12T02:06:29.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.348+0000 7f49e2ffd700 1 --2- 172.21.15.37:0/659633453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e40d2640 0x7f49e40cf1e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f49d80098f0 tx=0x7f49d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751e836ff8160ec1 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:06:29.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.348+0000 7f49e27fc700 1 -- 172.21.15.37:0/659633453 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d8004230 con 0x7f49e40d2640 2023-07-12T02:06:29.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.348+0000 7f49e27fc700 1 -- 172.21.15.37:0/659633453 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d8004390 con 0x7f49e40d2640 2023-07-12T02:06:29.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.348+0000 7f49e27fc700 1 -- 172.21.15.37:0/659633453 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d80036a0 con 0x7f49e40d2640 2023-07-12T02:06:29.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.349+0000 7f49e9dff700 1 -- 172.21.15.37:0/659633453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e40d2640 msgr2=0x7f49e40cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:06:29.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.349+0000 7f49e9dff700 1 --2- 172.21.15.37:0/659633453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e40d2640 0x7f49e40cf1e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f49d80098f0 tx=0x7f49d8009c00 comp rx=0 tx=0).stop 2023-07-12T02:06:29.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.349+0000 7f49e9dff700 1 -- 172.21.15.37:0/659633453 shutdown_connections 2023-07-12T02:06:29.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.349+0000 7f49e9dff700 1 --2- 172.21.15.37:0/659633453 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49e415c460 0x7f49e40b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:29.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.349+0000 7f49e9dff700 1 --2- 172.21.15.37:0/659633453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e40d2640 0x7f49e40cf1e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:29.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.349+0000 7f49e9dff700 1 -- 172.21.15.37:0/659633453 >> 172.21.15.37:0/659633453 conn(0x7f49e4071660 msgr2=0x7f49e4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:06:29.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.349+0000 7f49e9dff700 1 -- 172.21.15.37:0/659633453 shutdown_connections 2023-07-12T02:06:29.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.349+0000 7f49e9dff700 1 -- 172.21.15.37:0/659633453 wait complete. 2023-07-12T02:06:29.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.351+0000 7f49e9dff700 1 Processor -- start 2023-07-12T02:06:29.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.351+0000 7f49e9dff700 1 -- start start 2023-07-12T02:06:29.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.352+0000 7f49e9dff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49e40cf720 0x7f49e40c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:06:29.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.352+0000 7f49e9dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e40d2640 0x7f49e415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:06:29.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.352+0000 7f49e9dff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49e415c460 0x7f49e4153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:06:29.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.352+0000 7f49e9dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e415d560 con 0x7f49e40d2640 2023-07-12T02:06:29.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.352+0000 7f49e9dff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40c6e20 con 0x7f49e415c460 2023-07-12T02:06:29.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.352+0000 7f49e9dff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40c7100 con 0x7f49e40cf720 2023-07-12T02:06:29.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.353+0000 7f49e2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e40d2640 0x7f49e415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:06:29.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.353+0000 7f49e2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e40d2640 0x7f49e415a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60328/0 (socket says 172.21.15.37:60328) 2023-07-12T02:06:29.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.353+0000 7f49e2ffd700 1 -- 172.21.15.37:0/3259603892 learned_addr learned my addr 172.21.15.37:0/3259603892 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:06:29.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.353+0000 7f49e37fe700 1 --2- 172.21.15.37:0/3259603892 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49e40cf720 0x7f49e40c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:06:29.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.353+0000 7f49e3fff700 1 --2- 172.21.15.37:0/3259603892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49e415c460 0x7f49e4153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:06:29.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.353+0000 7f49e2ffd700 1 -- 172.21.15.37:0/3259603892 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49e40cf720 msgr2=0x7f49e40c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:06:29.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.353+0000 7f49e2ffd700 1 --2- 172.21.15.37:0/3259603892 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49e40cf720 0x7f49e40c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:29.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.353+0000 7f49e2ffd700 1 -- 172.21.15.37:0/3259603892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49e415c460 msgr2=0x7f49e4153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:06:29.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.353+0000 7f49e2ffd700 1 --2- 172.21.15.37:0/3259603892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49e415c460 0x7f49e4153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:29.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.353+0000 7f49e2ffd700 1 -- 172.21.15.37:0/3259603892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d8009550 con 0x7f49e40d2640 2023-07-12T02:06:29.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.353+0000 7f49e2ffd700 1 --2- 172.21.15.37:0/3259603892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e40d2640 0x7f49e415a7a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f49e40d3c80 tx=0x7f49d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:06:29.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.354+0000 7f49cbfff700 1 -- 172.21.15.37:0/3259603892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d800b860 con 0x7f49e40d2640 2023-07-12T02:06:29.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.354+0000 7f49cbfff700 1 -- 172.21.15.37:0/3259603892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d800ba00 con 0x7f49e40d2640 2023-07-12T02:06:29.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.354+0000 7f49cbfff700 1 -- 172.21.15.37:0/3259603892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d800bdb0 con 0x7f49e40d2640 2023-07-12T02:06:29.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.354+0000 7f49e9dff700 1 -- 172.21.15.37:0/3259603892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e40c73e0 con 0x7f49e40d2640 2023-07-12T02:06:29.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.354+0000 7f49e9dff700 1 -- 172.21.15.37:0/3259603892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e40c7e40 con 0x7f49e40d2640 2023-07-12T02:06:29.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.355+0000 7f49e9dff700 1 -- 172.21.15.37:0/3259603892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e404ea60 con 0x7f49e40d2640 2023-07-12T02:06:29.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.356+0000 7f49cbfff700 1 -- 172.21.15.37:0/3259603892 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f49d801b440 con 0x7f49e40d2640 2023-07-12T02:06:29.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.357+0000 7f49cbfff700 1 --2- 172.21.15.37:0/3259603892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f49d006ace0 0x7f49d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:06:29.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.357+0000 7f49cbfff700 1 -- 172.21.15.37:0/3259603892 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f49d808aff0 con 0x7f49e40d2640 2023-07-12T02:06:29.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.357+0000 7f49e37fe700 1 --2- 172.21.15.37:0/3259603892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f49d006ace0 0x7f49d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:06:29.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.358+0000 7f49e37fe700 1 --2- 172.21.15.37:0/3259603892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f49d006ace0 0x7f49d006d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f49d4006fd0 tx=0x7f49d4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:06:29.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.361+0000 7f49cbfff700 1 -- 172.21.15.37:0/3259603892 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f49d80bd380 con 0x7f49e40d2640 2023-07-12T02:06:29.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.653+0000 7f49e9dff700 1 -- 172.21.15.37:0/3259603892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f49e40b4fa0 con 0x7f49e40d2640 2023-07-12T02:06:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.653+0000 7f49cbfff700 1 -- 172.21.15.37:0/3259603892 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7f49d8056040 con 0x7f49e40d2640 2023-07-12T02:06:29.657 INFO:teuthology.orchestra.run.smithi037.stdout:[client.admin] 2023-07-12T02:06:29.657 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== 2023-07-12T02:06:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.655+0000 7f49e9dff700 1 -- 172.21.15.37:0/3259603892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f49d006ace0 msgr2=0x7f49d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:06:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.655+0000 7f49e9dff700 1 --2- 172.21.15.37:0/3259603892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f49d006ace0 0x7f49d006d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f49d4006fd0 tx=0x7f49d4008040 comp rx=0 tx=0).stop 2023-07-12T02:06:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.655+0000 7f49e9dff700 1 -- 172.21.15.37:0/3259603892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e40d2640 msgr2=0x7f49e415a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:06:29.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.655+0000 7f49e9dff700 1 --2- 172.21.15.37:0/3259603892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e40d2640 0x7f49e415a7a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f49e40d3c80 tx=0x7f49d8004750 comp rx=0 tx=0).stop 2023-07-12T02:06:29.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.655+0000 7f49e9dff700 1 -- 172.21.15.37:0/3259603892 shutdown_connections 2023-07-12T02:06:29.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.656+0000 7f49e9dff700 1 --2- 172.21.15.37:0/3259603892 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f49d006ace0 0x7f49d006d190 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:29.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.656+0000 7f49e9dff700 1 --2- 172.21.15.37:0/3259603892 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f49e415c460 0x7f49e4153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:29.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.656+0000 7f49e9dff700 1 --2- 172.21.15.37:0/3259603892 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49e40cf720 0x7f49e40c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:29.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.656+0000 7f49e9dff700 1 --2- 172.21.15.37:0/3259603892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e40d2640 0x7f49e415a7a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:06:29.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.656+0000 7f49e9dff700 1 -- 172.21.15.37:0/3259603892 >> 172.21.15.37:0/3259603892 conn(0x7f49e4071660 msgr2=0x7f49e4160700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:06:29.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.656+0000 7f49e9dff700 1 -- 172.21.15.37:0/3259603892 shutdown_connections 2023-07-12T02:06:29.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:06:29.656+0000 7f49e9dff700 1 -- 172.21.15.37:0/3259603892 wait complete. 2023-07-12T02:06:29.677 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:06:29.678 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/tmp/tmp.MWP0gTBaNBxfstests-dev/local.config 2023-07-12T02:06:29.747 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.37:6789:/test export TEST_DIR=/tmp/tmp.JoBPUdJofOtest export SCRATCH_DEV=172.21.15.37:6789:/scratch export SCRATCH_MNT=/tmp/tmp.4XvNFStKfQscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q==" 2023-07-12T02:06:29.747 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:06:29.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/tmp/tmp.MWP0gTBaNBxfstests-dev/ceph.exclude 2023-07-12T02:06:29.856 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo make) 2023-07-12T02:06:29.990 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize -cfi 2023-07-12T02:06:30.468 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: putting auxiliary files in '.'. 2023-07-12T02:06:30.468 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file './config.guess' 2023-07-12T02:06:30.478 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file './config.sub' 2023-07-12T02:06:30.488 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file './install-sh' 2023-07-12T02:06:30.499 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file './ltmain.sh' 2023-07-12T02:06:30.560 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-07-12T02:06:30.560 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-07-12T02:06:30.573 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-07-12T02:06:30.585 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-07-12T02:06:30.598 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-07-12T02:06:30.611 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-07-12T02:06:30.627 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-07-12T02:06:30.631 INFO:teuthology.orchestra.run.smithi037.stdout:cp include/install-sh . 2023-07-12T02:06:30.633 INFO:teuthology.orchestra.run.smithi037.stdout:aclocal -I m4 2023-07-12T02:06:31.927 INFO:teuthology.orchestra.run.smithi037.stdout:autoheader 2023-07-12T02:06:32.315 INFO:teuthology.orchestra.run.smithi037.stdout:autoconf 2023-07-12T02:06:32.532 INFO:teuthology.orchestra.run.smithi037.stdout:./configure \ 2023-07-12T02:06:32.532 INFO:teuthology.orchestra.run.smithi037.stdout: --libexecdir=/usr/lib \ 2023-07-12T02:06:32.533 INFO:teuthology.orchestra.run.smithi037.stdout: --exec_prefix=/var/lib 2023-07-12T02:06:32.899 INFO:teuthology.orchestra.run.smithi037.stdout:checking build system type... x86_64-pc-linux-gnu 2023-07-12T02:06:32.899 INFO:teuthology.orchestra.run.smithi037.stdout:checking host system type... x86_64-pc-linux-gnu 2023-07-12T02:06:32.903 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to print strings... printf 2023-07-12T02:06:32.903 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gcc... gcc 2023-07-12T02:06:33.044 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether the C compiler works... yes 2023-07-12T02:06:33.044 INFO:teuthology.orchestra.run.smithi037.stdout:checking for C compiler default output file name... a.out 2023-07-12T02:06:33.095 INFO:teuthology.orchestra.run.smithi037.stdout:checking for suffix of executables... 2023-07-12T02:06:33.161 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether we are cross compiling... no 2023-07-12T02:06:33.199 INFO:teuthology.orchestra.run.smithi037.stdout:checking for suffix of object files... o 2023-07-12T02:06:33.232 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether we are using the GNU C compiler... yes 2023-07-12T02:06:33.267 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether gcc accepts -g... yes 2023-07-12T02:06:33.315 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gcc option to accept ISO C89... none needed 2023-07-12T02:06:33.323 INFO:teuthology.orchestra.run.smithi037.stdout:checking for a sed that does not truncate output... /bin/sed 2023-07-12T02:06:33.328 INFO:teuthology.orchestra.run.smithi037.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-07-12T02:06:33.331 INFO:teuthology.orchestra.run.smithi037.stdout:checking for egrep... /bin/grep -E 2023-07-12T02:06:33.334 INFO:teuthology.orchestra.run.smithi037.stdout:checking for fgrep... /bin/grep -F 2023-07-12T02:06:33.342 INFO:teuthology.orchestra.run.smithi037.stdout:checking for ld used by gcc... /bin/ld 2023-07-12T02:06:33.346 INFO:teuthology.orchestra.run.smithi037.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-07-12T02:06:33.358 INFO:teuthology.orchestra.run.smithi037.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-07-12T02:06:33.398 INFO:teuthology.orchestra.run.smithi037.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-07-12T02:06:33.398 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether ln -s works... yes 2023-07-12T02:06:33.416 INFO:teuthology.orchestra.run.smithi037.stdout:checking the maximum length of command line arguments... 1572864 2023-07-12T02:06:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-07-12T02:06:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-07-12T02:06:33.422 INFO:teuthology.orchestra.run.smithi037.stdout:checking for /bin/ld option to reload object files... -r 2023-07-12T02:06:33.423 INFO:teuthology.orchestra.run.smithi037.stdout:checking for objdump... objdump 2023-07-12T02:06:33.423 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to recognize dependent libraries... pass_all 2023-07-12T02:06:33.424 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dlltool... no 2023-07-12T02:06:33.424 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-07-12T02:06:33.424 INFO:teuthology.orchestra.run.smithi037.stdout:checking for ar... ar 2023-07-12T02:06:33.483 INFO:teuthology.orchestra.run.smithi037.stdout:checking for archiver @FILE support... @ 2023-07-12T02:06:33.483 INFO:teuthology.orchestra.run.smithi037.stdout:checking for strip... strip 2023-07-12T02:06:33.484 INFO:teuthology.orchestra.run.smithi037.stdout:checking for ranlib... ranlib 2023-07-12T02:06:33.484 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gawk... gawk 2023-07-12T02:06:33.595 INFO:teuthology.orchestra.run.smithi037.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-07-12T02:06:33.598 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sysroot... no 2023-07-12T02:06:33.605 INFO:teuthology.orchestra.run.smithi037.stdout:checking for a working dd... /bin/dd 2023-07-12T02:06:33.614 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-07-12T02:06:33.642 INFO:teuthology.orchestra.run.smithi037.stdout:checking for mt... no 2023-07-12T02:06:33.648 INFO:teuthology.orchestra.run.smithi037.stdout:checking if : is a manifest tool... no 2023-07-12T02:06:33.708 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to run the C preprocessor... gcc -E 2023-07-12T02:06:33.948 INFO:teuthology.orchestra.run.smithi037.stdout:checking for ANSI C header files... yes 2023-07-12T02:06:33.992 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/types.h... yes 2023-07-12T02:06:34.053 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/stat.h... yes 2023-07-12T02:06:34.105 INFO:teuthology.orchestra.run.smithi037.stdout:checking for stdlib.h... yes 2023-07-12T02:06:34.159 INFO:teuthology.orchestra.run.smithi037.stdout:checking for string.h... yes 2023-07-12T02:06:34.216 INFO:teuthology.orchestra.run.smithi037.stdout:checking for memory.h... yes 2023-07-12T02:06:34.269 INFO:teuthology.orchestra.run.smithi037.stdout:checking for strings.h... yes 2023-07-12T02:06:34.334 INFO:teuthology.orchestra.run.smithi037.stdout:checking for inttypes.h... yes 2023-07-12T02:06:34.388 INFO:teuthology.orchestra.run.smithi037.stdout:checking for stdint.h... yes 2023-07-12T02:06:34.462 INFO:teuthology.orchestra.run.smithi037.stdout:checking for unistd.h... yes 2023-07-12T02:06:34.524 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dlfcn.h... yes 2023-07-12T02:06:34.533 INFO:teuthology.orchestra.run.smithi037.stdout:checking for objdir... .libs 2023-07-12T02:06:34.668 INFO:teuthology.orchestra.run.smithi037.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-07-12T02:06:34.669 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-07-12T02:06:34.707 INFO:teuthology.orchestra.run.smithi037.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-07-12T02:06:34.745 INFO:teuthology.orchestra.run.smithi037.stdout:checking if gcc static flag -static works... no 2023-07-12T02:06:34.799 INFO:teuthology.orchestra.run.smithi037.stdout:checking if gcc supports -c -o file.o... yes 2023-07-12T02:06:34.799 INFO:teuthology.orchestra.run.smithi037.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-07-12T02:06:34.814 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-07-12T02:06:34.863 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether -lc should be explicitly linked in... no 2023-07-12T02:06:34.959 INFO:teuthology.orchestra.run.smithi037.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-07-12T02:06:34.959 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to hardcode library paths into programs... immediate 2023-07-12T02:06:34.972 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether stripping libraries is possible... yes 2023-07-12T02:06:34.973 INFO:teuthology.orchestra.run.smithi037.stdout:checking if libtool supports shared libraries... yes 2023-07-12T02:06:34.973 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether to build shared libraries... yes 2023-07-12T02:06:34.973 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether to build static libraries... yes 2023-07-12T02:06:34.984 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gcc... (cached) gcc 2023-07-12T02:06:35.023 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-12T02:06:35.023 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-12T02:06:35.024 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-12T02:06:35.024 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gmake... /usr/bin/gmake 2023-07-12T02:06:35.024 INFO:teuthology.orchestra.run.smithi037.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-07-12T02:06:35.025 INFO:teuthology.orchestra.run.smithi037.stdout:checking for tar... /bin/tar 2023-07-12T02:06:35.025 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gzip... /bin/gzip 2023-07-12T02:06:35.041 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether gcc -MM is supported... yes 2023-07-12T02:06:35.042 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sort... /bin/sort 2023-07-12T02:06:35.042 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether ln -s works... yes 2023-07-12T02:06:35.042 INFO:teuthology.orchestra.run.smithi037.stdout:checking for rpm... /bin/rpm 2023-07-12T02:06:35.051 INFO:teuthology.orchestra.run.smithi037.stdout:checking for rpmbuild... no 2023-07-12T02:06:35.110 INFO:teuthology.orchestra.run.smithi037.stdout:checking assert.h usability... yes 2023-07-12T02:06:35.126 INFO:teuthology.orchestra.run.smithi037.stdout:checking assert.h presence... yes 2023-07-12T02:06:35.126 INFO:teuthology.orchestra.run.smithi037.stdout:checking for assert.h... yes 2023-07-12T02:06:35.185 INFO:teuthology.orchestra.run.smithi037.stdout:checking bstring.h usability... no 2023-07-12T02:06:35.209 INFO:teuthology.orchestra.run.smithi037.stdout:checking bstring.h presence... no 2023-07-12T02:06:35.209 INFO:teuthology.orchestra.run.smithi037.stdout:checking for bstring.h... no 2023-07-12T02:06:35.259 INFO:teuthology.orchestra.run.smithi037.stdout:checking libgen.h usability... yes 2023-07-12T02:06:35.275 INFO:teuthology.orchestra.run.smithi037.stdout:checking libgen.h presence... yes 2023-07-12T02:06:35.276 INFO:teuthology.orchestra.run.smithi037.stdout:checking for libgen.h... yes 2023-07-12T02:06:35.334 INFO:teuthology.orchestra.run.smithi037.stdout:checking dirent.h usability... yes 2023-07-12T02:06:35.351 INFO:teuthology.orchestra.run.smithi037.stdout:checking dirent.h presence... yes 2023-07-12T02:06:35.351 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dirent.h... yes 2023-07-12T02:06:35.435 INFO:teuthology.orchestra.run.smithi037.stdout:checking errno.h usability... yes 2023-07-12T02:06:35.452 INFO:teuthology.orchestra.run.smithi037.stdout:checking errno.h presence... yes 2023-07-12T02:06:35.452 INFO:teuthology.orchestra.run.smithi037.stdout:checking for errno.h... yes 2023-07-12T02:06:35.516 INFO:teuthology.orchestra.run.smithi037.stdout:checking malloc.h usability... yes 2023-07-12T02:06:35.534 INFO:teuthology.orchestra.run.smithi037.stdout:checking malloc.h presence... yes 2023-07-12T02:06:35.534 INFO:teuthology.orchestra.run.smithi037.stdout:checking for malloc.h... yes 2023-07-12T02:06:35.591 INFO:teuthology.orchestra.run.smithi037.stdout:checking uuid.h usability... no 2023-07-12T02:06:35.615 INFO:teuthology.orchestra.run.smithi037.stdout:checking uuid.h presence... no 2023-07-12T02:06:35.616 INFO:teuthology.orchestra.run.smithi037.stdout:checking for uuid.h... no 2023-07-12T02:06:35.678 INFO:teuthology.orchestra.run.smithi037.stdout:checking uuid/uuid.h usability... yes 2023-07-12T02:06:35.697 INFO:teuthology.orchestra.run.smithi037.stdout:checking uuid/uuid.h presence... yes 2023-07-12T02:06:35.697 INFO:teuthology.orchestra.run.smithi037.stdout:checking for uuid/uuid.h... yes 2023-07-12T02:06:35.755 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/uuid.h usability... no 2023-07-12T02:06:35.779 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/uuid.h presence... no 2023-07-12T02:06:35.779 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/uuid.h... no 2023-07-12T02:06:35.830 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/file.h usability... yes 2023-07-12T02:06:35.847 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/file.h presence... yes 2023-07-12T02:06:35.848 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/file.h... yes 2023-07-12T02:06:35.906 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fcntl.h usability... yes 2023-07-12T02:06:35.923 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fcntl.h presence... yes 2023-07-12T02:06:35.923 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/fcntl.h... yes 2023-07-12T02:06:35.980 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/syssgi.h usability... no 2023-07-12T02:06:36.004 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/syssgi.h presence... no 2023-07-12T02:06:36.004 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/syssgi.h... no 2023-07-12T02:06:36.078 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/param.h usability... yes 2023-07-12T02:06:36.099 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/param.h presence... yes 2023-07-12T02:06:36.100 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/param.h... yes 2023-07-12T02:06:36.114 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/stat.h... (cached) yes 2023-07-12T02:06:36.176 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/statvfs.h usability... yes 2023-07-12T02:06:36.192 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/statvfs.h presence... yes 2023-07-12T02:06:36.193 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/statvfs.h... yes 2023-07-12T02:06:36.250 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/time.h usability... yes 2023-07-12T02:06:36.267 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/time.h presence... yes 2023-07-12T02:06:36.267 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/time.h... yes 2023-07-12T02:06:36.334 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/ioctl.h usability... yes 2023-07-12T02:06:36.351 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/ioctl.h presence... yes 2023-07-12T02:06:36.351 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/ioctl.h... yes 2023-07-12T02:06:36.413 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/wait.h usability... yes 2023-07-12T02:06:36.432 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/wait.h presence... yes 2023-07-12T02:06:36.432 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/wait.h... yes 2023-07-12T02:06:36.446 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/types.h... (cached) yes 2023-07-12T02:06:36.460 INFO:teuthology.orchestra.run.smithi037.stdout:checking for strings.h... (cached) yes 2023-07-12T02:06:36.519 INFO:teuthology.orchestra.run.smithi037.stdout:checking err.h usability... yes 2023-07-12T02:06:36.535 INFO:teuthology.orchestra.run.smithi037.stdout:checking err.h presence... yes 2023-07-12T02:06:36.535 INFO:teuthology.orchestra.run.smithi037.stdout:checking for err.h... yes 2023-07-12T02:06:36.593 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/falloc.h usability... yes 2023-07-12T02:06:36.609 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/falloc.h presence... yes 2023-07-12T02:06:36.609 INFO:teuthology.orchestra.run.smithi037.stdout:checking for linux/falloc.h... yes 2023-07-12T02:06:36.666 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-07-12T02:06:36.690 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-07-12T02:06:36.690 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/fs/xfs_fsops.h... no 2023-07-12T02:06:36.739 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fs/xfs_itable.h usability... no 2023-07-12T02:06:36.764 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fs/xfs_itable.h presence... no 2023-07-12T02:06:36.764 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/fs/xfs_itable.h... no 2023-07-12T02:06:36.813 INFO:teuthology.orchestra.run.smithi037.stdout:checking xfs/platform_defs.h usability... no 2023-07-12T02:06:36.837 INFO:teuthology.orchestra.run.smithi037.stdout:checking xfs/platform_defs.h presence... no 2023-07-12T02:06:36.837 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/platform_defs.h... no 2023-07-12T02:06:36.886 INFO:teuthology.orchestra.run.smithi037.stdout:checking btrfs/ioctl.h usability... no 2023-07-12T02:06:36.911 INFO:teuthology.orchestra.run.smithi037.stdout:checking btrfs/ioctl.h presence... no 2023-07-12T02:06:36.911 INFO:teuthology.orchestra.run.smithi037.stdout:checking for btrfs/ioctl.h... no 2023-07-12T02:06:36.960 INFO:teuthology.orchestra.run.smithi037.stdout:checking cifs/ioctl.h usability... no 2023-07-12T02:06:36.985 INFO:teuthology.orchestra.run.smithi037.stdout:checking cifs/ioctl.h presence... no 2023-07-12T02:06:36.985 INFO:teuthology.orchestra.run.smithi037.stdout:checking for cifs/ioctl.h... no 2023-07-12T02:06:37.045 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/mman.h usability... yes 2023-07-12T02:06:37.062 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/mman.h presence... yes 2023-07-12T02:06:37.062 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/mman.h... yes 2023-07-12T02:06:37.100 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/xfs_log_format.h... no 2023-07-12T02:06:37.168 INFO:teuthology.orchestra.run.smithi037.stdout:checking for uuid_compare... no 2023-07-12T02:06:37.226 INFO:teuthology.orchestra.run.smithi037.stdout:checking for uuid_compare in -luuid... yes 2023-07-12T02:06:37.308 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/xfs.h... yes 2023-07-12T02:06:37.340 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/libxfs.h... no 2023-07-12T02:06:37.379 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether xlog_assign_lsn is declared... no 2023-07-12T02:06:37.436 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/xqm.h... yes 2023-07-12T02:06:37.517 INFO:teuthology.orchestra.run.smithi037.stdout:checking xfsctl from xfs/xfs.h... ok 2023-07-12T02:06:37.563 INFO:teuthology.orchestra.run.smithi037.stdout:checking xfs/handle.h usability... yes 2023-07-12T02:06:37.578 INFO:teuthology.orchestra.run.smithi037.stdout:checking xfs/handle.h presence... yes 2023-07-12T02:06:37.579 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/handle.h... yes 2023-07-12T02:06:37.638 INFO:teuthology.orchestra.run.smithi037.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-07-12T02:06:37.692 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/acl.h usability... yes 2023-07-12T02:06:37.711 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/acl.h presence... yes 2023-07-12T02:06:37.711 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/acl.h... yes 2023-07-12T02:06:37.768 INFO:teuthology.orchestra.run.smithi037.stdout:checking acl/libacl.h usability... yes 2023-07-12T02:06:37.786 INFO:teuthology.orchestra.run.smithi037.stdout:checking acl/libacl.h presence... yes 2023-07-12T02:06:37.786 INFO:teuthology.orchestra.run.smithi037.stdout:checking for acl/libacl.h... yes 2023-07-12T02:06:37.847 INFO:teuthology.orchestra.run.smithi037.stdout:checking for acl_init in -lacl... yes 2023-07-12T02:06:37.894 INFO:teuthology.orchestra.run.smithi037.stdout:checking gdbm-ndbm.h usability... no 2023-07-12T02:06:37.918 INFO:teuthology.orchestra.run.smithi037.stdout:checking gdbm-ndbm.h presence... no 2023-07-12T02:06:37.918 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gdbm-ndbm.h... no 2023-07-12T02:06:37.961 INFO:teuthology.orchestra.run.smithi037.stdout:checking gdbm/ndbm.h usability... no 2023-07-12T02:06:37.986 INFO:teuthology.orchestra.run.smithi037.stdout:checking gdbm/ndbm.h presence... no 2023-07-12T02:06:37.986 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gdbm/ndbm.h... no 2023-07-12T02:06:38.030 INFO:teuthology.orchestra.run.smithi037.stdout:checking ndbm.h usability... no 2023-07-12T02:06:38.054 INFO:teuthology.orchestra.run.smithi037.stdout:checking ndbm.h presence... no 2023-07-12T02:06:38.054 INFO:teuthology.orchestra.run.smithi037.stdout:checking for ndbm.h... no 2023-07-12T02:06:38.102 INFO:teuthology.orchestra.run.smithi037.stdout:checking libaio.h usability... yes 2023-07-12T02:06:38.124 INFO:teuthology.orchestra.run.smithi037.stdout:checking libaio.h presence... yes 2023-07-12T02:06:38.124 INFO:teuthology.orchestra.run.smithi037.stdout:checking for libaio.h... yes 2023-07-12T02:06:38.170 INFO:teuthology.orchestra.run.smithi037.stdout:checking liburing.h usability... no 2023-07-12T02:06:38.194 INFO:teuthology.orchestra.run.smithi037.stdout:checking liburing.h presence... no 2023-07-12T02:06:38.194 INFO:teuthology.orchestra.run.smithi037.stdout:checking for liburing.h... no 2023-07-12T02:06:38.237 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/capability.h usability... no 2023-07-12T02:06:38.262 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/capability.h presence... no 2023-07-12T02:06:38.262 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/capability.h... no 2023-07-12T02:06:38.307 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/fiemap.h usability... yes 2023-07-12T02:06:38.323 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/fiemap.h presence... yes 2023-07-12T02:06:38.324 INFO:teuthology.orchestra.run.smithi037.stdout:checking for linux/fiemap.h... yes 2023-07-12T02:06:38.385 INFO:teuthology.orchestra.run.smithi037.stdout:checking for fallocate... yes 2023-07-12T02:06:38.446 INFO:teuthology.orchestra.run.smithi037.stdout:checking for open_by_handle_at... yes 2023-07-12T02:06:38.493 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/prctl.h usability... yes 2023-07-12T02:06:38.510 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/prctl.h presence... yes 2023-07-12T02:06:38.510 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/prctl.h... yes 2023-07-12T02:06:38.558 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/fs.h usability... yes 2023-07-12T02:06:38.574 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/fs.h presence... yes 2023-07-12T02:06:38.575 INFO:teuthology.orchestra.run.smithi037.stdout:checking for linux/fs.h... yes 2023-07-12T02:06:38.627 INFO:teuthology.orchestra.run.smithi037.stdout:checking btrfsutil.h usability... no 2023-07-12T02:06:38.651 INFO:teuthology.orchestra.run.smithi037.stdout:checking btrfsutil.h presence... no 2023-07-12T02:06:38.651 INFO:teuthology.orchestra.run.smithi037.stdout:checking for btrfsutil.h... no 2023-07-12T02:06:38.714 INFO:teuthology.orchestra.run.smithi037.stdout:checking for copy_file_range... yes 2023-07-12T02:06:38.778 INFO:teuthology.orchestra.run.smithi037.stdout:checking for SEEK_DATA... yes 2023-07-12T02:06:38.859 INFO:teuthology.orchestra.run.smithi037.stdout:checking for BMV_OF_SHARED... yes 2023-07-12T02:06:38.924 INFO:teuthology.orchestra.run.smithi037.stdout:checking for nftw... yes 2023-07-12T02:06:38.987 INFO:teuthology.orchestra.run.smithi037.stdout:checking for RLIMIT_NOFILE... yes 2023-07-12T02:06:39.028 INFO:teuthology.orchestra.run.smithi037.stdout:checking for FIEXCHANGE_RANGE... no 2023-07-12T02:06:39.090 INFO:teuthology.orchestra.run.smithi037.stdout:checking for renameat2... yes 2023-07-12T02:06:39.152 INFO:teuthology.orchestra.run.smithi037.stdout:checking for reallocarray... yes 2023-07-12T02:06:39.185 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct mount_attr... no 2023-07-12T02:06:39.267 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_qgroup_limit... yes 2023-07-12T02:06:39.342 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-07-12T02:06:39.417 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-07-12T02:06:39.491 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-07-12T02:06:39.565 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-07-12T02:06:39.639 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-07-12T02:06:39.712 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-07-12T02:06:39.767 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/btrfs.h usability... yes 2023-07-12T02:06:39.783 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/btrfs.h presence... yes 2023-07-12T02:06:39.784 INFO:teuthology.orchestra.run.smithi037.stdout:checking for linux/btrfs.h... yes 2023-07-12T02:06:39.845 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/btrfs_tree.h usability... yes 2023-07-12T02:06:39.862 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/btrfs_tree.h presence... yes 2023-07-12T02:06:39.862 INFO:teuthology.orchestra.run.smithi037.stdout:checking for linux/btrfs_tree.h... yes 2023-07-12T02:06:39.936 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-07-12T02:06:39.965 INFO:teuthology.orchestra.run.smithi037.stdout:configure: creating ./config.status 2023-07-12T02:06:40.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:06:40.187 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:06:40.884 INFO:teuthology.orchestra.run.smithi037.stdout:config.status: creating include/builddefs 2023-07-12T02:06:40.914 INFO:teuthology.orchestra.run.smithi037.stdout:config.status: creating include/config.h 2023-07-12T02:06:40.936 INFO:teuthology.orchestra.run.smithi037.stdout:config.status: executing libtool commands 2023-07-12T02:06:41.017 INFO:teuthology.orchestra.run.smithi037.stdout:Building include 2023-07-12T02:06:41.024 INFO:teuthology.orchestra.run.smithi037.stdout:Building lib 2023-07-12T02:06:41.031 INFO:teuthology.orchestra.run.smithi037.stdout: [LTDEP] 2023-07-12T02:06:41.241 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dataascii.lo 2023-07-12T02:06:41.446 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] databin.lo 2023-07-12T02:06:41.684 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] datapid.lo 2023-07-12T02:06:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] file_lock.lo 2023-07-12T02:06:42.193 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] forker.lo 2023-07-12T02:06:42.420 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] pattern.lo 2023-07-12T02:06:42.620 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] open_flags.lo 2023-07-12T02:06:42.853 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] random_range.lo 2023-07-12T02:06:43.168 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] string_to_tokens.lo 2023-07-12T02:06:43.356 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] str_to_bytes.lo 2023-07-12T02:06:43.574 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] tlibio.lo 2023-07-12T02:06:43.903 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] write_log.lo 2023-07-12T02:06:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] random.lo 2023-07-12T02:06:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: [LD] 2023-07-12T02:06:44.655 INFO:teuthology.orchestra.run.smithi037.stdout:Building ltp 2023-07-12T02:06:44.661 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-07-12T02:06:44.948 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] doio 2023-07-12T02:06:45.718 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fsstress 2023-07-12T02:06:47.158 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fsx 2023-07-12T02:06:48.140 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] growfiles 2023-07-12T02:06:48.759 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] iogen 2023-07-12T02:06:49.222 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-stress 2023-07-12T02:06:49.750 INFO:teuthology.orchestra.run.smithi037.stdout:Building src 2023-07-12T02:06:49.759 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-07-12T02:06:52.245 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-07-12T02:06:52.295 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-07-12T02:06:52.312 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-07-12T02:06:52.664 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-07-12T02:06:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dirstress 2023-07-12T02:06:53.050 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fill 2023-07-12T02:06:53.304 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fill2 2023-07-12T02:06:53.642 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] getpagesize 2023-07-12T02:06:53.878 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] holes 2023-07-12T02:06:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] lstat64 2023-07-12T02:06:54.464 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] nametest 2023-07-12T02:06:54.811 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] permname 2023-07-12T02:06:55.118 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] randholes 2023-07-12T02:06:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] runas 2023-07-12T02:06:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] truncfile 2023-07-12T02:06:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] usemem 2023-07-12T02:06:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] mmapcat 2023-07-12T02:06:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] append_reader 2023-07-12T02:06:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] append_writer 2023-07-12T02:06:57.052 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dirperf 2023-07-12T02:06:57.380 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] metaperf 2023-07-12T02:06:57.738 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] devzero 2023-07-12T02:06:58.020 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] feature 2023-07-12T02:06:58.343 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] alloc 2023-07-12T02:06:58.660 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fault 2023-07-12T02:06:58.930 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fstest 2023-07-12T02:06:59.274 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_access_root 2023-07-12T02:06:59.533 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] godown 2023-07-12T02:06:59.808 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] resvtest 2023-07-12T02:07:00.100 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] writemod 2023-07-12T02:07:00.346 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] writev_on_pagefault 2023-07-12T02:07:00.611 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] makeextents 2023-07-12T02:07:00.895 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] itrash 2023-07-12T02:07:01.152 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] rename 2023-07-12T02:07:01.393 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] multi_open_unlink 2023-07-12T02:07:01.662 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] unwritten_sync 2023-07-12T02:07:01.947 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] genhashnames 2023-07-12T02:07:02.237 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_holes 2023-07-12T02:07:02.485 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_writev 2023-07-12T02:07:02.735 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_truncate_cmtime 2023-07-12T02:07:02.997 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dirhash_collide 2023-07-12T02:07:03.283 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_rename_overwrite 2023-07-12T02:07:03.527 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] holetest 2023-07-12T02:07:03.850 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_truncate_self 2023-07-12T02:07:04.091 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] af_unix 2023-07-12T02:07:04.348 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_stale_pmd 2023-07-12T02:07:04.604 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_cow_race 2023-07-12T02:07:04.873 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_fallocate 2023-07-12T02:07:05.125 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fsync-err 2023-07-12T02:07:05.413 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_write_ro 2023-07-12T02:07:05.666 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_ext4_dax_journal_corruption 2023-07-12T02:07:05.927 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_ext4_dax_inline_corruption 2023-07-12T02:07:06.185 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_ofd_locks 2023-07-12T02:07:06.490 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_collision 2023-07-12T02:07:06.791 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] mmap-write-concurrent 2023-07-12T02:07:07.065 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_get_file_time 2023-07-12T02:07:07.315 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_create_short_dirs 2023-07-12T02:07:07.585 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_create_long_dirs 2023-07-12T02:07:07.852 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_enospc 2023-07-12T02:07:08.142 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_writev_overlap 2023-07-12T02:07:08.415 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] checkpoint_journal 2023-07-12T02:07:08.672 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] mmap-rw-fault 2023-07-12T02:07:08.961 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] allocstale 2023-07-12T02:07:09.235 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_cow_memory_failure 2023-07-12T02:07:09.512 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fake-dump-rootino 2023-07-12T02:07:09.765 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dio-buf-fault 2023-07-12T02:07:10.020 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] xfsctl 2023-07-12T02:07:10.315 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] bstat 2023-07-12T02:07:10.374 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:07:10.378 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:07:10.630 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mtab 2023-07-12T02:07:10.922 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] getdevicesize 2023-07-12T02:07:11.167 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] preallo_rw_pattern_reader 2023-07-12T02:07:11.432 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] preallo_rw_pattern_writer 2023-07-12T02:07:11.699 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] ftrunc 2023-07-12T02:07:11.950 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] trunc 2023-07-12T02:07:12.215 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fs_perms 2023-07-12T02:07:12.484 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] testx 2023-07-12T02:07:12.715 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] looptest 2023-07-12T02:07:13.012 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] locktest 2023-07-12T02:07:13.424 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] unwritten_mmap 2023-07-12T02:07:13.693 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] bulkstat_unlink_test 2023-07-12T02:07:14.001 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] deduperace 2023-07-12T02:07:14.301 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] bulkstat_unlink_test_modified 2023-07-12T02:07:14.607 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_dir_offset 2023-07-12T02:07:14.858 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_futimens 2023-07-12T02:07:15.102 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_immutable 2023-07-12T02:07:15.818 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] stale_handle 2023-07-12T02:07:16.094 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] pwrite_mmap_blocked 2023-07-12T02:07:16.352 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_dir_offset2 2023-07-12T02:07:16.650 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] seek_sanity_test 2023-07-12T02:07:17.172 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] seek_copy_test 2023-07-12T02:07:17.457 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_readdir_1 2023-07-12T02:07:17.708 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_readdir_2 2023-07-12T02:07:17.961 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fsync-tester 2023-07-12T02:07:18.316 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] nsexec 2023-07-12T02:07:18.596 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] cloner 2023-07-12T02:07:18.877 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] renameat2 2023-07-12T02:07:19.150 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_getcwd 2023-07-12T02:07:19.412 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] e4compact 2023-07-12T02:07:19.718 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] test-nextquota 2023-07-12T02:07:19.995 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] punch-alternating 2023-07-12T02:07:20.274 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] attr-list-by-handle-cursor-test 2023-07-12T02:07:20.549 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] listxattr 2023-07-12T02:07:20.798 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dio-interleaved 2023-07-12T02:07:21.062 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_dir_type 2023-07-12T02:07:21.321 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dio-invalidate-cache 2023-07-12T02:07:21.630 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] stat_test 2023-07-12T02:07:22.032 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_encrypted_d_revalidate 2023-07-12T02:07:22.303 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] attr_replace_test 2023-07-12T02:07:22.569 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] swapon 2023-07-12T02:07:22.838 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] mkswap 2023-07-12T02:07:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_attr_corruption 2023-07-12T02:07:23.346 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_open_tmpfiles 2023-07-12T02:07:23.633 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fscrypt-crypt-util 2023-07-12T02:07:24.378 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] bulkstat_null_ocount 2023-07-12T02:07:24.644 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] splice-test 2023-07-12T02:07:24.929 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] chprojid_fail 2023-07-12T02:07:25.200 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] detached_mounts_propagation 2023-07-12T02:07:25.496 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] ext4_resize 2023-07-12T02:07:25.748 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_readdir_3 2023-07-12T02:07:26.047 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] splice2pipe 2023-07-12T02:07:26.314 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] uuid_ioctl 2023-07-12T02:07:26.573 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fiemap-tester 2023-07-12T02:07:26.944 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_stripealign 2023-07-12T02:07:27.200 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] open_by_handle 2023-07-12T02:07:27.558 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_dio 2023-07-12T02:07:27.824 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] xfsfind 2023-07-12T02:07:28.127 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fssum 2023-07-12T02:07:28.669 INFO:teuthology.orchestra.run.smithi037.stdout:Building log-writes 2023-07-12T02:07:28.679 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] replay-log 2023-07-12T02:07:29.101 INFO:teuthology.orchestra.run.smithi037.stdout:Building perf 2023-07-12T02:07:29.108 INFO:teuthology.orchestra.run.smithi037.stdout:Building aio-dio-regress 2023-07-12T02:07:29.119 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-append-write-fallocate-race 2023-07-12T02:07:29.403 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-fcntl-race 2023-07-12T02:07:29.673 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-subblock-eof-read 2023-07-12T02:07:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-append-write-read-race 2023-07-12T02:07:30.207 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-invalidate-readahead 2023-07-12T02:07:30.480 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-hole-filling-race 2023-07-12T02:07:30.737 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-07-12T02:07:30.977 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-last-ref-held-by-io 2023-07-12T02:07:31.260 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-cycle-write 2023-07-12T02:07:31.553 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-extend-stat 2023-07-12T02:07:31.827 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-07-12T02:07:32.067 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-invalidate-failure 2023-07-12T02:07:32.334 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aiodio_sparse2 2023-07-12T02:07:32.661 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aiocp 2023-07-12T02:07:32.992 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-cow-race 2023-07-12T02:07:33.255 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-write-verify 2023-07-12T02:07:33.557 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-eof-race 2023-07-12T02:07:33.849 INFO:teuthology.orchestra.run.smithi037.stdout:Building vfs 2023-07-12T02:07:33.859 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] vfstest 2023-07-12T02:07:35.948 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] mount-idmapped 2023-07-12T02:07:36.474 INFO:teuthology.orchestra.run.smithi037.stdout:Building m4 2023-07-12T02:07:36.482 INFO:teuthology.orchestra.run.smithi037.stdout:Building common 2023-07-12T02:07:36.490 INFO:teuthology.orchestra.run.smithi037.stdout:Building tests 2023-07-12T02:07:36.500 INFO:teuthology.orchestra.run.smithi037.stdout:Building perf 2023-07-12T02:07:36.510 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/perf/group.list 2023-07-12T02:07:36.540 INFO:teuthology.orchestra.run.smithi037.stdout:Building ext4 2023-07-12T02:07:36.550 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/ext4/group.list 2023-07-12T02:07:36.645 INFO:teuthology.orchestra.run.smithi037.stdout:Building ocfs2 2023-07-12T02:07:36.655 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/ocfs2/group.list 2023-07-12T02:07:36.689 INFO:teuthology.orchestra.run.smithi037.stdout:Building overlay 2023-07-12T02:07:36.699 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/overlay/group.list 2023-07-12T02:07:36.796 INFO:teuthology.orchestra.run.smithi037.stdout:Building cifs 2023-07-12T02:07:36.806 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/cifs/group.list 2023-07-12T02:07:36.838 INFO:teuthology.orchestra.run.smithi037.stdout:Building generic 2023-07-12T02:07:36.852 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/generic/group.list 2023-07-12T02:07:37.097 INFO:teuthology.orchestra.run.smithi037.stdout:Building shared 2023-07-12T02:07:37.106 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/shared/group.list 2023-07-12T02:07:37.151 INFO:teuthology.orchestra.run.smithi037.stdout:Building nfs 2023-07-12T02:07:37.162 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/nfs/group.list 2023-07-12T02:07:37.198 INFO:teuthology.orchestra.run.smithi037.stdout:Building f2fs 2023-07-12T02:07:37.208 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/f2fs/group.list 2023-07-12T02:07:37.252 INFO:teuthology.orchestra.run.smithi037.stdout:Building udf 2023-07-12T02:07:37.262 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/udf/group.list 2023-07-12T02:07:37.291 INFO:teuthology.orchestra.run.smithi037.stdout:Building ceph 2023-07-12T02:07:37.301 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/ceph/group.list 2023-07-12T02:07:37.339 INFO:teuthology.orchestra.run.smithi037.stdout:Building xfs 2023-07-12T02:07:37.351 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/xfs/group.list 2023-07-12T02:07:37.602 INFO:teuthology.orchestra.run.smithi037.stdout:Building btrfs 2023-07-12T02:07:37.613 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/btrfs/group.list 2023-07-12T02:07:37.762 INFO:teuthology.orchestra.run.smithi037.stdout:Building tmpfs 2023-07-12T02:07:37.772 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/tmpfs/group.list 2023-07-12T02:07:37.806 INFO:teuthology.orchestra.run.smithi037.stdout:Building selftest 2023-07-12T02:07:37.816 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/selftest/group.list 2023-07-12T02:07:37.850 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo make install) 2023-07-12T02:07:37.944 INFO:teuthology.orchestra.run.smithi037.stdout:Building include 2023-07-12T02:07:37.951 INFO:teuthology.orchestra.run.smithi037.stdout:Building lib 2023-07-12T02:07:37.959 INFO:teuthology.orchestra.run.smithi037.stdout:Building ltp 2023-07-12T02:07:37.967 INFO:teuthology.orchestra.run.smithi037.stdout:Building src 2023-07-12T02:07:38.029 INFO:teuthology.orchestra.run.smithi037.stdout:Building log-writes 2023-07-12T02:07:38.036 INFO:teuthology.orchestra.run.smithi037.stdout:Building perf 2023-07-12T02:07:38.044 INFO:teuthology.orchestra.run.smithi037.stdout:Building aio-dio-regress 2023-07-12T02:07:38.052 INFO:teuthology.orchestra.run.smithi037.stdout:Building vfs 2023-07-12T02:07:38.060 INFO:teuthology.orchestra.run.smithi037.stdout:Building m4 2023-07-12T02:07:38.068 INFO:teuthology.orchestra.run.smithi037.stdout:Building common 2023-07-12T02:07:38.075 INFO:teuthology.orchestra.run.smithi037.stdout:Building tests 2023-07-12T02:07:38.085 INFO:teuthology.orchestra.run.smithi037.stdout:Building perf 2023-07-12T02:07:38.095 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/perf/group.list 2023-07-12T02:07:38.125 INFO:teuthology.orchestra.run.smithi037.stdout:Building ext4 2023-07-12T02:07:38.135 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/ext4/group.list 2023-07-12T02:07:38.230 INFO:teuthology.orchestra.run.smithi037.stdout:Building ocfs2 2023-07-12T02:07:38.239 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/ocfs2/group.list 2023-07-12T02:07:38.274 INFO:teuthology.orchestra.run.smithi037.stdout:Building overlay 2023-07-12T02:07:38.284 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/overlay/group.list 2023-07-12T02:07:38.380 INFO:teuthology.orchestra.run.smithi037.stdout:Building cifs 2023-07-12T02:07:38.390 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/cifs/group.list 2023-07-12T02:07:38.422 INFO:teuthology.orchestra.run.smithi037.stdout:Building generic 2023-07-12T02:07:38.434 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/generic/group.list 2023-07-12T02:07:38.677 INFO:teuthology.orchestra.run.smithi037.stdout:Building shared 2023-07-12T02:07:38.686 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/shared/group.list 2023-07-12T02:07:38.731 INFO:teuthology.orchestra.run.smithi037.stdout:Building nfs 2023-07-12T02:07:38.741 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/nfs/group.list 2023-07-12T02:07:38.778 INFO:teuthology.orchestra.run.smithi037.stdout:Building f2fs 2023-07-12T02:07:38.788 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/f2fs/group.list 2023-07-12T02:07:38.832 INFO:teuthology.orchestra.run.smithi037.stdout:Building udf 2023-07-12T02:07:38.842 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/udf/group.list 2023-07-12T02:07:38.871 INFO:teuthology.orchestra.run.smithi037.stdout:Building ceph 2023-07-12T02:07:38.881 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/ceph/group.list 2023-07-12T02:07:38.918 INFO:teuthology.orchestra.run.smithi037.stdout:Building xfs 2023-07-12T02:07:38.930 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/xfs/group.list 2023-07-12T02:07:39.175 INFO:teuthology.orchestra.run.smithi037.stdout:Building btrfs 2023-07-12T02:07:39.186 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/btrfs/group.list 2023-07-12T02:07:39.333 INFO:teuthology.orchestra.run.smithi037.stdout:Building tmpfs 2023-07-12T02:07:39.343 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/tmpfs/group.list 2023-07-12T02:07:39.377 INFO:teuthology.orchestra.run.smithi037.stdout:Building selftest 2023-07-12T02:07:39.387 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/selftest/group.list 2023-07-12T02:07:39.418 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-07-12T02:07:39.421 INFO:teuthology.orchestra.run.smithi037.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-12T02:07:39.421 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-07-12T02:07:39.424 INFO:teuthology.orchestra.run.smithi037.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-12T02:07:39.425 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-07-12T02:07:39.428 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-07-12T02:07:39.452 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-07-12T02:07:39.628 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-07-12T02:07:39.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-07-12T02:07:39.682 INFO:teuthology.orchestra.run.smithi037.stdout:Building log-writes 2023-07-12T02:07:39.689 INFO:teuthology.orchestra.run.smithi037.stdout:Building perf 2023-07-12T02:07:39.697 INFO:teuthology.orchestra.run.smithi037.stdout:Building aio-dio-regress 2023-07-12T02:07:39.705 INFO:teuthology.orchestra.run.smithi037.stdout:Building vfs 2023-07-12T02:07:39.711 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake -C log-writes install 2023-07-12T02:07:39.713 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-07-12T02:07:39.737 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-07-12T02:07:39.761 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake -C perf install 2023-07-12T02:07:39.764 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-07-12T02:07:39.787 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-07-12T02:07:39.847 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-07-12T02:07:39.850 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-07-12T02:07:39.873 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-dio-append-write-fallocate-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-07-12T02:07:40.017 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake -C vfs install 2023-07-12T02:07:40.020 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-07-12T02:07:40.043 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-07-12T02:07:40.076 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-07-12T02:07:40.099 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-07-12T02:07:40.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:07:40.558 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:07:43.103 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-07-12T02:07:43.323 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-07-12T02:07:43.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-07-12T02:07:43.381 INFO:teuthology.orchestra.run.smithi037.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-12T02:07:43.382 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-07-12T02:07:43.384 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-07-12T02:07:43.407 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-07-12T02:07:43.766 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-07-12T02:07:43.768 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/btrfs/ install 2023-07-12T02:07:43.772 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-07-12T02:07:43.796 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 299 /var/lib/xfstests/tests/btrfs 2023-07-12T02:07:45.964 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-07-12T02:07:45.987 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 036.out 275.out 016.out 175.out 240.out 180.out 069.out 282.out 015.out 280.out 140.out 056.out 008.out 004.out 199.out 233.out 194.out 234.out 248.out 109.out 033.out 252.out 270.out 040.out 176.out 202.out 137.out 125.out 078.out 152.out 003.out 264.out 243.out 192.out 148.out 075.out 178.out 284.out 052.out 256.out 207.out 228.out 128.out 028.out 183.out 225.out 094.out 046.out 273.out 090.out 251.out 089.out 206.out 215.out 115.out 197.out 250.out 266.out 051.out 246.out 219.out 119.out 244.out 232.out 121.out 112.out 012.out 195.out 107.out 162.out 083.out 147.out 288.out 242.out 187.out 024.out 220.out 153.out 020.out 102.out 002.out 171.out 261.out 135.out 156.out 092.out 255.out 072.out 068.out 143.out 048.out 062.out 084.out 129.out 029.out 229.out 103.out 254.out 111.out 011.out 155.out 134.out 170.out 260.out 034.out 161.out 043.out 247.out 216.out 116.out 157.out 274.out 110.out 101.out 238.out 276.out 114.out 138.out 095.out 038.out 145.out 160.out 091.out 081.out 071.out 061.out 085.out 265.out 200.out 100.out 025.out 258.out 286.out 269.out 039.out 196.out 098.out 080.out 070.out 060.out 208.out 106.out 009.out 167.out 217.out 120.out 191.out 117.out 017.out 211.out 158.out 182.out 066.out 146.out 212.out 188.out 065.out 204.out 104.out 041.out 177.out 279.out 241.out 235.out 253.out 257.out 124.out 035.out 172.out 278.out 058.out 262.out 169.out 042.out 193.out 097.out 271.out 283.out 236.out 186.out 053.out 133.out 164.out 154.out 239.out 189.out 037.out 139.out 267.out 141.out 214.out 014.out 223.out 086.out 132.out 179.out 144.out 032.out 277.out 205.out 136.out 005.out 096.out 198.out 108.out 190.out 173.out 050.out 105.out 291.out 185.out 067.out 088.out 285.out 209.out 123.out 044.out 201.out 019.out 001.out 287.out 142.out 237.out 151.out 231.out 163.out 131.out 213.out 113.out 013.out 031.out 027.out 057.out 272.out 268.out 184.out 259.out 210.out 227.out 010.out 263.out 127.out 230.out 166.out 130.out 023.out 073.out 099.out 082.out 030.out 203.out 063.out 055.out 076.out 245.out 122.out 074.out 222.out 159.out 249.out 022.out 289.out 174.out 006.out 045.out 281.out 290.out 299.out 224.out 181.out 149.out 064.out 218.out 118.out 018.out 047.out 168.out 007.out 093.out 079.out 054.out 059.out 150.out 049.out 226.out 126.out 165.out 026.out 021.out 077.out 221.out 087.out /var/lib/xfstests/tests/btrfs 2023-07-12T02:07:48.158 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/ceph/ install 2023-07-12T02:07:48.160 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-07-12T02:07:48.183 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-07-12T02:07:48.236 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-07-12T02:07:48.259 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-07-12T02:07:48.312 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/cifs/ install 2023-07-12T02:07:48.315 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-07-12T02:07:48.339 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-07-12T02:07:48.362 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-07-12T02:07:48.387 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-07-12T02:07:48.411 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/ext4/ install 2023-07-12T02:07:48.414 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-07-12T02:07:48.437 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-07-12T02:07:48.953 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-07-12T02:07:48.976 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 005.out 026.out 308.out 008.out 040.out 304.out 007.out 021.out 016.out 037.out 044.out 012.out 009.out 033.out 057.out 050.out 301.out 019.out 034.out 046.out 058.out 047.out 302.out 020.out 002.out 024.out 013.out 031.out 025.out 306.out 017.out 004.out 048.out 038.out 056.out 042.out 052.out 307.out 029.out 011.out 027.out 303.out 003.out 045.out 055.out 053.out 035.out 043.out 059.out 010.out 023.out 022.out 014.out 006.out 015.out 305.out 036.out 271.out 051.out 041.out 030.out 018.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-07-12T02:07:49.518 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/f2fs/ install 2023-07-12T02:07:49.521 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-07-12T02:07:49.544 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-07-12T02:07:49.575 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-07-12T02:07:49.599 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-07-12T02:07:49.630 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/generic/ install 2023-07-12T02:07:49.636 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-07-12T02:07:49.659 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 /var/lib/xfstests/tests/generic 2023-07-12T02:07:55.055 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-07-12T02:07:55.078 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 537.out 194.out 133.out 683.out 033.out 489.out 696.out 237.out 502.out 310.out 202.out 137.out 586.out 181.out 664.out 571.out 126.out 243.out 592.out 282.out 272.out 728.out 178.out 628.out 528.out 607.out 428.out 507.out 407.out 328.out 171.out 028.out 620.out 273.out 570.out 468.out 182.out 265.out 420.out 492.out 120.out 059.out 595.out 346.out 466.out 443.out 700.out 632.out 652.out 311.out 655.out 591.out 064.out 471.out 432.out 255.out 623.out 371.out 319.out 177.out 523.out 119.out 423.out 232.out 673.out 260.out 312.out 718.out 034.out 465.out 716.out 616.out 246.out 416.out 247.out 216.out 116.out 041.out 358.out 338.out 287.out 238.out 295.out 390.out 497.out 160.out 691.out 274.out 061.out 239.out 457.out 025.out 530.out 258.out 362.out 039.out 098.out 690.out 573.out 706.out 606.out 506.out 406.out 306.out 106.out 642.out 217.out 446.out 017.out 211.out 130.out 158.out 370.out 442.out 188.out 640.out 199.out 467.out 281.out 174.out 163.out 324.out 224.out 355.out 124.out 672.out 278.out 058.out 384.out 296.out 042.out 193.out 097.out 271.out 283.out 541.out 709.out 609.out 045.out 509.out 309.out 391.out 441.out 009.out 356.out 341.out 494.out 189.out 037.out 555.out 712.out 241.out 501.out 612.out 540.out 365.out 412.out 614.out 514.out 414.out 314.out 440.out 114.out 316.out 014.out 026.out 012.out 634.out 340.out 156.out 572.out 240.out 180.out 549.out 473.out 633.out 321.out 140.out 348.out 568.out 185.out 408.out 308.out 566.out 433.out 704.out 108.out 504.out 404.out 304.out 104.out 175.out 297.out 393.out 333.out 599.out 476.out 099.out 233.out 639.out 107.out 086.out 053.out 500.out 164.out 339.out 294.out 352.out 498.out 139.out 267.out 317.out 399.out 220.out 552.out 695.out 480.out 436.out 544.out 169.out 593.out 067.out 186.out 187.out 679.out 252.out 585.out 003.out 376.out 724.out 206.out 663.out 651.out 248.out 625.out 525.out 670.out 488.out 040.out 325.out 551.out 225.out 636.out 125.out 142.out 715.out 279.out 222.out 515.out 650.out 152.out 658.out 563.out 215.out 451.out 015.out 392.out 682.out 472.out 684.out 674.out 550.out 052.out 351.out 430.out 276.out 094.out 266.out 450.out 463.out 157.out 600.out 349.out 444.out 644.out 487.out 688.out 643.out 615.out 395.out 151.out 415.out 315.out 344.out 115.out 539.out 179.out 542.out 250.out 705.out 475.out 536.out 228.out 518.out 101.out 030.out 244.out 128.out 385.out 005.out 336.out 579.out 236.out 405.out 667.out 205.out 136.out 598.out 036.out 198.out 723.out 008.out 680.out 605.out 505.out 305.out 105.out 263.out 144.out 291.out 437.out 044.out 719.out 619.out 721.out 323.out 685.out 088.out 382.out 337.out 219.out 527.out 019.out 577.out 481.out 574.out 556.out 332.out 060.out 521.out 027.out 191.out 582.out 372.out 478.out 584.out 462.out 597.out 350.out 132.out 693.out 638.out 448.out 660.out 063.out 561.out 214.out 074.out 648.out 387.out 594.out 335.out 438.out 076.out 289.out 699.out 545.out 516.out 477.out 621.out 519.out 290.out 548.out 560.out 166.out 707.out 461.out 381.out 445.out 647.out 626.out 380.out 562.out 526.out 479.out 426.out 192.out 150.out 613.out 326.out 082.out 226.out 668.out 454.out 121.out 447.out 499.out 580.out 460.out 485.out 694.out 347.out 077.out 361.out 564.out 455.out 089.out 558.out 162.out 686.out 147.out 173.out 197.out 396.out 051.out 354.out 298.out 024.out 148.out 360.out 543.out 270.out 261.out 251.out 657.out 692.out 482.out 046.out 726.out 729.out 378.out 004.out 458.out 062.out 529.out 231.out 343.out 662.out 503.out 329.out 334.out 590.out 254.out 363.out 131.out 155.out 661.out 547.out 368.out 486.out 223.out 123.out 669.out 023.out 459.out 032.out 277.out 398.out 366.out 161.out 190.out 280.out 470.out 484.out 257.out 006.out 016.out 091.out 201.out 656.out 227.out 676.out 374.out 583.out 285.out 127.out 256.out 654.out 389.out 649.out 301.out 431.out 635.out 288.out 722.out 331.out 377.out 713.out 535.out 513.out 554.out 622.out 313.out 213.out 113.out 013.out 031.out 435.out 630.out 645.out 057.out 727.out 078.out 510.out 627.out 184.out 534.out 427.out 210.out 449.out 327.out 330.out 493.out 604.out 419.out 230.out 071.out 083.out 292.out 299.out 434.out 575.out 073.out 603.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 532.out 245.out 522.out 422.out 624.out 322.out 394.out 159.out 524.out 122.out 689.out 234.out 022.out 424.out 637.out 578.out 490.out 439.out 517.out 154.out 149.out 618.out 675.out 418.out 318.out 264.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 533.out 512.out 221.out 087.out 212.out 538.out 112.out 342.out 021.out 195.out 388.out 483.out 397.out 070.out 596.out 720.out 565.out 196.out 520.out 242.out 576.out 587.out 320.out 629.out 702.out 602.out 153.out 402.out 302.out 020.out 102.out 002.out 717.out 617.out 129.out 429.out 417.out 138.out 167.out 092.out 117.out 357.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 611.out 511.out 411.out 029.out 111.out 011.out 659.out 183.out 170.out 065.out 286.out 043.out 056.out 714.out 559.out 710.out 610.out 687.out 413.out 410.out 701.out 601.out 401.out 110.out 010.out 001.out 141.out 495.out 048.out 665.out 589.out 095.out 581.out 697.out 145.out 641.out 464.out 491.out 081.out 075.out 653.out 671.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 677.out 698.out 553.out 375.out 259.out 090.out 080.out 708.out 608.out 508.out 409.out 307.out 209.out 109.out 007.out 567.out 284.out 557.out 453.out 666.out 364.out 725.out 383.out 085.out 066.out 588.out 146.out 631.out 204.out 353.out 425.out 069.out 093.out 681.out 249.out 207.out 531.out 235.out 646.out 474.out 703.out 253.out 275.out 678.out 496.out 373.out 176.out 134.out 452.out 096.out /var/lib/xfstests/tests/generic 2023-07-12T02:08:00.532 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/nfs/ install 2023-07-12T02:08:00.534 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-07-12T02:08:00.558 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-07-12T02:08:00.581 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-07-12T02:08:00.604 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-07-12T02:08:00.629 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/ocfs2/ install 2023-07-12T02:08:00.633 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-07-12T02:08:00.654 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-07-12T02:08:00.678 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-07-12T02:08:00.701 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-07-12T02:08:00.725 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/overlay/ install 2023-07-12T02:08:00.728 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-07-12T02:08:00.752 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-07-12T02:08:01.474 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-07-12T02:08:01.497 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 110.out 067.out 018.out 024.out 010.out 065.out 020.out 102.out 002.out 113.out 013.out 031.out 045.out 117.out 046.out 075.out 072.out 068.out 063.out 014.out 062.out 038.out 042.out 052.out 029.out 027.out 043.out 112.out 023.out 073.out 078.out 030.out 058.out 003.out 004.out 055.out 053.out 109.out 035.out 116.out 016.out 059.out 101.out 001.out 009.out 047.out 076.out 022.out 074.out 006.out 044.out 115.out 015.out 064.out 114.out 026.out 071.out 111.out 061.out 011.out 041.out 048.out 100.out 019.out 107.out 007.out 028.out 069.out 054.out 049.out 032.out 039.out 077.out 105.out 025.out 056.out 057.out 108.out 070.out 060.out 008.out 040.out 106.out 005.out 021.out 017.out 012.out 037.out 103.out 033.out 066.out 050.out 036.out 051.out 034.out 104.out /var/lib/xfstests/tests/overlay 2023-07-12T02:08:02.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/perf/ install 2023-07-12T02:08:02.224 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-07-12T02:08:02.247 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-07-12T02:08:02.271 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-07-12T02:08:02.294 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-07-12T02:08:02.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/selftest/ install 2023-07-12T02:08:02.321 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-07-12T02:08:02.344 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-07-12T02:08:02.405 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-07-12T02:08:02.428 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-07-12T02:08:02.489 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/shared/ install 2023-07-12T02:08:02.491 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-07-12T02:08:02.515 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-07-12T02:08:02.553 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-07-12T02:08:02.576 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-07-12T02:08:02.615 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/tmpfs/ install 2023-07-12T02:08:02.617 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-07-12T02:08:02.640 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-07-12T02:08:02.664 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-07-12T02:08:02.688 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-07-12T02:08:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/udf/ install 2023-07-12T02:08:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-07-12T02:08:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-07-12T02:08:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-07-12T02:08:02.784 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-07-12T02:08:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MWP0gTBaNBxfstests-dev/tests/xfs/ install 2023-07-12T02:08:02.813 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-07-12T02:08:02.837 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-07-12T02:08:07.930 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-07-12T02:08:07.954 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 308.out 737.out 108.out 504.out 404.out 104.out 004.out 377.out 537.out 194.out 158.out 337.out 082.out 237.out 759.out 502.out 088.out 202.out 137.out 102.out 746.out 110.out 586.out 181.out 571.out 567.out 592.out 282.out 266.out 728.out 178.out 528.out 769.out 428.out 507.out 407.out 328.out 171.out 028.out 046.out 273.out 570.out 468.out 474.out 059.out 346.out 732.out 784.out 443.out 411.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 371.out 319.out 177.out 523.out 119.out 775.out 232.out 363.out 131.out 243.out 183.out 547.out 738.out 260.out 718.out 034.out 465.out 716.out 161.out 246.out 416.out 247.out 116.out 016.out 041.out 358.out 338.out 287.out 099.out 238.out 065.out 566.out 295.out 138.out 765.out 160.out 291.out 274.out 722.out 061.out 239.out 085.out 457.out 025.out 772.out 530.out 258.out 322.out 039.out 498.out 098.out 517.out 573.out 060.out 506.out 406.out 306.out 106.out 006.out 003.out 217.out 120.out 191.out 133.out 455.out 130.out 442.out 188.out 030.out 199.out 595.out 467.out 281.out 242.out 163.out 771.out 324.out 224.out 050.out 764.out 124.out 382.out 278.out 058.out 741.out 384.out 042.out 497.out 466.out 193.out 097.out 392.out 283.out 541.out 770.out 709.out 755.out 309.out 441.out 157.out 740.out 356.out 341.out 494.out 189.out 555.out 241.out 540.out 077.out 412.out 514.out 414.out 314.out 440.out 114.out 316.out 074.out 147.out 012.out 155.out 340.out 793.out 156.out 572.out 568.out 240.out 279.out 180.out 733.out 280.out 434.out 140.out 766.out 185.out 408.out 383.out 066.out 552.out 304.out 204.out 353.out 425.out 069.out 254.out 335.out 531.out 235.out 556.out 253.out 503.out 418.out 275.out 272.out 496.out 751.out 433.out 176.out 134.out 393.out 333.out 476.out 535.out 739.out 233.out 752.out 736.out 107.out 053.out 164.out 587.out 339.out 294.out 521.out 352.out 799.out 489.out 139.out 774.out 267.out 390.out 399.out 781.out 017.out 169.out 593.out 186.out 452.out 252.out 585.out 167.out 724.out 206.out 794.out 348.out 394.out 509.out 248.out 785.out 424.out 750.out 525.out 488.out 040.out 325.out 551.out 225.out 125.out 142.out 715.out 789.out 581.out 152.out 563.out 215.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 351.out 430.out 276.out 290.out 094.out 451.out 450.out 744.out 043.out 086.out 349.out 444.out 500.out 487.out 762.out 544.out 305.out 395.out 515.out 415.out 389.out 315.out 344.out 115.out 015.out 542.out 250.out 791.out 464.out 475.out 536.out 228.out 439.out 244.out 128.out 385.out 005.out 336.out 150.out 579.out 236.out 342.out 580.out 136.out 036.out 198.out 723.out 008.out 790.out 505.out 405.out 588.out 205.out 105.out 144.out 768.out 437.out 037.out 044.out 719.out 381.out 721.out 323.out 519.out 562.out 419.out 219.out 123.out 056.out 019.out 577.out 151.out 760.out 574.out 332.out 796.out 027.out 372.out 584.out 462.out 220.out 350.out 312.out 492.out 745.out 076.out 112.out 063.out 561.out 214.out 776.out 014.out 758.out 362.out 387.out 594.out 438.out 265.out 289.out 554.out 516.out 477.out 548.out 560.out 166.out 461.out 445.out 296.out 207.out 493.out 786.out 007.out 251.out 380.out 093.out 526.out 479.out 426.out 192.out 326.out 226.out 454.out 126.out 121.out 447.out 761.out 773.out 460.out 485.out 347.out 035.out 361.out 564.out 788.out 795.out 089.out 747.out 558.out 162.out 743.out 288.out 197.out 396.out 576.out 051.out 354.out 355.out 575.out 148.out 301.out 360.out 543.out 263.out 270.out 261.out 734.out 045.out 292.out 482.out 726.out 729.out 378.out 458.out 062.out 249.out 231.out 343.out 334.out 590.out 368.out 486.out 223.out 132.out 023.out 459.out 032.out 798.out 277.out 748.out 527.out 146.out 398.out 366.out 427.out 190.out 173.out 470.out 484.out 754.out 767.out 749.out 187.out 091.out 201.out 725.out 731.out 782.out 374.out 583.out 285.out 127.out 256.out 501.out 376.out 431.out 068.out 331.out 179.out 713.out 024.out 513.out 413.out 313.out 549.out 213.out 730.out 113.out 013.out 031.out 435.out 182.out 057.out 727.out 078.out 510.out 184.out 797.out 534.out 545.out 210.out 449.out 327.out 330.out 067.out 227.out 010.out 230.out 083.out 473.out 299.out 073.out 370.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 742.out 245.out 026.out 522.out 787.out 422.out 222.out 159.out 539.out 524.out 122.out 448.out 234.out 022.out 174.out 779.out 490.out 565.out 090.out 423.out 154.out 271.out 149.out 518.out 318.out 264.out 218.out 118.out 018.out 329.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 712.out 321.out 533.out 512.out 221.out 087.out 212.out 538.out 021.out 195.out 388.out 483.out 397.out 070.out 373.out 720.out 481.out 196.out 520.out 129.out 446.out 420.out 478.out 320.out 499.out 153.out 402.out 302.out 020.out 529.out 002.out 717.out 429.out 417.out 317.out 365.out 092.out 117.out 357.out 072.out 778.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 511.out 029.out 311.out 211.out 011.out 783.out 170.out 286.out 756.out 175.out 714.out 559.out 710.out 410.out 310.out 401.out 101.out 001.out 141.out 495.out 048.out 589.out 753.out 095.out 297.out 480.out 145.out 257.out 757.out 491.out 081.out 800.out 777.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 780.out 553.out 763.out 375.out 298.out 259.out 080.out 708.out 508.out 409.out 307.out 209.out 109.out 009.out 391.out 284.out 557.out 453.out 364.out 582.out 735.out /var/lib/xfstests/tests/xfs 2023-07-12T02:08:10.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:08:10.846 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:08:13.114 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-07-12T02:08:13.141 INFO:teuthology.orchestra.run.smithi037.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-07-12T02:08:13.160 INFO:teuthology.orchestra.run.smithi037.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-07-12T02:08:13.184 INFO:teuthology.orchestra.run.smithi037.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-07-12T02:08:13.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:08:13.211 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec ls tests/generic) 2023-07-12T02:08:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:001 2023-07-12T02:08:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:001.out 2023-07-12T02:08:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:002 2023-07-12T02:08:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:002.out 2023-07-12T02:08:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:003 2023-07-12T02:08:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:003.out 2023-07-12T02:08:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:004 2023-07-12T02:08:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:004.out 2023-07-12T02:08:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:005 2023-07-12T02:08:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:005.out 2023-07-12T02:08:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:006 2023-07-12T02:08:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:006.out 2023-07-12T02:08:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:007 2023-07-12T02:08:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:007.out 2023-07-12T02:08:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:008 2023-07-12T02:08:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:008.out 2023-07-12T02:08:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:009 2023-07-12T02:08:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:009.out 2023-07-12T02:08:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:010 2023-07-12T02:08:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:010.out 2023-07-12T02:08:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:011 2023-07-12T02:08:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:011.out 2023-07-12T02:08:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:012 2023-07-12T02:08:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:012.out 2023-07-12T02:08:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:013 2023-07-12T02:08:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:013.out 2023-07-12T02:08:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:014 2023-07-12T02:08:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:014.out 2023-07-12T02:08:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:015 2023-07-12T02:08:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:015.out 2023-07-12T02:08:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:016 2023-07-12T02:08:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:016.out 2023-07-12T02:08:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:017 2023-07-12T02:08:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:017.out 2023-07-12T02:08:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:018 2023-07-12T02:08:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:018.out 2023-07-12T02:08:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:019 2023-07-12T02:08:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:019.out 2023-07-12T02:08:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:020 2023-07-12T02:08:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:020.out 2023-07-12T02:08:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:021 2023-07-12T02:08:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:021.out 2023-07-12T02:08:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:022 2023-07-12T02:08:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:022.out 2023-07-12T02:08:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:023 2023-07-12T02:08:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:023.out 2023-07-12T02:08:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:024 2023-07-12T02:08:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:024.out 2023-07-12T02:08:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:025 2023-07-12T02:08:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:025.out 2023-07-12T02:08:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:026 2023-07-12T02:08:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:026.out 2023-07-12T02:08:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:027 2023-07-12T02:08:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:027.out 2023-07-12T02:08:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:028 2023-07-12T02:08:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:028.out 2023-07-12T02:08:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:029 2023-07-12T02:08:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:029.out 2023-07-12T02:08:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:030 2023-07-12T02:08:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:030.out 2023-07-12T02:08:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:031 2023-07-12T02:08:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:031.out 2023-07-12T02:08:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:032 2023-07-12T02:08:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:032.out 2023-07-12T02:08:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:033 2023-07-12T02:08:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:033.out 2023-07-12T02:08:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:034 2023-07-12T02:08:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:034.out 2023-07-12T02:08:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:035 2023-07-12T02:08:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:035.cfg 2023-07-12T02:08:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:035.out.default 2023-07-12T02:08:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:035.out.nfs 2023-07-12T02:08:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:036 2023-07-12T02:08:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:036.out 2023-07-12T02:08:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:037 2023-07-12T02:08:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:037.out 2023-07-12T02:08:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:038 2023-07-12T02:08:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:038.out 2023-07-12T02:08:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:039 2023-07-12T02:08:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:039.out 2023-07-12T02:08:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:040 2023-07-12T02:08:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:040.out 2023-07-12T02:08:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:041 2023-07-12T02:08:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:041.out 2023-07-12T02:08:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:042 2023-07-12T02:08:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:042.out 2023-07-12T02:08:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:043 2023-07-12T02:08:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:043.out 2023-07-12T02:08:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:044 2023-07-12T02:08:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:044.out 2023-07-12T02:08:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:045 2023-07-12T02:08:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:045.out 2023-07-12T02:08:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:046 2023-07-12T02:08:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:046.out 2023-07-12T02:08:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:047 2023-07-12T02:08:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:047.out 2023-07-12T02:08:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:048 2023-07-12T02:08:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:048.out 2023-07-12T02:08:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:049 2023-07-12T02:08:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:049.out 2023-07-12T02:08:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:050 2023-07-12T02:08:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:050.cfg 2023-07-12T02:08:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:050.out.default 2023-07-12T02:08:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:050.out.nojournal 2023-07-12T02:08:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:050.out.xfsquota 2023-07-12T02:08:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:051 2023-07-12T02:08:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:051.out 2023-07-12T02:08:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:052 2023-07-12T02:08:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:052.out 2023-07-12T02:08:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:053 2023-07-12T02:08:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:053.out 2023-07-12T02:08:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:054 2023-07-12T02:08:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:054.out 2023-07-12T02:08:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:055 2023-07-12T02:08:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:055.out 2023-07-12T02:08:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:056 2023-07-12T02:08:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:056.out 2023-07-12T02:08:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:057 2023-07-12T02:08:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:057.out 2023-07-12T02:08:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:058 2023-07-12T02:08:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:058.out 2023-07-12T02:08:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:059 2023-07-12T02:08:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:059.out 2023-07-12T02:08:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:060 2023-07-12T02:08:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:060.out 2023-07-12T02:08:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:061 2023-07-12T02:08:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:061.out 2023-07-12T02:08:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:062 2023-07-12T02:08:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:062.out 2023-07-12T02:08:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:063 2023-07-12T02:08:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:063.out 2023-07-12T02:08:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:064 2023-07-12T02:08:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:064.out 2023-07-12T02:08:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:065 2023-07-12T02:08:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:065.out 2023-07-12T02:08:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:066 2023-07-12T02:08:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:066.out 2023-07-12T02:08:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:067 2023-07-12T02:08:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:067.out 2023-07-12T02:08:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:068 2023-07-12T02:08:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:068.out 2023-07-12T02:08:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:069 2023-07-12T02:08:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:069.out 2023-07-12T02:08:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:070 2023-07-12T02:08:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:070.out 2023-07-12T02:08:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:071 2023-07-12T02:08:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:071.out 2023-07-12T02:08:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:072 2023-07-12T02:08:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:072.out 2023-07-12T02:08:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:073 2023-07-12T02:08:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:073.out 2023-07-12T02:08:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:074 2023-07-12T02:08:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:074.out 2023-07-12T02:08:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:075 2023-07-12T02:08:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:075.out 2023-07-12T02:08:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:076 2023-07-12T02:08:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:076.out 2023-07-12T02:08:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:077 2023-07-12T02:08:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:077.out 2023-07-12T02:08:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:078 2023-07-12T02:08:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:078.out 2023-07-12T02:08:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:079 2023-07-12T02:08:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:079.out 2023-07-12T02:08:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:080 2023-07-12T02:08:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:080.out 2023-07-12T02:08:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:081 2023-07-12T02:08:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:081.out 2023-07-12T02:08:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:082 2023-07-12T02:08:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:082.out 2023-07-12T02:08:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:083 2023-07-12T02:08:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:083.out 2023-07-12T02:08:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:084 2023-07-12T02:08:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:084.out 2023-07-12T02:08:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:085 2023-07-12T02:08:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:085.out 2023-07-12T02:08:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:086 2023-07-12T02:08:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:086.out 2023-07-12T02:08:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:087 2023-07-12T02:08:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:087.out 2023-07-12T02:08:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:088 2023-07-12T02:08:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:088.out 2023-07-12T02:08:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:089 2023-07-12T02:08:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:089.out 2023-07-12T02:08:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:090 2023-07-12T02:08:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:090.out 2023-07-12T02:08:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:091 2023-07-12T02:08:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:091.out 2023-07-12T02:08:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:092 2023-07-12T02:08:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:092.out 2023-07-12T02:08:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:093 2023-07-12T02:08:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:093.out 2023-07-12T02:08:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:094 2023-07-12T02:08:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:094.out 2023-07-12T02:08:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:095 2023-07-12T02:08:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:095.out 2023-07-12T02:08:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:096 2023-07-12T02:08:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:096.out 2023-07-12T02:08:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:097 2023-07-12T02:08:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:097.out 2023-07-12T02:08:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:098 2023-07-12T02:08:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:098.out 2023-07-12T02:08:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:099 2023-07-12T02:08:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:099.out 2023-07-12T02:08:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:100 2023-07-12T02:08:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:100.out 2023-07-12T02:08:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:101 2023-07-12T02:08:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:101.out 2023-07-12T02:08:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:102 2023-07-12T02:08:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:102.out 2023-07-12T02:08:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:103 2023-07-12T02:08:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:103.out 2023-07-12T02:08:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:104 2023-07-12T02:08:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:104.out 2023-07-12T02:08:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:105 2023-07-12T02:08:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:105.out 2023-07-12T02:08:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:106 2023-07-12T02:08:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:106.out 2023-07-12T02:08:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:107 2023-07-12T02:08:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:107.out 2023-07-12T02:08:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:108 2023-07-12T02:08:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:108.out 2023-07-12T02:08:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:109 2023-07-12T02:08:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:109.out 2023-07-12T02:08:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:110 2023-07-12T02:08:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:110.out 2023-07-12T02:08:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:111 2023-07-12T02:08:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:111.out 2023-07-12T02:08:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:112 2023-07-12T02:08:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:112.out 2023-07-12T02:08:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:113 2023-07-12T02:08:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:113.out 2023-07-12T02:08:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:114 2023-07-12T02:08:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:114.out 2023-07-12T02:08:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:115 2023-07-12T02:08:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:115.out 2023-07-12T02:08:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:116 2023-07-12T02:08:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:116.out 2023-07-12T02:08:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:117 2023-07-12T02:08:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:117.out 2023-07-12T02:08:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:118 2023-07-12T02:08:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:118.out 2023-07-12T02:08:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:119 2023-07-12T02:08:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:119.out 2023-07-12T02:08:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:120 2023-07-12T02:08:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:120.out 2023-07-12T02:08:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:121 2023-07-12T02:08:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:121.out 2023-07-12T02:08:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:122 2023-07-12T02:08:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:122.out 2023-07-12T02:08:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:123 2023-07-12T02:08:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:123.out 2023-07-12T02:08:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:124 2023-07-12T02:08:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:124.out 2023-07-12T02:08:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:125 2023-07-12T02:08:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:125.out 2023-07-12T02:08:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:126 2023-07-12T02:08:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:126.out 2023-07-12T02:08:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:127 2023-07-12T02:08:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:127.out 2023-07-12T02:08:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:128 2023-07-12T02:08:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:128.out 2023-07-12T02:08:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:129 2023-07-12T02:08:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:129.out 2023-07-12T02:08:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:130 2023-07-12T02:08:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:130.out 2023-07-12T02:08:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:131 2023-07-12T02:08:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:131.out 2023-07-12T02:08:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:132 2023-07-12T02:08:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:132.out 2023-07-12T02:08:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:133 2023-07-12T02:08:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:133.out 2023-07-12T02:08:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:134 2023-07-12T02:08:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:134.out 2023-07-12T02:08:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:135 2023-07-12T02:08:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:135.out 2023-07-12T02:08:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:136 2023-07-12T02:08:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:136.out 2023-07-12T02:08:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:137 2023-07-12T02:08:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:137.out 2023-07-12T02:08:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:138 2023-07-12T02:08:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:138.out 2023-07-12T02:08:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:139 2023-07-12T02:08:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:139.out 2023-07-12T02:08:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:140 2023-07-12T02:08:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:140.out 2023-07-12T02:08:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:141 2023-07-12T02:08:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:141.out 2023-07-12T02:08:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:142 2023-07-12T02:08:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:142.out 2023-07-12T02:08:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:143 2023-07-12T02:08:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:143.out 2023-07-12T02:08:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:144 2023-07-12T02:08:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:144.out 2023-07-12T02:08:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:145 2023-07-12T02:08:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:145.out 2023-07-12T02:08:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:146 2023-07-12T02:08:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:146.out 2023-07-12T02:08:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:147 2023-07-12T02:08:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:147.out 2023-07-12T02:08:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:148 2023-07-12T02:08:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:148.out 2023-07-12T02:08:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:149 2023-07-12T02:08:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:149.out 2023-07-12T02:08:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:150 2023-07-12T02:08:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:150.out 2023-07-12T02:08:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:151 2023-07-12T02:08:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:151.out 2023-07-12T02:08:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:152 2023-07-12T02:08:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:152.out 2023-07-12T02:08:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:153 2023-07-12T02:08:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:153.out 2023-07-12T02:08:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:154 2023-07-12T02:08:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:154.out 2023-07-12T02:08:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:155 2023-07-12T02:08:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:155.out 2023-07-12T02:08:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:156 2023-07-12T02:08:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:156.out 2023-07-12T02:08:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:157 2023-07-12T02:08:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:157.out 2023-07-12T02:08:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:158 2023-07-12T02:08:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:158.out 2023-07-12T02:08:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:159 2023-07-12T02:08:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:159.out 2023-07-12T02:08:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:160 2023-07-12T02:08:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:160.out 2023-07-12T02:08:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:161 2023-07-12T02:08:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:161.out 2023-07-12T02:08:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:162 2023-07-12T02:08:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:162.out 2023-07-12T02:08:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:163 2023-07-12T02:08:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:163.out 2023-07-12T02:08:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:164 2023-07-12T02:08:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:164.out 2023-07-12T02:08:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:165 2023-07-12T02:08:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:165.out 2023-07-12T02:08:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:166 2023-07-12T02:08:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:166.out 2023-07-12T02:08:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:167 2023-07-12T02:08:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:167.out 2023-07-12T02:08:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:168 2023-07-12T02:08:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:168.out 2023-07-12T02:08:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:169 2023-07-12T02:08:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:169.out 2023-07-12T02:08:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:170 2023-07-12T02:08:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:170.out 2023-07-12T02:08:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:171 2023-07-12T02:08:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:171.out 2023-07-12T02:08:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:172 2023-07-12T02:08:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:172.out 2023-07-12T02:08:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:173 2023-07-12T02:08:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:173.out 2023-07-12T02:08:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:174 2023-07-12T02:08:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:174.out 2023-07-12T02:08:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:175 2023-07-12T02:08:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:175.out 2023-07-12T02:08:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:176 2023-07-12T02:08:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:176.out 2023-07-12T02:08:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:177 2023-07-12T02:08:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:177.out 2023-07-12T02:08:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:178 2023-07-12T02:08:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:178.out 2023-07-12T02:08:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:179 2023-07-12T02:08:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:179.out 2023-07-12T02:08:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:180 2023-07-12T02:08:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:180.out 2023-07-12T02:08:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:181 2023-07-12T02:08:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:181.out 2023-07-12T02:08:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:182 2023-07-12T02:08:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:182.out 2023-07-12T02:08:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:183 2023-07-12T02:08:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:183.out 2023-07-12T02:08:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:184 2023-07-12T02:08:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:184.out 2023-07-12T02:08:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:185 2023-07-12T02:08:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:185.out 2023-07-12T02:08:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:186 2023-07-12T02:08:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:186.out 2023-07-12T02:08:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:187 2023-07-12T02:08:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:187.out 2023-07-12T02:08:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:188 2023-07-12T02:08:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:188.out 2023-07-12T02:08:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:189 2023-07-12T02:08:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:189.out 2023-07-12T02:08:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:190 2023-07-12T02:08:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:190.out 2023-07-12T02:08:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:191 2023-07-12T02:08:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:191.out 2023-07-12T02:08:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:192 2023-07-12T02:08:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:192.out 2023-07-12T02:08:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:193 2023-07-12T02:08:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:193.out 2023-07-12T02:08:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:194 2023-07-12T02:08:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:194.out 2023-07-12T02:08:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:195 2023-07-12T02:08:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:195.out 2023-07-12T02:08:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:196 2023-07-12T02:08:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:196.out 2023-07-12T02:08:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:197 2023-07-12T02:08:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:197.out 2023-07-12T02:08:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:198 2023-07-12T02:08:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:198.out 2023-07-12T02:08:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:199 2023-07-12T02:08:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:199.out 2023-07-12T02:08:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:200 2023-07-12T02:08:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:200.out 2023-07-12T02:08:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:201 2023-07-12T02:08:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:201.out 2023-07-12T02:08:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:202 2023-07-12T02:08:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:202.out 2023-07-12T02:08:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:203 2023-07-12T02:08:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:203.out 2023-07-12T02:08:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:204 2023-07-12T02:08:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:204.out 2023-07-12T02:08:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:205 2023-07-12T02:08:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:205.out 2023-07-12T02:08:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:206 2023-07-12T02:08:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:206.out 2023-07-12T02:08:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:207 2023-07-12T02:08:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:207.out 2023-07-12T02:08:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:208 2023-07-12T02:08:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:208.out 2023-07-12T02:08:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:209 2023-07-12T02:08:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:209.out 2023-07-12T02:08:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:210 2023-07-12T02:08:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:210.out 2023-07-12T02:08:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:211 2023-07-12T02:08:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:211.out 2023-07-12T02:08:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:212 2023-07-12T02:08:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:212.out 2023-07-12T02:08:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:213 2023-07-12T02:08:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:213.out 2023-07-12T02:08:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:214 2023-07-12T02:08:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:214.out 2023-07-12T02:08:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:215 2023-07-12T02:08:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:215.out 2023-07-12T02:08:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:216 2023-07-12T02:08:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:216.out 2023-07-12T02:08:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:217 2023-07-12T02:08:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:217.out 2023-07-12T02:08:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:218 2023-07-12T02:08:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:218.out 2023-07-12T02:08:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:219 2023-07-12T02:08:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:219.out 2023-07-12T02:08:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:220 2023-07-12T02:08:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:220.out 2023-07-12T02:08:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:221 2023-07-12T02:08:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:221.out 2023-07-12T02:08:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:222 2023-07-12T02:08:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:222.out 2023-07-12T02:08:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:223 2023-07-12T02:08:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:223.out 2023-07-12T02:08:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:224 2023-07-12T02:08:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:224.out 2023-07-12T02:08:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:225 2023-07-12T02:08:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:225.out 2023-07-12T02:08:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:226 2023-07-12T02:08:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:226.out 2023-07-12T02:08:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:227 2023-07-12T02:08:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:227.out 2023-07-12T02:08:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:228 2023-07-12T02:08:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:228.out 2023-07-12T02:08:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:229 2023-07-12T02:08:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:229.out 2023-07-12T02:08:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:230 2023-07-12T02:08:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:230.out 2023-07-12T02:08:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:231 2023-07-12T02:08:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:231.out 2023-07-12T02:08:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:232 2023-07-12T02:08:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:232.out 2023-07-12T02:08:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:233 2023-07-12T02:08:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:233.out 2023-07-12T02:08:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:234 2023-07-12T02:08:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:234.out 2023-07-12T02:08:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:235 2023-07-12T02:08:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:235.out 2023-07-12T02:08:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:236 2023-07-12T02:08:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:236.out 2023-07-12T02:08:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:237 2023-07-12T02:08:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:237.out 2023-07-12T02:08:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:238 2023-07-12T02:08:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:238.out 2023-07-12T02:08:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:239 2023-07-12T02:08:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:239.out 2023-07-12T02:08:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:240 2023-07-12T02:08:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:240.out 2023-07-12T02:08:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:241 2023-07-12T02:08:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:241.out 2023-07-12T02:08:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:242 2023-07-12T02:08:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:242.out 2023-07-12T02:08:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:243 2023-07-12T02:08:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:243.out 2023-07-12T02:08:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:244 2023-07-12T02:08:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:244.out 2023-07-12T02:08:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:245 2023-07-12T02:08:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:245.out 2023-07-12T02:08:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:246 2023-07-12T02:08:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:246.out 2023-07-12T02:08:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:247 2023-07-12T02:08:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:247.out 2023-07-12T02:08:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:248 2023-07-12T02:08:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:248.out 2023-07-12T02:08:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:249 2023-07-12T02:08:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:249.out 2023-07-12T02:08:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:250 2023-07-12T02:08:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:250.out 2023-07-12T02:08:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:251 2023-07-12T02:08:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:251.out 2023-07-12T02:08:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:252 2023-07-12T02:08:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:252.out 2023-07-12T02:08:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:253 2023-07-12T02:08:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:253.out 2023-07-12T02:08:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:254 2023-07-12T02:08:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:254.out 2023-07-12T02:08:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:255 2023-07-12T02:08:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:255.out 2023-07-12T02:08:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:256 2023-07-12T02:08:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:256.out 2023-07-12T02:08:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:257 2023-07-12T02:08:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:257.out 2023-07-12T02:08:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:258 2023-07-12T02:08:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:258.out 2023-07-12T02:08:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:259 2023-07-12T02:08:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:259.out 2023-07-12T02:08:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:260 2023-07-12T02:08:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:260.out 2023-07-12T02:08:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:261 2023-07-12T02:08:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:261.out 2023-07-12T02:08:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:262 2023-07-12T02:08:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:262.out 2023-07-12T02:08:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:263 2023-07-12T02:08:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:263.out 2023-07-12T02:08:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:264 2023-07-12T02:08:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:264.out 2023-07-12T02:08:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:265 2023-07-12T02:08:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:265.out 2023-07-12T02:08:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:266 2023-07-12T02:08:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:266.out 2023-07-12T02:08:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:267 2023-07-12T02:08:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:267.out 2023-07-12T02:08:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:268 2023-07-12T02:08:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:268.out 2023-07-12T02:08:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:269 2023-07-12T02:08:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:269.out 2023-07-12T02:08:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:270 2023-07-12T02:08:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:270.out 2023-07-12T02:08:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:271 2023-07-12T02:08:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:271.out 2023-07-12T02:08:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:272 2023-07-12T02:08:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:272.out 2023-07-12T02:08:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:273 2023-07-12T02:08:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:273.out 2023-07-12T02:08:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:274 2023-07-12T02:08:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:274.out 2023-07-12T02:08:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:275 2023-07-12T02:08:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:275.out 2023-07-12T02:08:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:276 2023-07-12T02:08:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:276.out 2023-07-12T02:08:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:277 2023-07-12T02:08:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:277.out 2023-07-12T02:08:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:278 2023-07-12T02:08:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:278.out 2023-07-12T02:08:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:279 2023-07-12T02:08:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:279.out 2023-07-12T02:08:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:280 2023-07-12T02:08:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:280.out 2023-07-12T02:08:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:281 2023-07-12T02:08:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:281.out 2023-07-12T02:08:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:282 2023-07-12T02:08:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:282.out 2023-07-12T02:08:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:283 2023-07-12T02:08:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:283.out 2023-07-12T02:08:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:284 2023-07-12T02:08:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:284.out 2023-07-12T02:08:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:285 2023-07-12T02:08:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:285.out 2023-07-12T02:08:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:286 2023-07-12T02:08:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:286.out 2023-07-12T02:08:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:287 2023-07-12T02:08:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:287.out 2023-07-12T02:08:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:288 2023-07-12T02:08:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:288.out 2023-07-12T02:08:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:289 2023-07-12T02:08:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:289.out 2023-07-12T02:08:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:290 2023-07-12T02:08:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:290.out 2023-07-12T02:08:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:291 2023-07-12T02:08:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:291.out 2023-07-12T02:08:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:292 2023-07-12T02:08:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:292.out 2023-07-12T02:08:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:293 2023-07-12T02:08:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:293.out 2023-07-12T02:08:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:294 2023-07-12T02:08:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:294.out 2023-07-12T02:08:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:295 2023-07-12T02:08:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:295.out 2023-07-12T02:08:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:296 2023-07-12T02:08:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:296.out 2023-07-12T02:08:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:297 2023-07-12T02:08:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:297.out 2023-07-12T02:08:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:298 2023-07-12T02:08:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:298.out 2023-07-12T02:08:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:299 2023-07-12T02:08:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:299.out 2023-07-12T02:08:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:300 2023-07-12T02:08:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:300.out 2023-07-12T02:08:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:301 2023-07-12T02:08:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:301.out 2023-07-12T02:08:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:302 2023-07-12T02:08:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:302.out 2023-07-12T02:08:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:303 2023-07-12T02:08:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:303.out 2023-07-12T02:08:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:304 2023-07-12T02:08:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:304.out 2023-07-12T02:08:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:305 2023-07-12T02:08:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:305.out 2023-07-12T02:08:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:306 2023-07-12T02:08:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:306.out 2023-07-12T02:08:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:307 2023-07-12T02:08:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:307.out 2023-07-12T02:08:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:308 2023-07-12T02:08:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:308.out 2023-07-12T02:08:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:309 2023-07-12T02:08:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:309.out 2023-07-12T02:08:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:310 2023-07-12T02:08:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:310.out 2023-07-12T02:08:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:311 2023-07-12T02:08:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:311.out 2023-07-12T02:08:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:312 2023-07-12T02:08:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:312.out 2023-07-12T02:08:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:313 2023-07-12T02:08:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:313.out 2023-07-12T02:08:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:314 2023-07-12T02:08:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:314.out 2023-07-12T02:08:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:315 2023-07-12T02:08:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:315.out 2023-07-12T02:08:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:316 2023-07-12T02:08:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:316.out 2023-07-12T02:08:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:317 2023-07-12T02:08:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:317.out 2023-07-12T02:08:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:318 2023-07-12T02:08:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:318.out 2023-07-12T02:08:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:319 2023-07-12T02:08:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:319.out 2023-07-12T02:08:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:320 2023-07-12T02:08:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:320.out 2023-07-12T02:08:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:321 2023-07-12T02:08:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:321.out 2023-07-12T02:08:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:322 2023-07-12T02:08:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:322.out 2023-07-12T02:08:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:323 2023-07-12T02:08:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:323.out 2023-07-12T02:08:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:324 2023-07-12T02:08:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:324.out 2023-07-12T02:08:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:325 2023-07-12T02:08:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:325.out 2023-07-12T02:08:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:326 2023-07-12T02:08:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:326.out 2023-07-12T02:08:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:327 2023-07-12T02:08:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:327.out 2023-07-12T02:08:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:328 2023-07-12T02:08:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:328.out 2023-07-12T02:08:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:329 2023-07-12T02:08:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:329.out 2023-07-12T02:08:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:330 2023-07-12T02:08:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:330.out 2023-07-12T02:08:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:331 2023-07-12T02:08:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:331.out 2023-07-12T02:08:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:332 2023-07-12T02:08:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:332.out 2023-07-12T02:08:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:333 2023-07-12T02:08:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:333.out 2023-07-12T02:08:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:334 2023-07-12T02:08:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:334.out 2023-07-12T02:08:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:335 2023-07-12T02:08:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:335.out 2023-07-12T02:08:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:336 2023-07-12T02:08:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:336.out 2023-07-12T02:08:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:337 2023-07-12T02:08:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:337.out 2023-07-12T02:08:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:338 2023-07-12T02:08:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:338.out 2023-07-12T02:08:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:339 2023-07-12T02:08:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:339.out 2023-07-12T02:08:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:340 2023-07-12T02:08:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:340.out 2023-07-12T02:08:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:341 2023-07-12T02:08:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:341.out 2023-07-12T02:08:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:342 2023-07-12T02:08:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:342.out 2023-07-12T02:08:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:343 2023-07-12T02:08:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:343.out 2023-07-12T02:08:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:344 2023-07-12T02:08:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:344.out 2023-07-12T02:08:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:345 2023-07-12T02:08:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:345.out 2023-07-12T02:08:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:346 2023-07-12T02:08:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:346.out 2023-07-12T02:08:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:347 2023-07-12T02:08:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:347.out 2023-07-12T02:08:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:348 2023-07-12T02:08:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:348.out 2023-07-12T02:08:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:349 2023-07-12T02:08:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:349.out 2023-07-12T02:08:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:350 2023-07-12T02:08:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:350.out 2023-07-12T02:08:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:351 2023-07-12T02:08:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:351.out 2023-07-12T02:08:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:352 2023-07-12T02:08:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:352.out 2023-07-12T02:08:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:353 2023-07-12T02:08:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:353.out 2023-07-12T02:08:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:354 2023-07-12T02:08:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:354.out 2023-07-12T02:08:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:355 2023-07-12T02:08:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:355.out 2023-07-12T02:08:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:356 2023-07-12T02:08:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:356.out 2023-07-12T02:08:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:357 2023-07-12T02:08:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:357.out 2023-07-12T02:08:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:358 2023-07-12T02:08:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:358.out 2023-07-12T02:08:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:359 2023-07-12T02:08:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:359.out 2023-07-12T02:08:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:360 2023-07-12T02:08:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:360.out 2023-07-12T02:08:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:361 2023-07-12T02:08:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:361.out 2023-07-12T02:08:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:362 2023-07-12T02:08:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:362.out 2023-07-12T02:08:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:363 2023-07-12T02:08:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:363.out 2023-07-12T02:08:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:364 2023-07-12T02:08:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:364.out 2023-07-12T02:08:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:365 2023-07-12T02:08:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:365.out 2023-07-12T02:08:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:366 2023-07-12T02:08:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:366.out 2023-07-12T02:08:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:367 2023-07-12T02:08:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:367.out 2023-07-12T02:08:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:368 2023-07-12T02:08:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:368.out 2023-07-12T02:08:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:369 2023-07-12T02:08:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:369.out 2023-07-12T02:08:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:370 2023-07-12T02:08:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:370.out 2023-07-12T02:08:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:371 2023-07-12T02:08:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:371.out 2023-07-12T02:08:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:372 2023-07-12T02:08:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:372.out 2023-07-12T02:08:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:373 2023-07-12T02:08:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:373.out 2023-07-12T02:08:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:374 2023-07-12T02:08:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:374.out 2023-07-12T02:08:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:375 2023-07-12T02:08:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:375.out 2023-07-12T02:08:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:376 2023-07-12T02:08:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:376.out 2023-07-12T02:08:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:377 2023-07-12T02:08:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:377.out 2023-07-12T02:08:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:378 2023-07-12T02:08:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:378.out 2023-07-12T02:08:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:379 2023-07-12T02:08:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:379.out 2023-07-12T02:08:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:380 2023-07-12T02:08:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:380.out 2023-07-12T02:08:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:381 2023-07-12T02:08:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:381.out 2023-07-12T02:08:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:382 2023-07-12T02:08:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:382.out 2023-07-12T02:08:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:383 2023-07-12T02:08:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:383.out 2023-07-12T02:08:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:384 2023-07-12T02:08:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:384.out 2023-07-12T02:08:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:385 2023-07-12T02:08:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:385.out 2023-07-12T02:08:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:386 2023-07-12T02:08:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:386.out 2023-07-12T02:08:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:387 2023-07-12T02:08:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:387.out 2023-07-12T02:08:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:388 2023-07-12T02:08:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:388.out 2023-07-12T02:08:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:389 2023-07-12T02:08:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:389.out 2023-07-12T02:08:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:390 2023-07-12T02:08:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:390.out 2023-07-12T02:08:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:391 2023-07-12T02:08:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:391.out 2023-07-12T02:08:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:392 2023-07-12T02:08:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:392.out 2023-07-12T02:08:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:393 2023-07-12T02:08:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:393.out 2023-07-12T02:08:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:394 2023-07-12T02:08:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:394.out 2023-07-12T02:08:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:395 2023-07-12T02:08:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:395.out 2023-07-12T02:08:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:396 2023-07-12T02:08:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:396.out 2023-07-12T02:08:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:397 2023-07-12T02:08:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:397.out 2023-07-12T02:08:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:398 2023-07-12T02:08:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:398.out 2023-07-12T02:08:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:399 2023-07-12T02:08:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:399.out 2023-07-12T02:08:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:400 2023-07-12T02:08:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:400.out 2023-07-12T02:08:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:401 2023-07-12T02:08:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:401.out 2023-07-12T02:08:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:402 2023-07-12T02:08:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:402.out 2023-07-12T02:08:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:403 2023-07-12T02:08:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:403.out 2023-07-12T02:08:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:404 2023-07-12T02:08:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:404.out 2023-07-12T02:08:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:405 2023-07-12T02:08:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:405.out 2023-07-12T02:08:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:406 2023-07-12T02:08:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:406.out 2023-07-12T02:08:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:407 2023-07-12T02:08:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:407.out 2023-07-12T02:08:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:408 2023-07-12T02:08:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:408.out 2023-07-12T02:08:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:409 2023-07-12T02:08:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:409.out 2023-07-12T02:08:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:410 2023-07-12T02:08:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:410.out 2023-07-12T02:08:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:411 2023-07-12T02:08:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:411.out 2023-07-12T02:08:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:412 2023-07-12T02:08:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:412.out 2023-07-12T02:08:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:413 2023-07-12T02:08:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:413.out 2023-07-12T02:08:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:414 2023-07-12T02:08:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:414.out 2023-07-12T02:08:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:415 2023-07-12T02:08:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:415.out 2023-07-12T02:08:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:416 2023-07-12T02:08:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:416.out 2023-07-12T02:08:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:417 2023-07-12T02:08:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:417.out 2023-07-12T02:08:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:418 2023-07-12T02:08:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:418.out 2023-07-12T02:08:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:419 2023-07-12T02:08:13.367 INFO:teuthology.orchestra.run.smithi037.stdout:419.out 2023-07-12T02:08:13.367 INFO:teuthology.orchestra.run.smithi037.stdout:420 2023-07-12T02:08:13.367 INFO:teuthology.orchestra.run.smithi037.stdout:420.out 2023-07-12T02:08:13.367 INFO:teuthology.orchestra.run.smithi037.stdout:421 2023-07-12T02:08:13.367 INFO:teuthology.orchestra.run.smithi037.stdout:421.out 2023-07-12T02:08:13.367 INFO:teuthology.orchestra.run.smithi037.stdout:422 2023-07-12T02:08:13.367 INFO:teuthology.orchestra.run.smithi037.stdout:422.out 2023-07-12T02:08:13.367 INFO:teuthology.orchestra.run.smithi037.stdout:423 2023-07-12T02:08:13.368 INFO:teuthology.orchestra.run.smithi037.stdout:423.out 2023-07-12T02:08:13.368 INFO:teuthology.orchestra.run.smithi037.stdout:424 2023-07-12T02:08:13.368 INFO:teuthology.orchestra.run.smithi037.stdout:424.out 2023-07-12T02:08:13.368 INFO:teuthology.orchestra.run.smithi037.stdout:425 2023-07-12T02:08:13.368 INFO:teuthology.orchestra.run.smithi037.stdout:425.out 2023-07-12T02:08:13.368 INFO:teuthology.orchestra.run.smithi037.stdout:426 2023-07-12T02:08:13.368 INFO:teuthology.orchestra.run.smithi037.stdout:426.out 2023-07-12T02:08:13.368 INFO:teuthology.orchestra.run.smithi037.stdout:427 2023-07-12T02:08:13.369 INFO:teuthology.orchestra.run.smithi037.stdout:427.out 2023-07-12T02:08:13.369 INFO:teuthology.orchestra.run.smithi037.stdout:428 2023-07-12T02:08:13.369 INFO:teuthology.orchestra.run.smithi037.stdout:428.out 2023-07-12T02:08:13.369 INFO:teuthology.orchestra.run.smithi037.stdout:429 2023-07-12T02:08:13.369 INFO:teuthology.orchestra.run.smithi037.stdout:429.out 2023-07-12T02:08:13.369 INFO:teuthology.orchestra.run.smithi037.stdout:430 2023-07-12T02:08:13.369 INFO:teuthology.orchestra.run.smithi037.stdout:430.out 2023-07-12T02:08:13.369 INFO:teuthology.orchestra.run.smithi037.stdout:431 2023-07-12T02:08:13.370 INFO:teuthology.orchestra.run.smithi037.stdout:431.out 2023-07-12T02:08:13.370 INFO:teuthology.orchestra.run.smithi037.stdout:432 2023-07-12T02:08:13.370 INFO:teuthology.orchestra.run.smithi037.stdout:432.out 2023-07-12T02:08:13.370 INFO:teuthology.orchestra.run.smithi037.stdout:433 2023-07-12T02:08:13.370 INFO:teuthology.orchestra.run.smithi037.stdout:433.out 2023-07-12T02:08:13.370 INFO:teuthology.orchestra.run.smithi037.stdout:434 2023-07-12T02:08:13.370 INFO:teuthology.orchestra.run.smithi037.stdout:434.out 2023-07-12T02:08:13.370 INFO:teuthology.orchestra.run.smithi037.stdout:435 2023-07-12T02:08:13.371 INFO:teuthology.orchestra.run.smithi037.stdout:435.out 2023-07-12T02:08:13.371 INFO:teuthology.orchestra.run.smithi037.stdout:436 2023-07-12T02:08:13.371 INFO:teuthology.orchestra.run.smithi037.stdout:436.out 2023-07-12T02:08:13.371 INFO:teuthology.orchestra.run.smithi037.stdout:437 2023-07-12T02:08:13.371 INFO:teuthology.orchestra.run.smithi037.stdout:437.out 2023-07-12T02:08:13.371 INFO:teuthology.orchestra.run.smithi037.stdout:438 2023-07-12T02:08:13.371 INFO:teuthology.orchestra.run.smithi037.stdout:438.out 2023-07-12T02:08:13.371 INFO:teuthology.orchestra.run.smithi037.stdout:439 2023-07-12T02:08:13.372 INFO:teuthology.orchestra.run.smithi037.stdout:439.out 2023-07-12T02:08:13.372 INFO:teuthology.orchestra.run.smithi037.stdout:440 2023-07-12T02:08:13.372 INFO:teuthology.orchestra.run.smithi037.stdout:440.out 2023-07-12T02:08:13.372 INFO:teuthology.orchestra.run.smithi037.stdout:441 2023-07-12T02:08:13.372 INFO:teuthology.orchestra.run.smithi037.stdout:441.out 2023-07-12T02:08:13.372 INFO:teuthology.orchestra.run.smithi037.stdout:442 2023-07-12T02:08:13.372 INFO:teuthology.orchestra.run.smithi037.stdout:442.out 2023-07-12T02:08:13.372 INFO:teuthology.orchestra.run.smithi037.stdout:443 2023-07-12T02:08:13.373 INFO:teuthology.orchestra.run.smithi037.stdout:443.out 2023-07-12T02:08:13.373 INFO:teuthology.orchestra.run.smithi037.stdout:444 2023-07-12T02:08:13.373 INFO:teuthology.orchestra.run.smithi037.stdout:444.out 2023-07-12T02:08:13.373 INFO:teuthology.orchestra.run.smithi037.stdout:445 2023-07-12T02:08:13.373 INFO:teuthology.orchestra.run.smithi037.stdout:445.out 2023-07-12T02:08:13.373 INFO:teuthology.orchestra.run.smithi037.stdout:446 2023-07-12T02:08:13.373 INFO:teuthology.orchestra.run.smithi037.stdout:446.out 2023-07-12T02:08:13.373 INFO:teuthology.orchestra.run.smithi037.stdout:447 2023-07-12T02:08:13.374 INFO:teuthology.orchestra.run.smithi037.stdout:447.out 2023-07-12T02:08:13.374 INFO:teuthology.orchestra.run.smithi037.stdout:448 2023-07-12T02:08:13.374 INFO:teuthology.orchestra.run.smithi037.stdout:448.out 2023-07-12T02:08:13.374 INFO:teuthology.orchestra.run.smithi037.stdout:449 2023-07-12T02:08:13.374 INFO:teuthology.orchestra.run.smithi037.stdout:449.out 2023-07-12T02:08:13.374 INFO:teuthology.orchestra.run.smithi037.stdout:450 2023-07-12T02:08:13.374 INFO:teuthology.orchestra.run.smithi037.stdout:450.out 2023-07-12T02:08:13.374 INFO:teuthology.orchestra.run.smithi037.stdout:451 2023-07-12T02:08:13.375 INFO:teuthology.orchestra.run.smithi037.stdout:451.out 2023-07-12T02:08:13.375 INFO:teuthology.orchestra.run.smithi037.stdout:452 2023-07-12T02:08:13.375 INFO:teuthology.orchestra.run.smithi037.stdout:452.out 2023-07-12T02:08:13.375 INFO:teuthology.orchestra.run.smithi037.stdout:453 2023-07-12T02:08:13.375 INFO:teuthology.orchestra.run.smithi037.stdout:453.out 2023-07-12T02:08:13.375 INFO:teuthology.orchestra.run.smithi037.stdout:454 2023-07-12T02:08:13.375 INFO:teuthology.orchestra.run.smithi037.stdout:454.out 2023-07-12T02:08:13.375 INFO:teuthology.orchestra.run.smithi037.stdout:455 2023-07-12T02:08:13.376 INFO:teuthology.orchestra.run.smithi037.stdout:455.out 2023-07-12T02:08:13.376 INFO:teuthology.orchestra.run.smithi037.stdout:456 2023-07-12T02:08:13.376 INFO:teuthology.orchestra.run.smithi037.stdout:456.out 2023-07-12T02:08:13.376 INFO:teuthology.orchestra.run.smithi037.stdout:457 2023-07-12T02:08:13.376 INFO:teuthology.orchestra.run.smithi037.stdout:457.out 2023-07-12T02:08:13.376 INFO:teuthology.orchestra.run.smithi037.stdout:458 2023-07-12T02:08:13.376 INFO:teuthology.orchestra.run.smithi037.stdout:458.out 2023-07-12T02:08:13.376 INFO:teuthology.orchestra.run.smithi037.stdout:459 2023-07-12T02:08:13.377 INFO:teuthology.orchestra.run.smithi037.stdout:459.out 2023-07-12T02:08:13.377 INFO:teuthology.orchestra.run.smithi037.stdout:460 2023-07-12T02:08:13.377 INFO:teuthology.orchestra.run.smithi037.stdout:460.out 2023-07-12T02:08:13.377 INFO:teuthology.orchestra.run.smithi037.stdout:461 2023-07-12T02:08:13.377 INFO:teuthology.orchestra.run.smithi037.stdout:461.out 2023-07-12T02:08:13.377 INFO:teuthology.orchestra.run.smithi037.stdout:462 2023-07-12T02:08:13.377 INFO:teuthology.orchestra.run.smithi037.stdout:462.out 2023-07-12T02:08:13.377 INFO:teuthology.orchestra.run.smithi037.stdout:463 2023-07-12T02:08:13.378 INFO:teuthology.orchestra.run.smithi037.stdout:463.out 2023-07-12T02:08:13.378 INFO:teuthology.orchestra.run.smithi037.stdout:464 2023-07-12T02:08:13.378 INFO:teuthology.orchestra.run.smithi037.stdout:464.out 2023-07-12T02:08:13.378 INFO:teuthology.orchestra.run.smithi037.stdout:465 2023-07-12T02:08:13.378 INFO:teuthology.orchestra.run.smithi037.stdout:465.out 2023-07-12T02:08:13.378 INFO:teuthology.orchestra.run.smithi037.stdout:466 2023-07-12T02:08:13.378 INFO:teuthology.orchestra.run.smithi037.stdout:466.out 2023-07-12T02:08:13.378 INFO:teuthology.orchestra.run.smithi037.stdout:467 2023-07-12T02:08:13.379 INFO:teuthology.orchestra.run.smithi037.stdout:467.out 2023-07-12T02:08:13.379 INFO:teuthology.orchestra.run.smithi037.stdout:468 2023-07-12T02:08:13.379 INFO:teuthology.orchestra.run.smithi037.stdout:468.out 2023-07-12T02:08:13.379 INFO:teuthology.orchestra.run.smithi037.stdout:469 2023-07-12T02:08:13.379 INFO:teuthology.orchestra.run.smithi037.stdout:469.out 2023-07-12T02:08:13.379 INFO:teuthology.orchestra.run.smithi037.stdout:470 2023-07-12T02:08:13.379 INFO:teuthology.orchestra.run.smithi037.stdout:470.out 2023-07-12T02:08:13.379 INFO:teuthology.orchestra.run.smithi037.stdout:471 2023-07-12T02:08:13.380 INFO:teuthology.orchestra.run.smithi037.stdout:471.out 2023-07-12T02:08:13.380 INFO:teuthology.orchestra.run.smithi037.stdout:472 2023-07-12T02:08:13.380 INFO:teuthology.orchestra.run.smithi037.stdout:472.out 2023-07-12T02:08:13.380 INFO:teuthology.orchestra.run.smithi037.stdout:473 2023-07-12T02:08:13.380 INFO:teuthology.orchestra.run.smithi037.stdout:473.out 2023-07-12T02:08:13.380 INFO:teuthology.orchestra.run.smithi037.stdout:474 2023-07-12T02:08:13.380 INFO:teuthology.orchestra.run.smithi037.stdout:474.out 2023-07-12T02:08:13.380 INFO:teuthology.orchestra.run.smithi037.stdout:475 2023-07-12T02:08:13.381 INFO:teuthology.orchestra.run.smithi037.stdout:475.out 2023-07-12T02:08:13.381 INFO:teuthology.orchestra.run.smithi037.stdout:476 2023-07-12T02:08:13.381 INFO:teuthology.orchestra.run.smithi037.stdout:476.out 2023-07-12T02:08:13.381 INFO:teuthology.orchestra.run.smithi037.stdout:477 2023-07-12T02:08:13.381 INFO:teuthology.orchestra.run.smithi037.stdout:477.out 2023-07-12T02:08:13.381 INFO:teuthology.orchestra.run.smithi037.stdout:478 2023-07-12T02:08:13.381 INFO:teuthology.orchestra.run.smithi037.stdout:478.out 2023-07-12T02:08:13.381 INFO:teuthology.orchestra.run.smithi037.stdout:479 2023-07-12T02:08:13.382 INFO:teuthology.orchestra.run.smithi037.stdout:479.out 2023-07-12T02:08:13.382 INFO:teuthology.orchestra.run.smithi037.stdout:480 2023-07-12T02:08:13.382 INFO:teuthology.orchestra.run.smithi037.stdout:480.out 2023-07-12T02:08:13.382 INFO:teuthology.orchestra.run.smithi037.stdout:481 2023-07-12T02:08:13.382 INFO:teuthology.orchestra.run.smithi037.stdout:481.out 2023-07-12T02:08:13.382 INFO:teuthology.orchestra.run.smithi037.stdout:482 2023-07-12T02:08:13.382 INFO:teuthology.orchestra.run.smithi037.stdout:482.out 2023-07-12T02:08:13.382 INFO:teuthology.orchestra.run.smithi037.stdout:483 2023-07-12T02:08:13.383 INFO:teuthology.orchestra.run.smithi037.stdout:483.out 2023-07-12T02:08:13.383 INFO:teuthology.orchestra.run.smithi037.stdout:484 2023-07-12T02:08:13.383 INFO:teuthology.orchestra.run.smithi037.stdout:484.out 2023-07-12T02:08:13.383 INFO:teuthology.orchestra.run.smithi037.stdout:485 2023-07-12T02:08:13.383 INFO:teuthology.orchestra.run.smithi037.stdout:485.out 2023-07-12T02:08:13.383 INFO:teuthology.orchestra.run.smithi037.stdout:486 2023-07-12T02:08:13.383 INFO:teuthology.orchestra.run.smithi037.stdout:486.out 2023-07-12T02:08:13.383 INFO:teuthology.orchestra.run.smithi037.stdout:487 2023-07-12T02:08:13.384 INFO:teuthology.orchestra.run.smithi037.stdout:487.out 2023-07-12T02:08:13.384 INFO:teuthology.orchestra.run.smithi037.stdout:488 2023-07-12T02:08:13.384 INFO:teuthology.orchestra.run.smithi037.stdout:488.out 2023-07-12T02:08:13.384 INFO:teuthology.orchestra.run.smithi037.stdout:489 2023-07-12T02:08:13.384 INFO:teuthology.orchestra.run.smithi037.stdout:489.out 2023-07-12T02:08:13.384 INFO:teuthology.orchestra.run.smithi037.stdout:490 2023-07-12T02:08:13.384 INFO:teuthology.orchestra.run.smithi037.stdout:490.out 2023-07-12T02:08:13.385 INFO:teuthology.orchestra.run.smithi037.stdout:491 2023-07-12T02:08:13.385 INFO:teuthology.orchestra.run.smithi037.stdout:491.out 2023-07-12T02:08:13.385 INFO:teuthology.orchestra.run.smithi037.stdout:492 2023-07-12T02:08:13.385 INFO:teuthology.orchestra.run.smithi037.stdout:492.out 2023-07-12T02:08:13.385 INFO:teuthology.orchestra.run.smithi037.stdout:493 2023-07-12T02:08:13.385 INFO:teuthology.orchestra.run.smithi037.stdout:493.out 2023-07-12T02:08:13.385 INFO:teuthology.orchestra.run.smithi037.stdout:494 2023-07-12T02:08:13.385 INFO:teuthology.orchestra.run.smithi037.stdout:494.out 2023-07-12T02:08:13.386 INFO:teuthology.orchestra.run.smithi037.stdout:495 2023-07-12T02:08:13.386 INFO:teuthology.orchestra.run.smithi037.stdout:495.out 2023-07-12T02:08:13.386 INFO:teuthology.orchestra.run.smithi037.stdout:496 2023-07-12T02:08:13.386 INFO:teuthology.orchestra.run.smithi037.stdout:496.out 2023-07-12T02:08:13.386 INFO:teuthology.orchestra.run.smithi037.stdout:497 2023-07-12T02:08:13.386 INFO:teuthology.orchestra.run.smithi037.stdout:497.out 2023-07-12T02:08:13.386 INFO:teuthology.orchestra.run.smithi037.stdout:498 2023-07-12T02:08:13.386 INFO:teuthology.orchestra.run.smithi037.stdout:498.out 2023-07-12T02:08:13.387 INFO:teuthology.orchestra.run.smithi037.stdout:499 2023-07-12T02:08:13.387 INFO:teuthology.orchestra.run.smithi037.stdout:499.out 2023-07-12T02:08:13.387 INFO:teuthology.orchestra.run.smithi037.stdout:500 2023-07-12T02:08:13.387 INFO:teuthology.orchestra.run.smithi037.stdout:500.out 2023-07-12T02:08:13.387 INFO:teuthology.orchestra.run.smithi037.stdout:501 2023-07-12T02:08:13.387 INFO:teuthology.orchestra.run.smithi037.stdout:501.out 2023-07-12T02:08:13.387 INFO:teuthology.orchestra.run.smithi037.stdout:502 2023-07-12T02:08:13.387 INFO:teuthology.orchestra.run.smithi037.stdout:502.out 2023-07-12T02:08:13.388 INFO:teuthology.orchestra.run.smithi037.stdout:503 2023-07-12T02:08:13.388 INFO:teuthology.orchestra.run.smithi037.stdout:503.out 2023-07-12T02:08:13.388 INFO:teuthology.orchestra.run.smithi037.stdout:504 2023-07-12T02:08:13.388 INFO:teuthology.orchestra.run.smithi037.stdout:504.out 2023-07-12T02:08:13.388 INFO:teuthology.orchestra.run.smithi037.stdout:505 2023-07-12T02:08:13.388 INFO:teuthology.orchestra.run.smithi037.stdout:505.out 2023-07-12T02:08:13.388 INFO:teuthology.orchestra.run.smithi037.stdout:506 2023-07-12T02:08:13.388 INFO:teuthology.orchestra.run.smithi037.stdout:506.out 2023-07-12T02:08:13.389 INFO:teuthology.orchestra.run.smithi037.stdout:507 2023-07-12T02:08:13.389 INFO:teuthology.orchestra.run.smithi037.stdout:507.out 2023-07-12T02:08:13.389 INFO:teuthology.orchestra.run.smithi037.stdout:508 2023-07-12T02:08:13.389 INFO:teuthology.orchestra.run.smithi037.stdout:508.out 2023-07-12T02:08:13.389 INFO:teuthology.orchestra.run.smithi037.stdout:509 2023-07-12T02:08:13.389 INFO:teuthology.orchestra.run.smithi037.stdout:509.out 2023-07-12T02:08:13.389 INFO:teuthology.orchestra.run.smithi037.stdout:510 2023-07-12T02:08:13.389 INFO:teuthology.orchestra.run.smithi037.stdout:510.out 2023-07-12T02:08:13.390 INFO:teuthology.orchestra.run.smithi037.stdout:511 2023-07-12T02:08:13.390 INFO:teuthology.orchestra.run.smithi037.stdout:511.out 2023-07-12T02:08:13.390 INFO:teuthology.orchestra.run.smithi037.stdout:512 2023-07-12T02:08:13.390 INFO:teuthology.orchestra.run.smithi037.stdout:512.out 2023-07-12T02:08:13.390 INFO:teuthology.orchestra.run.smithi037.stdout:513 2023-07-12T02:08:13.390 INFO:teuthology.orchestra.run.smithi037.stdout:513.out 2023-07-12T02:08:13.390 INFO:teuthology.orchestra.run.smithi037.stdout:514 2023-07-12T02:08:13.390 INFO:teuthology.orchestra.run.smithi037.stdout:514.out 2023-07-12T02:08:13.391 INFO:teuthology.orchestra.run.smithi037.stdout:515 2023-07-12T02:08:13.391 INFO:teuthology.orchestra.run.smithi037.stdout:515.out 2023-07-12T02:08:13.391 INFO:teuthology.orchestra.run.smithi037.stdout:516 2023-07-12T02:08:13.391 INFO:teuthology.orchestra.run.smithi037.stdout:516.out 2023-07-12T02:08:13.391 INFO:teuthology.orchestra.run.smithi037.stdout:517 2023-07-12T02:08:13.391 INFO:teuthology.orchestra.run.smithi037.stdout:517.out 2023-07-12T02:08:13.391 INFO:teuthology.orchestra.run.smithi037.stdout:518 2023-07-12T02:08:13.391 INFO:teuthology.orchestra.run.smithi037.stdout:518.out 2023-07-12T02:08:13.392 INFO:teuthology.orchestra.run.smithi037.stdout:519 2023-07-12T02:08:13.392 INFO:teuthology.orchestra.run.smithi037.stdout:519.out 2023-07-12T02:08:13.392 INFO:teuthology.orchestra.run.smithi037.stdout:520 2023-07-12T02:08:13.392 INFO:teuthology.orchestra.run.smithi037.stdout:520.out 2023-07-12T02:08:13.392 INFO:teuthology.orchestra.run.smithi037.stdout:521 2023-07-12T02:08:13.392 INFO:teuthology.orchestra.run.smithi037.stdout:521.out 2023-07-12T02:08:13.392 INFO:teuthology.orchestra.run.smithi037.stdout:522 2023-07-12T02:08:13.392 INFO:teuthology.orchestra.run.smithi037.stdout:522.out 2023-07-12T02:08:13.393 INFO:teuthology.orchestra.run.smithi037.stdout:523 2023-07-12T02:08:13.393 INFO:teuthology.orchestra.run.smithi037.stdout:523.out 2023-07-12T02:08:13.393 INFO:teuthology.orchestra.run.smithi037.stdout:524 2023-07-12T02:08:13.393 INFO:teuthology.orchestra.run.smithi037.stdout:524.out 2023-07-12T02:08:13.393 INFO:teuthology.orchestra.run.smithi037.stdout:525 2023-07-12T02:08:13.393 INFO:teuthology.orchestra.run.smithi037.stdout:525.out 2023-07-12T02:08:13.393 INFO:teuthology.orchestra.run.smithi037.stdout:526 2023-07-12T02:08:13.393 INFO:teuthology.orchestra.run.smithi037.stdout:526.out 2023-07-12T02:08:13.394 INFO:teuthology.orchestra.run.smithi037.stdout:527 2023-07-12T02:08:13.394 INFO:teuthology.orchestra.run.smithi037.stdout:527.out 2023-07-12T02:08:13.394 INFO:teuthology.orchestra.run.smithi037.stdout:528 2023-07-12T02:08:13.394 INFO:teuthology.orchestra.run.smithi037.stdout:528.out 2023-07-12T02:08:13.394 INFO:teuthology.orchestra.run.smithi037.stdout:529 2023-07-12T02:08:13.394 INFO:teuthology.orchestra.run.smithi037.stdout:529.out 2023-07-12T02:08:13.394 INFO:teuthology.orchestra.run.smithi037.stdout:530 2023-07-12T02:08:13.394 INFO:teuthology.orchestra.run.smithi037.stdout:530.out 2023-07-12T02:08:13.395 INFO:teuthology.orchestra.run.smithi037.stdout:531 2023-07-12T02:08:13.395 INFO:teuthology.orchestra.run.smithi037.stdout:531.out 2023-07-12T02:08:13.395 INFO:teuthology.orchestra.run.smithi037.stdout:532 2023-07-12T02:08:13.395 INFO:teuthology.orchestra.run.smithi037.stdout:532.out 2023-07-12T02:08:13.395 INFO:teuthology.orchestra.run.smithi037.stdout:533 2023-07-12T02:08:13.395 INFO:teuthology.orchestra.run.smithi037.stdout:533.out 2023-07-12T02:08:13.395 INFO:teuthology.orchestra.run.smithi037.stdout:534 2023-07-12T02:08:13.395 INFO:teuthology.orchestra.run.smithi037.stdout:534.out 2023-07-12T02:08:13.396 INFO:teuthology.orchestra.run.smithi037.stdout:535 2023-07-12T02:08:13.396 INFO:teuthology.orchestra.run.smithi037.stdout:535.out 2023-07-12T02:08:13.396 INFO:teuthology.orchestra.run.smithi037.stdout:536 2023-07-12T02:08:13.396 INFO:teuthology.orchestra.run.smithi037.stdout:536.out 2023-07-12T02:08:13.396 INFO:teuthology.orchestra.run.smithi037.stdout:537 2023-07-12T02:08:13.396 INFO:teuthology.orchestra.run.smithi037.stdout:537.out 2023-07-12T02:08:13.396 INFO:teuthology.orchestra.run.smithi037.stdout:538 2023-07-12T02:08:13.396 INFO:teuthology.orchestra.run.smithi037.stdout:538.out 2023-07-12T02:08:13.397 INFO:teuthology.orchestra.run.smithi037.stdout:539 2023-07-12T02:08:13.397 INFO:teuthology.orchestra.run.smithi037.stdout:539.out 2023-07-12T02:08:13.397 INFO:teuthology.orchestra.run.smithi037.stdout:540 2023-07-12T02:08:13.397 INFO:teuthology.orchestra.run.smithi037.stdout:540.out 2023-07-12T02:08:13.397 INFO:teuthology.orchestra.run.smithi037.stdout:541 2023-07-12T02:08:13.397 INFO:teuthology.orchestra.run.smithi037.stdout:541.out 2023-07-12T02:08:13.397 INFO:teuthology.orchestra.run.smithi037.stdout:542 2023-07-12T02:08:13.397 INFO:teuthology.orchestra.run.smithi037.stdout:542.out 2023-07-12T02:08:13.398 INFO:teuthology.orchestra.run.smithi037.stdout:543 2023-07-12T02:08:13.398 INFO:teuthology.orchestra.run.smithi037.stdout:543.out 2023-07-12T02:08:13.398 INFO:teuthology.orchestra.run.smithi037.stdout:544 2023-07-12T02:08:13.398 INFO:teuthology.orchestra.run.smithi037.stdout:544.out 2023-07-12T02:08:13.398 INFO:teuthology.orchestra.run.smithi037.stdout:545 2023-07-12T02:08:13.398 INFO:teuthology.orchestra.run.smithi037.stdout:545.out 2023-07-12T02:08:13.398 INFO:teuthology.orchestra.run.smithi037.stdout:546 2023-07-12T02:08:13.398 INFO:teuthology.orchestra.run.smithi037.stdout:546.out 2023-07-12T02:08:13.399 INFO:teuthology.orchestra.run.smithi037.stdout:547 2023-07-12T02:08:13.399 INFO:teuthology.orchestra.run.smithi037.stdout:547.out 2023-07-12T02:08:13.399 INFO:teuthology.orchestra.run.smithi037.stdout:548 2023-07-12T02:08:13.399 INFO:teuthology.orchestra.run.smithi037.stdout:548.out 2023-07-12T02:08:13.399 INFO:teuthology.orchestra.run.smithi037.stdout:549 2023-07-12T02:08:13.399 INFO:teuthology.orchestra.run.smithi037.stdout:549.out 2023-07-12T02:08:13.399 INFO:teuthology.orchestra.run.smithi037.stdout:550 2023-07-12T02:08:13.399 INFO:teuthology.orchestra.run.smithi037.stdout:550.out 2023-07-12T02:08:13.400 INFO:teuthology.orchestra.run.smithi037.stdout:551 2023-07-12T02:08:13.400 INFO:teuthology.orchestra.run.smithi037.stdout:551.out 2023-07-12T02:08:13.400 INFO:teuthology.orchestra.run.smithi037.stdout:552 2023-07-12T02:08:13.400 INFO:teuthology.orchestra.run.smithi037.stdout:552.out 2023-07-12T02:08:13.400 INFO:teuthology.orchestra.run.smithi037.stdout:553 2023-07-12T02:08:13.400 INFO:teuthology.orchestra.run.smithi037.stdout:553.out 2023-07-12T02:08:13.400 INFO:teuthology.orchestra.run.smithi037.stdout:554 2023-07-12T02:08:13.400 INFO:teuthology.orchestra.run.smithi037.stdout:554.out 2023-07-12T02:08:13.401 INFO:teuthology.orchestra.run.smithi037.stdout:555 2023-07-12T02:08:13.401 INFO:teuthology.orchestra.run.smithi037.stdout:555.out 2023-07-12T02:08:13.401 INFO:teuthology.orchestra.run.smithi037.stdout:556 2023-07-12T02:08:13.401 INFO:teuthology.orchestra.run.smithi037.stdout:556.out 2023-07-12T02:08:13.401 INFO:teuthology.orchestra.run.smithi037.stdout:557 2023-07-12T02:08:13.401 INFO:teuthology.orchestra.run.smithi037.stdout:557.out 2023-07-12T02:08:13.401 INFO:teuthology.orchestra.run.smithi037.stdout:558 2023-07-12T02:08:13.401 INFO:teuthology.orchestra.run.smithi037.stdout:558.out 2023-07-12T02:08:13.402 INFO:teuthology.orchestra.run.smithi037.stdout:559 2023-07-12T02:08:13.402 INFO:teuthology.orchestra.run.smithi037.stdout:559.out 2023-07-12T02:08:13.402 INFO:teuthology.orchestra.run.smithi037.stdout:560 2023-07-12T02:08:13.402 INFO:teuthology.orchestra.run.smithi037.stdout:560.out 2023-07-12T02:08:13.402 INFO:teuthology.orchestra.run.smithi037.stdout:561 2023-07-12T02:08:13.402 INFO:teuthology.orchestra.run.smithi037.stdout:561.out 2023-07-12T02:08:13.402 INFO:teuthology.orchestra.run.smithi037.stdout:562 2023-07-12T02:08:13.402 INFO:teuthology.orchestra.run.smithi037.stdout:562.out 2023-07-12T02:08:13.403 INFO:teuthology.orchestra.run.smithi037.stdout:563 2023-07-12T02:08:13.403 INFO:teuthology.orchestra.run.smithi037.stdout:563.out 2023-07-12T02:08:13.403 INFO:teuthology.orchestra.run.smithi037.stdout:564 2023-07-12T02:08:13.403 INFO:teuthology.orchestra.run.smithi037.stdout:564.out 2023-07-12T02:08:13.403 INFO:teuthology.orchestra.run.smithi037.stdout:565 2023-07-12T02:08:13.403 INFO:teuthology.orchestra.run.smithi037.stdout:565.out 2023-07-12T02:08:13.403 INFO:teuthology.orchestra.run.smithi037.stdout:566 2023-07-12T02:08:13.403 INFO:teuthology.orchestra.run.smithi037.stdout:566.out 2023-07-12T02:08:13.404 INFO:teuthology.orchestra.run.smithi037.stdout:567 2023-07-12T02:08:13.404 INFO:teuthology.orchestra.run.smithi037.stdout:567.out 2023-07-12T02:08:13.404 INFO:teuthology.orchestra.run.smithi037.stdout:568 2023-07-12T02:08:13.404 INFO:teuthology.orchestra.run.smithi037.stdout:568.out 2023-07-12T02:08:13.404 INFO:teuthology.orchestra.run.smithi037.stdout:569 2023-07-12T02:08:13.404 INFO:teuthology.orchestra.run.smithi037.stdout:569.out 2023-07-12T02:08:13.404 INFO:teuthology.orchestra.run.smithi037.stdout:570 2023-07-12T02:08:13.404 INFO:teuthology.orchestra.run.smithi037.stdout:570.out 2023-07-12T02:08:13.405 INFO:teuthology.orchestra.run.smithi037.stdout:571 2023-07-12T02:08:13.405 INFO:teuthology.orchestra.run.smithi037.stdout:571.out 2023-07-12T02:08:13.405 INFO:teuthology.orchestra.run.smithi037.stdout:572 2023-07-12T02:08:13.405 INFO:teuthology.orchestra.run.smithi037.stdout:572.out 2023-07-12T02:08:13.405 INFO:teuthology.orchestra.run.smithi037.stdout:573 2023-07-12T02:08:13.405 INFO:teuthology.orchestra.run.smithi037.stdout:573.out 2023-07-12T02:08:13.405 INFO:teuthology.orchestra.run.smithi037.stdout:574 2023-07-12T02:08:13.405 INFO:teuthology.orchestra.run.smithi037.stdout:574.out 2023-07-12T02:08:13.406 INFO:teuthology.orchestra.run.smithi037.stdout:575 2023-07-12T02:08:13.406 INFO:teuthology.orchestra.run.smithi037.stdout:575.out 2023-07-12T02:08:13.406 INFO:teuthology.orchestra.run.smithi037.stdout:576 2023-07-12T02:08:13.406 INFO:teuthology.orchestra.run.smithi037.stdout:576.out 2023-07-12T02:08:13.406 INFO:teuthology.orchestra.run.smithi037.stdout:577 2023-07-12T02:08:13.406 INFO:teuthology.orchestra.run.smithi037.stdout:577.out 2023-07-12T02:08:13.406 INFO:teuthology.orchestra.run.smithi037.stdout:578 2023-07-12T02:08:13.406 INFO:teuthology.orchestra.run.smithi037.stdout:578.out 2023-07-12T02:08:13.407 INFO:teuthology.orchestra.run.smithi037.stdout:579 2023-07-12T02:08:13.407 INFO:teuthology.orchestra.run.smithi037.stdout:579.out 2023-07-12T02:08:13.407 INFO:teuthology.orchestra.run.smithi037.stdout:580 2023-07-12T02:08:13.407 INFO:teuthology.orchestra.run.smithi037.stdout:580.out 2023-07-12T02:08:13.407 INFO:teuthology.orchestra.run.smithi037.stdout:581 2023-07-12T02:08:13.407 INFO:teuthology.orchestra.run.smithi037.stdout:581.out 2023-07-12T02:08:13.407 INFO:teuthology.orchestra.run.smithi037.stdout:582 2023-07-12T02:08:13.407 INFO:teuthology.orchestra.run.smithi037.stdout:582.out 2023-07-12T02:08:13.408 INFO:teuthology.orchestra.run.smithi037.stdout:583 2023-07-12T02:08:13.408 INFO:teuthology.orchestra.run.smithi037.stdout:583.out 2023-07-12T02:08:13.408 INFO:teuthology.orchestra.run.smithi037.stdout:584 2023-07-12T02:08:13.408 INFO:teuthology.orchestra.run.smithi037.stdout:584.out 2023-07-12T02:08:13.408 INFO:teuthology.orchestra.run.smithi037.stdout:585 2023-07-12T02:08:13.408 INFO:teuthology.orchestra.run.smithi037.stdout:585.out 2023-07-12T02:08:13.408 INFO:teuthology.orchestra.run.smithi037.stdout:586 2023-07-12T02:08:13.408 INFO:teuthology.orchestra.run.smithi037.stdout:586.out 2023-07-12T02:08:13.409 INFO:teuthology.orchestra.run.smithi037.stdout:587 2023-07-12T02:08:13.409 INFO:teuthology.orchestra.run.smithi037.stdout:587.out 2023-07-12T02:08:13.409 INFO:teuthology.orchestra.run.smithi037.stdout:588 2023-07-12T02:08:13.409 INFO:teuthology.orchestra.run.smithi037.stdout:588.out 2023-07-12T02:08:13.409 INFO:teuthology.orchestra.run.smithi037.stdout:589 2023-07-12T02:08:13.409 INFO:teuthology.orchestra.run.smithi037.stdout:589.out 2023-07-12T02:08:13.409 INFO:teuthology.orchestra.run.smithi037.stdout:590 2023-07-12T02:08:13.409 INFO:teuthology.orchestra.run.smithi037.stdout:590.out 2023-07-12T02:08:13.410 INFO:teuthology.orchestra.run.smithi037.stdout:591 2023-07-12T02:08:13.410 INFO:teuthology.orchestra.run.smithi037.stdout:591.out 2023-07-12T02:08:13.410 INFO:teuthology.orchestra.run.smithi037.stdout:592 2023-07-12T02:08:13.410 INFO:teuthology.orchestra.run.smithi037.stdout:592.out 2023-07-12T02:08:13.410 INFO:teuthology.orchestra.run.smithi037.stdout:593 2023-07-12T02:08:13.410 INFO:teuthology.orchestra.run.smithi037.stdout:593.out 2023-07-12T02:08:13.410 INFO:teuthology.orchestra.run.smithi037.stdout:594 2023-07-12T02:08:13.410 INFO:teuthology.orchestra.run.smithi037.stdout:594.out 2023-07-12T02:08:13.411 INFO:teuthology.orchestra.run.smithi037.stdout:595 2023-07-12T02:08:13.411 INFO:teuthology.orchestra.run.smithi037.stdout:595.out 2023-07-12T02:08:13.411 INFO:teuthology.orchestra.run.smithi037.stdout:596 2023-07-12T02:08:13.411 INFO:teuthology.orchestra.run.smithi037.stdout:596.out 2023-07-12T02:08:13.411 INFO:teuthology.orchestra.run.smithi037.stdout:597 2023-07-12T02:08:13.411 INFO:teuthology.orchestra.run.smithi037.stdout:597.out 2023-07-12T02:08:13.411 INFO:teuthology.orchestra.run.smithi037.stdout:598 2023-07-12T02:08:13.411 INFO:teuthology.orchestra.run.smithi037.stdout:598.out 2023-07-12T02:08:13.412 INFO:teuthology.orchestra.run.smithi037.stdout:599 2023-07-12T02:08:13.412 INFO:teuthology.orchestra.run.smithi037.stdout:599.out 2023-07-12T02:08:13.412 INFO:teuthology.orchestra.run.smithi037.stdout:600 2023-07-12T02:08:13.412 INFO:teuthology.orchestra.run.smithi037.stdout:600.out 2023-07-12T02:08:13.412 INFO:teuthology.orchestra.run.smithi037.stdout:601 2023-07-12T02:08:13.412 INFO:teuthology.orchestra.run.smithi037.stdout:601.out 2023-07-12T02:08:13.412 INFO:teuthology.orchestra.run.smithi037.stdout:602 2023-07-12T02:08:13.412 INFO:teuthology.orchestra.run.smithi037.stdout:602.out 2023-07-12T02:08:13.413 INFO:teuthology.orchestra.run.smithi037.stdout:603 2023-07-12T02:08:13.413 INFO:teuthology.orchestra.run.smithi037.stdout:603.out 2023-07-12T02:08:13.413 INFO:teuthology.orchestra.run.smithi037.stdout:604 2023-07-12T02:08:13.413 INFO:teuthology.orchestra.run.smithi037.stdout:604.out 2023-07-12T02:08:13.413 INFO:teuthology.orchestra.run.smithi037.stdout:605 2023-07-12T02:08:13.413 INFO:teuthology.orchestra.run.smithi037.stdout:605.out 2023-07-12T02:08:13.413 INFO:teuthology.orchestra.run.smithi037.stdout:606 2023-07-12T02:08:13.413 INFO:teuthology.orchestra.run.smithi037.stdout:606.out 2023-07-12T02:08:13.414 INFO:teuthology.orchestra.run.smithi037.stdout:607 2023-07-12T02:08:13.414 INFO:teuthology.orchestra.run.smithi037.stdout:607.out 2023-07-12T02:08:13.414 INFO:teuthology.orchestra.run.smithi037.stdout:608 2023-07-12T02:08:13.415 INFO:teuthology.orchestra.run.smithi037.stdout:608.out 2023-07-12T02:08:13.415 INFO:teuthology.orchestra.run.smithi037.stdout:609 2023-07-12T02:08:13.415 INFO:teuthology.orchestra.run.smithi037.stdout:609.out 2023-07-12T02:08:13.415 INFO:teuthology.orchestra.run.smithi037.stdout:610 2023-07-12T02:08:13.416 INFO:teuthology.orchestra.run.smithi037.stdout:610.out 2023-07-12T02:08:13.416 INFO:teuthology.orchestra.run.smithi037.stdout:611 2023-07-12T02:08:13.416 INFO:teuthology.orchestra.run.smithi037.stdout:611.out 2023-07-12T02:08:13.416 INFO:teuthology.orchestra.run.smithi037.stdout:612 2023-07-12T02:08:13.416 INFO:teuthology.orchestra.run.smithi037.stdout:612.out 2023-07-12T02:08:13.416 INFO:teuthology.orchestra.run.smithi037.stdout:613 2023-07-12T02:08:13.417 INFO:teuthology.orchestra.run.smithi037.stdout:613.out 2023-07-12T02:08:13.417 INFO:teuthology.orchestra.run.smithi037.stdout:614 2023-07-12T02:08:13.417 INFO:teuthology.orchestra.run.smithi037.stdout:614.out 2023-07-12T02:08:13.417 INFO:teuthology.orchestra.run.smithi037.stdout:615 2023-07-12T02:08:13.417 INFO:teuthology.orchestra.run.smithi037.stdout:615.out 2023-07-12T02:08:13.417 INFO:teuthology.orchestra.run.smithi037.stdout:616 2023-07-12T02:08:13.418 INFO:teuthology.orchestra.run.smithi037.stdout:616.out 2023-07-12T02:08:13.418 INFO:teuthology.orchestra.run.smithi037.stdout:617 2023-07-12T02:08:13.418 INFO:teuthology.orchestra.run.smithi037.stdout:617.out 2023-07-12T02:08:13.418 INFO:teuthology.orchestra.run.smithi037.stdout:618 2023-07-12T02:08:13.418 INFO:teuthology.orchestra.run.smithi037.stdout:618.out 2023-07-12T02:08:13.418 INFO:teuthology.orchestra.run.smithi037.stdout:619 2023-07-12T02:08:13.418 INFO:teuthology.orchestra.run.smithi037.stdout:619.out 2023-07-12T02:08:13.419 INFO:teuthology.orchestra.run.smithi037.stdout:620 2023-07-12T02:08:13.419 INFO:teuthology.orchestra.run.smithi037.stdout:620.out 2023-07-12T02:08:13.419 INFO:teuthology.orchestra.run.smithi037.stdout:621 2023-07-12T02:08:13.419 INFO:teuthology.orchestra.run.smithi037.stdout:621.out 2023-07-12T02:08:13.419 INFO:teuthology.orchestra.run.smithi037.stdout:622 2023-07-12T02:08:13.419 INFO:teuthology.orchestra.run.smithi037.stdout:622.out 2023-07-12T02:08:13.419 INFO:teuthology.orchestra.run.smithi037.stdout:623 2023-07-12T02:08:13.419 INFO:teuthology.orchestra.run.smithi037.stdout:623.out 2023-07-12T02:08:13.420 INFO:teuthology.orchestra.run.smithi037.stdout:624 2023-07-12T02:08:13.420 INFO:teuthology.orchestra.run.smithi037.stdout:624.out 2023-07-12T02:08:13.420 INFO:teuthology.orchestra.run.smithi037.stdout:625 2023-07-12T02:08:13.420 INFO:teuthology.orchestra.run.smithi037.stdout:625.out 2023-07-12T02:08:13.420 INFO:teuthology.orchestra.run.smithi037.stdout:626 2023-07-12T02:08:13.420 INFO:teuthology.orchestra.run.smithi037.stdout:626.out 2023-07-12T02:08:13.420 INFO:teuthology.orchestra.run.smithi037.stdout:627 2023-07-12T02:08:13.420 INFO:teuthology.orchestra.run.smithi037.stdout:627.out 2023-07-12T02:08:13.421 INFO:teuthology.orchestra.run.smithi037.stdout:628 2023-07-12T02:08:13.421 INFO:teuthology.orchestra.run.smithi037.stdout:628.out 2023-07-12T02:08:13.421 INFO:teuthology.orchestra.run.smithi037.stdout:629 2023-07-12T02:08:13.421 INFO:teuthology.orchestra.run.smithi037.stdout:629.out 2023-07-12T02:08:13.421 INFO:teuthology.orchestra.run.smithi037.stdout:630 2023-07-12T02:08:13.421 INFO:teuthology.orchestra.run.smithi037.stdout:630.out 2023-07-12T02:08:13.422 INFO:teuthology.orchestra.run.smithi037.stdout:631 2023-07-12T02:08:13.422 INFO:teuthology.orchestra.run.smithi037.stdout:631.out 2023-07-12T02:08:13.422 INFO:teuthology.orchestra.run.smithi037.stdout:632 2023-07-12T02:08:13.422 INFO:teuthology.orchestra.run.smithi037.stdout:632.out 2023-07-12T02:08:13.422 INFO:teuthology.orchestra.run.smithi037.stdout:633 2023-07-12T02:08:13.423 INFO:teuthology.orchestra.run.smithi037.stdout:633.out 2023-07-12T02:08:13.423 INFO:teuthology.orchestra.run.smithi037.stdout:634 2023-07-12T02:08:13.423 INFO:teuthology.orchestra.run.smithi037.stdout:634.out 2023-07-12T02:08:13.423 INFO:teuthology.orchestra.run.smithi037.stdout:635 2023-07-12T02:08:13.424 INFO:teuthology.orchestra.run.smithi037.stdout:635.out 2023-07-12T02:08:13.424 INFO:teuthology.orchestra.run.smithi037.stdout:636 2023-07-12T02:08:13.424 INFO:teuthology.orchestra.run.smithi037.stdout:636.out 2023-07-12T02:08:13.424 INFO:teuthology.orchestra.run.smithi037.stdout:637 2023-07-12T02:08:13.424 INFO:teuthology.orchestra.run.smithi037.stdout:637.out 2023-07-12T02:08:13.425 INFO:teuthology.orchestra.run.smithi037.stdout:638 2023-07-12T02:08:13.425 INFO:teuthology.orchestra.run.smithi037.stdout:638.out 2023-07-12T02:08:13.425 INFO:teuthology.orchestra.run.smithi037.stdout:639 2023-07-12T02:08:13.425 INFO:teuthology.orchestra.run.smithi037.stdout:639.out 2023-07-12T02:08:13.425 INFO:teuthology.orchestra.run.smithi037.stdout:640 2023-07-12T02:08:13.425 INFO:teuthology.orchestra.run.smithi037.stdout:640.out 2023-07-12T02:08:13.425 INFO:teuthology.orchestra.run.smithi037.stdout:641 2023-07-12T02:08:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:641.out 2023-07-12T02:08:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:642 2023-07-12T02:08:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:642.out 2023-07-12T02:08:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:643 2023-07-12T02:08:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:643.out 2023-07-12T02:08:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:644 2023-07-12T02:08:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:644.out 2023-07-12T02:08:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:645 2023-07-12T02:08:13.427 INFO:teuthology.orchestra.run.smithi037.stdout:645.out 2023-07-12T02:08:13.427 INFO:teuthology.orchestra.run.smithi037.stdout:646 2023-07-12T02:08:13.427 INFO:teuthology.orchestra.run.smithi037.stdout:646.out 2023-07-12T02:08:13.427 INFO:teuthology.orchestra.run.smithi037.stdout:647 2023-07-12T02:08:13.427 INFO:teuthology.orchestra.run.smithi037.stdout:647.out 2023-07-12T02:08:13.427 INFO:teuthology.orchestra.run.smithi037.stdout:648 2023-07-12T02:08:13.427 INFO:teuthology.orchestra.run.smithi037.stdout:648.out 2023-07-12T02:08:13.428 INFO:teuthology.orchestra.run.smithi037.stdout:649 2023-07-12T02:08:13.428 INFO:teuthology.orchestra.run.smithi037.stdout:649.out 2023-07-12T02:08:13.428 INFO:teuthology.orchestra.run.smithi037.stdout:650 2023-07-12T02:08:13.428 INFO:teuthology.orchestra.run.smithi037.stdout:650.out 2023-07-12T02:08:13.428 INFO:teuthology.orchestra.run.smithi037.stdout:651 2023-07-12T02:08:13.428 INFO:teuthology.orchestra.run.smithi037.stdout:651.out 2023-07-12T02:08:13.428 INFO:teuthology.orchestra.run.smithi037.stdout:652 2023-07-12T02:08:13.428 INFO:teuthology.orchestra.run.smithi037.stdout:652.out 2023-07-12T02:08:13.429 INFO:teuthology.orchestra.run.smithi037.stdout:653 2023-07-12T02:08:13.429 INFO:teuthology.orchestra.run.smithi037.stdout:653.out 2023-07-12T02:08:13.429 INFO:teuthology.orchestra.run.smithi037.stdout:654 2023-07-12T02:08:13.429 INFO:teuthology.orchestra.run.smithi037.stdout:654.out 2023-07-12T02:08:13.429 INFO:teuthology.orchestra.run.smithi037.stdout:655 2023-07-12T02:08:13.429 INFO:teuthology.orchestra.run.smithi037.stdout:655.out 2023-07-12T02:08:13.429 INFO:teuthology.orchestra.run.smithi037.stdout:656 2023-07-12T02:08:13.429 INFO:teuthology.orchestra.run.smithi037.stdout:656.out 2023-07-12T02:08:13.430 INFO:teuthology.orchestra.run.smithi037.stdout:657 2023-07-12T02:08:13.430 INFO:teuthology.orchestra.run.smithi037.stdout:657.out 2023-07-12T02:08:13.430 INFO:teuthology.orchestra.run.smithi037.stdout:658 2023-07-12T02:08:13.430 INFO:teuthology.orchestra.run.smithi037.stdout:658.out 2023-07-12T02:08:13.430 INFO:teuthology.orchestra.run.smithi037.stdout:659 2023-07-12T02:08:13.430 INFO:teuthology.orchestra.run.smithi037.stdout:659.out 2023-07-12T02:08:13.430 INFO:teuthology.orchestra.run.smithi037.stdout:660 2023-07-12T02:08:13.431 INFO:teuthology.orchestra.run.smithi037.stdout:660.out 2023-07-12T02:08:13.431 INFO:teuthology.orchestra.run.smithi037.stdout:661 2023-07-12T02:08:13.431 INFO:teuthology.orchestra.run.smithi037.stdout:661.out 2023-07-12T02:08:13.431 INFO:teuthology.orchestra.run.smithi037.stdout:662 2023-07-12T02:08:13.431 INFO:teuthology.orchestra.run.smithi037.stdout:662.out 2023-07-12T02:08:13.431 INFO:teuthology.orchestra.run.smithi037.stdout:663 2023-07-12T02:08:13.431 INFO:teuthology.orchestra.run.smithi037.stdout:663.out 2023-07-12T02:08:13.432 INFO:teuthology.orchestra.run.smithi037.stdout:664 2023-07-12T02:08:13.432 INFO:teuthology.orchestra.run.smithi037.stdout:664.out 2023-07-12T02:08:13.432 INFO:teuthology.orchestra.run.smithi037.stdout:665 2023-07-12T02:08:13.432 INFO:teuthology.orchestra.run.smithi037.stdout:665.out 2023-07-12T02:08:13.432 INFO:teuthology.orchestra.run.smithi037.stdout:666 2023-07-12T02:08:13.432 INFO:teuthology.orchestra.run.smithi037.stdout:666.out 2023-07-12T02:08:13.432 INFO:teuthology.orchestra.run.smithi037.stdout:667 2023-07-12T02:08:13.433 INFO:teuthology.orchestra.run.smithi037.stdout:667.out 2023-07-12T02:08:13.433 INFO:teuthology.orchestra.run.smithi037.stdout:668 2023-07-12T02:08:13.433 INFO:teuthology.orchestra.run.smithi037.stdout:668.out 2023-07-12T02:08:13.433 INFO:teuthology.orchestra.run.smithi037.stdout:669 2023-07-12T02:08:13.433 INFO:teuthology.orchestra.run.smithi037.stdout:669.out 2023-07-12T02:08:13.433 INFO:teuthology.orchestra.run.smithi037.stdout:670 2023-07-12T02:08:13.433 INFO:teuthology.orchestra.run.smithi037.stdout:670.out 2023-07-12T02:08:13.433 INFO:teuthology.orchestra.run.smithi037.stdout:671 2023-07-12T02:08:13.434 INFO:teuthology.orchestra.run.smithi037.stdout:671.out 2023-07-12T02:08:13.434 INFO:teuthology.orchestra.run.smithi037.stdout:672 2023-07-12T02:08:13.434 INFO:teuthology.orchestra.run.smithi037.stdout:672.out 2023-07-12T02:08:13.434 INFO:teuthology.orchestra.run.smithi037.stdout:673 2023-07-12T02:08:13.434 INFO:teuthology.orchestra.run.smithi037.stdout:673.out 2023-07-12T02:08:13.434 INFO:teuthology.orchestra.run.smithi037.stdout:674 2023-07-12T02:08:13.434 INFO:teuthology.orchestra.run.smithi037.stdout:674.out 2023-07-12T02:08:13.434 INFO:teuthology.orchestra.run.smithi037.stdout:675 2023-07-12T02:08:13.435 INFO:teuthology.orchestra.run.smithi037.stdout:675.out 2023-07-12T02:08:13.435 INFO:teuthology.orchestra.run.smithi037.stdout:676 2023-07-12T02:08:13.435 INFO:teuthology.orchestra.run.smithi037.stdout:676.out 2023-07-12T02:08:13.435 INFO:teuthology.orchestra.run.smithi037.stdout:677 2023-07-12T02:08:13.435 INFO:teuthology.orchestra.run.smithi037.stdout:677.out 2023-07-12T02:08:13.435 INFO:teuthology.orchestra.run.smithi037.stdout:678 2023-07-12T02:08:13.435 INFO:teuthology.orchestra.run.smithi037.stdout:678.out 2023-07-12T02:08:13.435 INFO:teuthology.orchestra.run.smithi037.stdout:679 2023-07-12T02:08:13.436 INFO:teuthology.orchestra.run.smithi037.stdout:679.out 2023-07-12T02:08:13.436 INFO:teuthology.orchestra.run.smithi037.stdout:680 2023-07-12T02:08:13.436 INFO:teuthology.orchestra.run.smithi037.stdout:680.out 2023-07-12T02:08:13.436 INFO:teuthology.orchestra.run.smithi037.stdout:681 2023-07-12T02:08:13.436 INFO:teuthology.orchestra.run.smithi037.stdout:681.out 2023-07-12T02:08:13.436 INFO:teuthology.orchestra.run.smithi037.stdout:682 2023-07-12T02:08:13.436 INFO:teuthology.orchestra.run.smithi037.stdout:682.out 2023-07-12T02:08:13.437 INFO:teuthology.orchestra.run.smithi037.stdout:683 2023-07-12T02:08:13.437 INFO:teuthology.orchestra.run.smithi037.stdout:683.out 2023-07-12T02:08:13.437 INFO:teuthology.orchestra.run.smithi037.stdout:684 2023-07-12T02:08:13.437 INFO:teuthology.orchestra.run.smithi037.stdout:684.out 2023-07-12T02:08:13.437 INFO:teuthology.orchestra.run.smithi037.stdout:685 2023-07-12T02:08:13.437 INFO:teuthology.orchestra.run.smithi037.stdout:685.out 2023-07-12T02:08:13.437 INFO:teuthology.orchestra.run.smithi037.stdout:686 2023-07-12T02:08:13.437 INFO:teuthology.orchestra.run.smithi037.stdout:686.out 2023-07-12T02:08:13.438 INFO:teuthology.orchestra.run.smithi037.stdout:687 2023-07-12T02:08:13.438 INFO:teuthology.orchestra.run.smithi037.stdout:687.out 2023-07-12T02:08:13.438 INFO:teuthology.orchestra.run.smithi037.stdout:688 2023-07-12T02:08:13.438 INFO:teuthology.orchestra.run.smithi037.stdout:688.out 2023-07-12T02:08:13.438 INFO:teuthology.orchestra.run.smithi037.stdout:689 2023-07-12T02:08:13.438 INFO:teuthology.orchestra.run.smithi037.stdout:689.out 2023-07-12T02:08:13.438 INFO:teuthology.orchestra.run.smithi037.stdout:690 2023-07-12T02:08:13.438 INFO:teuthology.orchestra.run.smithi037.stdout:690.out 2023-07-12T02:08:13.439 INFO:teuthology.orchestra.run.smithi037.stdout:691 2023-07-12T02:08:13.439 INFO:teuthology.orchestra.run.smithi037.stdout:691.out 2023-07-12T02:08:13.439 INFO:teuthology.orchestra.run.smithi037.stdout:692 2023-07-12T02:08:13.439 INFO:teuthology.orchestra.run.smithi037.stdout:692.out 2023-07-12T02:08:13.439 INFO:teuthology.orchestra.run.smithi037.stdout:693 2023-07-12T02:08:13.439 INFO:teuthology.orchestra.run.smithi037.stdout:693.out 2023-07-12T02:08:13.439 INFO:teuthology.orchestra.run.smithi037.stdout:694 2023-07-12T02:08:13.439 INFO:teuthology.orchestra.run.smithi037.stdout:694.out 2023-07-12T02:08:13.440 INFO:teuthology.orchestra.run.smithi037.stdout:695 2023-07-12T02:08:13.440 INFO:teuthology.orchestra.run.smithi037.stdout:695.out 2023-07-12T02:08:13.440 INFO:teuthology.orchestra.run.smithi037.stdout:696 2023-07-12T02:08:13.440 INFO:teuthology.orchestra.run.smithi037.stdout:696.out 2023-07-12T02:08:13.440 INFO:teuthology.orchestra.run.smithi037.stdout:697 2023-07-12T02:08:13.440 INFO:teuthology.orchestra.run.smithi037.stdout:697.out 2023-07-12T02:08:13.440 INFO:teuthology.orchestra.run.smithi037.stdout:698 2023-07-12T02:08:13.440 INFO:teuthology.orchestra.run.smithi037.stdout:698.out 2023-07-12T02:08:13.441 INFO:teuthology.orchestra.run.smithi037.stdout:699 2023-07-12T02:08:13.441 INFO:teuthology.orchestra.run.smithi037.stdout:699.out 2023-07-12T02:08:13.441 INFO:teuthology.orchestra.run.smithi037.stdout:700 2023-07-12T02:08:13.441 INFO:teuthology.orchestra.run.smithi037.stdout:700.out 2023-07-12T02:08:13.441 INFO:teuthology.orchestra.run.smithi037.stdout:701 2023-07-12T02:08:13.441 INFO:teuthology.orchestra.run.smithi037.stdout:701.out 2023-07-12T02:08:13.441 INFO:teuthology.orchestra.run.smithi037.stdout:702 2023-07-12T02:08:13.441 INFO:teuthology.orchestra.run.smithi037.stdout:702.out 2023-07-12T02:08:13.442 INFO:teuthology.orchestra.run.smithi037.stdout:703 2023-07-12T02:08:13.442 INFO:teuthology.orchestra.run.smithi037.stdout:703.out 2023-07-12T02:08:13.442 INFO:teuthology.orchestra.run.smithi037.stdout:704 2023-07-12T02:08:13.442 INFO:teuthology.orchestra.run.smithi037.stdout:704.out 2023-07-12T02:08:13.442 INFO:teuthology.orchestra.run.smithi037.stdout:705 2023-07-12T02:08:13.442 INFO:teuthology.orchestra.run.smithi037.stdout:705.out 2023-07-12T02:08:13.442 INFO:teuthology.orchestra.run.smithi037.stdout:706 2023-07-12T02:08:13.442 INFO:teuthology.orchestra.run.smithi037.stdout:706.out 2023-07-12T02:08:13.443 INFO:teuthology.orchestra.run.smithi037.stdout:707 2023-07-12T02:08:13.443 INFO:teuthology.orchestra.run.smithi037.stdout:707.out 2023-07-12T02:08:13.443 INFO:teuthology.orchestra.run.smithi037.stdout:708 2023-07-12T02:08:13.443 INFO:teuthology.orchestra.run.smithi037.stdout:708.out 2023-07-12T02:08:13.443 INFO:teuthology.orchestra.run.smithi037.stdout:709 2023-07-12T02:08:13.443 INFO:teuthology.orchestra.run.smithi037.stdout:709.out 2023-07-12T02:08:13.443 INFO:teuthology.orchestra.run.smithi037.stdout:710 2023-07-12T02:08:13.443 INFO:teuthology.orchestra.run.smithi037.stdout:710.out 2023-07-12T02:08:13.444 INFO:teuthology.orchestra.run.smithi037.stdout:711 2023-07-12T02:08:13.444 INFO:teuthology.orchestra.run.smithi037.stdout:711.out 2023-07-12T02:08:13.444 INFO:teuthology.orchestra.run.smithi037.stdout:712 2023-07-12T02:08:13.444 INFO:teuthology.orchestra.run.smithi037.stdout:712.out 2023-07-12T02:08:13.444 INFO:teuthology.orchestra.run.smithi037.stdout:713 2023-07-12T02:08:13.444 INFO:teuthology.orchestra.run.smithi037.stdout:713.out 2023-07-12T02:08:13.444 INFO:teuthology.orchestra.run.smithi037.stdout:714 2023-07-12T02:08:13.445 INFO:teuthology.orchestra.run.smithi037.stdout:714.out 2023-07-12T02:08:13.445 INFO:teuthology.orchestra.run.smithi037.stdout:715 2023-07-12T02:08:13.445 INFO:teuthology.orchestra.run.smithi037.stdout:715.out 2023-07-12T02:08:13.445 INFO:teuthology.orchestra.run.smithi037.stdout:716 2023-07-12T02:08:13.445 INFO:teuthology.orchestra.run.smithi037.stdout:716.out 2023-07-12T02:08:13.445 INFO:teuthology.orchestra.run.smithi037.stdout:717 2023-07-12T02:08:13.445 INFO:teuthology.orchestra.run.smithi037.stdout:717.out 2023-07-12T02:08:13.445 INFO:teuthology.orchestra.run.smithi037.stdout:718 2023-07-12T02:08:13.446 INFO:teuthology.orchestra.run.smithi037.stdout:718.out 2023-07-12T02:08:13.446 INFO:teuthology.orchestra.run.smithi037.stdout:719 2023-07-12T02:08:13.446 INFO:teuthology.orchestra.run.smithi037.stdout:719.out 2023-07-12T02:08:13.446 INFO:teuthology.orchestra.run.smithi037.stdout:720 2023-07-12T02:08:13.446 INFO:teuthology.orchestra.run.smithi037.stdout:720.out 2023-07-12T02:08:13.446 INFO:teuthology.orchestra.run.smithi037.stdout:721 2023-07-12T02:08:13.446 INFO:teuthology.orchestra.run.smithi037.stdout:721.out 2023-07-12T02:08:13.446 INFO:teuthology.orchestra.run.smithi037.stdout:722 2023-07-12T02:08:13.447 INFO:teuthology.orchestra.run.smithi037.stdout:722.out 2023-07-12T02:08:13.447 INFO:teuthology.orchestra.run.smithi037.stdout:723 2023-07-12T02:08:13.447 INFO:teuthology.orchestra.run.smithi037.stdout:723.out 2023-07-12T02:08:13.447 INFO:teuthology.orchestra.run.smithi037.stdout:724 2023-07-12T02:08:13.447 INFO:teuthology.orchestra.run.smithi037.stdout:724.out 2023-07-12T02:08:13.447 INFO:teuthology.orchestra.run.smithi037.stdout:725 2023-07-12T02:08:13.447 INFO:teuthology.orchestra.run.smithi037.stdout:725.out 2023-07-12T02:08:13.447 INFO:teuthology.orchestra.run.smithi037.stdout:726 2023-07-12T02:08:13.448 INFO:teuthology.orchestra.run.smithi037.stdout:726.out 2023-07-12T02:08:13.448 INFO:teuthology.orchestra.run.smithi037.stdout:727 2023-07-12T02:08:13.448 INFO:teuthology.orchestra.run.smithi037.stdout:727.out 2023-07-12T02:08:13.448 INFO:teuthology.orchestra.run.smithi037.stdout:728 2023-07-12T02:08:13.448 INFO:teuthology.orchestra.run.smithi037.stdout:728.out 2023-07-12T02:08:13.448 INFO:teuthology.orchestra.run.smithi037.stdout:729 2023-07-12T02:08:13.449 INFO:teuthology.orchestra.run.smithi037.stdout:729.out 2023-07-12T02:08:13.449 INFO:teuthology.orchestra.run.smithi037.stdout:group.list 2023-07-12T02:08:13.449 INFO:teuthology.orchestra.run.smithi037.stdout:Makefile 2023-07-12T02:08:13.450 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-07-12T02:08:13.939 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:08:13.951 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:08:13.952 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:08:13.955 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:08:13.955 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:08:21.863 INFO:teuthology.orchestra.run.smithi037.stdout:generic/001 7s 2023-07-12T02:08:21.876 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/001 2023-07-12T02:08:21.876 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:08:21.882 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:08:22.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:08:22.039 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-07-12T02:08:22.485 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:08:22.499 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:08:22.501 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:08:22.503 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:08:22.503 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:08:23.349 INFO:teuthology.orchestra.run.smithi037.stdout:generic/002 1s 2023-07-12T02:08:23.362 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/002 2023-07-12T02:08:23.362 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:08:23.368 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:08:23.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:08:23.454 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-07-12T02:08:23.903 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:08:23.916 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:08:23.917 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:08:23.919 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:08:23.919 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:08:24.412 INFO:teuthology.orchestra.run.smithi037.stdout:generic/003 [not run] atime not maintained by ceph 2023-07-12T02:08:24.422 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/003 2023-07-12T02:08:24.422 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/003 2023-07-12T02:08:24.422 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:08:24.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:08:24.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:08:24.463 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-07-12T02:08:24.925 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:08:24.937 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:08:24.938 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:08:24.941 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:08:24.941 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:08:25.451 INFO:teuthology.orchestra.run.smithi037.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-07-12T02:08:25.461 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/004 2023-07-12T02:08:25.461 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/004 2023-07-12T02:08:25.461 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:08:25.467 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:08:25.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:08:25.508 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-07-12T02:08:25.953 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:08:25.965 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:08:25.966 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:08:25.969 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:08:25.969 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:08:26.714 INFO:teuthology.orchestra.run.smithi037.stdout:generic/005 0s 2023-07-12T02:08:26.726 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/005 2023-07-12T02:08:26.727 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:08:26.732 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:08:26.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:08:26.839 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-07-12T02:08:27.288 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:08:27.300 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:08:27.301 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:08:27.304 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:08:27.304 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:08:40.954 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:08:40.959 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:08:51.549 INFO:teuthology.orchestra.run.smithi037.stdout:generic/006 24s 2023-07-12T02:08:51.561 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/006 2023-07-12T02:08:51.561 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:08:51.567 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:08:51.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:08:51.633 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-07-12T02:08:52.257 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:08:52.269 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:08:52.271 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:08:52.273 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:08:52.273 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:09:11.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:09:11.112 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:09:41.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:09:41.217 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:09:43.103 INFO:teuthology.orchestra.run.smithi037.stdout:generic/007 51s 2023-07-12T02:09:43.127 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/007 2023-07-12T02:09:43.127 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:09:43.138 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:09:43.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:09:43.330 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-07-12T02:09:43.778 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:09:43.790 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:09:43.792 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:09:43.794 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:09:43.794 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:09:44.419 INFO:teuthology.orchestra.run.smithi037.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-12T02:09:44.428 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/008 2023-07-12T02:09:44.428 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/008 2023-07-12T02:09:44.428 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:09:44.434 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:09:44.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:09:44.479 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-07-12T02:09:44.927 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:09:44.940 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:09:44.941 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:09:44.944 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:09:44.944 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:09:45.540 INFO:teuthology.orchestra.run.smithi037.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-12T02:09:45.549 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/009 2023-07-12T02:09:45.550 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/009 2023-07-12T02:09:45.550 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:09:45.556 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:09:45.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:09:45.595 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-07-12T02:09:46.045 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:09:46.057 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:09:46.058 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:09:46.061 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:09:46.061 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:09:46.547 INFO:teuthology.orchestra.run.smithi037.stdout:generic/010 [not run] /tmp/tmp.MWP0gTBaNBxfstests-dev/src/dbtest not built 2023-07-12T02:09:46.557 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/010 2023-07-12T02:09:46.557 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/010 2023-07-12T02:09:46.557 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:09:46.563 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:09:46.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:09:46.602 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-07-12T02:09:47.048 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:09:47.061 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:09:47.062 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:09:47.064 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:09:47.064 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:10:11.405 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:10:11.410 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:10:24.582 INFO:teuthology.orchestra.run.smithi037.stdout:generic/011 37s 2023-07-12T02:10:24.594 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/011 2023-07-12T02:10:24.594 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:10:24.600 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:10:24.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:10:24.769 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-07-12T02:10:25.221 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:10:25.233 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:10:25.235 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:10:25.237 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:10:25.237 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:10:25.974 INFO:teuthology.orchestra.run.smithi037.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-12T02:10:25.984 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/012 2023-07-12T02:10:25.984 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/012 2023-07-12T02:10:25.985 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:10:25.990 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:10:26.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:10:26.071 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-07-12T02:10:26.528 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:10:26.540 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:10:26.541 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:10:26.544 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:10:26.544 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:10:43.349 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:10:43.360 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:11:13.958 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:11:13.964 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:11:36.703 INFO:teuthology.orchestra.run.smithi037.stdout:generic/013 70s 2023-07-12T02:11:39.518 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/013 2023-07-12T02:11:39.518 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:11:39.528 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:11:39.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:11:39.584 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-07-12T02:11:40.306 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:11:40.324 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:11:40.326 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:11:40.329 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:11:40.330 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:11:44.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:11:44.108 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:12:14.268 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:12:14.274 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:12:45.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:12:45.425 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:13:19.417 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:13:19.427 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:13:52.715 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:13:52.729 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:14:24.821 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:14:24.826 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:14:56.073 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:14:56.078 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:15:27.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:15:27.055 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:15:59.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:15:59.748 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:16:24.429 INFO:teuthology.orchestra.run.smithi037.stdout:generic/014 284s 2023-07-12T02:16:25.227 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/014 2023-07-12T02:16:25.227 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:16:25.238 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:25.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:16:25.313 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-07-12T02:16:26.026 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:16:26.044 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:16:26.045 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:16:26.049 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:16:26.049 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:26.829 INFO:teuthology.orchestra.run.smithi037.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-12T02:16:26.845 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/015 2023-07-12T02:16:26.845 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/015 2023-07-12T02:16:26.845 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:16:26.855 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:26.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:16:26.905 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-07-12T02:16:27.634 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:16:27.651 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:16:27.654 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:16:27.659 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:16:27.659 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:28.706 INFO:teuthology.orchestra.run.smithi037.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-12T02:16:28.721 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/016 2023-07-12T02:16:28.721 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/016 2023-07-12T02:16:28.722 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:16:28.731 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:28.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:16:28.874 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-07-12T02:16:29.730 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:16:29.751 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:16:29.752 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:16:29.756 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:16:29.756 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:29.987 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:16:29.994 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:16:30.548 INFO:teuthology.orchestra.run.smithi037.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-12T02:16:30.566 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/017 2023-07-12T02:16:30.566 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/017 2023-07-12T02:16:30.566 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:16:30.575 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:30.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:16:30.633 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-07-12T02:16:31.344 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:16:31.366 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:16:31.368 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:16:31.372 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:16:31.372 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:32.327 INFO:teuthology.orchestra.run.smithi037.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-07-12T02:16:32.363 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/018 2023-07-12T02:16:32.364 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/018 2023-07-12T02:16:32.364 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:16:32.372 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:32.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:16:32.430 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-07-12T02:16:33.131 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:16:33.151 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:16:33.153 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:16:33.157 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:16:33.157 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:33.910 INFO:teuthology.orchestra.run.smithi037.stdout:generic/019 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-07-12T02:16:33.924 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/019 2023-07-12T02:16:33.925 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/019 2023-07-12T02:16:33.925 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:16:33.934 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:33.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:16:33.996 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-07-12T02:16:34.735 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:16:34.753 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:16:34.755 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:16:34.758 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:16:34.758 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:43.314 INFO:teuthology.orchestra.run.smithi037.stdout:generic/020 8s 2023-07-12T02:16:43.336 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/020 2023-07-12T02:16:43.336 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:16:43.345 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:43.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:16:43.486 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-07-12T02:16:44.307 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:16:44.331 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:16:44.333 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:45.320 INFO:teuthology.orchestra.run.smithi037.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-12T02:16:45.337 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/021 2023-07-12T02:16:45.337 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/021 2023-07-12T02:16:45.338 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:16:45.347 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:45.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:16:45.486 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-07-12T02:16:46.304 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:16:46.330 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:16:46.331 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:16:46.335 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:16:46.335 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:47.361 INFO:teuthology.orchestra.run.smithi037.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-12T02:16:47.377 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/022 2023-07-12T02:16:47.377 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/022 2023-07-12T02:16:47.377 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:16:47.393 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:16:47.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:16:47.555 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-07-12T02:16:48.395 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:16:48.414 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:16:48.415 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:16:48.419 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:16:48.419 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:00.146 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:17:00.151 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:17:22.826 INFO:teuthology.orchestra.run.smithi037.stdout:generic/023 34s 2023-07-12T02:17:22.844 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/023 2023-07-12T02:17:22.844 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:17:22.853 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:22.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:17:22.975 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-07-12T02:17:23.872 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:17:23.892 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:17:23.894 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:17:23.897 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:17:23.898 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:24.706 INFO:teuthology.orchestra.run.smithi037.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-07-12T02:17:24.722 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/024 2023-07-12T02:17:24.723 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/024 2023-07-12T02:17:24.723 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:17:24.735 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:24.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:17:24.877 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-07-12T02:17:25.756 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:17:25.777 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:17:25.778 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:17:25.782 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:17:25.782 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:26.600 INFO:teuthology.orchestra.run.smithi037.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-07-12T02:17:26.614 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/025 2023-07-12T02:17:26.614 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/025 2023-07-12T02:17:26.614 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:17:26.624 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:26.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:17:26.756 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-07-12T02:17:27.652 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:17:27.671 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:17:27.673 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:17:27.678 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:17:27.678 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:28.554 INFO:teuthology.orchestra.run.smithi037.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-07-12T02:17:28.567 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/026 2023-07-12T02:17:28.568 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/026 2023-07-12T02:17:28.568 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:17:28.577 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:28.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:17:28.648 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-07-12T02:17:29.405 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:17:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:17:29.424 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:17:29.427 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:17:29.427 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:30.224 INFO:teuthology.orchestra.run.smithi037.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-12T02:17:30.240 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/027 2023-07-12T02:17:30.240 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/027 2023-07-12T02:17:30.241 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:17:30.280 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:17:30.285 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:17:30.576 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:30.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:17:30.646 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-07-12T02:17:31.386 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:17:31.403 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:17:31.405 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:17:31.409 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:17:31.409 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:37.408 INFO:teuthology.orchestra.run.smithi037.stdout:generic/028 6s 2023-07-12T02:17:37.429 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/028 2023-07-12T02:17:37.430 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:17:37.438 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:37.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:17:37.508 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-07-12T02:17:38.223 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:17:38.243 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:17:38.246 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:17:38.250 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:17:38.250 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:41.656 INFO:teuthology.orchestra.run.smithi037.stdout:generic/029 3s 2023-07-12T02:17:41.681 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/029 2023-07-12T02:17:41.682 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:17:41.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:41.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:17:41.722 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-07-12T02:17:42.455 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:17:42.480 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:17:42.482 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:17:42.485 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:17:42.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:45.177 INFO:teuthology.orchestra.run.smithi037.stdout:generic/030 3s 2023-07-12T02:17:45.196 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/030 2023-07-12T02:17:45.196 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:17:45.206 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:45.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:17:45.240 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-07-12T02:17:45.885 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:17:45.906 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:17:45.908 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:17:45.910 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:17:45.911 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:46.912 INFO:teuthology.orchestra.run.smithi037.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-12T02:17:46.930 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/031 2023-07-12T02:17:46.930 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/031 2023-07-12T02:17:46.930 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:17:46.939 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:46.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:17:46.998 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-07-12T02:17:47.743 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:17:47.770 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:17:47.771 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:17:47.774 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:17:47.774 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:48.561 INFO:teuthology.orchestra.run.smithi037.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-12T02:17:48.572 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/032 2023-07-12T02:17:48.572 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/032 2023-07-12T02:17:48.573 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:17:48.579 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:48.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:17:48.644 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-07-12T02:17:49.353 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:17:49.377 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:17:49.379 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:17:49.382 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:17:49.382 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:50.361 INFO:teuthology.orchestra.run.smithi037.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-12T02:17:50.378 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/033 2023-07-12T02:17:50.379 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/033 2023-07-12T02:17:50.379 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:17:50.386 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:50.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:17:50.454 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-07-12T02:17:51.178 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:17:51.198 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:17:51.200 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:17:51.202 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:17:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:51.995 INFO:teuthology.orchestra.run.smithi037.stdout:generic/034 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-07-12T02:17:52.010 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/034 2023-07-12T02:17:52.010 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/034 2023-07-12T02:17:52.010 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:17:52.021 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:52.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:17:52.074 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-07-12T02:17:52.801 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:17:52.823 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:17:52.824 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:17:52.828 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:17:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:53.756 INFO:teuthology.orchestra.run.smithi037.stdout:generic/035 0s 2023-07-12T02:17:53.774 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/035 2023-07-12T02:17:53.774 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:17:53.783 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:17:53.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:17:53.923 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-07-12T02:17:54.802 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:17:54.820 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:17:54.821 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:17:54.825 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:17:54.825 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:01.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:18:01.609 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:18:05.866 INFO:teuthology.orchestra.run.smithi037.stdout:generic/036 10s 2023-07-12T02:18:05.893 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/036 2023-07-12T02:18:05.893 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:05.902 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:06.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:06.071 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-07-12T02:18:07.831 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:07.849 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:07.851 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:07.854 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:07.854 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:21.326 INFO:teuthology.orchestra.run.smithi037.stdout:generic/037 13s 2023-07-12T02:18:21.345 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/037 2023-07-12T02:18:21.345 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:21.355 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:21.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:21.388 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-07-12T02:18:22.229 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:22.260 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:22.261 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:22.263 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:22.264 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:23.503 INFO:teuthology.orchestra.run.smithi037.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-12T02:18:23.513 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/038 2023-07-12T02:18:23.513 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/038 2023-07-12T02:18:23.514 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:23.519 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:23.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:23.564 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-07-12T02:18:24.396 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:24.408 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:24.410 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:24.412 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:24.412 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:24.970 INFO:teuthology.orchestra.run.smithi037.stdout:generic/039 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-07-12T02:18:24.980 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/039 2023-07-12T02:18:24.980 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/039 2023-07-12T02:18:24.980 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:24.986 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:25.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:25.029 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-07-12T02:18:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:25.491 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:25.492 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:25.495 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:25.495 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:26.026 INFO:teuthology.orchestra.run.smithi037.stdout:generic/040 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-07-12T02:18:26.036 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/040 2023-07-12T02:18:26.036 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/040 2023-07-12T02:18:26.036 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:26.042 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:26.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:26.082 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-07-12T02:18:26.535 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:26.548 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:26.549 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:26.552 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:26.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:27.100 INFO:teuthology.orchestra.run.smithi037.stdout:generic/041 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-07-12T02:18:27.110 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/041 2023-07-12T02:18:27.110 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/041 2023-07-12T02:18:27.110 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:27.116 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:27.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:27.160 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-07-12T02:18:27.610 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:27.622 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:27.623 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:27.626 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:27.626 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:28.272 INFO:teuthology.orchestra.run.smithi037.stdout:generic/042 [not run] ceph does not support shutdown 2023-07-12T02:18:28.298 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/042 2023-07-12T02:18:28.298 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/042 2023-07-12T02:18:28.298 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:28.304 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:28.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:28.339 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-07-12T02:18:28.794 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:28.806 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:28.807 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:28.810 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:28.810 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:29.464 INFO:teuthology.orchestra.run.smithi037.stdout:generic/043 [not run] ceph does not support shutdown 2023-07-12T02:18:29.490 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/043 2023-07-12T02:18:29.491 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/043 2023-07-12T02:18:29.491 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:29.497 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:29.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:29.535 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-07-12T02:18:29.996 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:30.008 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:30.010 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:30.012 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:30.012 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:30.652 INFO:teuthology.orchestra.run.smithi037.stdout:generic/044 [not run] ceph does not support shutdown 2023-07-12T02:18:30.679 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/044 2023-07-12T02:18:30.679 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/044 2023-07-12T02:18:30.679 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:30.685 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:30.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:30.725 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-07-12T02:18:31.172 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:31.185 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:31.186 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:31.188 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:31.188 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:31.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:18:31.772 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:18:31.854 INFO:teuthology.orchestra.run.smithi037.stdout:generic/045 [not run] ceph does not support shutdown 2023-07-12T02:18:31.880 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/045 2023-07-12T02:18:31.880 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/045 2023-07-12T02:18:31.880 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:31.886 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:31.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:31.927 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-07-12T02:18:32.426 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:32.438 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:32.439 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:32.442 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:32.442 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:33.095 INFO:teuthology.orchestra.run.smithi037.stdout:generic/046 [not run] ceph does not support shutdown 2023-07-12T02:18:33.121 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/046 2023-07-12T02:18:33.121 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/046 2023-07-12T02:18:33.121 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:33.127 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:33.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:33.164 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-07-12T02:18:33.615 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:33.628 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:33.629 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:33.631 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:33.632 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:34.289 INFO:teuthology.orchestra.run.smithi037.stdout:generic/047 [not run] ceph does not support shutdown 2023-07-12T02:18:34.313 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/047 2023-07-12T02:18:34.313 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/047 2023-07-12T02:18:34.313 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:34.319 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:34.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:34.361 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-07-12T02:18:34.817 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:34.830 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:34.831 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:34.833 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:34.834 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:35.474 INFO:teuthology.orchestra.run.smithi037.stdout:generic/048 [not run] ceph does not support shutdown 2023-07-12T02:18:35.496 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/048 2023-07-12T02:18:35.497 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/048 2023-07-12T02:18:35.497 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:35.503 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:35.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:35.535 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-07-12T02:18:35.984 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:35.997 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:35.998 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:36.000 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:36.001 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:36.644 INFO:teuthology.orchestra.run.smithi037.stdout:generic/049 [not run] ceph does not support shutdown 2023-07-12T02:18:36.673 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/049 2023-07-12T02:18:36.674 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/049 2023-07-12T02:18:36.674 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:36.679 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:36.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:36.724 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-07-12T02:18:37.178 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:37.191 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:37.192 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:37.195 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:37.195 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:37.845 INFO:teuthology.orchestra.run.smithi037.stdout:generic/050 [not run] ceph does not support shutdown 2023-07-12T02:18:37.871 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/050 2023-07-12T02:18:37.872 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/050 2023-07-12T02:18:37.872 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:37.877 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:37.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:37.911 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-07-12T02:18:38.357 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:38.369 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:38.370 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:38.373 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:38.373 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:39.042 INFO:teuthology.orchestra.run.smithi037.stdout:generic/051 [not run] ceph does not support shutdown 2023-07-12T02:18:39.052 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/051 2023-07-12T02:18:39.052 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/051 2023-07-12T02:18:39.052 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:39.058 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:39.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:39.093 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-07-12T02:18:39.538 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:39.551 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:39.552 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:39.554 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:39.555 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:40.196 INFO:teuthology.orchestra.run.smithi037.stdout:generic/052 [not run] ceph does not support shutdown 2023-07-12T02:18:40.222 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/052 2023-07-12T02:18:40.222 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/052 2023-07-12T02:18:40.222 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:40.228 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:40.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:40.264 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-07-12T02:18:40.723 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:40.735 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:40.736 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:40.739 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:40.739 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:41.889 INFO:teuthology.orchestra.run.smithi037.stdout:generic/053 1s 2023-07-12T02:18:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/053 2023-07-12T02:18:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:41.977 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:42.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:42.021 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-07-12T02:18:42.505 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:42.517 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:42.519 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:42.521 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:42.521 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:43.214 INFO:teuthology.orchestra.run.smithi037.stdout:generic/054 [not run] ceph does not support shutdown 2023-07-12T02:18:43.239 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/054 2023-07-12T02:18:43.240 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/054 2023-07-12T02:18:43.240 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:43.246 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:43.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:43.288 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-07-12T02:18:43.763 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:43.775 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:43.776 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:43.779 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:43.779 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:44.450 INFO:teuthology.orchestra.run.smithi037.stdout:generic/055 [not run] ceph does not support shutdown 2023-07-12T02:18:44.480 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/055 2023-07-12T02:18:44.481 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/055 2023-07-12T02:18:44.481 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:44.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:44.523 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-07-12T02:18:44.972 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:44.984 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:44.986 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:44.988 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:44.988 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:45.524 INFO:teuthology.orchestra.run.smithi037.stdout:generic/056 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-07-12T02:18:45.534 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/056 2023-07-12T02:18:45.535 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/056 2023-07-12T02:18:45.535 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:45.541 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:45.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:45.579 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-07-12T02:18:46.025 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:46.037 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:46.038 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:46.041 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:46.041 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:46.567 INFO:teuthology.orchestra.run.smithi037.stdout:generic/057 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-07-12T02:18:46.577 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/057 2023-07-12T02:18:46.577 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/057 2023-07-12T02:18:46.578 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:46.583 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:46.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:46.623 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-07-12T02:18:47.075 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:47.087 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:47.088 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:47.091 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:47.091 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:47.753 INFO:teuthology.orchestra.run.smithi037.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-12T02:18:47.763 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/058 2023-07-12T02:18:47.763 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/058 2023-07-12T02:18:47.763 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:47.769 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:47.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:47.899 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-07-12T02:18:48.588 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:48.601 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:48.603 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:48.605 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:48.605 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:49.131 INFO:teuthology.orchestra.run.smithi037.stdout:generic/059 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-07-12T02:18:49.141 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/059 2023-07-12T02:18:49.141 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/059 2023-07-12T02:18:49.141 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:49.147 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:49.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:49.189 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-07-12T02:18:49.641 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:49.653 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:49.654 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:49.657 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:49.657 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:50.313 INFO:teuthology.orchestra.run.smithi037.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-12T02:18:50.323 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/060 2023-07-12T02:18:50.323 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/060 2023-07-12T02:18:50.323 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:50.329 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:50.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:50.474 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-07-12T02:18:51.101 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:51.121 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:51.122 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:51.125 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:51.125 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:51.789 INFO:teuthology.orchestra.run.smithi037.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-12T02:18:51.799 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/061 2023-07-12T02:18:51.799 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/061 2023-07-12T02:18:51.799 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:51.805 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:51.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:51.919 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-07-12T02:18:52.596 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:52.608 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:52.609 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:52.612 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:52.612 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:55.270 INFO:teuthology.orchestra.run.smithi037.stdout:generic/062 3s 2023-07-12T02:18:55.319 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/062 2023-07-12T02:18:55.319 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:55.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:55.398 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-07-12T02:18:55.920 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:55.933 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:55.934 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:55.937 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:56.706 INFO:teuthology.orchestra.run.smithi037.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-12T02:18:56.716 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/063 2023-07-12T02:18:56.716 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/063 2023-07-12T02:18:56.717 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:56.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:56.895 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-07-12T02:18:57.516 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:57.528 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:57.529 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:57.532 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:57.532 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:58.053 INFO:teuthology.orchestra.run.smithi037.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-12T02:18:58.063 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/064 2023-07-12T02:18:58.063 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/064 2023-07-12T02:18:58.063 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:58.069 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:58.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:58.112 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-07-12T02:18:58.562 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:58.574 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:58.575 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:58.577 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:58.578 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:59.135 INFO:teuthology.orchestra.run.smithi037.stdout:generic/065 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-07-12T02:18:59.145 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/065 2023-07-12T02:18:59.145 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/065 2023-07-12T02:18:59.145 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:18:59.151 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:18:59.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:18:59.190 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-07-12T02:18:59.645 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:18:59.657 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:18:59.658 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:18:59.661 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:18:59.661 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:19:00.191 INFO:teuthology.orchestra.run.smithi037.stdout:generic/066 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-07-12T02:19:00.201 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/066 2023-07-12T02:19:00.201 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/066 2023-07-12T02:19:00.201 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:19:00.207 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:19:00.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:19:00.250 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-07-12T02:19:00.700 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:19:00.713 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:19:00.714 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:19:00.716 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:19:00.716 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:19:01.296 INFO:teuthology.orchestra.run.smithi037.stdout:generic/067 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-07-12T02:19:01.305 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/067 2023-07-12T02:19:01.306 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/067 2023-07-12T02:19:01.306 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:19:01.311 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:19:01.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:19:01.354 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-07-12T02:19:01.804 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:19:01.816 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:19:01.817 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:19:01.820 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:19:01.820 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:19:01.877 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:19:01.881 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:19:02.354 INFO:teuthology.orchestra.run.smithi037.stdout:generic/068 [not run] ceph does not support freezing 2023-07-12T02:19:02.364 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/068 2023-07-12T02:19:02.364 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/068 2023-07-12T02:19:02.365 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:19:02.370 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:19:02.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:19:02.412 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-07-12T02:19:02.862 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:19:02.874 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:19:02.876 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:19:02.878 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:19:02.878 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:19:23.922 INFO:teuthology.orchestra.run.smithi037.stdout:generic/069 20s 2023-07-12T02:19:23.955 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/069 2023-07-12T02:19:23.955 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:19:23.965 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:19:24.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:19:24.021 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-07-12T02:19:24.496 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:19:24.508 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:19:24.509 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:19:24.512 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:19:24.512 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:19:32.024 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:19:32.049 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:19:51.595 INFO:teuthology.orchestra.run.smithi037.stdout:generic/070 27s 2023-07-12T02:19:51.632 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/070 2023-07-12T02:19:51.633 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:19:51.661 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:19:51.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:19:51.907 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-07-12T02:19:52.691 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:19:52.712 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:19:52.713 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:19:52.717 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:19:52.717 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:19:53.526 INFO:teuthology.orchestra.run.smithi037.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-12T02:19:53.545 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/071 2023-07-12T02:19:53.545 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/071 2023-07-12T02:19:53.545 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:19:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:19:53.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:19:53.616 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-07-12T02:19:54.329 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:19:54.348 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:19:54.351 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:19:54.354 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:19:54.355 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:19:55.302 INFO:teuthology.orchestra.run.smithi037.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-12T02:19:55.314 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/072 2023-07-12T02:19:55.315 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/072 2023-07-12T02:19:55.315 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:19:55.326 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:19:55.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:19:55.396 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-07-12T02:19:56.084 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:19:56.107 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:19:56.108 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:19:56.112 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:19:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:19:56.915 INFO:teuthology.orchestra.run.smithi037.stdout:generic/073 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-07-12T02:19:56.928 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/073 2023-07-12T02:19:56.928 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/073 2023-07-12T02:19:56.929 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:19:56.938 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:19:57.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:19:57.007 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-07-12T02:19:57.742 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:19:57.760 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:19:57.763 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:19:57.765 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:19:57.765 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:20:02.462 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:20:02.473 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:20:32.666 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:20:32.673 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:20:32.934 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-07-12T02:20:32.930+0000 7ff96bbf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 220779) UID: 0 2023-07-12T02:20:32.936 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-07-12T02:20:32.932+0000 7fe5333f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 220779) UID: 0 2023-07-12T02:20:47.621 INFO:teuthology.orchestra.run.smithi037.stdout:generic/074 49s 2023-07-12T02:20:47.717 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/074 2023-07-12T02:20:47.718 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:20:47.728 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:20:48.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:20:48.209 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-07-12T02:20:49.192 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:20:49.218 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:20:49.220 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:20:49.225 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:20:49.225 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:29.709 INFO:teuthology.orchestra.run.smithi037.stdout:generic/075 40s 2023-07-12T02:21:29.737 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/075 2023-07-12T02:21:29.738 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:21:29.749 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:29.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:21:29.926 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-07-12T02:21:30.942 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:21:30.972 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:21:30.973 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:21:30.976 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:21:30.976 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:31.912 INFO:teuthology.orchestra.run.smithi037.stdout:generic/076 [not run] require 172.21.15.37:6789:/scratch to be local device 2023-07-12T02:21:31.930 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/076 2023-07-12T02:21:31.930 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/076 2023-07-12T02:21:31.930 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:21:31.939 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:32.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:21:32.004 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-07-12T02:21:32.668 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:21:32.752 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:21:32.753 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:21:32.759 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:21:32.759 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:36.440 INFO:teuthology.orchestra.run.smithi037.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-12T02:21:36.456 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/077 2023-07-12T02:21:36.456 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/077 2023-07-12T02:21:36.456 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:21:36.464 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:36.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:21:36.639 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-07-12T02:21:37.649 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:21:37.674 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:21:37.675 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:21:37.679 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:21:37.679 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:38.659 INFO:teuthology.orchestra.run.smithi037.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-07-12T02:21:38.671 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/078 2023-07-12T02:21:38.671 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/078 2023-07-12T02:21:38.672 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:21:38.689 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:38.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:21:38.847 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-07-12T02:21:39.834 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:21:39.855 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:21:39.857 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:21:39.861 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:21:39.862 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:40.847 INFO:teuthology.orchestra.run.smithi037.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-07-12T02:21:40.871 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/079 2023-07-12T02:21:40.871 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/079 2023-07-12T02:21:40.872 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:21:40.887 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:40.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:21:40.979 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-07-12T02:21:41.771 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:21:41.790 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:21:41.793 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:21:41.797 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:21:41.797 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:44.813 INFO:teuthology.orchestra.run.smithi037.stdout:generic/080 2s 2023-07-12T02:21:44.837 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/080 2023-07-12T02:21:44.837 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:21:44.849 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:44.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:21:44.923 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-07-12T02:21:45.786 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:21:45.810 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:21:45.812 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:21:45.817 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:21:45.817 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:46.764 INFO:teuthology.orchestra.run.smithi037.stdout:generic/081 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-07-12T02:21:46.780 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/081 2023-07-12T02:21:46.780 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/081 2023-07-12T02:21:46.780 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:21:46.792 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:46.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:21:46.854 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-07-12T02:21:47.610 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:21:47.625 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:21:47.629 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:21:47.633 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:21:47.633 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:48.530 INFO:teuthology.orchestra.run.smithi037.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-12T02:21:48.544 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/082 2023-07-12T02:21:48.544 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/082 2023-07-12T02:21:48.544 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:21:48.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:48.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:21:48.615 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-07-12T02:21:49.577 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:21:49.611 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:21:49.614 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:21:49.617 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:21:49.618 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:50.338 INFO:teuthology.orchestra.run.smithi037.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-12T02:21:50.348 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/083 2023-07-12T02:21:50.348 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/083 2023-07-12T02:21:50.348 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:21:50.354 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:50.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:21:50.394 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-07-12T02:21:50.857 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:21:50.869 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:21:50.870 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:21:50.873 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:21:50.873 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:21:53.885 INFO:tasks.ceph.mds.c.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7ff9643ea700 time 2023-07-12T02:21:53.882618+0000 2023-07-12T02:21:53.885 INFO:tasks.ceph.mds.c.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-12T02:21:53.897 INFO:tasks.ceph.mds.c.smithi037.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-12T02:21:53.898 INFO:tasks.ceph.mds.c.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff97a8a8dbf] 2023-07-12T02:21:53.898 INFO:tasks.ceph.mds.c.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7ff97a8a8f85] 2023-07-12T02:21:53.898 INFO:tasks.ceph.mds.c.smithi037.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x561dcb2acbc2] 2023-07-12T02:21:53.898 INFO:tasks.ceph.mds.c.smithi037.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x561dcb294e5c] 2023-07-12T02:21:53.898 INFO:tasks.ceph.mds.c.smithi037.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x561dcb29da37] 2023-07-12T02:21:53.898 INFO:tasks.ceph.mds.c.smithi037.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x561dcb2a22af] 2023-07-12T02:21:53.899 INFO:tasks.ceph.mds.c.smithi037.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x561dcb0f4137] 2023-07-12T02:21:53.899 INFO:tasks.ceph.mds.c.smithi037.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x561dcb0f4fe0] 2023-07-12T02:21:53.899 INFO:tasks.ceph.mds.c.smithi037.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x561dcb0f6ee5] 2023-07-12T02:21:53.899 INFO:tasks.ceph.mds.c.smithi037.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x561dcb17d585] 2023-07-12T02:21:53.899 INFO:tasks.ceph.mds.c.smithi037.stderr: 11: (MDSContext::complete(int)+0x5f) [0x561dcb3db79f] 2023-07-12T02:21:53.899 INFO:tasks.ceph.mds.c.smithi037.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x561dcb3dbf24] 2023-07-12T02:21:53.899 INFO:tasks.ceph.mds.c.smithi037.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x561dcb3dc2db] 2023-07-12T02:21:53.900 INFO:tasks.ceph.mds.c.smithi037.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7ff97a94c93d] 2023-07-12T02:21:53.900 INFO:tasks.ceph.mds.c.smithi037.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff978c081ca] 2023-07-12T02:21:53.900 INFO:tasks.ceph.mds.c.smithi037.stderr: 16: clone() 2023-07-12T02:21:53.900 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-07-12T02:21:53.893+0000 7ff9643ea700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7ff9643ea700 time 2023-07-12T02:21:53.882618+0000 2023-07-12T02:21:53.900 INFO:tasks.ceph.mds.c.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-12T02:21:53.900 INFO:tasks.ceph.mds.c.smithi037.stderr: 2023-07-12T02:21:53.901 INFO:tasks.ceph.mds.c.smithi037.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-12T02:21:53.901 INFO:tasks.ceph.mds.c.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff97a8a8dbf] 2023-07-12T02:21:53.901 INFO:tasks.ceph.mds.c.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7ff97a8a8f85] 2023-07-12T02:21:53.901 INFO:tasks.ceph.mds.c.smithi037.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x561dcb2acbc2] 2023-07-12T02:21:53.901 INFO:tasks.ceph.mds.c.smithi037.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x561dcb294e5c] 2023-07-12T02:21:53.901 INFO:tasks.ceph.mds.c.smithi037.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x561dcb29da37] 2023-07-12T02:21:53.901 INFO:tasks.ceph.mds.c.smithi037.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x561dcb2a22af] 2023-07-12T02:21:53.902 INFO:tasks.ceph.mds.c.smithi037.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x561dcb0f4137] 2023-07-12T02:21:53.902 INFO:tasks.ceph.mds.c.smithi037.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x561dcb0f4fe0] 2023-07-12T02:21:53.902 INFO:tasks.ceph.mds.c.smithi037.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x561dcb0f6ee5] 2023-07-12T02:21:53.902 INFO:tasks.ceph.mds.c.smithi037.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x561dcb17d585] 2023-07-12T02:21:53.902 INFO:tasks.ceph.mds.c.smithi037.stderr: 11: (MDSContext::complete(int)+0x5f) [0x561dcb3db79f] 2023-07-12T02:21:53.902 INFO:tasks.ceph.mds.c.smithi037.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x561dcb3dbf24] 2023-07-12T02:21:53.903 INFO:tasks.ceph.mds.c.smithi037.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x561dcb3dc2db] 2023-07-12T02:21:53.903 INFO:tasks.ceph.mds.c.smithi037.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7ff97a94c93d] 2023-07-12T02:21:53.903 INFO:tasks.ceph.mds.c.smithi037.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff978c081ca] 2023-07-12T02:21:53.903 INFO:tasks.ceph.mds.c.smithi037.stderr: 16: clone() 2023-07-12T02:21:53.903 INFO:tasks.ceph.mds.c.smithi037.stderr: 2023-07-12T02:21:53.903 INFO:tasks.ceph.mds.c.smithi037.stderr:*** Caught signal (Aborted) ** 2023-07-12T02:21:53.903 INFO:tasks.ceph.mds.c.smithi037.stderr: in thread 7ff9643ea700 thread_name:MR_Finisher 2023-07-12T02:21:53.904 INFO:tasks.ceph.mds.c.smithi037.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-12T02:21:53.904 INFO:tasks.ceph.mds.c.smithi037.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7ff978c12cf0] 2023-07-12T02:21:53.904 INFO:tasks.ceph.mds.c.smithi037.stderr: 2: gsignal() 2023-07-12T02:21:53.904 INFO:tasks.ceph.mds.c.smithi037.stderr: 3: abort() 2023-07-12T02:21:53.904 INFO:tasks.ceph.mds.c.smithi037.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff97a8a8e19] 2023-07-12T02:21:53.905 INFO:tasks.ceph.mds.c.smithi037.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7ff97a8a8f85] 2023-07-12T02:21:53.905 INFO:tasks.ceph.mds.c.smithi037.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x561dcb2acbc2] 2023-07-12T02:21:53.905 INFO:tasks.ceph.mds.c.smithi037.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x561dcb294e5c] 2023-07-12T02:21:53.905 INFO:tasks.ceph.mds.c.smithi037.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x561dcb29da37] 2023-07-12T02:21:53.905 INFO:tasks.ceph.mds.c.smithi037.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x561dcb2a22af] 2023-07-12T02:21:53.905 INFO:tasks.ceph.mds.c.smithi037.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x561dcb0f4137] 2023-07-12T02:21:53.905 INFO:tasks.ceph.mds.c.smithi037.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x561dcb0f4fe0] 2023-07-12T02:21:53.905 INFO:tasks.ceph.mds.c.smithi037.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x561dcb0f6ee5] 2023-07-12T02:21:53.906 INFO:tasks.ceph.mds.c.smithi037.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x561dcb17d585] 2023-07-12T02:21:53.906 INFO:tasks.ceph.mds.c.smithi037.stderr: 14: (MDSContext::complete(int)+0x5f) [0x561dcb3db79f] 2023-07-12T02:21:53.906 INFO:tasks.ceph.mds.c.smithi037.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x561dcb3dbf24] 2023-07-12T02:21:53.906 INFO:tasks.ceph.mds.c.smithi037.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x561dcb3dc2db] 2023-07-12T02:21:53.906 INFO:tasks.ceph.mds.c.smithi037.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7ff97a94c93d] 2023-07-12T02:21:53.906 INFO:tasks.ceph.mds.c.smithi037.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7ff978c081ca] 2023-07-12T02:21:53.907 INFO:tasks.ceph.mds.c.smithi037.stderr: 19: clone() 2023-07-12T02:21:53.907 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-07-12T02:21:53.896+0000 7ff9643ea700 -1 *** Caught signal (Aborted) ** 2023-07-12T02:21:53.907 INFO:tasks.ceph.mds.c.smithi037.stderr: in thread 7ff9643ea700 thread_name:MR_Finisher 2023-07-12T02:21:53.907 INFO:tasks.ceph.mds.c.smithi037.stderr: 2023-07-12T02:21:53.907 INFO:tasks.ceph.mds.c.smithi037.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-12T02:21:53.908 INFO:tasks.ceph.mds.c.smithi037.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7ff978c12cf0] 2023-07-12T02:21:53.908 INFO:tasks.ceph.mds.c.smithi037.stderr: 2: gsignal() 2023-07-12T02:21:53.908 INFO:tasks.ceph.mds.c.smithi037.stderr: 3: abort() 2023-07-12T02:21:53.908 INFO:tasks.ceph.mds.c.smithi037.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff97a8a8e19] 2023-07-12T02:21:53.908 INFO:tasks.ceph.mds.c.smithi037.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7ff97a8a8f85] 2023-07-12T02:21:53.908 INFO:tasks.ceph.mds.c.smithi037.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x561dcb2acbc2] 2023-07-12T02:21:53.909 INFO:tasks.ceph.mds.c.smithi037.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x561dcb294e5c] 2023-07-12T02:21:53.909 INFO:tasks.ceph.mds.c.smithi037.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x561dcb29da37] 2023-07-12T02:21:53.909 INFO:tasks.ceph.mds.c.smithi037.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x561dcb2a22af] 2023-07-12T02:21:53.909 INFO:tasks.ceph.mds.c.smithi037.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x561dcb0f4137] 2023-07-12T02:21:53.909 INFO:tasks.ceph.mds.c.smithi037.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x561dcb0f4fe0] 2023-07-12T02:21:53.909 INFO:tasks.ceph.mds.c.smithi037.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x561dcb0f6ee5] 2023-07-12T02:21:53.910 INFO:tasks.ceph.mds.c.smithi037.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x561dcb17d585] 2023-07-12T02:21:53.910 INFO:tasks.ceph.mds.c.smithi037.stderr: 14: (MDSContext::complete(int)+0x5f) [0x561dcb3db79f] 2023-07-12T02:21:53.910 INFO:tasks.ceph.mds.c.smithi037.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x561dcb3dbf24] 2023-07-12T02:21:53.910 INFO:tasks.ceph.mds.c.smithi037.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x561dcb3dc2db] 2023-07-12T02:21:53.910 INFO:tasks.ceph.mds.c.smithi037.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7ff97a94c93d] 2023-07-12T02:21:53.910 INFO:tasks.ceph.mds.c.smithi037.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7ff978c081ca] 2023-07-12T02:21:53.910 INFO:tasks.ceph.mds.c.smithi037.stderr: 19: clone() 2023-07-12T02:21:53.911 INFO:tasks.ceph.mds.c.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-12T02:21:53.911 INFO:tasks.ceph.mds.c.smithi037.stderr: 2023-07-12T02:21:53.927 INFO:tasks.ceph.mds.c.smithi037.stderr: -1> 2023-07-12T02:21:53.893+0000 7ff9643ea700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7ff9643ea700 time 2023-07-12T02:21:53.882618+0000 2023-07-12T02:21:53.927 INFO:tasks.ceph.mds.c.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-12T02:21:53.928 INFO:tasks.ceph.mds.c.smithi037.stderr: 2023-07-12T02:21:53.928 INFO:tasks.ceph.mds.c.smithi037.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-12T02:21:53.928 INFO:tasks.ceph.mds.c.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff97a8a8dbf] 2023-07-12T02:21:53.928 INFO:tasks.ceph.mds.c.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7ff97a8a8f85] 2023-07-12T02:21:53.928 INFO:tasks.ceph.mds.c.smithi037.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x561dcb2acbc2] 2023-07-12T02:21:53.928 INFO:tasks.ceph.mds.c.smithi037.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x561dcb294e5c] 2023-07-12T02:21:53.929 INFO:tasks.ceph.mds.c.smithi037.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x561dcb29da37] 2023-07-12T02:21:53.929 INFO:tasks.ceph.mds.c.smithi037.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x561dcb2a22af] 2023-07-12T02:21:53.929 INFO:tasks.ceph.mds.c.smithi037.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x561dcb0f4137] 2023-07-12T02:21:53.929 INFO:tasks.ceph.mds.c.smithi037.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x561dcb0f4fe0] 2023-07-12T02:21:53.929 INFO:tasks.ceph.mds.c.smithi037.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x561dcb0f6ee5] 2023-07-12T02:21:53.929 INFO:tasks.ceph.mds.c.smithi037.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x561dcb17d585] 2023-07-12T02:21:53.930 INFO:tasks.ceph.mds.c.smithi037.stderr: 11: (MDSContext::complete(int)+0x5f) [0x561dcb3db79f] 2023-07-12T02:21:53.930 INFO:tasks.ceph.mds.c.smithi037.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x561dcb3dbf24] 2023-07-12T02:21:53.930 INFO:tasks.ceph.mds.c.smithi037.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x561dcb3dc2db] 2023-07-12T02:21:53.930 INFO:tasks.ceph.mds.c.smithi037.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7ff97a94c93d] 2023-07-12T02:21:53.930 INFO:tasks.ceph.mds.c.smithi037.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff978c081ca] 2023-07-12T02:21:53.930 INFO:tasks.ceph.mds.c.smithi037.stderr: 16: clone() 2023-07-12T02:21:53.931 INFO:tasks.ceph.mds.c.smithi037.stderr: 2023-07-12T02:21:53.931 INFO:tasks.ceph.mds.c.smithi037.stderr: 0> 2023-07-12T02:21:53.896+0000 7ff9643ea700 -1 *** Caught signal (Aborted) ** 2023-07-12T02:21:53.931 INFO:tasks.ceph.mds.c.smithi037.stderr: in thread 7ff9643ea700 thread_name:MR_Finisher 2023-07-12T02:21:53.931 INFO:tasks.ceph.mds.c.smithi037.stderr: 2023-07-12T02:21:53.931 INFO:tasks.ceph.mds.c.smithi037.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-12T02:21:53.931 INFO:tasks.ceph.mds.c.smithi037.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7ff978c12cf0] 2023-07-12T02:21:53.931 INFO:tasks.ceph.mds.c.smithi037.stderr: 2: gsignal() 2023-07-12T02:21:53.932 INFO:tasks.ceph.mds.c.smithi037.stderr: 3: abort() 2023-07-12T02:21:53.932 INFO:tasks.ceph.mds.c.smithi037.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff97a8a8e19] 2023-07-12T02:21:53.932 INFO:tasks.ceph.mds.c.smithi037.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7ff97a8a8f85] 2023-07-12T02:21:53.932 INFO:tasks.ceph.mds.c.smithi037.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x561dcb2acbc2] 2023-07-12T02:21:53.932 INFO:tasks.ceph.mds.c.smithi037.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x561dcb294e5c] 2023-07-12T02:21:53.933 INFO:tasks.ceph.mds.c.smithi037.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x561dcb29da37] 2023-07-12T02:21:53.933 INFO:tasks.ceph.mds.c.smithi037.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x561dcb2a22af] 2023-07-12T02:21:53.933 INFO:tasks.ceph.mds.c.smithi037.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x561dcb0f4137] 2023-07-12T02:21:53.933 INFO:tasks.ceph.mds.c.smithi037.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x561dcb0f4fe0] 2023-07-12T02:21:53.933 INFO:tasks.ceph.mds.c.smithi037.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x561dcb0f6ee5] 2023-07-12T02:21:53.933 INFO:tasks.ceph.mds.c.smithi037.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x561dcb17d585] 2023-07-12T02:21:53.934 INFO:tasks.ceph.mds.c.smithi037.stderr: 14: (MDSContext::complete(int)+0x5f) [0x561dcb3db79f] 2023-07-12T02:21:53.934 INFO:tasks.ceph.mds.c.smithi037.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x561dcb3dbf24] 2023-07-12T02:21:53.934 INFO:tasks.ceph.mds.c.smithi037.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x561dcb3dc2db] 2023-07-12T02:21:53.934 INFO:tasks.ceph.mds.c.smithi037.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7ff97a94c93d] 2023-07-12T02:21:53.934 INFO:tasks.ceph.mds.c.smithi037.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7ff978c081ca] 2023-07-12T02:21:53.934 INFO:tasks.ceph.mds.c.smithi037.stderr: 19: clone() 2023-07-12T02:21:53.935 INFO:tasks.ceph.mds.c.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-12T02:21:53.935 INFO:tasks.ceph.mds.c.smithi037.stderr: 2023-07-12T02:21:53.942 INFO:tasks.ceph.mds.c.smithi037.stderr: -1> 2023-07-12T02:21:53.893+0000 7ff9643ea700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7ff9643ea700 time 2023-07-12T02:21:53.882618+0000 2023-07-12T02:21:53.942 INFO:tasks.ceph.mds.c.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-12T02:21:53.942 INFO:tasks.ceph.mds.c.smithi037.stderr: 2023-07-12T02:21:53.942 INFO:tasks.ceph.mds.c.smithi037.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-12T02:21:53.943 INFO:tasks.ceph.mds.c.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff97a8a8dbf] 2023-07-12T02:21:53.943 INFO:tasks.ceph.mds.c.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7ff97a8a8f85] 2023-07-12T02:21:53.943 INFO:tasks.ceph.mds.c.smithi037.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x561dcb2acbc2] 2023-07-12T02:21:53.943 INFO:tasks.ceph.mds.c.smithi037.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x561dcb294e5c] 2023-07-12T02:21:53.943 INFO:tasks.ceph.mds.c.smithi037.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x561dcb29da37] 2023-07-12T02:21:53.943 INFO:tasks.ceph.mds.c.smithi037.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x561dcb2a22af] 2023-07-12T02:21:53.943 INFO:tasks.ceph.mds.c.smithi037.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x561dcb0f4137] 2023-07-12T02:21:53.943 INFO:tasks.ceph.mds.c.smithi037.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x561dcb0f4fe0] 2023-07-12T02:21:53.944 INFO:tasks.ceph.mds.c.smithi037.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x561dcb0f6ee5] 2023-07-12T02:21:53.944 INFO:tasks.ceph.mds.c.smithi037.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x561dcb17d585] 2023-07-12T02:21:53.944 INFO:tasks.ceph.mds.c.smithi037.stderr: 11: (MDSContext::complete(int)+0x5f) [0x561dcb3db79f] 2023-07-12T02:21:53.944 INFO:tasks.ceph.mds.c.smithi037.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x561dcb3dbf24] 2023-07-12T02:21:53.944 INFO:tasks.ceph.mds.c.smithi037.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x561dcb3dc2db] 2023-07-12T02:21:53.944 INFO:tasks.ceph.mds.c.smithi037.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7ff97a94c93d] 2023-07-12T02:21:53.944 INFO:tasks.ceph.mds.c.smithi037.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff978c081ca] 2023-07-12T02:21:53.944 INFO:tasks.ceph.mds.c.smithi037.stderr: 16: clone() 2023-07-12T02:21:53.945 INFO:tasks.ceph.mds.c.smithi037.stderr: 2023-07-12T02:21:53.945 INFO:tasks.ceph.mds.c.smithi037.stderr: 0> 2023-07-12T02:21:53.896+0000 7ff9643ea700 -1 *** Caught signal (Aborted) ** 2023-07-12T02:21:53.945 INFO:tasks.ceph.mds.c.smithi037.stderr: in thread 7ff9643ea700 thread_name:MR_Finisher 2023-07-12T02:21:53.945 INFO:tasks.ceph.mds.c.smithi037.stderr: 2023-07-12T02:21:53.945 INFO:tasks.ceph.mds.c.smithi037.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-12T02:21:53.945 INFO:tasks.ceph.mds.c.smithi037.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7ff978c12cf0] 2023-07-12T02:21:53.945 INFO:tasks.ceph.mds.c.smithi037.stderr: 2: gsignal() 2023-07-12T02:21:53.945 INFO:tasks.ceph.mds.c.smithi037.stderr: 3: abort() 2023-07-12T02:21:53.946 INFO:tasks.ceph.mds.c.smithi037.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff97a8a8e19] 2023-07-12T02:21:53.946 INFO:tasks.ceph.mds.c.smithi037.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7ff97a8a8f85] 2023-07-12T02:21:53.946 INFO:tasks.ceph.mds.c.smithi037.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x561dcb2acbc2] 2023-07-12T02:21:53.946 INFO:tasks.ceph.mds.c.smithi037.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x561dcb294e5c] 2023-07-12T02:21:53.946 INFO:tasks.ceph.mds.c.smithi037.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x561dcb29da37] 2023-07-12T02:21:53.946 INFO:tasks.ceph.mds.c.smithi037.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x561dcb2a22af] 2023-07-12T02:21:53.946 INFO:tasks.ceph.mds.c.smithi037.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x561dcb0f4137] 2023-07-12T02:21:53.947 INFO:tasks.ceph.mds.c.smithi037.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x561dcb0f4fe0] 2023-07-12T02:21:53.947 INFO:tasks.ceph.mds.c.smithi037.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x561dcb0f6ee5] 2023-07-12T02:21:53.947 INFO:tasks.ceph.mds.c.smithi037.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x561dcb17d585] 2023-07-12T02:21:53.947 INFO:tasks.ceph.mds.c.smithi037.stderr: 14: (MDSContext::complete(int)+0x5f) [0x561dcb3db79f] 2023-07-12T02:21:53.947 INFO:tasks.ceph.mds.c.smithi037.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x561dcb3dbf24] 2023-07-12T02:21:53.947 INFO:tasks.ceph.mds.c.smithi037.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x561dcb3dc2db] 2023-07-12T02:21:53.947 INFO:tasks.ceph.mds.c.smithi037.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7ff97a94c93d] 2023-07-12T02:21:53.947 INFO:tasks.ceph.mds.c.smithi037.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7ff978c081ca] 2023-07-12T02:21:53.948 INFO:tasks.ceph.mds.c.smithi037.stderr: 19: clone() 2023-07-12T02:21:53.948 INFO:tasks.ceph.mds.c.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-12T02:21:53.948 INFO:tasks.ceph.mds.c.smithi037.stderr: 2023-07-12T02:21:55.947 INFO:tasks.ceph.mds.c.smithi037.stderr:daemon-helper: command crashed with signal 6 2023-07-12T02:22:02.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-07-12T02:22:09.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-07-12T02:22:15.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-07-12T02:22:22.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2023-07-12T02:22:22.729 INFO:teuthology.orchestra.run.smithi037.stdout:generic/084 31s 2023-07-12T02:22:22.798 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/084 2023-07-12T02:22:22.799 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:22:22.826 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:22:22.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:22:22.920 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-07-12T02:22:23.556 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:22:23.568 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:22:23.569 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:22:23.572 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:22:23.572 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:22:24.169 INFO:teuthology.orchestra.run.smithi037.stdout:generic/085 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-07-12T02:22:24.180 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/085 2023-07-12T02:22:24.180 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/085 2023-07-12T02:22:24.181 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:22:24.187 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:22:24.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:22:24.225 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-07-12T02:22:24.290 INFO:tasks.ceph.mds.d.smithi196.stderr:2023-07-12T02:22:24.285+0000 7f1ba81f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-12T02:22:24.690 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:22:24.702 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:22:24.703 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:22:24.706 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:22:24.706 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:22:25.273 INFO:teuthology.orchestra.run.smithi037.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-12T02:22:25.283 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/086 2023-07-12T02:22:25.283 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/086 2023-07-12T02:22:25.283 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:22:25.289 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:22:25.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:22:25.327 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-07-12T02:22:25.791 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:22:25.803 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:22:25.805 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:22:25.807 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:22:25.807 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:22:26.592 INFO:teuthology.orchestra.run.smithi037.stdout:generic/087 0s 2023-07-12T02:22:26.605 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/087 2023-07-12T02:22:26.605 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:22:26.611 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:22:26.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:22:26.751 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-07-12T02:22:27.510 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:22:27.523 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:22:27.524 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:22:27.526 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:22:27.526 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:22:28.101 INFO:teuthology.orchestra.run.smithi037.stdout:generic/088 1s 2023-07-12T02:22:28.114 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/088 2023-07-12T02:22:28.114 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-07-12T02:22:28.120 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:22:28.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-12T02:22:28.262 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.MWP0gTBaNBxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-07-12T02:22:28.964 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-07-12T02:22:28.976 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:22:28.977 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-07-12T02:22:28.979 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCa5kU20hMxAAzmAMeELA0rcJaPxdwlzZ9Q== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4XvNFStKfQscratch 2023-07-12T02:22:28.980 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:22:29.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~26s 2023-07-12T02:22:35.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~33s 2023-07-12T02:22:42.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~40s 2023-07-12T02:22:48.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~46s 2023-07-12T02:22:55.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~53s 2023-07-12T02:23:02.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~59s 2023-07-12T02:23:08.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~66s 2023-07-12T02:23:15.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~73s 2023-07-12T02:23:21.983 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~79s 2023-07-12T02:23:28.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~86s 2023-07-12T02:23:35.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~93s 2023-07-12T02:23:41.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~99s 2023-07-12T02:23:48.357 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:23:48.362 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:23:48.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~106s 2023-07-12T02:23:55.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~112s 2023-07-12T02:24:01.649 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~119s 2023-07-12T02:24:08.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~126s 2023-07-12T02:24:14.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~132s 2023-07-12T02:24:18.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:24:18.489 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:24:21.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~139s 2023-07-12T02:24:28.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~145s 2023-07-12T02:24:34.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~152s 2023-07-12T02:24:41.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~159s 2023-07-12T02:24:47.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~165s 2023-07-12T02:24:50.913 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:24:50.917 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:24:54.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~172s 2023-07-12T02:25:01.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~178s 2023-07-12T02:25:07.740 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~185s 2023-07-12T02:25:14.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~192s 2023-07-12T02:25:20.961 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~198s 2023-07-12T02:25:21.236 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:25:21.240 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:25:27.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~205s 2023-07-12T02:25:34.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~212s 2023-07-12T02:25:40.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~218s 2023-07-12T02:25:47.399 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~225s 2023-07-12T02:25:51.357 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:25:51.361 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:25:54.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~231s 2023-07-12T02:25:54.530 INFO:tasks.ceph.mds.d.smithi196.stderr:2023-07-12T02:25:54.527+0000 7f1bac1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 122160) UID: 0 2023-07-12T02:25:54.531 INFO:tasks.ceph.mds.b.smithi196.stderr:2023-07-12T02:25:54.527+0000 7f33c6df9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 122160) UID: 0 2023-07-12T02:26:00.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~238s 2023-07-12T02:26:07.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~245s 2023-07-12T02:26:13.843 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~251s 2023-07-12T02:26:20.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~258s 2023-07-12T02:26:27.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~264s 2023-07-12T02:26:33.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~271s 2023-07-12T02:26:40.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~278s 2023-07-12T02:26:46.886 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~284s 2023-07-12T02:26:53.494 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~291s 2023-07-12T02:27:00.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~297s 2023-07-12T02:27:06.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~304s 2023-07-12T02:27:06.712 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-07-12T02:27:06.713 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:27:06.713 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:27:06.771 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:27:06.772 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:27:06.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:27:07.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.386+0000 7f588ffff700 1 Processor -- start 2023-07-12T02:27:07.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.386+0000 7f588ffff700 1 -- start start 2023-07-12T02:27:07.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.387+0000 7f588ffff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5888156be0 0x7f58880cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:07.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.388+0000 7f588ffff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f58880cd600 0x7f58880cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:07.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.388+0000 7f588ffff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58880cda70 con 0x7f58880cb4f0 2023-07-12T02:27:07.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.388+0000 7f588ffff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5888156fb0 con 0x7f58880cd600 2023-07-12T02:27:07.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.388+0000 7f588ffff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588815da40 con 0x7f5888156be0 2023-07-12T02:27:07.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.388+0000 7f588e59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f58880cb4f0 0x7f5888070340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60858/0 (socket says 172.21.15.37:60858) 2023-07-12T02:27:07.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.388+0000 7f588e59c700 1 -- 172.21.15.37:0/1684592868 learned_addr learned my addr 172.21.15.37:0/1684592868 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:27:07.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.388+0000 7f588d59a700 1 --2- 172.21.15.37:0/1684592868 >> v2:172.21.15.196:3300/0 conn(0x7f58880cd600 0x7f58880cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:07.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.388+0000 7f588dd9b700 1 --2- 172.21.15.37:0/1684592868 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5888156be0 0x7f58880cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:07.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.388+0000 7f588cd99700 1 -- 172.21.15.37:0/1684592868 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432256336 0 0) 0x7f5880001490 con 0x7f58880cb4f0 2023-07-12T02:27:07.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.388+0000 7f588cd99700 1 -- 172.21.15.37:0/1684592868 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58740035b0 con 0x7f58880cb4f0 2023-07-12T02:27:07.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.389+0000 7f588dd9b700 1 -- 172.21.15.37:0/1684592868 >> v2:172.21.15.196:3300/0 conn(0x7f58880cd600 msgr2=0x7f58880cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:27:07.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.389+0000 7f588dd9b700 1 --2- 172.21.15.37:0/1684592868 >> v2:172.21.15.196:3300/0 conn(0x7f58880cd600 0x7f58880cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:07.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.389+0000 7f588dd9b700 1 -- 172.21.15.37:0/1684592868 >> v1:172.21.15.37:6789/0 conn(0x7f58880cb4f0 legacy=0x7f5888070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:07.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.389+0000 7f588dd9b700 1 -- 172.21.15.37:0/1684592868 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58880cbc00 con 0x7f5888156be0 2023-07-12T02:27:07.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.389+0000 7f588d59a700 1 --2- 172.21.15.37:0/1684592868 >> v2:172.21.15.196:3300/0 conn(0x7f58880cd600 0x7f58880cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:27:07.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.389+0000 7f588dd9b700 1 --2- 172.21.15.37:0/1684592868 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5888156be0 0x7f58880cd0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5884009840 tx=0x7f5884009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b862dc85e3795d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:07.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.389+0000 7f588cd99700 1 -- 172.21.15.37:0/1684592868 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884011830 con 0x7f5888156be0 2023-07-12T02:27:07.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.389+0000 7f588cd99700 1 -- 172.21.15.37:0/1684592868 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5884011990 con 0x7f5888156be0 2023-07-12T02:27:07.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.389+0000 7f588cd99700 1 -- 172.21.15.37:0/1684592868 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884011d20 con 0x7f5888156be0 2023-07-12T02:27:07.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.390+0000 7f588ffff700 1 -- 172.21.15.37:0/1684592868 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5888156be0 msgr2=0x7f58880cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:07.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.390+0000 7f588ffff700 1 --2- 172.21.15.37:0/1684592868 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5888156be0 0x7f58880cd0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5884009840 tx=0x7f5884009b50 comp rx=0 tx=0).stop 2023-07-12T02:27:07.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.390+0000 7f588ffff700 1 -- 172.21.15.37:0/1684592868 shutdown_connections 2023-07-12T02:27:07.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.390+0000 7f588ffff700 1 --2- 172.21.15.37:0/1684592868 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5888156be0 0x7f58880cd0c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:07.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.390+0000 7f588ffff700 1 --2- 172.21.15.37:0/1684592868 >> v2:172.21.15.196:3300/0 conn(0x7f58880cd600 0x7f58880cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:07.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.390+0000 7f588ffff700 1 -- 172.21.15.37:0/1684592868 >> 172.21.15.37:0/1684592868 conn(0x7f58880b0390 msgr2=0x7f58880b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:27:07.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.390+0000 7f588ffff700 1 -- 172.21.15.37:0/1684592868 shutdown_connections 2023-07-12T02:27:07.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.390+0000 7f588ffff700 1 -- 172.21.15.37:0/1684592868 wait complete. 2023-07-12T02:27:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.392+0000 7f588ffff700 1 Processor -- start 2023-07-12T02:27:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.392+0000 7f588ffff700 1 -- start start 2023-07-12T02:27:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.393+0000 7f588ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58880cb4f0 0x7f58880acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.393+0000 7f588ffff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58880cd600 0x7f58880c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.393+0000 7f588ffff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5888156be0 0x7f58880c2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.393+0000 7f588ffff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58880acbd0 con 0x7f58880cb4f0 2023-07-12T02:27:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.393+0000 7f588ffff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58880abd00 con 0x7f5888156be0 2023-07-12T02:27:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.393+0000 7f588ffff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58880abf50 con 0x7f58880cd600 2023-07-12T02:27:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.393+0000 7f588dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58880cb4f0 0x7f58880acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.393+0000 7f588dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58880cb4f0 0x7f58880acff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42956/0 (socket says 172.21.15.37:42956) 2023-07-12T02:27:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.393+0000 7f588dd9b700 1 -- 172.21.15.37:0/3276585705 learned_addr learned my addr 172.21.15.37:0/3276585705 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:27:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.394+0000 7f588d59a700 1 --2- 172.21.15.37:0/3276585705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58880cd600 0x7f58880c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.394+0000 7f588e59c700 1 --2- 172.21.15.37:0/3276585705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5888156be0 0x7f58880c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.394+0000 7f588dd9b700 1 -- 172.21.15.37:0/3276585705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58880cd600 msgr2=0x7f58880c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.394+0000 7f588dd9b700 1 --2- 172.21.15.37:0/3276585705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58880cd600 0x7f58880c22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.394+0000 7f588dd9b700 1 -- 172.21.15.37:0/3276585705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5888156be0 msgr2=0x7f58880c2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.394+0000 7f588dd9b700 1 --2- 172.21.15.37:0/3276585705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5888156be0 0x7f58880c2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.394+0000 7f588dd9b700 1 -- 172.21.15.37:0/3276585705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58780094a0 con 0x7f58880cb4f0 2023-07-12T02:27:07.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.394+0000 7f588dd9b700 1 --2- 172.21.15.37:0/3276585705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58880cb4f0 0x7f58880acff0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f5884009fd0 tx=0x7f5884004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:07.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.394+0000 7f587e7fc700 1 -- 172.21.15.37:0/3276585705 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884004590 con 0x7f58880cb4f0 2023-07-12T02:27:07.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.394+0000 7f587e7fc700 1 -- 172.21.15.37:0/3276585705 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588401e070 con 0x7f58880cb4f0 2023-07-12T02:27:07.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.394+0000 7f587e7fc700 1 -- 172.21.15.37:0/3276585705 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58840038c0 con 0x7f58880cb4f0 2023-07-12T02:27:07.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.394+0000 7f588ffff700 1 -- 172.21.15.37:0/3276585705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58840094a0 con 0x7f58880cb4f0 2023-07-12T02:27:07.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.395+0000 7f588ffff700 1 -- 172.21.15.37:0/3276585705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58880ac510 con 0x7f58880cb4f0 2023-07-12T02:27:07.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.396+0000 7f588ffff700 1 -- 172.21.15.37:0/3276585705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58880acd10 con 0x7f58880cb4f0 2023-07-12T02:27:07.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.396+0000 7f587e7fc700 1 -- 172.21.15.37:0/3276585705 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5884003a20 con 0x7f58880cb4f0 2023-07-12T02:27:07.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.398+0000 7f587e7fc700 1 --2- 172.21.15.37:0/3276585705 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f586c06acb0 0x7f586c06d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:07.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.398+0000 7f587e7fc700 1 -- 172.21.15.37:0/3276585705 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f588408a5e0 con 0x7f58880cb4f0 2023-07-12T02:27:07.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.398+0000 7f588d59a700 1 --2- 172.21.15.37:0/3276585705 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f586c06acb0 0x7f586c06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:07.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.399+0000 7f588d59a700 1 --2- 172.21.15.37:0/3276585705 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f586c06acb0 0x7f586c06d160 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5888151d60 tx=0x7f5878009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.403+0000 7f587e7fc700 1 -- 172.21.15.37:0/3276585705 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f58880acd10 con 0x7f58880cb4f0 2023-07-12T02:27:07.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.621+0000 7f588ffff700 1 -- 172.21.15.37:0/3276585705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58880acd10 con 0x7f58880cb4f0 2023-07-12T02:27:07.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.622+0000 7f587e7fc700 1 -- 172.21.15.37:0/3276585705 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18731 (secure 0 0 0) 0x7f58880acd10 con 0x7f58880cb4f0 2023-07-12T02:27:07.627 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-12T02:27:07.627 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":44,"fsid":"e0d485b9-796c-494c-84d4-d32d9c18c85f","created":"2023-07-12T02:03:30.092188+0000","modified":"2023-07-12T02:22:10.344320+0000","last_up_change":"2023-07-12T02:03:42.386686+0000","last_in_change":"2023-07-12T02:03:33.536148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-12T02:03:43.403480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-12T02:03:49.998312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:05:39.292112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-12T02:05:39.847178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0c40269f-4c97-4c5a-940e-b2df90bf0d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6801","nonce":4138487872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6803","nonce":4138487872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6807","nonce":4138487872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":4138487872},{"type":"v1","addr":"172.21.15.37:6805","nonce":4138487872}]},"public_addr":"172.21.15.37:6801/4138487872","cluster_addr":"172.21.15.37:6803/4138487872","heartbeat_back_addr":"172.21.15.37:6807/4138487872","heartbeat_front_addr":"172.21.15.37:6805/4138487872","state":["exists","up"]},{"osd":1,"uuid":"acf2cbe4-9e0f-40ac-80e4-3d8832972dc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6809","nonce":769438993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6813","nonce":769438993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6821","nonce":769438993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":769438993},{"type":"v1","addr":"172.21.15.37:6817","nonce":769438993}]},"public_addr":"172.21.15.37:6809/769438993","cluster_addr":"172.21.15.37:6813/769438993","heartbeat_back_addr":"172.21.15.37:6821/769438993","heartbeat_front_addr":"172.21.15.37:6817/769438993","state":["exists","up"]},{"osd":2,"uuid":"070d4293-2e9c-44cf-9ee2-2ec76d12a144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6825","nonce":527039359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6827","nonce":527039359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6831","nonce":527039359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":527039359},{"type":"v1","addr":"172.21.15.37:6829","nonce":527039359}]},"public_addr":"172.21.15.37:6825/527039359","cluster_addr":"172.21.15.37:6827/527039359","heartbeat_back_addr":"172.21.15.37:6831/527039359","heartbeat_front_addr":"172.21.15.37:6829/527039359","state":["exists","up"]},{"osd":3,"uuid":"51e0df88-11a0-45f9-a66b-f3327ac7b9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6812","nonce":2081951691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6816","nonce":2081951691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6823","nonce":2081951691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2081951691},{"type":"v1","addr":"172.21.15.37:6820","nonce":2081951691}]},"public_addr":"172.21.15.37:6812/2081951691","cluster_addr":"172.21.15.37:6816/2081951691","heartbeat_back_addr":"172.21.15.37:6823/2081951691","heartbeat_front_addr":"172.21.15.37:6820/2081951691","state":["exists","up"]},{"osd":4,"uuid":"f893e297-ed8f-41a2-b59f-3cfecfb42511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6817","nonce":814714896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6819","nonce":814714896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6823","nonce":814714896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":814714896},{"type":"v1","addr":"172.21.15.196:6821","nonce":814714896}]},"public_addr":"172.21.15.196:6817/814714896","cluster_addr":"172.21.15.196:6819/814714896","heartbeat_back_addr":"172.21.15.196:6823/814714896","heartbeat_front_addr":"172.21.15.196:6821/814714896","state":["exists","up"]},{"osd":5,"uuid":"625fb321-fc02-4779-8edb-c1864a477bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6801","nonce":3108128182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6803","nonce":3108128182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6807","nonce":3108128182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3108128182},{"type":"v1","addr":"172.21.15.196:6805","nonce":3108128182}]},"public_addr":"172.21.15.196:6801/3108128182","cluster_addr":"172.21.15.196:6803/3108128182","heartbeat_back_addr":"172.21.15.196:6807/3108128182","heartbeat_front_addr":"172.21.15.196:6805/3108128182","state":["exists","up"]},{"osd":6,"uuid":"8173819d-8b5e-4ad4-9bc8-d6b0b68a25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6809","nonce":25224914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6811","nonce":25224914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6815","nonce":25224914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":25224914},{"type":"v1","addr":"172.21.15.196:6813","nonce":25224914}]},"public_addr":"172.21.15.196:6809/25224914","cluster_addr":"172.21.15.196:6811/25224914","heartbeat_back_addr":"172.21.15.196:6815/25224914","heartbeat_front_addr":"172.21.15.196:6813/25224914","state":["exists","up"]},{"osd":7,"uuid":"ce737012-d478-4c4d-aab8-83c231e41cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6825","nonce":1327123744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6827","nonce":1327123744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6831","nonce":1327123744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":1327123744},{"type":"v1","addr":"172.21.15.196:6829","nonce":1327123744}]},"public_addr":"172.21.15.196:6825/1327123744","cluster_addr":"172.21.15.196:6827/1327123744","heartbeat_back_addr":"172.21.15.196:6831/1327123744","heartbeat_front_addr":"172.21.15.196:6829/1327123744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.751849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.903018+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.934205+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.084413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.121779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:39.104896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.870660+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:03:38.930772+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":5}]},{"pgid":"7.2c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/483849162":"2023-07-13T02:22:10.344253+0000","172.21.15.37:6833/483849162":"2023-07-13T02:22:10.344253+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:27:07.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.624+0000 7f588ffff700 1 -- 172.21.15.37:0/3276585705 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f586c06acb0 msgr2=0x7f586c06d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:07.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.624+0000 7f588ffff700 1 --2- 172.21.15.37:0/3276585705 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f586c06acb0 0x7f586c06d160 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5888151d60 tx=0x7f5878009210 comp rx=0 tx=0).stop 2023-07-12T02:27:07.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.624+0000 7f588ffff700 1 -- 172.21.15.37:0/3276585705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58880cb4f0 msgr2=0x7f58880acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:07.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.624+0000 7f588ffff700 1 --2- 172.21.15.37:0/3276585705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58880cb4f0 0x7f58880acff0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f5884009fd0 tx=0x7f5884004750 comp rx=0 tx=0).stop 2023-07-12T02:27:07.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.624+0000 7f588ffff700 1 -- 172.21.15.37:0/3276585705 shutdown_connections 2023-07-12T02:27:07.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.624+0000 7f588ffff700 1 --2- 172.21.15.37:0/3276585705 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f586c06acb0 0x7f586c06d160 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:07.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.624+0000 7f588ffff700 1 --2- 172.21.15.37:0/3276585705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58880cb4f0 0x7f58880acff0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:07.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.624+0000 7f588ffff700 1 --2- 172.21.15.37:0/3276585705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5888156be0 0x7f58880c2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:07.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.624+0000 7f588ffff700 1 --2- 172.21.15.37:0/3276585705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58880cd600 0x7f58880c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:07.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.624+0000 7f588ffff700 1 -- 172.21.15.37:0/3276585705 >> 172.21.15.37:0/3276585705 conn(0x7f58880b0390 msgr2=0x7f5888070240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:27:07.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.625+0000 7f588ffff700 1 -- 172.21.15.37:0/3276585705 shutdown_connections 2023-07-12T02:27:07.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.625+0000 7f588ffff700 1 -- 172.21.15.37:0/3276585705 wait complete. 2023-07-12T02:27:07.647 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:03:43.403480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:03:49.998312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:05:39.292112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:05:39.847178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-12T02:27:07.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:27:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.884+0000 7f56a9fff700 1 Processor -- start 2023-07-12T02:27:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.884+0000 7f56a9fff700 1 -- start start 2023-07-12T02:27:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.887+0000 7f56a9fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56a406dfd0 0x7f56a40ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.887+0000 7f56a9fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f56a40ceec0 0x7f56a4069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.887+0000 7f56a9fff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a40c97e0 con 0x7f56a406c4a0 2023-07-12T02:27:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.887+0000 7f56a9fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a406e3a0 con 0x7f56a406dfd0 2023-07-12T02:27:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.887+0000 7f56a9fff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a40ce560 con 0x7f56a40ceec0 2023-07-12T02:27:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.887+0000 7f56a2ffd700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f56a40ceec0 0x7f56a4069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.888+0000 7f56a3fff700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f56a406c4a0 0x7f56a4070440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:47862/0 (socket says 172.21.15.37:47862) 2023-07-12T02:27:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.888+0000 7f56a3fff700 1 -- 172.21.15.37:0/3537605729 learned_addr learned my addr 172.21.15.37:0/3537605729 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:27:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.888+0000 7f56a37fe700 1 --2- 172.21.15.37:0/3537605729 >> v2:172.21.15.37:3300/0 conn(0x7f56a406dfd0 0x7f56a40ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:07.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.889+0000 7f56a2ffd700 1 -- 172.21.15.37:0/3537605729 >> v2:172.21.15.37:3300/0 conn(0x7f56a406dfd0 msgr2=0x7f56a40ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:27:07.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.889+0000 7f56a2ffd700 1 --2- 172.21.15.37:0/3537605729 >> v2:172.21.15.37:3300/0 conn(0x7f56a406dfd0 0x7f56a40ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:07.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.889+0000 7f56a2ffd700 1 -- 172.21.15.37:0/3537605729 >> v1:172.21.15.196:6789/0 conn(0x7f56a406c4a0 legacy=0x7f56a4070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:07.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.889+0000 7f56a2ffd700 1 -- 172.21.15.37:0/3537605729 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a415c8e0 con 0x7f56a40ceec0 2023-07-12T02:27:07.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.895+0000 7f56a2ffd700 1 --2- 172.21.15.37:0/3537605729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56a40ceec0 0x7f56a4069f30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f56a406fef0 tx=0x7f5694009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=939aa280cbdd5f3d server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.902+0000 7f56a27fc700 1 -- 172.21.15.37:0/3537605729 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694011830 con 0x7f56a40ceec0 2023-07-12T02:27:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.902+0000 7f56a27fc700 1 -- 172.21.15.37:0/3537605729 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5694011990 con 0x7f56a40ceec0 2023-07-12T02:27:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.902+0000 7f56a27fc700 1 -- 172.21.15.37:0/3537605729 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694011d20 con 0x7f56a40ceec0 2023-07-12T02:27:07.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.905+0000 7f56a9fff700 1 -- 172.21.15.37:0/3537605729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56a40ceec0 msgr2=0x7f56a4069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.905+0000 7f56a9fff700 1 --2- 172.21.15.37:0/3537605729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56a40ceec0 0x7f56a4069f30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f56a406fef0 tx=0x7f5694009b20 comp rx=0 tx=0).stop 2023-07-12T02:27:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.905+0000 7f56a9fff700 1 -- 172.21.15.37:0/3537605729 shutdown_connections 2023-07-12T02:27:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.905+0000 7f56a9fff700 1 --2- 172.21.15.37:0/3537605729 >> v2:172.21.15.37:3300/0 conn(0x7f56a406dfd0 0x7f56a40ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.905+0000 7f56a9fff700 1 --2- 172.21.15.37:0/3537605729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56a40ceec0 0x7f56a4069f30 secure :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f56a406fef0 tx=0x7f5694009b20 comp rx=0 tx=0).stop 2023-07-12T02:27:07.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.905+0000 7f56a9fff700 1 -- 172.21.15.37:0/3537605729 >> 172.21.15.37:0/3537605729 conn(0x7f56a40b0fd0 msgr2=0x7f56a40ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:27:07.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.908+0000 7f56a9fff700 1 -- 172.21.15.37:0/3537605729 shutdown_connections 2023-07-12T02:27:07.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.909+0000 7f56a9fff700 1 -- 172.21.15.37:0/3537605729 wait complete. 2023-07-12T02:27:07.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.911+0000 7f56a9fff700 1 Processor -- start 2023-07-12T02:27:07.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.912+0000 7f56a9fff700 1 -- start start 2023-07-12T02:27:07.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.913+0000 7f56a9fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56a406c4a0 0x7f56a415e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:07.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.913+0000 7f56a9fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56a406dfd0 0x7f56a40c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:07.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.913+0000 7f56a9fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56a40af570 0x7f56a4158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.913+0000 7f56a9fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a40c4f00 con 0x7f56a40af570 2023-07-12T02:27:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.913+0000 7f56a9fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a415f3a0 con 0x7f56a406dfd0 2023-07-12T02:27:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.913+0000 7f56a9fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a415e790 con 0x7f56a406c4a0 2023-07-12T02:27:07.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.914+0000 7f56a3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56a40af570 0x7f56a4158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:07.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.914+0000 7f56a3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56a40af570 0x7f56a4158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42968/0 (socket says 172.21.15.37:42968) 2023-07-12T02:27:07.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.914+0000 7f56a3fff700 1 -- 172.21.15.37:0/699994988 learned_addr learned my addr 172.21.15.37:0/699994988 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:27:07.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.914+0000 7f56a37fe700 1 --2- 172.21.15.37:0/699994988 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56a406c4a0 0x7f56a415e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:07.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.915+0000 7f56a3fff700 1 -- 172.21.15.37:0/699994988 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56a406c4a0 msgr2=0x7f56a415e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.915+0000 7f56a3fff700 1 --2- 172.21.15.37:0/699994988 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56a406c4a0 0x7f56a415e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.915+0000 7f56a3fff700 1 -- 172.21.15.37:0/699994988 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56a406dfd0 msgr2=0x7f56a40c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.915+0000 7f56a3fff700 1 --2- 172.21.15.37:0/699994988 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56a406dfd0 0x7f56a40c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.915+0000 7f56a3fff700 1 -- 172.21.15.37:0/699994988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56940094a0 con 0x7f56a40af570 2023-07-12T02:27:07.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.915+0000 7f56a3fff700 1 --2- 172.21.15.37:0/699994988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56a40af570 0x7f56a4158c40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f569800c400 tx=0x7f569800c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:07.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.915+0000 7f568bfff700 1 -- 172.21.15.37:0/699994988 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698005d70 con 0x7f56a40af570 2023-07-12T02:27:07.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.915+0000 7f568bfff700 1 -- 172.21.15.37:0/699994988 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56980070d0 con 0x7f56a40af570 2023-07-12T02:27:07.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.915+0000 7f568bfff700 1 -- 172.21.15.37:0/699994988 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698007480 con 0x7f56a40af570 2023-07-12T02:27:07.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.915+0000 7f56a9fff700 1 -- 172.21.15.37:0/699994988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a415ea70 con 0x7f56a40af570 2023-07-12T02:27:07.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.916+0000 7f56a9fff700 1 -- 172.21.15.37:0/699994988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a415f030 con 0x7f56a40af570 2023-07-12T02:27:07.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.917+0000 7f56a9fff700 1 -- 172.21.15.37:0/699994988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a415f530 con 0x7f56a40af570 2023-07-12T02:27:07.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.920+0000 7f568bfff700 1 -- 172.21.15.37:0/699994988 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56980075e0 con 0x7f56a40af570 2023-07-12T02:27:07.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.921+0000 7f568bfff700 1 --2- 172.21.15.37:0/699994988 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f569006ad10 0x7f569006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:07.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.922+0000 7f568bfff700 1 -- 172.21.15.37:0/699994988 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f5698088d80 con 0x7f56a40af570 2023-07-12T02:27:07.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.926+0000 7f56a37fe700 1 --2- 172.21.15.37:0/699994988 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f569006ad10 0x7f569006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:07.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.929+0000 7f568bfff700 1 -- 172.21.15.37:0/699994988 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5698053bb0 con 0x7f56a40af570 2023-07-12T02:27:07.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:07.936+0000 7f56a37fe700 1 --2- 172.21.15.37:0/699994988 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f569006ad10 0x7f569006d1c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f569c011340 tx=0x7f569c00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:08.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.184+0000 7f56a9fff700 1 -- 172.21.15.37:0/699994988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56a40c97e0 con 0x7f56a40af570 2023-07-12T02:27:08.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.185+0000 7f568bfff700 1 -- 172.21.15.37:0/699994988 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f56a40c97e0 con 0x7f56a40af570 2023-07-12T02:27:08.190 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-12T02:27:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.187+0000 7f56a9fff700 1 -- 172.21.15.37:0/699994988 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f569006ad10 msgr2=0x7f569006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.187+0000 7f56a9fff700 1 --2- 172.21.15.37:0/699994988 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f569006ad10 0x7f569006d1c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f569c011340 tx=0x7f569c00b040 comp rx=0 tx=0).stop 2023-07-12T02:27:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.187+0000 7f56a9fff700 1 -- 172.21.15.37:0/699994988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56a40af570 msgr2=0x7f56a4158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.187+0000 7f56a9fff700 1 --2- 172.21.15.37:0/699994988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56a40af570 0x7f56a4158c40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f569800c400 tx=0x7f569800c710 comp rx=0 tx=0).stop 2023-07-12T02:27:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.187+0000 7f56a9fff700 1 -- 172.21.15.37:0/699994988 shutdown_connections 2023-07-12T02:27:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.187+0000 7f56a9fff700 1 --2- 172.21.15.37:0/699994988 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f569006ad10 0x7f569006d1c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.187+0000 7f56a9fff700 1 --2- 172.21.15.37:0/699994988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56a40af570 0x7f56a4158c40 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.187+0000 7f56a9fff700 1 --2- 172.21.15.37:0/699994988 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56a406c4a0 0x7f56a415e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.187+0000 7f56a9fff700 1 --2- 172.21.15.37:0/699994988 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56a406dfd0 0x7f56a40c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.187+0000 7f56a9fff700 1 -- 172.21.15.37:0/699994988 >> 172.21.15.37:0/699994988 conn(0x7f56a40b0fd0 msgr2=0x7f56a40c9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:27:08.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.187+0000 7f56a9fff700 1 -- 172.21.15.37:0/699994988 shutdown_connections 2023-07-12T02:27:08.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.188+0000 7f56a9fff700 1 -- 172.21.15.37:0/699994988 wait complete. 2023-07-12T02:27:08.210 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:27:08.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.420+0000 7f7c43fff700 1 Processor -- start 2023-07-12T02:27:08.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.420+0000 7f7c43fff700 1 -- start start 2023-07-12T02:27:08.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.422+0000 7f7c43fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7c3c0afca0 0x7f7c3c160a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:08.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.422+0000 7f7c43fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c3c06e0a0 0x7f7c3c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:08.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.422+0000 7f7c43fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c0b0070 con 0x7f7c3c06c300 2023-07-12T02:27:08.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.422+0000 7f7c43fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c06e880 con 0x7f7c3c06e0a0 2023-07-12T02:27:08.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.422+0000 7f7c43fff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c06eb60 con 0x7f7c3c0afca0 2023-07-12T02:27:08.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.422+0000 7f7c4159a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c3c06e0a0 0x7f7c3c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:08.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.422+0000 7f7c4259c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7c3c06c300 0x7f7c3c0caee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60866/0 (socket says 172.21.15.37:60866) 2023-07-12T02:27:08.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.422+0000 7f7c4259c700 1 -- 172.21.15.37:0/1492895033 learned_addr learned my addr 172.21.15.37:0/1492895033 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:27:08.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.422+0000 7f7c41d9b700 1 --2- 172.21.15.37:0/1492895033 >> v2:172.21.15.196:3300/0 conn(0x7f7c3c0afca0 0x7f7c3c160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:08.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.423+0000 7f7c4159a700 1 -- 172.21.15.37:0/1492895033 >> v2:172.21.15.196:3300/0 conn(0x7f7c3c0afca0 msgr2=0x7f7c3c160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:27:08.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.423+0000 7f7c4159a700 1 --2- 172.21.15.37:0/1492895033 >> v2:172.21.15.196:3300/0 conn(0x7f7c3c0afca0 0x7f7c3c160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.423+0000 7f7c4159a700 1 -- 172.21.15.37:0/1492895033 >> v1:172.21.15.37:6789/0 conn(0x7f7c3c06c300 legacy=0x7f7c3c0caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:08.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.423+0000 7f7c4159a700 1 -- 172.21.15.37:0/1492895033 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c06b5c0 con 0x7f7c3c06e0a0 2023-07-12T02:27:08.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.423+0000 7f7c40d99700 1 -- 172.21.15.37:0/1492895033 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17359900 0 0) 0x7f7c3c0b0070 con 0x7f7c3c06c300 2023-07-12T02:27:08.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.423+0000 7f7c4159a700 1 --2- 172.21.15.37:0/1492895033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c3c06e0a0 0x7f7c3c06bdc0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0b3480 tx=0x7f7c3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345f0907c5186d55 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:08.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.423+0000 7f7c40d99700 1 -- 172.21.15.37:0/1492895033 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3000e070 con 0x7f7c3c06e0a0 2023-07-12T02:27:08.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.423+0000 7f7c40d99700 1 -- 172.21.15.37:0/1492895033 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3000bb20 con 0x7f7c3c06e0a0 2023-07-12T02:27:08.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.423+0000 7f7c40d99700 1 -- 172.21.15.37:0/1492895033 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c30012430 con 0x7f7c3c06e0a0 2023-07-12T02:27:08.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.424+0000 7f7c43fff700 1 -- 172.21.15.37:0/1492895033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c3c06e0a0 msgr2=0x7f7c3c06bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:08.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.424+0000 7f7c43fff700 1 --2- 172.21.15.37:0/1492895033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c3c06e0a0 0x7f7c3c06bdc0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0b3480 tx=0x7f7c3000b330 comp rx=0 tx=0).stop 2023-07-12T02:27:08.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.424+0000 7f7c43fff700 1 -- 172.21.15.37:0/1492895033 shutdown_connections 2023-07-12T02:27:08.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.424+0000 7f7c43fff700 1 --2- 172.21.15.37:0/1492895033 >> v2:172.21.15.196:3300/0 conn(0x7f7c3c0afca0 0x7f7c3c160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.424+0000 7f7c43fff700 1 --2- 172.21.15.37:0/1492895033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c3c06e0a0 0x7f7c3c06bdc0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.424+0000 7f7c43fff700 1 -- 172.21.15.37:0/1492895033 >> 172.21.15.37:0/1492895033 conn(0x7f7c3c08a3b0 msgr2=0x7f7c3c06a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:27:08.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.424+0000 7f7c43fff700 1 -- 172.21.15.37:0/1492895033 shutdown_connections 2023-07-12T02:27:08.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.424+0000 7f7c43fff700 1 -- 172.21.15.37:0/1492895033 wait complete. 2023-07-12T02:27:08.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.427+0000 7f7c43fff700 1 Processor -- start 2023-07-12T02:27:08.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.427+0000 7f7c43fff700 1 -- start start 2023-07-12T02:27:08.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.428+0000 7f7c43fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c3c06c300 0x7f7c3c1f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:08.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.428+0000 7f7c43fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7c3c06e0a0 0x7f7c3c0ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:08.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.428+0000 7f7c43fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c3c0afca0 0x7f7c3c15d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:08.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.428+0000 7f7c43fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c1468d0 con 0x7f7c3c0afca0 2023-07-12T02:27:08.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.428+0000 7f7c43fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c145c50 con 0x7f7c3c06c300 2023-07-12T02:27:08.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.428+0000 7f7c43fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c145f30 con 0x7f7c3c06e0a0 2023-07-12T02:27:08.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.428+0000 7f7c4259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c3c0afca0 0x7f7c3c15d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:08.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.428+0000 7f7c41d9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c3c06c300 0x7f7c3c1f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:08.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.429+0000 7f7c4259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c3c0afca0 0x7f7c3c15d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42984/0 (socket says 172.21.15.37:42984) 2023-07-12T02:27:08.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.429+0000 7f7c4259c700 1 -- 172.21.15.37:0/2462119642 learned_addr learned my addr 172.21.15.37:0/2462119642 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:27:08.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.429+0000 7f7c4159a700 1 --2- 172.21.15.37:0/2462119642 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7c3c06e0a0 0x7f7c3c0ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:08.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.429+0000 7f7c4259c700 1 -- 172.21.15.37:0/2462119642 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7c3c06e0a0 msgr2=0x7f7c3c0ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:08.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.429+0000 7f7c4259c700 1 --2- 172.21.15.37:0/2462119642 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7c3c06e0a0 0x7f7c3c0ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.429+0000 7f7c4259c700 1 -- 172.21.15.37:0/2462119642 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c3c06c300 msgr2=0x7f7c3c1f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:08.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.429+0000 7f7c4259c700 1 --2- 172.21.15.37:0/2462119642 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c3c06c300 0x7f7c3c1f2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.429+0000 7f7c4259c700 1 -- 172.21.15.37:0/2462119642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c30009a70 con 0x7f7c3c0afca0 2023-07-12T02:27:08.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.429+0000 7f7c4259c700 1 --2- 172.21.15.37:0/2462119642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c3c0afca0 0x7f7c3c15d770 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7c340011e0 tx=0x7f7c3400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:08.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.429+0000 7f7c2e7fc700 1 -- 172.21.15.37:0/2462119642 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34004c80 con 0x7f7c3c0afca0 2023-07-12T02:27:08.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.429+0000 7f7c2e7fc700 1 -- 172.21.15.37:0/2462119642 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c34004de0 con 0x7f7c3c0afca0 2023-07-12T02:27:08.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.429+0000 7f7c43fff700 1 -- 172.21.15.37:0/2462119642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3c146210 con 0x7f7c3c0afca0 2023-07-12T02:27:08.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.429+0000 7f7c2e7fc700 1 -- 172.21.15.37:0/2462119642 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c340072d0 con 0x7f7c3c0afca0 2023-07-12T02:27:08.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.430+0000 7f7c43fff700 1 -- 172.21.15.37:0/2462119642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c1f2bd0 con 0x7f7c3c0afca0 2023-07-12T02:27:08.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.431+0000 7f7c43fff700 1 -- 172.21.15.37:0/2462119642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3c0b22a0 con 0x7f7c3c0afca0 2023-07-12T02:27:08.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.432+0000 7f7c2e7fc700 1 -- 172.21.15.37:0/2462119642 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c34007430 con 0x7f7c3c0afca0 2023-07-12T02:27:08.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.433+0000 7f7c2e7fc700 1 --2- 172.21.15.37:0/2462119642 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7c2006ace0 0x7f7c2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:08.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.433+0000 7f7c2e7fc700 1 -- 172.21.15.37:0/2462119642 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f7c34089330 con 0x7f7c3c0afca0 2023-07-12T02:27:08.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.434+0000 7f7c41d9b700 1 --2- 172.21.15.37:0/2462119642 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7c2006ace0 0x7f7c2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:08.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.434+0000 7f7c41d9b700 1 --2- 172.21.15.37:0/2462119642 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7c2006ace0 0x7f7c2006d190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c15be30 tx=0x7f7c380091c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:08.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.438+0000 7f7c2e7fc700 1 -- 172.21.15.37:0/2462119642 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7c34054170 con 0x7f7c3c0afca0 2023-07-12T02:27:08.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.663+0000 7f7c43fff700 1 -- 172.21.15.37:0/2462119642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7c3c04ea60 con 0x7f7c3c0afca0 2023-07-12T02:27:08.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.664+0000 7f7c2e7fc700 1 -- 172.21.15.37:0/2462119642 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7c34057790 con 0x7f7c3c0afca0 2023-07-12T02:27:08.669 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-12T02:27:08.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.666+0000 7f7c43fff700 1 -- 172.21.15.37:0/2462119642 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7c2006ace0 msgr2=0x7f7c2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:08.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.666+0000 7f7c43fff700 1 --2- 172.21.15.37:0/2462119642 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7c2006ace0 0x7f7c2006d190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c15be30 tx=0x7f7c380091c0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.666+0000 7f7c43fff700 1 -- 172.21.15.37:0/2462119642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c3c0afca0 msgr2=0x7f7c3c15d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:08.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.666+0000 7f7c43fff700 1 --2- 172.21.15.37:0/2462119642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c3c0afca0 0x7f7c3c15d770 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7c340011e0 tx=0x7f7c3400c800 comp rx=0 tx=0).stop 2023-07-12T02:27:08.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.666+0000 7f7c43fff700 1 -- 172.21.15.37:0/2462119642 shutdown_connections 2023-07-12T02:27:08.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.666+0000 7f7c43fff700 1 --2- 172.21.15.37:0/2462119642 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f7c2006ace0 0x7f7c2006d190 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.666+0000 7f7c43fff700 1 --2- 172.21.15.37:0/2462119642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c3c0afca0 0x7f7c3c15d770 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.666+0000 7f7c43fff700 1 --2- 172.21.15.37:0/2462119642 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c3c06c300 0x7f7c3c1f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.666+0000 7f7c43fff700 1 --2- 172.21.15.37:0/2462119642 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7c3c06e0a0 0x7f7c3c0ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.666+0000 7f7c43fff700 1 -- 172.21.15.37:0/2462119642 >> 172.21.15.37:0/2462119642 conn(0x7f7c3c08a3b0 msgr2=0x7f7c3c06c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:27:08.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.666+0000 7f7c43fff700 1 -- 172.21.15.37:0/2462119642 shutdown_connections 2023-07-12T02:27:08.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.666+0000 7f7c43fff700 1 -- 172.21.15.37:0/2462119642 wait complete. 2023-07-12T02:27:08.689 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:27:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.892+0000 7f1ddc5ff700 1 Processor -- start 2023-07-12T02:27:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.892+0000 7f1ddc5ff700 1 -- start start 2023-07-12T02:27:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.893+0000 7f1ddc5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1dd406bd70 0x7f1dd4160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.894+0000 7f1ddc5ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd4160fa0 con 0x7f1dd415c370 2023-07-12T02:27:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.894+0000 7f1ddc5ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd406b200 con 0x7f1dd415c740 2023-07-12T02:27:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.894+0000 7f1ddc5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd40cd6d0 con 0x7f1dd406bd70 2023-07-12T02:27:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.894+0000 7f1dda39b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1dd415c370 0x7f1dd406aaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60870/0 (socket says 172.21.15.37:60870) 2023-07-12T02:27:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.894+0000 7f1dda39b700 1 -- 172.21.15.37:0/1183619222 learned_addr learned my addr 172.21.15.37:0/1183619222 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-12T02:27:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.894+0000 7f1ddab9c700 1 --2- 172.21.15.37:0/1183619222 >> v2:172.21.15.37:3300/0 conn(0x7f1dd406bd70 0x7f1dd4160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.894+0000 7f1ddab9c700 1 -- 172.21.15.37:0/1183619222 >> v1:172.21.15.196:6789/0 conn(0x7f1dd415c740 legacy=0x7f1dd406b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.894+0000 7f1dd9399700 1 -- 172.21.15.37:0/1183619222 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583657331 0 0) 0x7f1dd406b200 con 0x7f1dd415c740 2023-07-12T02:27:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.894+0000 7f1ddab9c700 1 -- 172.21.15.37:0/1183619222 >> v1:172.21.15.37:6789/0 conn(0x7f1dd415c370 legacy=0x7f1dd406aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.894+0000 7f1ddab9c700 1 -- 172.21.15.37:0/1183619222 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd40cd9b0 con 0x7f1dd406bd70 2023-07-12T02:27:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.895+0000 7f1ddab9c700 1 --2- 172.21.15.37:0/1183619222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd406bd70 0x7f1dd4160a60 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009d90 tx=0x7f1dcc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60d008fe70ef39e server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.895+0000 7f1dd9399700 1 -- 172.21.15.37:0/1183619222 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc00e070 con 0x7f1dd406bd70 2023-07-12T02:27:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.895+0000 7f1dd9399700 1 -- 172.21.15.37:0/1183619222 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc00bad0 con 0x7f1dd406bd70 2023-07-12T02:27:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.895+0000 7f1dd9399700 1 -- 172.21.15.37:0/1183619222 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc00be80 con 0x7f1dd406bd70 2023-07-12T02:27:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.895+0000 7f1ddc5ff700 1 -- 172.21.15.37:0/1183619222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd406bd70 msgr2=0x7f1dd4160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.895+0000 7f1ddc5ff700 1 --2- 172.21.15.37:0/1183619222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd406bd70 0x7f1dd4160a60 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009d90 tx=0x7f1dcc00b330 comp rx=0 tx=0).stop 2023-07-12T02:27:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.896+0000 7f1ddc5ff700 1 -- 172.21.15.37:0/1183619222 shutdown_connections 2023-07-12T02:27:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.896+0000 7f1ddc5ff700 1 --2- 172.21.15.37:0/1183619222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd406bd70 0x7f1dd4160a60 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.896+0000 7f1ddc5ff700 1 -- 172.21.15.37:0/1183619222 >> 172.21.15.37:0/1183619222 conn(0x7f1dd406e1a0 msgr2=0x7f1dd40b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:27:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.896+0000 7f1ddc5ff700 1 -- 172.21.15.37:0/1183619222 shutdown_connections 2023-07-12T02:27:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.896+0000 7f1ddc5ff700 1 -- 172.21.15.37:0/1183619222 wait complete. 2023-07-12T02:27:08.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.898+0000 7f1ddc5ff700 1 Processor -- start 2023-07-12T02:27:08.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.898+0000 7f1ddc5ff700 1 -- start start 2023-07-12T02:27:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.899+0000 7f1ddc5ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dd406bd70 0x7f1dd41515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.899+0000 7f1ddc5ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1dd415c370 0x7f1dd40ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.899+0000 7f1ddc5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd415c740 0x7f1dd40abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.899+0000 7f1ddc5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd40b4090 con 0x7f1dd415c740 2023-07-12T02:27:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.899+0000 7f1ddc5ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd40ae580 con 0x7f1dd406bd70 2023-07-12T02:27:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.899+0000 7f1ddc5ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd40b4330 con 0x7f1dd415c370 2023-07-12T02:27:08.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.899+0000 7f1dda39b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dd406bd70 0x7f1dd41515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:08.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.899+0000 7f1ddab9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd415c740 0x7f1dd40abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:08.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.899+0000 7f1dda39b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dd406bd70 0x7f1dd41515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:58662/0 (socket says 172.21.15.37:58662) 2023-07-12T02:27:08.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.899+0000 7f1dda39b700 1 -- 172.21.15.37:0/1755606442 learned_addr learned my addr 172.21.15.37:0/1755606442 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:27:08.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.899+0000 7f1dd9b9a700 1 --2- 172.21.15.37:0/1755606442 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1dd415c370 0x7f1dd40ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:08.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.900+0000 7f1dda39b700 1 -- 172.21.15.37:0/1755606442 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1dd415c370 msgr2=0x7f1dd40ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:08.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.900+0000 7f1dda39b700 1 --2- 172.21.15.37:0/1755606442 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1dd415c370 0x7f1dd40ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.900+0000 7f1dda39b700 1 -- 172.21.15.37:0/1755606442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd415c740 msgr2=0x7f1dd40abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:08.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.900+0000 7f1dda39b700 1 --2- 172.21.15.37:0/1755606442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd415c740 0x7f1dd40abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:08.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.900+0000 7f1dda39b700 1 -- 172.21.15.37:0/1755606442 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc009a70 con 0x7f1dd406bd70 2023-07-12T02:27:08.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.900+0000 7f1ddab9c700 1 --2- 172.21.15.37:0/1755606442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd415c740 0x7f1dd40abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:27:08.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.900+0000 7f1dda39b700 1 --2- 172.21.15.37:0/1755606442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dd406bd70 0x7f1dd41515d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000c780 tx=0x7f1dd000ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:08.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.900+0000 7f1dcaffd700 1 -- 172.21.15.37:0/1755606442 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0004c80 con 0x7f1dd406bd70 2023-07-12T02:27:08.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.900+0000 7f1dcaffd700 1 -- 172.21.15.37:0/1755606442 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd0004de0 con 0x7f1dd406bd70 2023-07-12T02:27:08.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.900+0000 7f1dcaffd700 1 -- 172.21.15.37:0/1755606442 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0007310 con 0x7f1dd406bd70 2023-07-12T02:27:08.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.900+0000 7f1ddc5ff700 1 -- 172.21.15.37:0/1755606442 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd40b4610 con 0x7f1dd406bd70 2023-07-12T02:27:08.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.900+0000 7f1ddc5ff700 1 -- 172.21.15.37:0/1755606442 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd40ae130 con 0x7f1dd406bd70 2023-07-12T02:27:08.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.902+0000 7f1ddc5ff700 1 -- 172.21.15.37:0/1755606442 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd404ea60 con 0x7f1dd406bd70 2023-07-12T02:27:08.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.902+0000 7f1dcaffd700 1 -- 172.21.15.37:0/1755606442 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1dd0007470 con 0x7f1dd406bd70 2023-07-12T02:27:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.903+0000 7f1dcaffd700 1 --2- 172.21.15.37:0/1755606442 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1db806ace0 0x7f1db806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.904+0000 7f1dcaffd700 1 -- 172.21.15.37:0/1755606442 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f1dd0089390 con 0x7f1dd406bd70 2023-07-12T02:27:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.904+0000 7f1dd9b9a700 1 --2- 172.21.15.37:0/1755606442 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1db806ace0 0x7f1db806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.905+0000 7f1dd9b9a700 1 --2- 172.21.15.37:0/1755606442 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1db806ace0 0x7f1db806d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4159300 tx=0x7f1dc4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:08.909+0000 7f1dcaffd700 1 -- 172.21.15.37:0/1755606442 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1dd0054260 con 0x7f1dd406bd70 2023-07-12T02:27:09.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.125+0000 7f1ddc5ff700 1 -- 172.21.15.37:0/1755606442 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1dd40b5750 con 0x7f1dd406bd70 2023-07-12T02:27:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.126+0000 7f1dcaffd700 1 -- 172.21.15.37:0/1755606442 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1dd0007720 con 0x7f1dd406bd70 2023-07-12T02:27:09.130 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-12T02:27:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.128+0000 7f1ddc5ff700 1 -- 172.21.15.37:0/1755606442 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1db806ace0 msgr2=0x7f1db806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.128+0000 7f1ddc5ff700 1 --2- 172.21.15.37:0/1755606442 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1db806ace0 0x7f1db806d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4159300 tx=0x7f1dc4009040 comp rx=0 tx=0).stop 2023-07-12T02:27:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.128+0000 7f1ddc5ff700 1 -- 172.21.15.37:0/1755606442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dd406bd70 msgr2=0x7f1dd41515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.128+0000 7f1ddc5ff700 1 --2- 172.21.15.37:0/1755606442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dd406bd70 0x7f1dd41515d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000c780 tx=0x7f1dd000ca90 comp rx=0 tx=0).stop 2023-07-12T02:27:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.128+0000 7f1ddc5ff700 1 -- 172.21.15.37:0/1755606442 shutdown_connections 2023-07-12T02:27:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.128+0000 7f1ddc5ff700 1 --2- 172.21.15.37:0/1755606442 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7f1db806ace0 0x7f1db806d190 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.128+0000 7f1ddc5ff700 1 --2- 172.21.15.37:0/1755606442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd415c740 0x7f1dd40abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.128+0000 7f1ddc5ff700 1 --2- 172.21.15.37:0/1755606442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dd406bd70 0x7f1dd41515d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.128+0000 7f1ddc5ff700 1 --2- 172.21.15.37:0/1755606442 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1dd415c370 0x7f1dd40ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.128+0000 7f1ddc5ff700 1 -- 172.21.15.37:0/1755606442 >> 172.21.15.37:0/1755606442 conn(0x7f1dd406e1a0 msgr2=0x7f1dd41584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:27:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.129+0000 7f1ddc5ff700 1 -- 172.21.15.37:0/1755606442 shutdown_connections 2023-07-12T02:27:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.129+0000 7f1ddc5ff700 1 -- 172.21.15.37:0/1755606442 wait complete. 2023-07-12T02:27:09.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:27:09.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.363+0000 7fce3d3ff700 1 Processor -- start 2023-07-12T02:27:09.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.363+0000 7fce3d3ff700 1 -- start start 2023-07-12T02:27:09.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.364+0000 7fce3d3ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce380d3730 0x7fce380cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:09.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.365+0000 7fce3d3ff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fce380cfa90 0x7fce380d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:09.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.365+0000 7fce3d3ff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce380d0b20 con 0x7fce380b8430 2023-07-12T02:27:09.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.365+0000 7fce3d3ff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce380cda30 con 0x7fce380cfa90 2023-07-12T02:27:09.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.365+0000 7fce3d3ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce380b8800 con 0x7fce380d3730 2023-07-12T02:27:09.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.365+0000 7fce367fc700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce380d3730 0x7fce380cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:09.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.365+0000 7fce377fe700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fce380cfa90 0x7fce380d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:09.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.365+0000 7fce367fc700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce380d3730 0x7fce380cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:50384/0 (socket says 172.21.15.37:50384) 2023-07-12T02:27:09.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.365+0000 7fce36ffd700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fce380b8430 0x7fce380cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:47880/0 (socket says 172.21.15.37:47880) 2023-07-12T02:27:09.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.365+0000 7fce367fc700 1 -- 172.21.15.37:0/258988916 learned_addr learned my addr 172.21.15.37:0/258988916 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:27:09.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.365+0000 7fce367fc700 1 -- 172.21.15.37:0/258988916 >> v2:172.21.15.196:3300/0 conn(0x7fce380cfa90 msgr2=0x7fce380d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:27:09.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.365+0000 7fce367fc700 1 --2- 172.21.15.37:0/258988916 >> v2:172.21.15.196:3300/0 conn(0x7fce380cfa90 0x7fce380d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.365+0000 7fce367fc700 1 -- 172.21.15.37:0/258988916 >> v1:172.21.15.196:6789/0 conn(0x7fce380b8430 legacy=0x7fce380cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:09.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.365+0000 7fce367fc700 1 -- 172.21.15.37:0/258988916 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce380cfeb0 con 0x7fce380d3730 2023-07-12T02:27:09.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.366+0000 7fce377fe700 1 --2- 172.21.15.37:0/258988916 >> v2:172.21.15.196:3300/0 conn(0x7fce380cfa90 0x7fce380d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:27:09.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.366+0000 7fce367fc700 1 --2- 172.21.15.37:0/258988916 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce380d3730 0x7fce380cf550 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0098f0 tx=0x7fce2c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59c1752e70e40d9b server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:09.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.366+0000 7fce35ffb700 1 -- 172.21.15.37:0/258988916 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c011830 con 0x7fce380d3730 2023-07-12T02:27:09.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.366+0000 7fce35ffb700 1 -- 172.21.15.37:0/258988916 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c011990 con 0x7fce380d3730 2023-07-12T02:27:09.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.366+0000 7fce35ffb700 1 -- 172.21.15.37:0/258988916 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c011d20 con 0x7fce380d3730 2023-07-12T02:27:09.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.367+0000 7fce3d3ff700 1 -- 172.21.15.37:0/258988916 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce380d3730 msgr2=0x7fce380cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:09.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.367+0000 7fce3d3ff700 1 --2- 172.21.15.37:0/258988916 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce380d3730 0x7fce380cf550 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0098f0 tx=0x7fce2c009c00 comp rx=0 tx=0).stop 2023-07-12T02:27:09.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.367+0000 7fce3d3ff700 1 -- 172.21.15.37:0/258988916 shutdown_connections 2023-07-12T02:27:09.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.367+0000 7fce3d3ff700 1 --2- 172.21.15.37:0/258988916 >> v2:172.21.15.196:3300/0 conn(0x7fce380cfa90 0x7fce380d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.367+0000 7fce3d3ff700 1 --2- 172.21.15.37:0/258988916 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce380d3730 0x7fce380cf550 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.367+0000 7fce3d3ff700 1 -- 172.21.15.37:0/258988916 >> 172.21.15.37:0/258988916 conn(0x7fce3806b3f0 msgr2=0x7fce3806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:27:09.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.367+0000 7fce3d3ff700 1 -- 172.21.15.37:0/258988916 shutdown_connections 2023-07-12T02:27:09.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.367+0000 7fce3d3ff700 1 -- 172.21.15.37:0/258988916 wait complete. 2023-07-12T02:27:09.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.369+0000 7fce3d3ff700 1 Processor -- start 2023-07-12T02:27:09.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.370+0000 7fce3d3ff700 1 -- start start 2023-07-12T02:27:09.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.370+0000 7fce3d3ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce380b8430 0x7fce38155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:09.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.371+0000 7fce3d3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce380cfa90 0x7fce3815da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:09.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.371+0000 7fce3d3ff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce380d3730 0x7fce380ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:09.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.371+0000 7fce3d3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3815c9b0 con 0x7fce380cfa90 2023-07-12T02:27:09.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.371+0000 7fce3d3ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3815cc90 con 0x7fce380b8430 2023-07-12T02:27:09.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.371+0000 7fce3d3ff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3815cf70 con 0x7fce380d3730 2023-07-12T02:27:09.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.371+0000 7fce367fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce380cfa90 0x7fce3815da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:09.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.371+0000 7fce367fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce380cfa90 0x7fce3815da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43024/0 (socket says 172.21.15.37:43024) 2023-07-12T02:27:09.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.371+0000 7fce36ffd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce380b8430 0x7fce38155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:09.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.371+0000 7fce367fc700 1 -- 172.21.15.37:0/1979556243 learned_addr learned my addr 172.21.15.37:0/1979556243 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:27:09.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.371+0000 7fce377fe700 1 --2- 172.21.15.37:0/1979556243 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce380d3730 0x7fce380ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:09.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.371+0000 7fce367fc700 1 -- 172.21.15.37:0/1979556243 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce380d3730 msgr2=0x7fce380ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:09.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.371+0000 7fce367fc700 1 --2- 172.21.15.37:0/1979556243 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce380d3730 0x7fce380ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.371+0000 7fce367fc700 1 -- 172.21.15.37:0/1979556243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce380b8430 msgr2=0x7fce38155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:09.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.371+0000 7fce367fc700 1 --2- 172.21.15.37:0/1979556243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce380b8430 0x7fce38155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.371+0000 7fce367fc700 1 -- 172.21.15.37:0/1979556243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce30009a70 con 0x7fce380cfa90 2023-07-12T02:27:09.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.372+0000 7fce367fc700 1 --2- 172.21.15.37:0/1979556243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce380cfa90 0x7fce3815da50 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fce2c000c00 tx=0x7fce2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:09.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.372+0000 7fce1f7fe700 1 -- 172.21.15.37:0/1979556243 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0043c0 con 0x7fce380cfa90 2023-07-12T02:27:09.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.372+0000 7fce1f7fe700 1 -- 172.21.15.37:0/1979556243 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c01f070 con 0x7fce380cfa90 2023-07-12T02:27:09.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.372+0000 7fce1f7fe700 1 -- 172.21.15.37:0/1979556243 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0036a0 con 0x7fce380cfa90 2023-07-12T02:27:09.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.372+0000 7fce3d3ff700 1 -- 172.21.15.37:0/1979556243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2c009550 con 0x7fce380cfa90 2023-07-12T02:27:09.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.372+0000 7fce3d3ff700 1 -- 172.21.15.37:0/1979556243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3815d530 con 0x7fce380cfa90 2023-07-12T02:27:09.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.373+0000 7fce3d3ff700 1 -- 172.21.15.37:0/1979556243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3815d720 con 0x7fce380cfa90 2023-07-12T02:27:09.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.374+0000 7fce1f7fe700 1 -- 172.21.15.37:0/1979556243 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fce2c021030 con 0x7fce380cfa90 2023-07-12T02:27:09.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.375+0000 7fce1f7fe700 1 --2- 172.21.15.37:0/1979556243 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fce2406ace0 0x7fce2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:09.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.376+0000 7fce1f7fe700 1 -- 172.21.15.37:0/1979556243 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6526+0+0 (secure 0 0 0) 0x7fce2c08a9b0 con 0x7fce380cfa90 2023-07-12T02:27:09.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.376+0000 7fce36ffd700 1 --2- 172.21.15.37:0/1979556243 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fce2406ace0 0x7fce2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:09.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.377+0000 7fce36ffd700 1 --2- 172.21.15.37:0/1979556243 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fce2406ace0 0x7fce2406d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fce28000f60 tx=0x7fce28007ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:09.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.380+0000 7fce1f7fe700 1 -- 172.21.15.37:0/1979556243 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fce2c055880 con 0x7fce380cfa90 2023-07-12T02:27:09.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.604+0000 7fce3d3ff700 1 -- 172.21.15.37:0/1979556243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fce3804ea60 con 0x7fce380cfa90 2023-07-12T02:27:09.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.604+0000 7fce1f7fe700 1 -- 172.21.15.37:0/1979556243 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7fce2c058ea0 con 0x7fce380cfa90 2023-07-12T02:27:09.609 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-12T02:27:09.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.607+0000 7fce3d3ff700 1 -- 172.21.15.37:0/1979556243 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fce2406ace0 msgr2=0x7fce2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:09.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.607+0000 7fce3d3ff700 1 --2- 172.21.15.37:0/1979556243 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fce2406ace0 0x7fce2406d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fce28000f60 tx=0x7fce28007ed0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.607+0000 7fce3d3ff700 1 -- 172.21.15.37:0/1979556243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce380cfa90 msgr2=0x7fce3815da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:09.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.607+0000 7fce3d3ff700 1 --2- 172.21.15.37:0/1979556243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce380cfa90 0x7fce3815da50 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fce2c000c00 tx=0x7fce2c004750 comp rx=0 tx=0).stop 2023-07-12T02:27:09.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.607+0000 7fce3d3ff700 1 -- 172.21.15.37:0/1979556243 shutdown_connections 2023-07-12T02:27:09.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.607+0000 7fce3d3ff700 1 --2- 172.21.15.37:0/1979556243 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fce2406ace0 0x7fce2406d190 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.607+0000 7fce3d3ff700 1 --2- 172.21.15.37:0/1979556243 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce380d3730 0x7fce380ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.607+0000 7fce3d3ff700 1 --2- 172.21.15.37:0/1979556243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce380b8430 0x7fce38155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.607+0000 7fce3d3ff700 1 --2- 172.21.15.37:0/1979556243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce380cfa90 0x7fce3815da50 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.607+0000 7fce3d3ff700 1 -- 172.21.15.37:0/1979556243 >> 172.21.15.37:0/1979556243 conn(0x7fce3806b3f0 msgr2=0x7fce3815bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:27:09.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.607+0000 7fce3d3ff700 1 -- 172.21.15.37:0/1979556243 shutdown_connections 2023-07-12T02:27:09.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.607+0000 7fce3d3ff700 1 -- 172.21.15.37:0/1979556243 wait complete. 2023-07-12T02:27:09.630 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-12T02:27:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.856+0000 7fe674fff700 1 Processor -- start 2023-07-12T02:27:09.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.856+0000 7fe674fff700 1 -- start start 2023-07-12T02:27:09.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.858+0000 7fe674fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe6700b4cc0 0x7fe6700cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:09.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.859+0000 7fe674fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe6700d1cd0 0x7fe6701608e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:09.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.859+0000 7fe674fff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6700cf3b0 con 0x7fe6700b8320 2023-07-12T02:27:09.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.859+0000 7fe674fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe670160e20 con 0x7fe6700b4cc0 2023-07-12T02:27:09.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.859+0000 7fe674fff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6700b86f0 con 0x7fe6700d1cd0 2023-07-12T02:27:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.862+0000 7fe66dd9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe6700b4cc0 0x7fe6700cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.862+0000 7fe66dd9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe6700b4cc0 0x7fe6700cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43030/0 (socket says 172.21.15.37:43030) 2023-07-12T02:27:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.862+0000 7fe66dd9b700 1 -- 172.21.15.37:0/1092270512 learned_addr learned my addr 172.21.15.37:0/1092270512 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:27:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.863+0000 7fe66dd9b700 1 -- 172.21.15.37:0/1092270512 >> v2:172.21.15.196:3300/0 conn(0x7fe6700d1cd0 msgr2=0x7fe6701608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:27:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.864+0000 7fe66dd9b700 1 --2- 172.21.15.37:0/1092270512 >> v2:172.21.15.196:3300/0 conn(0x7fe6700d1cd0 0x7fe6701608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.864+0000 7fe66dd9b700 1 -- 172.21.15.37:0/1092270512 >> v1:172.21.15.196:6789/0 conn(0x7fe6700b8320 legacy=0x7fe6700b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:27:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.864+0000 7fe66dd9b700 1 -- 172.21.15.37:0/1092270512 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6700cf0d0 con 0x7fe6700b4cc0 2023-07-12T02:27:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.864+0000 7fe66dd9b700 1 --2- 172.21.15.37:0/1092270512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6700b4cc0 0x7fe6700cd4f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe6700b8c70 tx=0x7fe664009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae51bd8c37ce4a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.865+0000 7fe66d59a700 1 -- 172.21.15.37:0/1092270512 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664004230 con 0x7fe6700b4cc0 2023-07-12T02:27:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.865+0000 7fe66d59a700 1 -- 172.21.15.37:0/1092270512 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe664004390 con 0x7fe6700b4cc0 2023-07-12T02:27:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.865+0000 7fe66d59a700 1 -- 172.21.15.37:0/1092270512 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6640036a0 con 0x7fe6700b4cc0 2023-07-12T02:27:09.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.866+0000 7fe674fff700 1 -- 172.21.15.37:0/1092270512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6700b4cc0 msgr2=0x7fe6700cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:09.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.866+0000 7fe674fff700 1 --2- 172.21.15.37:0/1092270512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6700b4cc0 0x7fe6700cd4f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe6700b8c70 tx=0x7fe664009bd0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.866+0000 7fe674fff700 1 -- 172.21.15.37:0/1092270512 shutdown_connections 2023-07-12T02:27:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.866+0000 7fe674fff700 1 --2- 172.21.15.37:0/1092270512 >> v2:172.21.15.196:3300/0 conn(0x7fe6700d1cd0 0x7fe6701608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.866+0000 7fe674fff700 1 --2- 172.21.15.37:0/1092270512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6700b4cc0 0x7fe6700cd4f0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.866+0000 7fe674fff700 1 -- 172.21.15.37:0/1092270512 >> 172.21.15.37:0/1092270512 conn(0x7fe6700722b0 msgr2=0x7fe6700cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:27:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.867+0000 7fe674fff700 1 -- 172.21.15.37:0/1092270512 shutdown_connections 2023-07-12T02:27:09.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.867+0000 7fe674fff700 1 -- 172.21.15.37:0/1092270512 wait complete. 2023-07-12T02:27:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.869+0000 7fe674fff700 1 Processor -- start 2023-07-12T02:27:09.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.870+0000 7fe674fff700 1 -- start start 2023-07-12T02:27:09.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.871+0000 7fe674fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6700b8320 0x7fe670070890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.871+0000 7fe674fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6700d1cd0 0x7fe67015e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.871+0000 7fe674fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe670166fc0 0x7fe670167460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.871+0000 7fe674fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67014a380 con 0x7fe670166fc0 2023-07-12T02:27:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.871+0000 7fe674fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67014a5d0 con 0x7fe6700d1cd0 2023-07-12T02:27:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.871+0000 7fe674fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67014a8b0 con 0x7fe6700b8320 2023-07-12T02:27:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.873+0000 7fe66dd9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6700d1cd0 0x7fe67015e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:09.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.873+0000 7fe66dd9b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6700d1cd0 0x7fe67015e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:58698/0 (socket says 172.21.15.37:58698) 2023-07-12T02:27:09.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.873+0000 7fe66dd9b700 1 -- 172.21.15.37:0/737544685 learned_addr learned my addr 172.21.15.37:0/737544685 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-12T02:27:09.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.874+0000 7fe66dd9b700 1 -- 172.21.15.37:0/737544685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6700b8320 msgr2=0x7fe670070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:09.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.874+0000 7fe66dd9b700 1 --2- 172.21.15.37:0/737544685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6700b8320 0x7fe670070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.874+0000 7fe66dd9b700 1 -- 172.21.15.37:0/737544685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe670166fc0 msgr2=0x7fe670167460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:09.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.874+0000 7fe66dd9b700 1 --2- 172.21.15.37:0/737544685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe670166fc0 0x7fe670167460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:09.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.874+0000 7fe66dd9b700 1 -- 172.21.15.37:0/737544685 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe664009550 con 0x7fe6700d1cd0 2023-07-12T02:27:09.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.875+0000 7fe66dd9b700 1 --2- 172.21.15.37:0/737544685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6700d1cd0 0x7fe67015e870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe664009130 tx=0x7fe664004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.878+0000 7fe65effd700 1 -- 172.21.15.37:0/737544685 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664011830 con 0x7fe6700d1cd0 2023-07-12T02:27:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.878+0000 7fe65effd700 1 -- 172.21.15.37:0/737544685 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe664011990 con 0x7fe6700d1cd0 2023-07-12T02:27:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.878+0000 7fe65effd700 1 -- 172.21.15.37:0/737544685 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664011d00 con 0x7fe6700d1cd0 2023-07-12T02:27:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.878+0000 7fe674fff700 1 -- 172.21.15.37:0/737544685 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67014ab90 con 0x7fe6700d1cd0 2023-07-12T02:27:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.879+0000 7fe674fff700 1 -- 172.21.15.37:0/737544685 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67014b390 con 0x7fe6700d1cd0 2023-07-12T02:27:09.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.880+0000 7fe674fff700 1 -- 172.21.15.37:0/737544685 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67014b0b0 con 0x7fe6700d1cd0 2023-07-12T02:27:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.882+0000 7fe65effd700 1 -- 172.21.15.37:0/737544685 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe66401b440 con 0x7fe6700d1cd0 2023-07-12T02:27:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.884+0000 7fe65effd700 1 --2- 172.21.15.37:0/737544685 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe65006ad30 0x7fe65006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:27:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.884+0000 7fe65effd700 1 -- 172.21.15.37:0/737544685 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6526+0+0 (secure 0 0 0) 0x7fe66408abf0 con 0x7fe6700d1cd0 2023-07-12T02:27:09.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.893+0000 7fe66e59c700 1 --2- 172.21.15.37:0/737544685 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe65006ad30 0x7fe65006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:27:09.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.895+0000 7fe65effd700 1 -- 172.21.15.37:0/737544685 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe67014b0b0 con 0x7fe6700d1cd0 2023-07-12T02:27:09.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:09.901+0000 7fe66e59c700 1 --2- 172.21.15.37:0/737544685 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe65006ad30 0x7fe65006d1e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe6600096d0 tx=0x7fe660006c30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:27:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:10.162+0000 7fe674fff700 1 -- 172.21.15.37:0/737544685 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe67014b0b0 con 0x7fe6700d1cd0 2023-07-12T02:27:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:10.162+0000 7fe65effd700 1 -- 172.21.15.37:0/737544685 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v44) v1 ==== 80+0+120 (secure 0 0 0) 0x7fe67014b0b0 con 0x7fe6700d1cd0 2023-07-12T02:27:10.167 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6835/483849162 2023-07-13T02:22:10.344253+0000 2023-07-12T02:27:10.167 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6833/483849162 2023-07-13T02:22:10.344253+0000 2023-07-12T02:27:10.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:10.164+0000 7fe674fff700 1 -- 172.21.15.37:0/737544685 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe65006ad30 msgr2=0x7fe65006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:10.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:10.164+0000 7fe674fff700 1 --2- 172.21.15.37:0/737544685 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe65006ad30 0x7fe65006d1e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe6600096d0 tx=0x7fe660006c30 comp rx=0 tx=0).stop 2023-07-12T02:27:10.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:10.164+0000 7fe674fff700 1 -- 172.21.15.37:0/737544685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6700d1cd0 msgr2=0x7fe67015e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:27:10.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:10.164+0000 7fe674fff700 1 --2- 172.21.15.37:0/737544685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6700d1cd0 0x7fe67015e870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe664009130 tx=0x7fe664004750 comp rx=0 tx=0).stop 2023-07-12T02:27:10.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:10.164+0000 7fe674fff700 1 -- 172.21.15.37:0/737544685 shutdown_connections 2023-07-12T02:27:10.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:10.164+0000 7fe674fff700 1 --2- 172.21.15.37:0/737544685 >> [v2:172.21.15.196:6832/3490435896,v1:172.21.15.196:6833/3490435896] conn(0x7fe65006ad30 0x7fe65006d1e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:10.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:10.164+0000 7fe674fff700 1 --2- 172.21.15.37:0/737544685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe670166fc0 0x7fe670167460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:10.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:10.164+0000 7fe674fff700 1 --2- 172.21.15.37:0/737544685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6700b8320 0x7fe670070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:10.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:10.164+0000 7fe674fff700 1 --2- 172.21.15.37:0/737544685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6700d1cd0 0x7fe67015e870 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:27:10.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:10.165+0000 7fe674fff700 1 -- 172.21.15.37:0/737544685 >> 172.21.15.37:0/737544685 conn(0x7fe6700b4cc0 msgr2=0x7fe67015fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:27:10.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:10.165+0000 7fe674fff700 1 -- 172.21.15.37:0/737544685 shutdown_connections 2023-07-12T02:27:10.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-12T02:27:10.165+0000 7fe674fff700 1 -- 172.21.15.37:0/737544685 wait complete. 2023-07-12T02:27:10.171 INFO:teuthology.orchestra.run.smithi037.stderr:listed 2 entries 2023-07-12T02:27:10.187 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-12T02:27:10.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:27:10.187 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-12T02:27:10.273 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-12T02:27:10.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:27:10.273 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-12T02:27:10.333 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-12T02:27:10.334 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:27:10.381 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348780k,nr_inodes=4087195,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 172.21.15.37:6789:/test /tmp/tmp.JoBPUdJofOtest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=e0d485b9-796c-494c-84d4-d32d9c18c85f,acl 0 0 2023-07-12T02:27:10.381 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-12T02:27:10.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:27:10.381 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-12T02:27:10.467 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-07-12T02:27:10.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T02:27:10.469 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:27:10.469 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:27:10.636 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345640k,nr_inodes=4086410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-12T02:27:10.637 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi196.front.sepia.ceph.com 2023-07-12T02:27:10.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:27:10.637 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-12T02:27:10.709 INFO:teuthology.orchestra.run.smithi196.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-07-12T02:27:10.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T02:27:10.710 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-07-12T02:27:10.711 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:27:10.760 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345640k,nr_inodes=4086410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-12T02:27:10.761 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi196.front.sepia.ceph.com 2023-07-12T02:27:10.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:27:10.761 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-12T02:27:10.807 INFO:teuthology.orchestra.run.smithi196.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-07-12T02:27:10.808 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T02:27:12.415 INFO:tasks.ceph.osd.0:Sent signal 15 2023-07-12T02:27:12.416 INFO:tasks.ceph.osd.1:Sent signal 15 2023-07-12T02:27:12.416 INFO:tasks.ceph.osd.2:Sent signal 15 2023-07-12T02:27:12.417 INFO:tasks.ceph.osd.3:Sent signal 15 2023-07-12T02:27:12.417 INFO:tasks.ceph.osd.4:Sent signal 15 2023-07-12T02:27:12.417 INFO:tasks.ceph.osd.5:Sent signal 15 2023-07-12T02:27:12.417 INFO:tasks.ceph.osd.6:Sent signal 15 2023-07-12T02:27:12.418 INFO:tasks.ceph.osd.7:Sent signal 15 2023-07-12T02:27:12.418 INFO:tasks.ceph.mds.a:Sent signal 15 2023-07-12T02:27:12.418 INFO:tasks.ceph.mds.b:Sent signal 15 2023-07-12T02:27:12.419 INFO:tasks.ceph.mds.d:Sent signal 15 2023-07-12T02:27:12.419 INFO:tasks.ceph.mon.a:Sent signal 15 2023-07-12T02:27:12.419 INFO:tasks.ceph.mon.b:Sent signal 15 2023-07-12T02:27:12.419 INFO:tasks.ceph.mon.c:Sent signal 15 2023-07-12T02:27:12.420 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-07-12T02:27:12.420 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-07-12T02:27:12.421 INFO:tasks.ceph.osd.4.smithi196.stderr:2023-07-12T02:27:12.413+0000 7f0bacbf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 112443) UID: 0 2023-07-12T02:27:12.421 INFO:tasks.ceph.osd.4.smithi196.stderr:2023-07-12T02:27:12.413+0000 7f0bacbf9700 -1 osd.4 44 *** Got signal Terminated *** 2023-07-12T02:27:12.421 INFO:tasks.ceph.osd.4.smithi196.stderr:2023-07-12T02:27:12.413+0000 7f0bacbf9700 -1 osd.4 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-12T02:27:12.421 INFO:tasks.ceph.osd.5.smithi196.stderr:2023-07-12T02:27:12.413+0000 7f4d23df9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 112444) UID: 0 2023-07-12T02:27:12.422 INFO:tasks.ceph.osd.5.smithi196.stderr:2023-07-12T02:27:12.413+0000 7f4d23df9700 -1 osd.5 44 *** Got signal Terminated *** 2023-07-12T02:27:12.422 INFO:tasks.ceph.osd.5.smithi196.stderr:2023-07-12T02:27:12.413+0000 7f4d23df9700 -1 osd.5 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-12T02:27:12.422 INFO:tasks.ceph.osd.6.smithi196.stderr:2023-07-12T02:27:12.414+0000 7f21fa5f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 112449) UID: 0 2023-07-12T02:27:12.422 INFO:tasks.ceph.osd.6.smithi196.stderr:2023-07-12T02:27:12.414+0000 7f21fa5f9700 -1 osd.6 44 *** Got signal Terminated *** 2023-07-12T02:27:12.422 INFO:tasks.ceph.osd.6.smithi196.stderr:2023-07-12T02:27:12.414+0000 7f21fa5f9700 -1 osd.6 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-12T02:27:12.423 INFO:tasks.ceph.osd.7.smithi196.stderr:2023-07-12T02:27:12.414+0000 7f4642df9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 112451) UID: 0 2023-07-12T02:27:12.423 INFO:tasks.ceph.osd.7.smithi196.stderr:2023-07-12T02:27:12.414+0000 7f4642df9700 -1 osd.7 44 *** Got signal Terminated *** 2023-07-12T02:27:12.423 INFO:tasks.ceph.osd.7.smithi196.stderr:2023-07-12T02:27:12.414+0000 7f4642df9700 -1 osd.7 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-12T02:27:12.423 INFO:tasks.ceph.mds.b.smithi196.stderr:2023-07-12T02:27:12.415+0000 7f33c6df9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 120180) UID: 0 2023-07-12T02:27:12.424 INFO:tasks.ceph.mds.b.smithi196.stderr:2023-07-12T02:27:12.415+0000 7f33c6df9700 -1 mds.b *** got signal Terminated *** 2023-07-12T02:27:12.424 INFO:tasks.ceph.mon.b.smithi196.stderr:2023-07-12T02:27:12.416+0000 7f190adff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 111740) UID: 0 2023-07-12T02:27:12.424 INFO:tasks.ceph.mon.b.smithi196.stderr:2023-07-12T02:27:12.416+0000 7f190adff700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-07-12T02:27:12.425 INFO:tasks.ceph.mon.c.smithi196.stderr:2023-07-12T02:27:12.416+0000 7f7dae3ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 111743) UID: 0 2023-07-12T02:27:12.425 INFO:tasks.ceph.mon.c.smithi196.stderr:2023-07-12T02:27:12.416+0000 7f7dae3ff700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-07-12T02:27:12.425 INFO:tasks.ceph.mds.d.smithi196.stderr:2023-07-12T02:27:12.416+0000 7f1bac1f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 120181) UID: 0 2023-07-12T02:27:12.425 INFO:tasks.ceph.mds.d.smithi196.stderr:2023-07-12T02:27:12.416+0000 7f1bac1f9700 -1 mds.d *** got signal Terminated *** 2023-07-12T02:27:12.426 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-12T02:27:12.412+0000 7fd3517f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 112202) UID: 0 2023-07-12T02:27:12.426 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-12T02:27:12.412+0000 7fd3517f9700 -1 osd.0 44 *** Got signal Terminated *** 2023-07-12T02:27:12.426 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-12T02:27:12.412+0000 7fd3517f9700 -1 osd.0 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-12T02:27:12.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-12T02:27:12.413+0000 7f5d783f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 112208) UID: 0 2023-07-12T02:27:12.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-12T02:27:12.413+0000 7f5d783f9700 -1 osd.1 44 *** Got signal Terminated *** 2023-07-12T02:27:12.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-12T02:27:12.413+0000 7f5d783f9700 -1 osd.1 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-12T02:27:12.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-12T02:27:12.413+0000 7f1bfc3f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 112216) UID: 0 2023-07-12T02:27:12.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-12T02:27:12.413+0000 7f1bfc3f9700 -1 osd.2 44 *** Got signal Terminated *** 2023-07-12T02:27:12.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-12T02:27:12.413+0000 7f1bfc3f9700 -1 osd.2 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-12T02:27:12.428 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-07-12T02:27:12.413+0000 7f4a7ebf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 112217) UID: 0 2023-07-12T02:27:12.428 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-07-12T02:27:12.413+0000 7f4a7ebf9700 -1 osd.3 44 *** Got signal Terminated *** 2023-07-12T02:27:12.428 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-07-12T02:27:12.414+0000 7f4a7ebf9700 -1 osd.3 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-12T02:27:12.429 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-07-12T02:27:12.415+0000 7fe5333f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 128695) UID: 0 2023-07-12T02:27:12.429 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-07-12T02:27:12.415+0000 7fe5333f9700 -1 mds.a *** got signal Terminated *** 2023-07-12T02:27:12.429 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-12T02:27:12.416+0000 7f985b5ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 111842) UID: 0 2023-07-12T02:27:12.429 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-12T02:27:12.416+0000 7f985b5ff700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-07-12T02:27:12.621 INFO:tasks.ceph.mgr.y.smithi037.stderr:daemon-helper: command crashed with signal 15 2023-07-12T02:28:32.467 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:28:32.471 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:29:02.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:29:02.797 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:29:32.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:29:32.916 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:30:03.022 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:30:03.028 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:30:33.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:30:33.165 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:31:03.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:31:03.276 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:31:33.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:31:33.383 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:32:03.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:32:03.492 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:32:33.732 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:32:33.738 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:33:03.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:33:03.933 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:33:34.047 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:33:34.052 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:34:04.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:34:04.214 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:34:34.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:34:34.327 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:35:04.491 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:35:04.496 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:35:34.619 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:35:34.624 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:36:04.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:36:04.795 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:36:34.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:36:34.906 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:37:05.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:37:05.084 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:37:35.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:37:35.246 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:38:05.411 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:38:05.416 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:38:35.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:38:35.595 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:39:05.786 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:39:05.790 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:39:35.914 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:39:35.919 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:40:06.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:40:06.091 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:40:36.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:40:36.208 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:41:06.390 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:41:06.396 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:41:36.519 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:41:36.524 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:42:06.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:42:06.718 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:42:36.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:42:36.830 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:43:07.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:43:07.061 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:43:37.165 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:43:37.170 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:44:07.276 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:44:07.281 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:44:37.398 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:44:37.403 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:45:07.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:45:07.517 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:45:37.711 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:45:37.716 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:46:07.822 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:46:07.827 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:46:37.968 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:46:37.973 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:47:08.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:47:08.085 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:47:38.275 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:47:38.280 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:48:08.387 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:48:08.392 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:48:38.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:48:38.605 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:49:08.711 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:49:08.716 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:49:38.918 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:49:38.924 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:50:09.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:50:09.047 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:50:39.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:50:39.266 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:51:09.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:51:09.381 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:51:39.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:51:39.532 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:52:09.638 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:52:09.643 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:52:39.850 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:52:39.855 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:53:09.987 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:53:09.992 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:53:40.098 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:53:40.103 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:54:10.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:54:10.217 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:54:40.338 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:54:40.343 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:55:10.467 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:55:10.472 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:55:40.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:55:40.601 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:56:10.704 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:56:10.709 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:56:40.818 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:56:40.824 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:57:10.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:57:10.970 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:57:41.075 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:57:41.080 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:58:11.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:58:11.191 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:58:41.300 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:58:41.305 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:59:11.414 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:59:11.419 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:59:41.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:59:41.536 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:00:11.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:00:11.658 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:00:41.770 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:00:41.776 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:01:11.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:01:11.888 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:01:41.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:01:41.999 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:02:12.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:02:12.113 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:02:42.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:02:42.313 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:03:12.437 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:03:12.442 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:03:42.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:03:42.647 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:04:12.882 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:04:12.888 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:04:42.991 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:04:42.996 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:05:13.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:05:13.108 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:05:43.340 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:05:43.345 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:06:13.456 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:06:13.461 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:06:43.571 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:06:43.576 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:07:13.685 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:07:13.690 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:07:43.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:07:43.816 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:08:13.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:08:13.945 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:08:44.169 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:08:44.174 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:09:14.313 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:09:14.318 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:09:44.425 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:09:44.430 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:10:14.563 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:10:14.568 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:10:44.774 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:10:44.779 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:11:14.885 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:11:14.890 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:11:44.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:11:45.003 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:12:15.120 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:12:15.125 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:12:45.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:12:45.234 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:13:15.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:13:15.354 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:13:45.519 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:13:45.524 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:14:15.630 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:14:15.635 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:14:45.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:14:45.747 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:15:15.847 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:15:15.852 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:15:45.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:15:45.975 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:16:16.087 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:16:16.092 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:16:46.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:16:46.203 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:17:16.577 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:17:16.582 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:17:46.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:17:46.699 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:18:16.892 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:18:16.897 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:18:47.022 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:18:47.027 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:19:17.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:19:17.212 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:19:47.361 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:19:47.366 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:20:17.547 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:20:17.552 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:20:47.667 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:20:47.672 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:21:17.846 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:21:17.851 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:21:47.974 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:21:47.979 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:22:18.144 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:22:18.150 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:22:48.254 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:22:48.259 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:23:18.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:23:18.399 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:23:48.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:23:48.512 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:24:18.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:24:18.736 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:24:48.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:24:48.859 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:25:18.967 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:25:18.973 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:25:49.081 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:25:49.086 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:26:19.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:26:19.201 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:26:49.310 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:26:49.315 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:27:19.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:27:19.421 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:27:49.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:27:49.529 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:28:19.636 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:28:19.641 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:28:49.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:28:49.752 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:29:19.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:29:19.864 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:29:49.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:29:49.975 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:30:20.104 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:30:20.110 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:30:50.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:30:50.233 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:31:20.339 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:31:20.344 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:31:50.454 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:31:50.459 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:32:20.571 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:32:20.576 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:32:50.683 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:32:50.706 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:33:20.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:33:20.833 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:33:50.943 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:33:50.948 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:34:21.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:34:21.165 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:34:51.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:34:51.277 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:35:21.489 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:35:21.494 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:35:51.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:35:51.605 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:36:21.818 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:36:21.823 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:36:51.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:36:51.940 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:37:22.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:37:22.144 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:37:52.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:37:52.256 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:38:22.363 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:38:22.369 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:38:52.474 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:38:52.479 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:39:22.584 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:39:22.589 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:39:52.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:39:52.702 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:40:22.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:40:22.821 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:40:52.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:40:52.959 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:41:23.072 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:41:23.078 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:41:53.226 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:41:53.233 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:42:23.348 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:42:23.353 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:42:53.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:42:53.464 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:43:23.571 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:43:23.577 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:43:53.680 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:43:53.686 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:44:23.795 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:44:23.800 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:44:53.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:44:53.911 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:45:24.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:45:24.106 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:45:54.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:45:54.218 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:46:24.332 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:46:24.338 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:46:54.461 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:46:54.466 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:47:24.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:47:24.578 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:47:54.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:47:54.689 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:48:24.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:48:24.810 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:48:54.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:48:54.929 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:49:25.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:49:25.137 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:49:55.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:49:55.265 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:50:25.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:50:25.493 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:50:55.605 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:50:55.610 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:51:25.819 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:51:25.825 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:51:55.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:51:55.934 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:52:26.041 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:52:26.047 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:52:56.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:52:56.182 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:53:26.373 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:53:26.378 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:53:56.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:53:56.489 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:54:26.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:54:26.689 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:54:56.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:54:56.795 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:55:27.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:55:27.008 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:55:57.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:55:57.138 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:56:27.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:56:27.380 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:56:57.665 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:56:57.671 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:57:27.785 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:57:27.790 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:57:57.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:57:57.992 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:58:28.098 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:58:28.103 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:58:58.211 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:58:58.217 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:59:28.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:59:28.335 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:59:58.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:59:58.447 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:00:28.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:00:28.575 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:00:58.682 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:00:58.688 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:01:28.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:01:28.800 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:01:58.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:01:58.911 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:02:29.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:02:29.030 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:02:59.162 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:02:59.167 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:03:29.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:03:29.329 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:03:59.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:03:59.448 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:04:29.605 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:04:29.610 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:04:59.717 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:04:59.723 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:05:29.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:05:29.935 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:06:00.045 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:06:00.050 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:06:30.194 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:06:30.200 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:07:00.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:07:00.311 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:07:30.475 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:07:30.481 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:08:00.598 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:08:00.603 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:08:30.822 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:08:30.828 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:09:00.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:09:00.944 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:09:31.073 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:09:31.079 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:10:01.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:10:01.199 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:10:31.372 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:10:31.381 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:11:01.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:11:01.493 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:11:31.623 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:11:31.628 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:12:01.732 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:12:01.738 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:12:31.847 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:12:31.852 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:13:01.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:13:01.957 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:13:32.109 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:13:32.115 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:14:02.222 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:14:02.228 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:14:32.426 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:14:32.432 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:15:02.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:15:02.550 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:15:32.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:15:32.703 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:16:02.815 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:16:02.821 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:16:32.996 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:16:33.002 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:17:03.124 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:17:03.130 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:17:33.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:17:33.246 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:18:03.365 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:18:03.370 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:18:33.534 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:18:33.539 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:19:03.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:19:03.656 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:19:33.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:19:33.813 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:20:03.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:20:03.927 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:20:34.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:20:34.053 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:21:04.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:21:04.165 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:21:34.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:21:34.335 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:22:04.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:22:04.434 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:22:34.621 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:22:34.626 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:23:04.734 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:23:04.739 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:23:34.852 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:23:34.857 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:24:04.989 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:24:04.994 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:24:35.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:24:35.224 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:25:05.328 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:25:05.333 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:25:35.526 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:25:35.531 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:26:05.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:26:05.649 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:26:35.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:26:35.819 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:27:05.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:27:05.944 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:27:36.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:27:36.163 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:28:06.282 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:28:06.287 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:28:36.486 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:28:36.491 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:29:06.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:29:06.595 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:29:36.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:29:36.786 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:30:06.916 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:30:06.922 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:30:37.034 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:30:37.039 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:31:07.362 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:31:07.367 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:31:37.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:31:37.481 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:32:07.660 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:32:07.665 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:32:37.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:32:37.794 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:33:07.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:33:07.924 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:33:38.033 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:33:38.039 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:34:08.264 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:34:08.269 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:34:38.386 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:34:38.392 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:35:08.614 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:35:08.620 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:35:38.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:35:38.923 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:36:09.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:36:09.118 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:36:39.227 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:36:39.233 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:37:09.411 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:37:09.417 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:37:39.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:37:39.587 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:38:09.785 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:38:09.790 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:38:39.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:38:39.935 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:39:10.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:39:10.114 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:39:40.222 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:39:40.227 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:40:10.414 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:40:10.420 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:40:40.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:40:40.541 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:41:10.681 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:41:10.686 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:41:40.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:41:40.814 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:42:10.978 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:42:10.984 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:42:41.107 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:42:41.112 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:43:11.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:43:11.283 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:43:41.398 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:43:41.403 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:44:11.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:44:11.614 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:44:41.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:44:41.728 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:45:11.975 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:45:11.980 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:45:42.219 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:45:42.224 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:46:12.431 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:46:12.436 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:46:42.551 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:46:42.556 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:47:12.691 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:47:12.696 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:47:42.816 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:47:42.822 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:48:13.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:48:13.021 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:48:43.146 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:48:43.151 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:49:13.259 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:49:13.265 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:49:43.374 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:49:43.379 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:50:13.508 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:50:13.513 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:50:43.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:50:43.625 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:51:13.732 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:51:13.737 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:51:43.864 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:51:43.869 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:52:14.014 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:52:14.019 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:52:44.151 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:52:44.156 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:53:14.358 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:53:14.363 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:53:44.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:53:44.470 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:54:14.662 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:54:14.667 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:54:44.767 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:54:44.772 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:55:15.010 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:55:15.015 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:55:45.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:55:45.134 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:56:15.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:56:15.307 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:56:45.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:56:45.421 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:57:15.648 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:57:15.653 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:57:45.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:57:45.774 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:58:15.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:58:15.995 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:58:46.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:58:46.121 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:59:16.287 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:59:16.291 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:59:46.415 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:59:46.420 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:00:16.644 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:00:16.649 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:00:46.764 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:00:46.769 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:01:16.968 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:01:16.973 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:01:47.105 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:01:47.110 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:02:17.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:02:17.271 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:02:47.382 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:02:47.387 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:03:17.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:03:17.623 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:03:47.735 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:03:47.740 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:04:17.913 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:04:17.918 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:04:48.020 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:04:48.025 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:05:18.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:05:18.200 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:05:48.340 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:05:48.345 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:06:18.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:06:18.541 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:06:48.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:06:48.656 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:07:18.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:07:18.788 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:07:48.897 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:07:48.902 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:08:19.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:08:19.087 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:08:49.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:08:49.205 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:09:19.315 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:09:19.320 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:09:49.437 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:09:49.442 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:10:19.577 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:10:19.582 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:10:49.683 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:10:49.688 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:11:19.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:11:19.799 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:11:49.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:11:49.916 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:12:20.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:12:20.128 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:12:50.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:12:50.245 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:13:20.449 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:13:20.454 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:13:50.560 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:13:50.565 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:14:20.798 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:14:20.803 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:14:50.993 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:14:50.998 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:15:21.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:15:21.234 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:15:51.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:15:51.355 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:16:21.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:16:21.508 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:16:51.621 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:16:51.626 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:17:21.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:17:21.774 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:17:51.889 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:17:51.894 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:18:22.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:18:22.005 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:18:52.120 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:18:52.125 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:19:22.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:19:22.237 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:19:52.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:19:52.357 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:20:22.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:20:22.503 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:20:52.685 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:20:52.690 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:21:22.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:21:22.801 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:21:52.950 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:21:52.955 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:22:23.061 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:22:23.066 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:22:53.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:22:53.262 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:23:23.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:23:23.487 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:23:53.654 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:23:53.659 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:24:23.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:24:23.788 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:24:53.961 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:24:53.967 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:25:24.081 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:25:24.086 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:25:54.293 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:25:54.298 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:26:24.396 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:26:24.401 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:26:54.591 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:26:54.596 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:27:24.705 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:27:24.710 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:27:54.924 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:27:54.929 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:28:25.044 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:28:25.049 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:28:55.280 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:28:55.285 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:29:25.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:29:25.402 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:29:55.626 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:29:55.632 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:30:25.740 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:30:25.745 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:30:55.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:30:55.969 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:31:26.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:31:26.094 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:31:56.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:31:56.289 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:32:26.396 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:32:26.401 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:32:56.574 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:32:56.579 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:33:26.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:33:26.689 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:33:56.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:33:56.811 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:34:26.927 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:34:26.932 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:34:57.163 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:34:57.168 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:35:27.274 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:35:27.279 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:35:57.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:35:57.433 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:36:27.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:36:27.545 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:36:57.802 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:36:57.807 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:37:27.922 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:37:27.927 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:37:58.099 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:37:58.104 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:38:28.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:38:28.348 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:38:58.565 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:38:58.570 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:39:28.680 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:39:28.685 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:39:58.914 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:39:58.919 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:40:29.033 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:40:29.039 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:40:59.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:40:59.236 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:41:29.362 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:41:29.368 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:41:59.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:41:59.572 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:42:29.680 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:42:29.685 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:42:59.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:42:59.813 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:43:29.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:43:29.926 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:44:00.099 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:44:00.104 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:44:30.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:44:30.235 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:45:00.422 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:45:00.427 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:45:30.526 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:45:30.531 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:46:00.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:46:00.653 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:46:30.757 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:46:30.762 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:47:00.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:47:00.924 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:47:31.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:47:31.053 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:48:01.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:48:01.164 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:48:31.280 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:48:31.284 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:49:01.393 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:49:01.398 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:49:31.511 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:49:31.517 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:50:01.732 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:50:01.737 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:50:31.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:50:31.850 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:51:02.060 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:51:02.065 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:51:32.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:51:32.179 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:52:02.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:52:02.291 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:52:32.395 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:52:32.400 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:53:02.534 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:53:02.539 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:53:32.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:53:32.652 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:54:02.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:54:02.829 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:54:32.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:54:32.934 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:55:03.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:55:03.122 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:55:33.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:55:33.242 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:56:03.453 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:56:03.458 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:56:33.560 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:56:33.565 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:57:03.798 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:57:03.803 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:57:33.912 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:57:33.918 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:58:04.126 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:58:04.131 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:58:34.248 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:58:34.253 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:59:04.445 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:59:04.450 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:59:34.556 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:59:34.561 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:00:04.692 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:00:04.697 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:00:34.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:00:34.819 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:01:05.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:01:05.030 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:01:35.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:01:35.142 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:02:05.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:02:05.253 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:02:35.360 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:02:35.365 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:03:05.478 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:03:05.482 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:03:35.584 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:03:35.590 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:04:05.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:04:05.751 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:04:35.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:04:35.868 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:05:06.036 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:05:06.041 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:05:36.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:05:36.152 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:06:06.380 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:06:06.385 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:06:36.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:06:36.492 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:07:06.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:07:06.679 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:07:36.777 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:07:36.782 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:08:06.914 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:08:06.919 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:08:37.027 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:08:37.032 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:09:07.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:09:07.209 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:09:37.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:09:37.319 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:10:07.506 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:10:07.512 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:10:37.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:10:37.638 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:11:07.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:11:07.850 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:11:37.980 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:11:37.985 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:12:08.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:12:08.180 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:12:38.287 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:12:38.292 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:13:08.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:13:08.469 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:13:38.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:13:38.574 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:14:08.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:14:08.752 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:14:38.891 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:14:38.896 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:15:09.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:15:09.122 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:15:39.236 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:15:39.241 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:16:09.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:16:09.464 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:16:39.572 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:16:39.577 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:17:09.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:17:09.765 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:17:39.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:17:39.877 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:18:09.982 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:18:09.987 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:18:40.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:18:40.132 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:19:10.264 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:19:10.269 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:19:40.367 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:19:40.373 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:20:10.489 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:20:10.495 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:20:40.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:20:40.614 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:21:10.727 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:21:10.732 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:21:40.864 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:21:40.869 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:22:10.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:22:10.990 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:22:41.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:22:41.194 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:23:11.309 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:23:11.314 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:23:41.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:23:41.425 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:24:11.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:24:11.595 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:24:41.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:24:41.774 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:25:11.905 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:25:11.910 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:25:42.092 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:25:42.097 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:26:12.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:26:12.233 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:26:42.399 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:26:42.404 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:27:12.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:27:12.532 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:27:42.714 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:27:42.719 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:28:12.833 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:28:12.838 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:28:43.004 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:28:43.009 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:29:13.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:29:13.145 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:29:43.344 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:29:43.349 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:30:13.449 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:30:13.454 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:30:43.672 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:30:43.677 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:31:13.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:31:13.908 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:31:44.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:31:44.021 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:32:14.161 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:32:14.166 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:32:44.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:32:44.311 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:33:14.435 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:33:14.440 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:33:44.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:33:44.559 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:34:14.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:34:14.685 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:34:44.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:34:44.816 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:35:14.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:35:14.958 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:35:45.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:35:45.068 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:36:15.430 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:36:15.435 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:36:45.550 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:36:45.556 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:37:15.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:37:15.875 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:37:45.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:37:46.003 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:38:16.110 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:38:16.115 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:38:46.321 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:38:46.327 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:39:16.676 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:39:16.681 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:39:46.804 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:39:46.809 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:40:16.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:40:16.996 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:40:47.110 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:40:47.115 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:41:17.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:41:17.302 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:41:47.412 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:41:47.417 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:42:17.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:42:17.559 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:42:47.664 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:42:47.669 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:43:17.802 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:43:17.807 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:43:47.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:43:47.936 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:44:18.126 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:44:18.131 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:44:48.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:44:48.235 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:45:18.349 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:45:18.354 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:45:48.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:45:48.463 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:46:18.623 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:46:18.628 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:46:48.728 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:46:48.734 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:47:18.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:47:18.859 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:47:49.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:47:49.012 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:48:19.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:48:19.126 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:48:49.257 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:48:49.262 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:49:19.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:49:19.381 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:49:49.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:49:49.503 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:50:19.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:50:19.630 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:50:49.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:50:49.751 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:51:19.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:51:19.928 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:51:50.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:51:50.044 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:52:20.214 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:52:20.219 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:52:50.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:52:50.398 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:53:20.621 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:53:20.626 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:53:50.732 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:53:50.738 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:54:20.862 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:54:20.868 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:54:50.981 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:54:50.986 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:55:21.168 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:55:21.173 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:55:51.287 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:55:51.293 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:56:21.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:56:21.515 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:56:51.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:56:51.633 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:57:21.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:57:21.749 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:57:51.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:57:51.856 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:58:21.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:58:21.971 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:58:52.124 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:58:52.130 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:59:22.245 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:59:22.250 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:59:52.356 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:59:52.362 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:00:22.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:00:22.482 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:00:52.597 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:00:52.602 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:01:22.718 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:01:22.723 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:01:52.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:01:52.843 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:02:22.949 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:02:22.954 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:02:53.053 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:02:53.058 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:03:23.248 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:03:23.253 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:03:53.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:03:53.397 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:04:23.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:04:23.558 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:04:53.667 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:04:53.672 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:05:23.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:05:23.899 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:05:54.022 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:05:54.027 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:06:24.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:06:24.234 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:06:54.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:06:54.351 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:07:24.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:07:24.566 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:07:54.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:07:54.684 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:08:24.914 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:08:24.919 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:08:55.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:08:55.070 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:09:25.180 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:09:25.186 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:09:55.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:09:55.304 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:10:25.417 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:10:25.422 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:10:55.673 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:10:55.678 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:11:25.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:11:25.809 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:11:56.005 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:11:56.010 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:12:26.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:12:26.123 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:12:56.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:12:56.509 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:13:26.648 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:13:26.654 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:13:56.819 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:13:56.829 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:14:26.975 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:14:26.997 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:14:57.169 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:14:57.183 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:15:27.340 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:15:27.351 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:15:57.726 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:15:57.734 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:16:27.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:16:27.881 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:16:58.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:16:58.073 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:17:28.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:17:28.210 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:17:58.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:17:58.387 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:18:28.521 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:18:28.542 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:18:58.672 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:18:58.688 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:19:28.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:19:28.840 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:19:59.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:19:59.073 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:20:29.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:20:29.235 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:20:59.400 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:20:59.416 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:21:29.519 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:21:29.527 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:21:59.656 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:21:59.665 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:22:29.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:22:29.786 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:22:59.916 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:22:59.923 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:23:30.083 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:23:30.090 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:24:00.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:24:00.291 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:24:30.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:24:30.437 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:25:00.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:25:00.557 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:25:30.664 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:25:30.669 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:26:00.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:26:00.788 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:26:30.903 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:26:30.910 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:27:01.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:27:01.136 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:27:31.242 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:27:31.248 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:28:01.358 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:28:01.363 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:28:31.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:28:31.471 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:29:01.594 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:29:01.599 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:29:31.731 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:29:31.736 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:30:01.848 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:30:01.853 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:30:31.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:30:31.977 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:31:02.092 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:31:02.097 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:31:32.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:31:32.226 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:32:02.390 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:32:02.395 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:32:32.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:32:32.500 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:33:02.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:33:02.701 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:33:32.816 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:33:32.821 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:34:02.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:34:02.933 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:34:33.057 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:34:33.062 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:35:03.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:35:03.275 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:35:33.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:35:33.394 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:36:03.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:36:03.595 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:36:33.700 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:36:33.705 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:37:03.844 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:37:03.850 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:37:33.963 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:37:33.968 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:38:04.148 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:38:04.153 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:38:34.275 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:38:34.281 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:39:04.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:39:04.476 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:39:34.586 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:39:34.591 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:40:04.777 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:40:04.783 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:40:34.981 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:40:34.987 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:41:05.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:41:05.106 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:41:35.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:41:35.224 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:42:05.366 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:42:05.371 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:42:35.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:42:35.492 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:43:05.660 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:43:05.667 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:43:35.775 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:43:35.781 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:44:05.997 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:44:06.003 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:44:36.144 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:44:36.150 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:45:06.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:45:06.267 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:45:36.400 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:45:36.405 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:46:06.594 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:46:06.599 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:46:36.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:46:36.719 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:47:06.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:47:06.833 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:47:36.954 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:47:36.960 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:48:07.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:48:07.070 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:48:37.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:48:37.206 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:49:07.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:49:07.321 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:49:37.455 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:49:37.462 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:50:07.579 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:50:07.584 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:50:37.707 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:50:37.712 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:51:07.819 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:51:07.824 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:51:37.954 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:51:37.959 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:52:08.067 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:52:08.073 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:52:38.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:52:38.188 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:53:08.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:53:08.304 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:53:38.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:53:38.426 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:54:08.667 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:54:08.672 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:54:38.776 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:54:38.781 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:55:09.005 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:55:09.011 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:55:39.118 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:55:39.125 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:56:09.311 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:56:09.316 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:56:39.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:56:39.435 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:57:09.636 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:57:09.640 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:57:39.754 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:57:39.760 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:58:09.868 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:58:09.876 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:58:40.004 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:58:40.009 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:59:10.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:59:10.212 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:59:40.326 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:59:40.331 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:00:10.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:00:10.560 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:00:40.676 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:00:40.684 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:01:10.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:01:10.905 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:01:41.033 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:01:41.038 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:02:11.239 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:02:11.244 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:02:41.357 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:02:41.363 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:03:11.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:03:11.557 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:03:41.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:03:41.684 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:04:11.857 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:04:11.862 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:04:41.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:04:41.982 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:05:12.214 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:05:12.241 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:05:42.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:05:42.357 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:06:12.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:06:12.559 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:06:42.683 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:06:42.689 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:07:12.836 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:07:12.842 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:07:42.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:07:42.972 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:08:13.151 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:08:13.157 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:08:43.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:08:43.268 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:09:13.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:09:13.530 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:09:43.645 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:09:43.654 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:10:13.856 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:10:13.861 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:10:43.984 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:10:43.992 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:11:14.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:11:14.186 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:11:44.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:11:44.315 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:12:14.445 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:12:14.450 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:12:44.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:12:44.573 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:13:14.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:13:14.749 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:13:44.862 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:13:44.868 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:14:15.008 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:14:15.013 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:14:45.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:14:45.129 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:15:15.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:15:15.245 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:15:45.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:15:45.449 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:16:15.564 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:16:15.569 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:16:45.750 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:16:45.755 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:17:15.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:17:15.875 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:17:45.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:17:45.981 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:18:16.094 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:18:16.099 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:18:46.214 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:18:46.220 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:19:16.342 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:19:16.347 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:19:46.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:19:46.501 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:20:16.816 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:20:16.822 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:20:47.002 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:20:47.007 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:21:17.173 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:21:17.178 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:21:47.309 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:21:47.314 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:22:17.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:22:17.475 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:22:47.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:22:47.737 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:23:17.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:23:17.859 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:23:48.031 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:23:48.036 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:24:18.145 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:24:18.151 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:24:48.337 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:24:48.343 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:25:18.450 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:25:18.457 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:25:48.678 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:25:48.684 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:26:18.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:26:18.799 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:26:48.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:26:48.923 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:27:19.021 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:27:19.027 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:27:49.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:27:49.180 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:28:19.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:28:19.292 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:28:49.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:28:49.496 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:29:19.612 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:29:19.617 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:29:49.727 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:29:49.732 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:30:19.875 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:30:19.881 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:30:50.071 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:30:50.076 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:31:20.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:31:20.229 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:31:50.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:31:50.423 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:32:20.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:32:20.529 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:32:50.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:32:50.749 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:33:20.862 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:33:20.868 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:33:51.057 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:33:51.062 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:34:21.178 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:34:21.183 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:34:51.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:34:51.302 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:35:21.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:35:21.423 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:35:51.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:35:51.545 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:36:21.816 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:36:21.821 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:36:52.028 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:36:52.033 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:37:22.149 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:37:22.154 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:37:52.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:37:52.269 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:38:22.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:38:22.462 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:38:52.575 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:38:52.580 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:39:22.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:39:22.777 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:39:52.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:39:52.913 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:40:23.096 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:40:23.101 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:40:53.208 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:40:53.213 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:41:23.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:41:23.446 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:41:53.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:41:53.566 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:42:23.726 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:42:23.731 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:42:53.846 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:42:53.855 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:43:23.982 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:43:23.988 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:43:54.094 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:43:54.099 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:44:24.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:44:24.286 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:44:54.405 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:44:54.410 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:45:24.614 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:45:24.619 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:45:54.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:45:54.739 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:46:24.848 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:46:24.854 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:46:54.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:46:54.970 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:47:25.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:47:25.182 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:47:55.380 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:47:55.385 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:48:25.492 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:48:25.497 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:48:55.678 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:48:55.684 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:49:25.864 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:49:25.870 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:49:56.051 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:49:56.057 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:50:26.246 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:50:26.251 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:50:56.424 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:50:56.429 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:51:26.636 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:51:26.641 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:51:56.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:51:56.818 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:52:27.000 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:52:27.005 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:52:57.187 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:52:57.192 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:53:27.365 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:53:27.370 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:53:57.560 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:53:57.565 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:54:27.680 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:54:27.685 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:54:57.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:54:57.888 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:55:28.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:55:28.009 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:55:58.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:55:58.178 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:56:28.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:56:28.381 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:56:58.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:56:58.560 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:57:28.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:57:28.746 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:57:58.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:57:58.899 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:58:29.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:58:29.061 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:58:59.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:58:59.256 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:59:29.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:59:29.433 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:59:59.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:59:59.613 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:00:29.786 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:00:29.791 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:00:59.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:00:59.977 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:01:30.183 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:01:30.193 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:02:00.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:02:00.376 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:02:30.557 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:02:30.562 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:03:00.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:03:00.698 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:03:30.884 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:03:30.889 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:04:01.076 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:04:01.081 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:04:31.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:04:31.283 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:05:01.456 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:05:01.461 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:05:31.635 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:05:31.640 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:06:01.804 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:06:01.809 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:06:32.017 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:06:32.024 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:07:02.210 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:07:02.216 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:07:32.355 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:07:32.361 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:08:02.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:08:02.547 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:08:32.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:08:32.735 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:09:02.941 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:09:02.947 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:09:33.144 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:09:33.149 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:10:03.329 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:10:03.335 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:10:33.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:10:33.530 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:11:03.695 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:11:03.701 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:11:33.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:11:33.845 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:12:04.010 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:12:04.015 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:12:34.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:12:34.194 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:13:04.399 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:13:04.405 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:13:34.594 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:13:34.599 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:14:04.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:14:04.727 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:14:34.909 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:14:34.914 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:15:05.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:15:05.084 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:15:35.257 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:15:35.262 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:16:05.451 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:16:05.457 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:16:35.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:16:35.585 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:17:05.757 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:17:05.762 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:17:35.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:17:35.935 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:18:06.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:18:06.120 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:18:36.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:18:36.306 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:19:06.447 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:19:06.452 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:19:36.657 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:19:36.663 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:20:06.827 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:20:06.833 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:20:37.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:20:37.020 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:21:07.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:21:07.198 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:21:37.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:21:37.391 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:22:07.564 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:22:07.570 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:22:37.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:22:37.749 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:23:07.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:23:07.926 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:23:38.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:23:38.121 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:24:08.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:24:08.300 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:24:38.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:24:38.470 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:25:08.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:25:08.649 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:25:38.819 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:25:38.825 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:26:08.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:26:09.004 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:26:39.194 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:26:39.199 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:27:09.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:27:09.384 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:27:39.550 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:27:39.555 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:28:09.728 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:28:09.733 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:28:39.914 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:28:39.919 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:29:10.092 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:29:10.097 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:29:40.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:29:40.267 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:30:10.433 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:30:10.439 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:30:40.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:30:40.624 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:31:10.736 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:31:10.741 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:31:40.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:31:40.933 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:32:11.096 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:32:11.101 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:32:41.264 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:32:41.269 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:33:11.434 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:33:11.440 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:33:41.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:33:41.626 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:34:11.799 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:34:11.804 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:34:41.978 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:34:41.983 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:35:12.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:35:12.186 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:35:42.367 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:35:42.373 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:36:12.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:36:12.559 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:36:42.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:36:42.729 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:37:12.893 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:37:12.898 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:37:43.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:37:43.084 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:38:13.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:38:13.247 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:38:43.419 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:38:43.424 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:39:13.606 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:39:13.611 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:39:43.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:39:43.797 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:40:13.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:40:13.967 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:40:44.090 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:40:44.095 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:41:14.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:41:14.291 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:41:44.455 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:41:44.460 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:42:14.616 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:42:14.623 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:42:44.787 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:42:44.793 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:43:14.980 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:43:14.985 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:43:45.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:43:45.197 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:44:15.362 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:44:15.367 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:44:45.532 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:44:45.537 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:45:15.702 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:45:15.707 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:45:45.888 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:45:45.893 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:46:16.076 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:46:16.123 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:46:46.253 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:46:46.259 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:47:16.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:47:16.437 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:47:46.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:47:46.607 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:48:16.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:48:16.777 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:48:46.959 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:48:46.965 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:49:17.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:49:17.160 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:49:47.348 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:49:47.353 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:50:17.454 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:50:17.459 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:50:47.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:50:47.659 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:51:17.832 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:51:17.837 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:51:47.942 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:51:47.948 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:52:18.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:52:18.068 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:52:48.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:52:48.255 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:53:18.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:53:18.433 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:53:48.614 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:53:48.619 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:54:18.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:54:18.797 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:54:48.912 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:54:48.917 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:55:19.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:55:19.098 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:55:49.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:55:49.274 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:56:19.455 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:56:19.460 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:56:49.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:56:49.646 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:57:19.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:57:19.833 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:57:50.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:57:50.020 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:58:20.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:58:20.214 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:58:50.395 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:58:50.401 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:59:20.583 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:59:20.589 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:59:50.735 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:59:50.740 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:00:20.914 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:00:20.921 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:00:51.100 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:00:51.105 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:01:21.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:01:21.243 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:01:51.356 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:01:51.364 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:02:21.477 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:02:21.483 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:02:51.656 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:02:51.661 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:03:21.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:03:21.848 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:03:51.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:03:51.999 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:04:22.213 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:04:22.265 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:04:52.461 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:04:52.477 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:05:22.659 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:05:22.669 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:05:52.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:05:52.847 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:06:23.021 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:06:23.028 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:06:53.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:06:53.198 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:07:23.367 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:07:23.372 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:07:53.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:07:53.558 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:08:23.715 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:08:23.720 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:08:53.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:08:53.849 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:09:24.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:09:24.043 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:09:54.208 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:09:54.213 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:10:24.388 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:10:24.394 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:10:54.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:10:54.586 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:11:24.750 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:11:24.756 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:11:54.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:11:54.942 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:12:25.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:12:25.119 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:12:55.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:12:55.306 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:13:25.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:13:25.493 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:13:55.694 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:13:55.699 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:14:25.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:14:25.866 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:14:56.039 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:14:56.044 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:15:26.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:15:26.208 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:15:56.395 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:15:56.401 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:16:26.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:16:26.578 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:16:56.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:16:56.698 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:17:26.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:17:26.818 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:17:56.999 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:17:57.005 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:18:27.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:18:27.132 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:18:57.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:18:57.303 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:19:27.475 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:19:27.482 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:19:57.644 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:19:57.650 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:20:27.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:20:27.837 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:20:58.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:20:58.040 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:21:28.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:21:28.217 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:21:58.399 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:21:58.404 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:22:28.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:22:28.575 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:22:58.764 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:22:58.769 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:23:28.951 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:23:28.957 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:23:59.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:23:59.143 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:24:29.315 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:24:29.321 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:24:59.519 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:24:59.524 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:25:29.704 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:25:29.710 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:25:59.891 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:25:59.896 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:26:30.052 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:26:30.057 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:27:00.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:27:00.261 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:27:30.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:27:30.447 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:28:00.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:28:00.576 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:28:30.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:28:30.754 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:29:00.944 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:29:00.949 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:29:31.130 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:29:31.138 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:30:01.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:30:01.326 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:30:31.486 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:30:31.495 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:31:01.689 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:31:01.694 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:31:31.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:31:31.864 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:32:02.037 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:32:02.042 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:32:32.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:32:32.212 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:33:02.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:33:02.389 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:33:32.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:33:32.585 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:34:02.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:34:02.767 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:34:32.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:34:32.942 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:35:03.130 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:35:03.136 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:35:33.334 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:35:33.340 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:36:03.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:36:03.543 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:36:33.707 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:36:33.713 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:37:03.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:37:03.907 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:37:34.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:37:34.024 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:38:04.190 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:38:04.195 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:38:34.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:38:34.399 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:39:04.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:39:04.586 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:39:34.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:39:34.747 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:40:04.945 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:40:04.952 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:40:35.148 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:40:35.154 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:41:05.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:41:05.416 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:41:35.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:41:35.586 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:42:05.766 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:42:05.771 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:42:35.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:42:35.990 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:43:06.164 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:43:06.169 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:43:36.367 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:43:36.373 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:44:06.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:44:06.558 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:44:36.731 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:44:36.736 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:45:06.926 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:45:06.932 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:45:37.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:45:37.126 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:46:07.324 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:46:07.329 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:46:37.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:46:37.446 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:47:07.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:47:07.562 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:47:37.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:47:37.738 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:48:07.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:48:07.856 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:48:38.040 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:48:38.045 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:49:08.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:49:08.230 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:49:38.421 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:49:38.427 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:50:08.616 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:50:08.620 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:50:38.810 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:50:38.815 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:51:08.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:51:08.961 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:51:39.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:51:39.152 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:52:09.349 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:52:09.354 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:52:39.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:52:39.554 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:53:09.736 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:53:09.741 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:53:39.855 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:53:39.861 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:54:10.057 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:54:10.062 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:54:40.252 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:54:40.257 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:55:10.439 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:55:10.444 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:55:40.633 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:55:40.639 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:56:10.753 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:56:10.758 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:56:40.865 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:56:40.871 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:57:11.067 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:57:11.073 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:57:41.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:57:41.268 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:58:11.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:58:11.447 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:58:41.556 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:58:41.562 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:59:11.738 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:59:11.743 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:59:41.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:59:41.935 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:00:12.128 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:00:12.133 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:00:42.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:00:42.319 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:01:12.492 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:01:12.498 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:01:42.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:01:42.701 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:02:12.865 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:02:12.870 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:02:43.044 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:02:43.050 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:03:13.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:03:13.160 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:03:43.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:03:43.279 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:04:13.396 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:04:13.401 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:04:43.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:04:43.515 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:05:13.692 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:05:13.698 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:05:43.862 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:05:43.868 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:06:14.032 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:06:14.038 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:06:44.211 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:06:44.216 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:07:14.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:07:14.402 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:07:44.566 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:07:44.571 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:08:14.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:08:14.750 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:08:44.924 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:08:44.929 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:09:15.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:09:15.133 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:09:45.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:09:45.318 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:10:15.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:10:15.522 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:10:45.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:10:45.699 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:11:15.872 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:11:15.879 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:11:46.049 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:11:46.054 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:12:16.236 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:12:16.242 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:12:46.439 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:12:46.445 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:13:16.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:13:16.615 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:13:46.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:13:46.793 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:14:16.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:14:16.972 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:14:47.135 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:14:47.141 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:15:17.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:15:17.334 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:15:47.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:15:47.523 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:16:17.721 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:16:17.726 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:16:47.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:16:47.846 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:17:18.018 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:17:18.024 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:17:48.197 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:17:48.203 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:18:18.382 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:18:18.387 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:18:48.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:18:48.574 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:19:18.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:19:18.754 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:19:48.925 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:19:48.931 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:20:19.053 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:20:19.058 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:20:49.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:20:49.268 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:21:19.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:21:19.465 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:21:49.656 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:21:49.661 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:22:19.833 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:22:19.838 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:22:50.036 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:22:50.043 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:23:20.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:23:20.261 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:23:50.434 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:23:50.439 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:24:20.612 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:24:20.618 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:24:50.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:24:50.795 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:25:20.993 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:25:20.999 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:25:51.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:25:51.194 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:26:21.357 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:26:21.362 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:26:51.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:26:51.540 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:27:21.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:27:21.735 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:27:51.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:27:51.922 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:28:22.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:28:22.134 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:28:52.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:28:52.312 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:29:22.484 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:29:22.490 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:29:52.603 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:29:52.609 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:30:22.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:30:22.797 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:30:52.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:30:52.991 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:31:23.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:31:23.186 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:31:53.360 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:31:53.365 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:32:23.520 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:32:23.525 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:32:53.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:32:53.707 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:33:23.893 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:33:23.900 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:33:54.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:33:54.068 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:34:24.257 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:34:24.263 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:34:54.461 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:34:54.466 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:35:24.639 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:35:24.645 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:35:54.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:35:54.773 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:36:24.880 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:36:24.885 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:36:54.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:36:54.999 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:37:25.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:37:25.106 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:37:55.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:37:55.228 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:38:25.359 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:38:25.365 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:38:55.469 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:38:55.474 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:39:25.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:39:25.586 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:39:55.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:39:55.702 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:40:25.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:40:25.818 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:40:55.932 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:40:55.937 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:41:26.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:41:26.062 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:41:56.163 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:41:56.170 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:42:26.275 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:42:26.281 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:42:56.382 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:42:56.388 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:43:26.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:43:26.495 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:43:56.603 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:43:56.608 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:44:26.717 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:44:26.722 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:44:56.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:44:56.845 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:45:27.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:45:27.040 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:45:57.164 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:45:57.169 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:46:27.333 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:46:27.339 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:46:57.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:46:57.517 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:47:27.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:47:27.703 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:47:57.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:47:57.924 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:48:28.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:48:28.070 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:48:58.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:48:58.237 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:49:28.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:49:28.415 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:49:58.588 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:49:58.597 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:50:28.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:50:28.763 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:50:58.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:50:58.875 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:51:29.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:51:29.053 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:51:59.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:51:59.214 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:52:29.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:52:29.317 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:52:59.508 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:52:59.513 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:53:29.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:53:29.624 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:53:59.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:53:59.729 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:54:29.833 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:54:29.839 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:54:59.959 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:54:59.965 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:55:30.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:55:30.070 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:56:00.184 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:56:00.189 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:56:30.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:56:30.300 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:57:00.415 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:57:00.421 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:57:30.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:57:30.532 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:58:00.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:58:00.649 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:58:30.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:58:30.764 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:59:00.869 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:59:00.874 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:59:30.981 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:59:30.986 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:00:01.109 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:00:01.114 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:00:31.221 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:00:31.227 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:01:01.338 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:01:01.344 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:01:31.452 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:01:31.458 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:02:01.563 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:02:01.568 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:02:31.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:02:31.681 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:03:01.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:03:01.816 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:03:31.915 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:03:31.921 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:04:02.039 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:04:02.044 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:04:32.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:04:32.151 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:05:02.257 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:05:02.262 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:05:32.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:05:32.389 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:06:02.498 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:06:02.503 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:06:32.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:06:32.614 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:07:02.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:07:02.725 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:07:32.832 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:07:32.837 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:08:02.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:08:02.951 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:08:33.054 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:08:33.060 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:09:03.167 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:09:03.172 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:09:33.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:09:33.279 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:10:03.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:10:03.383 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:10:33.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:10:33.516 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:11:03.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:11:03.629 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:11:33.740 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:11:33.746 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:12:03.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:12:03.866 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:12:33.971 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:12:33.977 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:13:04.100 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:13:04.105 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:13:34.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:13:34.210 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:14:04.325 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:14:04.331 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:14:34.434 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:14:34.440 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:15:04.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:15:04.559 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:15:34.676 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:15:34.682 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:16:04.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:16:04.799 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:16:34.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:16:34.912 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:17:05.027 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:17:05.032 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:17:35.136 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:17:35.142 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:18:05.258 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:18:05.265 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:18:35.369 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:18:35.376 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:19:05.479 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:19:05.485 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:19:35.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:19:35.588 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:20:05.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:20:05.695 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:20:35.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:20:35.857 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:21:05.967 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:21:05.973 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:21:36.086 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:21:36.092 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:22:06.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:22:06.213 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:22:36.318 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:22:36.323 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:23:06.447 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:23:06.452 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:23:36.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:23:36.565 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:24:06.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:24:06.685 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:24:36.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:24:36.794 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:25:06.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:25:06.917 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:25:37.028 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:25:37.033 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:26:07.150 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:26:07.157 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:26:37.257 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:26:37.262 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:27:07.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:27:07.376 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:27:37.557 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:27:37.562 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:28:07.762 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:28:07.767 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:28:37.872 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:28:37.878 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:29:07.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:29:07.999 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:29:38.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:29:38.113 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:30:08.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:30:08.236 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:30:38.360 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:30:38.365 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:31:08.475 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:31:08.480 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:31:38.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:31:38.587 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:32:08.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:32:08.705 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:32:38.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:32:38.819 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:33:08.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:33:08.922 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:33:39.022 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:33:39.028 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:34:09.153 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:34:09.158 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:34:39.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:34:39.265 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:35:09.372 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:35:09.378 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:35:39.481 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:35:39.487 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:36:09.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:36:09.607 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:36:39.707 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:36:39.712 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:37:09.830 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:37:09.835 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:37:39.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:37:39.940 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:38:10.050 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:38:10.056 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:38:40.161 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:38:40.166 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:39:10.279 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:39:10.284 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:39:40.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:39:40.390 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:40:10.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:40:10.503 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:40:40.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:40:40.613 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:41:10.711 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:41:10.716 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:41:40.822 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:41:40.827 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:42:10.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:42:10.935 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:42:41.036 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:42:41.041 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:43:11.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:43:11.163 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:43:41.267 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:43:41.272 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:44:11.388 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:44:11.393 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:44:41.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:44:41.514 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:45:11.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:45:11.630 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:45:41.729 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:45:41.735 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:46:11.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:46:11.848 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:46:41.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:46:41.967 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:47:12.081 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:47:12.086 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:47:42.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:47:42.206 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:48:12.334 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:48:12.339 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:48:42.449 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:48:42.455 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:49:12.571 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:49:12.576 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:49:42.692 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:49:42.698 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:50:12.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:50:12.814 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:50:42.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:50:42.934 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:51:13.044 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:51:13.050 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:51:43.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:51:43.166 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:52:13.272 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:52:13.278 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:52:43.396 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:52:43.407 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:53:13.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:53:13.515 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:53:43.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:53:43.619 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:54:13.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:54:13.726 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:54:43.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:54:43.834 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:55:13.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:55:13.953 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:55:44.073 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:55:44.080 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:56:14.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:56:14.201 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:56:44.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:56:44.478 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:57:14.588 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:57:14.593 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:57:44.756 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:57:44.762 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:58:14.925 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:58:14.931 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:58:45.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:58:45.117 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:59:15.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:59:15.286 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:59:45.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:59:45.465 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:00:15.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:00:15.651 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:00:45.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:00:45.846 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:01:16.002 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:01:16.007 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:01:46.180 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:01:46.185 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:02:16.367 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:02:16.372 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:02:46.562 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:02:46.569 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:03:16.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:03:16.747 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:03:46.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:03:46.925 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:04:17.096 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:04:17.102 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:04:47.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:04:47.290 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:05:17.461 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:05:17.466 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:05:47.656 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:05:47.661 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:06:17.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:06:17.848 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:06:48.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:06:48.035 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:07:18.215 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:07:18.220 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:07:48.436 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:07:48.441 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:08:18.629 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:08:18.635 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:08:48.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:08:48.830 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:09:18.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:09:18.998 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:09:49.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:09:49.187 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:10:19.393 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:10:19.398 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:10:49.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:10:49.510 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:11:19.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:11:19.752 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:11:49.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:11:49.941 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:12:20.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:12:20.127 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:12:50.333 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:12:50.338 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:13:20.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:13:20.509 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:13:50.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:13:50.695 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:14:20.884 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:14:20.889 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:14:51.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:14:51.067 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:15:21.274 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:15:21.279 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:15:51.451 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:15:51.457 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:16:21.639 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:16:21.644 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:16:51.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:16:51.764 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:17:21.944 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:17:21.950 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:17:52.139 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:17:52.145 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:18:22.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:18:22.322 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:18:52.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:18:52.518 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:19:22.701 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:19:22.706 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:19:52.869 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:19:52.874 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:20:22.997 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:20:23.002 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:20:53.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:20:53.180 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:21:23.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:21:23.357 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:21:53.532 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:21:53.537 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:22:23.701 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:22:23.706 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:22:53.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:22:53.835 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:23:24.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:23:24.021 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:23:54.194 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:23:54.200 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:24:24.372 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:24:24.378 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:24:54.558 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:24:54.562 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:25:24.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:25:24.691 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:25:54.856 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:25:54.861 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:26:25.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:26:25.047 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:26:55.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:26:55.235 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:27:25.426 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:27:25.431 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:27:55.560 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:27:55.565 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:28:25.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:28:25.752 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:28:55.925 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:28:55.931 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:29:26.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:29:26.163 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:29:56.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:29:56.329 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:30:26.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:30:26.481 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:30:56.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:30:56.668 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:31:26.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:31:26.846 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:31:57.037 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:31:57.042 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:32:27.230 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:32:27.235 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:32:57.408 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:32:57.414 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:33:27.578 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:33:27.583 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:33:57.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:33:57.787 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:34:27.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:34:27.981 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:34:58.154 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:34:58.160 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:35:10.587 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-07-12T13:35:10.588 DEBUG:teuthology.task.console_log:Killing console logger for smithi037 2023-07-12T13:35:10.589 DEBUG:teuthology.task.console_log:Killing console logger for smithi196 2023-07-12T13:35:10.590 DEBUG:teuthology.exit:Finished running handlers